Computer Science ›› 2016, Vol. 43 ›› Issue (Z11): 45-49.doi: 10.11896/j.issn.1002-137X.2016.11A.010

Previous Articles     Next Articles

Speech Recognition System Based on Deep Neural Network

LI Wei-lin, WEN Jian and MA Wen-kai   

  • Online:2018-12-01 Published:2018-12-01

Abstract: Speech recognition is an important subject in the field of human computer interaction pattern recognition.A speech recognition system based on deep neural network was constructed in this paper.The model was trained without supervision by using the method of anti-chirp contrast divergence and anti-chirp least squares error.The model optimization was carried out using the average value normalization. The fitting degree of the network to the training set is improved and the error rate of speech recognition was reduced.The system used the multi-condition activation function for the model optimization,then the error rate of speech recognition without noise and noise measurement was further reduced.So the system can reduce the over fitting phenomenon.The model was reduced by using the method of singular value decomposition and reconstruction.Experimental results show that the system can greatly reduce the complexity of the system without affecting the error rate of speech recognition.

Key words: Pattern recognition,Deep neural network,Speech recognition,Hidden markov model(HMM),Model reconstruction

[1] Vincent P,Larocheiie H,Lajoie I,et al.Stacked Denoising Autoencoders:Learning Useful Representations in a Deep Network with a Local Denoising Criterion[J].Journal of Machine Lear-ning Research,2010,1:3371-3408
[2] Martens J.Deep learning via hessian-free optimization[C]∥Pro-ceedings of the 27th International Conference on Machine Learning (ICML-10).Israel:Haifa,2010:735-742
[3] Dean J,Corrado G,Monga R,et al.Large scale distributed deep networks[C]∥Advances in Neural Information Processing Systems 25:26th Annual Conference on Neural Information Processing Systems 2012.Lake Tahoe,Nevada,United States:Proceedings of a meeting held.2012:1232-1240
[4] Deng W,Qian Y,Fan Y,et al.Stochastic data sweeping for fast DNN training[C]∥IEEE International Conference on Acoustics,Speech and Signal Processing.Florence,Italy:ICASSP 2014,2014:240-244
[5] You Zhan,Wang Xiao-rui,Xu Bo.Exploring one pass learning for deep neural network training with averaged stochastic gra-dient descent[C]∥ICASSP 2014.2014:6854-6858
[6] Xue J,Li J,Gong Y.Restructuring of deep neural network acoustic models with singular value decomposition[C]∥INTERSPEECH 2013.Lyon,France:14th Annual Conference of the International Speech Communication Association,2013:2365-2369
[7] He Y,Qian F Y,et al.Reshaping deep neural network for fast decoding by node-pruning[C]∥IEEE International Conference on Acoustics,Speech and Signal Processing.Florence,Italy:ICASSP 2014,2014:245-249
[8] Graves A,Mohamed A R,Geoffrey E.HINTON.Speech recognition with deep recurrent neural networks[C]∥ICASSP 2013.2013:6645-6649
[9] Sarikaya R,Hinton G E,Deoras A.Application of Deep Belief Networks for Natural Language Understanding[J].IEEE/ACM Transactions on Audio,Speech & Language Processing,2014,2(4):778-784
[10] Mohamed A,Dahl G E,Hinton G E.Acoustic modeling using deep belief networks[J].IEEE Transactions on Audio,Speech &Language Processing,2012,0(1):14-22

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!