Computer Science ›› 2016, Vol. 43 ›› Issue (2): 18.doi: 10.11896/j.issn.1002137X.2016.02.001
SUN Zhiyuan, LU Chengxiang, SHI Zhongzhi and MA Gang
[1] Haykin S.Neural Networks:A Comprehensive Foundation (second edition) [M].N.J.:Prentice Hall,1999 [2] Haykin S.Neural Networks & Learning Machines [M].Upper Saddle River:Pearson Education,2009 [3] Rosenblatt F.The perceptron:a probabilistic model for information storage and organization in the brain [J].Psychological Review,1958,65(6):386 [4] Mo D.A survey on deep learning:one small step toward AI [R].2012 [5] Gori M,Tesi A.On the problem of local minima in backpropagation [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1992,14(1):7686 [6] Hinton G E,Osindero S,Teh Y W.A fast learning algorithm for deep belief nets [J].Neural Computation,2006,18(7):15271554 [7] Smolensky P.Information processing in dynamical systems:Foundations of harmony theory [M]∥Parallel Distributed Processing:Explorations in the Microstructure of Cognition.1986:194281 [8] Freund Y,Haussler D.Unsupervised learning of distributions of binary vectors using two layer networks [R].Santa Cruz:Computer Research Laboratory,University of California,1994 [9] Hinton G E.Training products of experts by minimizing contrastive divergence [J].Neural Computation,2002,14(8):17711800 [10] Bengio Y,Lamblin P,Popovici D,et al.Greedy layerwise training of deep networks [M]∥Advances in Neural Information Processing Systems.2007:153160 [11] Poultney C,Chopra S,Cun Y L.Efficient learning of sparse representations with an energybased model [C]∥Proceedings of the 2006 Conference on Advances in Neural Information Processing Systems.2007:11371144 [12] Hinton G E,Salakhutdinov R R.Reducing the dimensionality of data with neural networks [J].Science,2006,313(5786):504507 [13] Bengio Y.Learning deep architectures for AI(Foundations and Trends in Machine Learning)[M].2009 [14] Arel I,Rose D C,Karnowski T P.Deep machine learning—anew frontier in artificial intelligence research [J].Computational Intelligence Magazine,IEEE,2010,5(4):1318 [15] Hinton G,Deng L,Yu D,et al.Deep neural networks for acoustic modeling in speech recognition:The shared views of four research groups [J].Signal Processing Magazine,IEEE,2012,29(6):8297 [16] Deng L.An overview of deepstructured learning for information processing [C]∥Proceedings of AsianPacific Signal & Information Processing Annual Summit and Conference (APSIPAASC).2011 [17] Yu D,Deng L.Deep learning and its applications to signal and information processing [J].Signal Processing Magazine,IEEE,2011,28(1):145154 [18] Bengio Y,BoulangerLewandowski N,Pascanu R.Advances in optimizing recurrent networks [C]∥ 2013 IEEE International Conference on Acoustics,Speech,and Signal Processing (ICASSP).Vancouver,Canada,2013 [19] Bengio Y,Courville A,Vincent P.Representation learning:A review and new perspectives [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(8):17981828 [20] Hinton G E.Learning distributed representations of concepts[C]∥Proceedings of the eighth annual conference of the cognitive science society.1986 [21] Rumelhart D E,Hinton G E,Williams R J.Learning Representations by BackPropagating Errors [J].Nature,1986,323(6088):533536 [22] Glorot X,Bengio Y.Understanding the difficulty of trainingdeep feedforward neural networks [C]∥Proceedings of the International Conference on Artificial Intelligence and Statistics.2010 [23] Cortes C,Vapnik V.Supportvector networks [J].MachineLearning,1995,20(3):273297 [24] Lauer F,Bloch G.Incorporating prior knowledge in support vector machines for classification:A review [J].Neurocomputing,2008,71(79):15781594 [25] Barbero A,Dorronsoro J R.Momentum sequential minimal optimization:an accelerated method for support vector machine training [C]∥The 2011 International Joint Conference on Neural Networks (IJCNN).San Jose,2011:370377 [26] Hubel D H,Wiesel T N.Receptive fields,binocular interaction and functional architecture in the cat's visual cortex [J].The Journal of Physiology,1962,160:106154 [27] Bengio Y,LeCun Y.Scaling learning algorithms towards AI[J].LargeScale Kernel Machines,2007,34:141 [28] Schmidhuber J.Deep Learning in Neural Networks:An Overview [J].Neural Networks,2014,61:85117 [29] Welling M,RosenZvi M,Hinton G E.Exponential family harmoniums with an application to information retrieval [M]∥Advances in Neural Information Processing Systems.2004:14811488 [30] Hopfield J J.Neurons with graded response have collective computational properties like those of twostate neurons [J].Proceedings of the National Academy of Sciences,1984,81(10):30883092 [31] Liu J S.Monte Carlo strategies in scientific computing [M].Springer,2008 [32] Bouvrie J.Notes on Convolutional Neural Networks[D].Cambridge:MIT,2006 [33] Fukushima K.Neocognitron:A selforganizing neural networkmodel for a mechanism of pattern recognition unaffected by shift in position [J].Biological Cybernetics,1980,36(4):193202 [34] LeCun Y,Bottou L,Bengio Y,et al.Gradientbased learning applied to document recognition [J].Proceedings of the IEEE,1998,86(11):22782324 [35] LeCun Y,Boser B,Denker J S,et al.Backpropagation applied to handwritten zip code recognition [J].Neural Computation,1989,1(4):541551 [36] Hinton G.A practical guide to training restricted Boltzmann machines [J].Momentum,2010,9(1):926 [37] Chen H,Murray A.A continuous restricted Boltzmann machine with a hardwareamenable learning algorithm [C]∥Artificial Neural Networks—ICANN 2002.Springer,2002:358363 [38] Chen H,Murray A F.Continuous restricted Boltzmann machine with an implementable training algorithm [J].Iee ProceedingsVision Image And Signal Processing,2003,150(3):153158 [39] Lee H,Ekanadham C,Ng A Y.Sparse deep belief net model for visual area V2 [C]∥Proceedings of the Advances in neural information processing systems.2008 [40] Luo H,Shen R,Niu C,et al.Sparse Group Restricted Boltzmann Machines [C]∥Proceedings of the AAAI.2011 [41] Larochelle H,Bengio Y.Classification using discriminative restricted Boltzmann machines [C]∥ Proceedings of the 25th international conference on Machine learning.2008:536543 [42] Larochelle H,Mandel M,Pascanu R,et al.Learning Algorithms for the Classification Restricted Boltzmann Machine [J].Journal of Machine Learning Research,2012,13:643669 [43] Mrazova I,Kukacka M.Image Classification with Growing Neural Networks [J].International Journal of Computer Theory & Engineering,2013,5(3):422427 [44] Ranzato M,Huang F J,Boureau Y L,et al.Unsupervised learning of invariant feature hierarchies with applications to object recognition[C]∥IEEE Conference on Computer Vision and Pattern Recognition.2007:14291436 [45] Dempster A P,Laird N M,Rubin D B.Maximum Likelihood From Incomplete Data Via Em Algorithm [J].Journal of the Royal Statistical Society Series BMethodological,1977,39(1):138 [46] He K,Zhang X,Ren S,et al.Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition[M]∥Computer Vision－ECCV 2014:13th European Conference,Zurich,Switzerland,Sep.612,4,Proceedings,Part III.2014:346361 [47] Tieleman T.Training restricted Boltzmann machines using approximations to the likelihood gradient [C]∥Proceedings of the 25th international conference on Machine learning.ACM,2008:10641071 [48] Tieleman T,Hinton G.Using fast weights to improve persistent contrastive divergence [C]∥Proceedings of the 26th Annual International Conference on Machine Learning.ACM,2009:10331040 [49] Bengio Y,Courville A C,Vincent P.Unsupervised feature learning and deep learning:A review and new perspectives [Z].CoRR abs/12065538,2012 [50] Vincent P,Larochelle H,Bengio Y,et al.Extracting and composing robust features with denoising autoencoders [C]∥Proceedings of the 25th international conference on Machine learning.ACM,2008:10961103 [51] Hinton G E,Srivastava N,Krizhevsky A,et al.Improving neuralnetworks by preventing coadaptation of feature detectors [J].arXiv preprint arXiv:12070580,2012 [52] Jacobs R A.Increased Rates Of Convergence Through Learning Rate Adaptation [J].Neural Networks,1988,1(4):295307 [53] Sexton R S,Dorsey R E,Johnson J D.Optimization of neuralnetworks:A comparative analysis of the genetic algorithm and simulated annealing [J].European Journal of Operational Research,1999,114(3):589601 [54] Montana D J,Davis L.Training Feedforward Neural Networks Using Genetic Algorithms [C]∥IJCAI.1989:762767 [55] Abid S,Fnaiech F,Najim M.A fast feedforward training algorithm using a modified form of the standard backpropagation algorithm [J].IEEE Transactions on Neural Networks,2001,12(2):424430 [56] Yamamoto Y,Nikiforuk P N.A new supervised learning algorithm for multilayered and interconnected neural networks [J].IEEE Transactions on Neural Networks,2000,11(1):3646 [57] Yu X H,Efe M O,Kaynak O.A general backpropagation algorithm for feedforward neural networks learning [J].IEEE Transactions on Neural Networks,2002,13(1):251254 [58] Yam J Y F,Chow T W S.Extended least squares based algorithm for training feedforward networks [J].IEEE Transactions on Neural Networks,1997,8(3):806810 [59] Ngiam J,Coates A,Lahiri A,et al.On optimization methods for deep learning [C]∥Proceedings of the 28th International Conference on Machine Learning.2011 [60] LeCun Y,Bottou L,Orr G B,et al.Efficient backprop [M]∥Neural Networks:Tricks Of the Trade.1998:950 [61] Mohamed A R,Sainath T N,Dahl G,et al.Deep Belief Networks Using Discriminative Features for Phone Recognition [C]∥2011 IEEE International Conference on Acoustics,Speech,And Signal Processing (ICASSP).2011:50605063 [62] Mohamed A R,Yu D,Deng L.Investigation of FullSequenceTraining of Deep Belief Networks for Speech Recognition [C]∥The 11th Annual Conference of the International Speech Communication Association 2010 (Interspeech 2010).2010:28502853 [63] Hutchinson B,Deng L,Yu D.A Deep Architecture with Bilinear Modeling of Hidden Representations:Applications To Phonetic Recognition [C]∥2012 IEEE International Conference on Acoustics,Speech And Signal Processing (ICASSP).2012:48054808 [64] Torralba A,Fergus R,Weiss Y.Small codes and large image databases for recognition [C]∥2008 IEEE Conference on Computer Vision And Pattern Recognition.2008:22692276 [65] Krizhevsky A,Sutskever I,Hinton G E.Imagenet classification with deep convolutional neural networks [C]∥Proceedings of the Advances in neural information processing systems.2012 [66] Bengio Y,Ducharme R,Vincent P,et al.A neural probabilistic language model [J].Journal of Machine Learning Research,2003,3(6):11371155 [67] Collobert R,Weston J.A unified architecture for natural language processing:Deep neural networks with multitask learning [C]∥Proceedings of the 25th international conference on Machine learning.ACM,2008:160167 [68] Mikolov T.Statistical language models based on neural networks [D].Brno University of Technology,2012 [69] Deselaers T,Hasan S,Bender O,et al.A deep learning approach to machine transliteration [C]∥Proceedings of the Proceedings of the Fourth Workshop on Statistical Machine Translation.Association for Computational Linguistics,2009:233241 [70] Sarikaya R,Hinton G E,Ramabhadran B.Deep Belief Nets for Natural Language CallRouting [C]∥2011 IEEE International Conference on Acoustics,Speech,And Signal Processing.2011:56805683 [71] Socher R,Manning C D,Ng A Y.Learning continuous phraserepresentations and syntactic parsing with recursive neural networks [C]∥Proceedings of the NIPS2010 Deep Learning and Unsupervised Feature Learning Workshop.2010:19 [72] Yu Kai,Jia Lei,Chen Yuqiang,et al.Deep Learning:Yesterday,Today,and Tomorrow[J].Journal of Computer Research and Development,2013,50(9):17991804(in Chinese) 余凯,贾磊,陈雨强,等.深度学习的昨天、今天和明天[J].计算机研究与发展,2013,50(9):17991804 [73] Hasan M,RoyChowdhury A K.Continuous Learning of Human Activity Models using Deep Nets[C]∥European Conference on Computer Vision.Springer International Publishing,2014:705720 
No related articles found! 
