计算机科学 ›› 2023, Vol. 50 ›› Issue (1): 229-242.doi: 10.11896/jsjkx.220100058
黄泽南, 刘晓捷, 赵晨晖, 邓亚彬, 郭东辉
HUANG Zenan, LIU Xiaojie, ZHAO Chenhui, DENG Yabin, GUO Donghui
摘要: 深度神经网络在实际应用中的局限性日益凸显,具备生物可解释性的类脑计算脉冲神经网络成为了人们研究的热点课题。应用场景的不确定性及复杂多样性给研究者提出了新的挑战,要求类似生物大脑组织具备多尺度架构的类脑计算脉冲神经网络,能够实现对多模态、不确定性信息的感知决策功能。文中主要介绍了多尺度生物合理性的类脑计算脉冲神经网络模型及其面向多模态信息表征和不确定信息感知的学习算法,并分析探讨了基于忆阻器互联的脉冲神经网络可实现多尺度架构类脑计算的两个关键技术问题,即多模态、不确定信息与脉冲时序表示一致性问题和多尺度脉冲神经网络学习算法与容错计算问题。最后,对类脑计算脉冲神经网络的研究方向进行了分析与展望。
中图分类号:
[1]SHANG J Y,YANG L H,HE K.Analyzing Latent Representation of Deep Neural Networks Based on Feature Visualization[J].Computer Science,2020,47(5):190-197. [2]KAMILARIS A,PRENAFETA-BOLDÚ F X.Deep learning in agriculture:A survey[J/OL].Computers and Electronics in Agriculture,2018,147:70-90.https://www.sciencedirect.com/science/article/abs/pii/S0168169917308803. [3]GOODFELLOW I,BENGIO Y,COURVILLE A,et al.Deep learning[M].Cambridge:MIT press,2016. [4]SCHMIDHUBER,JÜRGEN.Deep Learning in Neural Net-works:An Overview[J/OL].Neural Networks,2015,61:85-117.https://www.scienc-edirect.com/science/article/abs/pii/S0893608014002135. [5]GUZE LIS C,KARAMAHMUT S.Recurrent perceptron lear-ning algorithm for completely stable cellular neural networks[C]//IEEE International Workshop on Cellular Neural Networks & Their Applications.IEEE,2002. [6]PANM Y,SONG H H,ZHANG K H,et al.Learning Global Guided Progressive Feature Aggregation Lightweight Network for Salient Object Detection[J].Computer Science,2021,48(6):103-109. [7]SZEGEDY C,LIU W,JIA Y,et al.Going deeper with convolutions[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:1-9. [8]HE K,ZHANG X,REN S,et al.Deep residual learning forimage recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:770-778. [9]ZHANG P,WANG X Q,XIAO Y,et al.Real-time Binocular Depth Estimation Algorithm Based on Semantic Edge Drive[J].Computer Science,2021,48(9):216-222. [10]REDMON J,DIVVALA S,GIRSHICK R,et al.You only look once:Unified,real-time object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:779-788. [11]LIU W,ANGUELOV D,ERHAN D,et al.SSD:Single shot-multibox detector[C]//European Conference on Computer Vision.Springer International Publishing,2016:21-37. [12]SUN S Z,GUO B H,YANG X B.Embedding ConsensusAutoencoder for Cross-modal Semantic Analysis[J].Computer Science,2021,48(7):93-98. [13]TONG X,W B,WANG R Z,et al.Survey on Adversarial Sample of Deep Learning Towards Natural Language Processing[J].Computer Science,2021,48(1):258-267. [14]HE K,ZHANG X,REN S,et al.Deep residual learning forimage recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:770-778. [15]SZE V,CHEN Y H,YANG T J,et al.Efficient Processing of Deep Neural Networks:A Tutorial and Survey[J].Proceedings of the IEEE,2017,105(12):2295-2392. [16]MEAD C.Neuromorphic electronic systems[J].Proceedings of the IEEE,1990,78(10):1629-1636. [17]MEMMESHEIMER R M,TIMME M.Designing the Dynamics of Spiking Neural Networks[J].Physical Review Letters,2006,97(18):188101-188101. [18]LI P Q,YU G J,HUA X,et al.PEST:Energy-Efficient NEST Brain-Like Simulator Implemented by PYNQ Cluster[J].Journal of Frontiers of Computer Science and Technology,2021,15(11):2127-2141. [19]KOO M,SRINIVASAN G,SHIM Y,et al.SBSNN:Stochastic-Bits Enabled Binary Spiking Neural Network with On-Chip Learning for Energy Efficient Neuromorphic Computing at the Edge[J].IEEE Transactions on Circuits and Systems I:Regular Papers,2020,67(8):2546-2555. [20]HUANG Z,LUO H,GUO D.Application of Locally Connected Spiking Neural Network in Image Processing[C]//2019 IEEE 13th International Conference on Anti-counterfeiting,Security,and Identification(ASID).IEEE,2019:108-111. [21]ESSER S K,MEROLLA P,ARTHUR J V,et al.Convolutional networks for fast,energy-efficient neuromorphic computing[J].Proceedings of the National Academy of Sciences,2016,113(41):11441-11446. [22]YEON H,LIN P,CHOI C,et al.Alloying conducting channels for reliable neuromorphic computing[J].Nature Nanotechno-logy,2020,15(7):574-579. [23]LI X,TANG J,ZHANG Q,et al.Power-efficient neural networkwith artificial dendrites[J].Nature Nanotechnology,2020,15(9):776-782. [24] AT A,MG B,SRK C,et al.Deep learning in spiking neural networks[J].Neural Networks,2019,111:47-63. [25]BUZSÁKI G,COSTAS A,KOCH C,et al.The origin of extracellular fields and currents--EEG,ECoG,LFP and spikes[J].Nature Reviews.Neuroscience,2012,13(6):407-420. [26]NAOYUKI S,RIKI M,AKIHIRO S,et al.Frequency-Depen-dent Cortical Interactions during Semantic Processing:An Electrocorticogram Cross-spectrum Analysis Using a Semantic Space Model[J].Cerebral Cortex,2021,31(9):4329-4339. [27]SUN S Z,GUO B H,YANG X B.Embedding Consensus Autoencoder for Cross-modal Semantic Analysis[J].Computer Science,2021,48(7):93-98. [28]LI Y,CHEN Y,WANG N,et al.Scale-aware trident networks for object detection[C]//Proceedings of the IEEE International Conference on Computer Vision.2019:6054-6063. [29]HARDCASTLE K,MAHESWARANATHAN N,GANGULIS,et al.A multiplexed,heterogeneous,and adaptive code for navigation in medial entorhinal cortex[J].Neuron,2017,94(2):375-387. [30]TONONI G,EDELMAN S.A Measure for Brain Complexity:Relating Functional Segregation and Integration in the Nervous System[J].Proceedings of the National Academy of Sciences of the United States of America,1994,91(11):5033-5037. [31]WARREN S,WALTER H.A logical calculus of the ideas immanent in nervous activity[J].The Bulletin of Mathematical Biophysics,1943,5(4):115-133. [32]AHMAD Z,NOOR R,ZHANG J.Multiple neural networks mo-deling techniques in process control:a review[J].Asia-pacific Journal of Chemical Engineering,2010,4(4):403-419. [33]KOHONEN T.The self-organizing map[J].Proceedings of the IEEE,1990,78(9):1464-1480. [34]HOPFIELD J.Neural networks and physical systems withemergent collective computational abilities[J].Proceedings of the National Academy of Sciences,1982,79(8):2554-2558. [35]PHANSALKAR V,SASTRY P.Analysis of the back-propagation algorithm with momentum[J].IEEE Transactions on Neural Networks,1994,5(3):505-506. [36]HEBB D O.The organization of behavior:a neuropsychologicaltheory[M].Psychology Press,1949. [37]DECO G,JIRSA V K,ROBINSON P A,et al.The DynamicBrain:From Spiking Neurons to Neural Masses and Cortical Fields[J].PLOS Computational Biology,2008,4(8):e1000092. [38]DAS A,WU Y,HUYNH K,et al.Mapping of local and global synapses on spiking neuromorphic hardware[C]//Design,Automation & Test in Europe Conference & Exhibition.IEEE,2018:1217-1222. [39]HAWRYLYCZ M J,LEIN E S,GUILLOZET-BONGAARTS A L,et al.An anatomically comprehensive atlas of the adult human brain transcriptome[J].Nature,2012,489(7416):391-399. [40]KOCH C,LAURENT G.Complexity and the nervous system[J].Science,1999,284(5411):96-98. [41]KOLLING N,O'REILLY J X.State-change decisions and dorsomedial prefrontal cortex:The importance of time[J/OL].Current Opinion in Behavioral Sciences,2018,22:152-160.https://www.science-direct.com/science/article/pii/S2352154618300585. [42]MURRAY J D,BERNACCHIA A,FREEDMAN D J,et al.A hierarchy of intrinsic timescales across primate cortex[J].Nature Neuroscience,2014,17(12):1661-1663. [43]HIKOSAKA O,TAKIKAWA Y,KAWAGOE R.Role of the basal ganglia in the control of purposive saccadic eye movements[J].Physiological Reviews,2000,80(3):953-978. [44]HODGKIN A L,HUXLEY A F.A quantitative description of membrane current and its application to conduction and excitation in nerve[J].The Journal of Physiology,1952,117(4):500. [45]IZHIKEVICH E M.Solving the Distal Reward Problem through Linkage of STDP and Dopamine Signaling[J].Bmc Neuroscience,2007,8(10):1-2. [46]MENG M,YANG X,XIAO S,et al.Spiking Inception Module for Multi-layer Unsupervised Spiking Neural Networks[C]//2020 International Joint Conference on Neural Networks(IJCNN).IEEE,2020:1-8. [47]MENG M,YANG X,BI L,et al.High-parallelism Inception-like Spiking Neural Networks for Unsupervised Feature Learning[J].arXiv:2001.01680,2019. [48]SAUNDERS D J,PATEL D,HAZAN H,et al.Locally connec-ted spiking neural networks for unsupervised feature learning[J/OL].Neural Networks,2019,119:332-340.https://www.sciencedirect.c-om/science/article/abs/pii/S0893608019302333. [49]DIEHL P U,COOK M.Unsupervised learning of digit recognition using spike-timing-dependent plasticity[J/OL].Frontiers in computational neuroscience,2015,9:99.https://www.frontiersin.o-rg/articles/10.3389/fncom.2015.00099/full. [50]BEIKMOHAMMADI A,ZAHABI N.A Hierarchical Methodfor Kannada-MNIST Classification Based on Convolutional Neural Networks[C]//2021 26th International Computer Conference,Computer Society of Iran(CSICC).IEEE,2021:1-6. [51]PRABHU V U.Kannada-MNIST:A new handwritten digitsdataset for the Kannada language[J].arXiv:1908.01242,2019. [52]CARRILLO S,HARKIN J,MCDAID L J,et al.Scalable hierarchical network-on-chip architecture for spiking neural network hardware implementations[J].IEEE Transactions on Parallel and Distributed Systems,2012,24(12):2451-2461. [53]NAWROCKI R A,VOYLES R M,SHAHEEN S E.A mini review of neuromorphic architectures and implementations[J].IEEE Transactions on Electron Devices,2016,63(10):3819-3829. [54]AKOPYAN F,SAWADA J,CASSIDY A,et al.Truenorth:Design and tool flow of a 65 mw 1 million neuron programmable neurosynaptic chip[J].IEEE Transactions on Computer-aided Design of Integrated Circuits and Systems,2015,34(10):1537-1557. [55]DAVIES M,SRINIVASA N,LIN T H,et al.Loihi:A neuromorphic manycore processor with on-chip learning[J].IEEE Micro,2018,38(1):82-99. [56]SPILIOTIS K G,SIETTOS C I.Multiscale computations onneural networks:from the individual neuron interactions to the macroscopic-level analysis[J].International Journal of Bifurcation and Chaos,2010,20(1):121-134. [57]KNOPFEL T,GALLERO-SALAS Y,SONG C.Genetically encoded voltage indicators for large scale cortical imaging come of age[J].Current Opinion in Chemical Biology,2015,100(27):75-83. [58]ROWEIS S,GHAHRAMANI Z.A Unifying Review of Linear Gaussian Models[J].Neural Computation,2014,11(2):305-345. [59]HSIEH H L,WONG Y T,PESARAN B,et al.Multiscale mo-deling and decoding algorithms for spike-field activity[J].Journal of Neural Engineering,2018,16(1):16-34. [60]WANG C,SHANECHI M M.Estimating multiscale direct causality graphs in neural spike-field networks[J].IEEE Transactions on Neural Systems and Rehabilitation Engineering,2019,27(5):857-866. [61]ABBASPOURAZAD H,HSIEH H L,SHANECHI M M.Amultiscale dynamical modeling and identification framework for spike-field activity[J].IEEE Transactions on Neural Systems and Rehabilitation Engineering,2019,27(6):1128-1138. [62]ROY K,JAISWAL A,PANDA P.Towards spike-based machine intelligence with neuromorphic computing[J].Nature,2019,575(7784):607-617. [63]PEI J,DENG L,SONG S,et al.Towards artificial general intelligence with hybrid Tianjic chip architecture[J].Nature,2019,572(7767):106-111. [64]SHAZEER N,MIRHOSEINI A,MAZIARZ K,et al.Outra-geously large neural networks:The sparsely-gated mixture-of-experts layer[J].arXiv:1701.06538,2017. [65]SHE X,LONG Y,MUKHOPADHYAY S.Improving robustness ofreram-based spiking neural network accelerator with stochastic spike-timing-dependent-plasticity[C]//2019 Interna-tional Joint Conference on Neural Networks(IJCNN).IEEE,2019:1-8. [66]GILBERT C D,LI W.Top-down influences on visual processing[J].Nature Reviews Neuroscience,2013,14(5):350-363. [67]JAHFARI S,RIDDERINKHOF K R,SCHOLTE H S.Spatial frequency information modulates response inhibition and decision-making processes[J/OL].PLoS One,2013,8(10):e76467.https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0076467. [68]AMANO K,GODA N,NISHIDA S,et al.Estimation of the ti-ming of human visual perception from magnetoencephalography[J].Journal of Neuroscience,2006,26(15):3981-3991. [69]HEEKEREN H R,MARRETT S,UNGERLEIDER L G.The neural systems that mediate human perceptual decision making.[J].Nature Reviews Neuroscience,2008,9(6):467-479. [70]GOLD J I,SHADLEN M N.The neural basis of decision ma-king.[J].Annual Review of Neuroscience,2007,30(1):535-574. [71]XU R,XIONG C,CHEN W,et al.Jointly Modeling Deep Video and Compositional Text to Bridge Vision and Language in a Unified Framework[C]//AAAI.2015. [72]MROUEH Y,MARCHERET E,GOEL V.Deep multimodallearning for audio-visual speech recognition[C]//2015 IEEE International Conference on Acoustics,Speech and Signal Proces-sing(ICASSP).IEEE,2015:2130-2134. [73]WANG D,CUI P,OU M,et al.Deep multimodal hashing with orthogonal regularization[C]//Twenty-Fourth International Joint Conference on Artificial Intelligence.2015:999-1002. [74]WESTON J,BENGIO S,USUNIER N.Large scale image annotation:learningtorank withjoint word-image embeddings[J].Machine Learning,2010,81(1):21-35. [75]FROME A,CORRADO G S,SHLENS J,et al.Devise:A deep visual-semantic embedding model[C]//Advances in Neural Information Processing Systems.2013:2121-2129. [76]KIROS R,SALAKHUTDINOV R,ZEMEL R S.Unifying vi-sual-semantic embeddings with multimodal neural language mo-dels[J].arXiv:1411.2539,2014. [77]PAN Y,MEI T,YAO T,et al.Jointly modeling embedding and translation to bridge video and language[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:4594-4602. [78]RESULAJ A,KIANI R,WOLPERT D M,et al.Changes ofmind in decision-making[J].Nature,2009,461(7261):263-266. [79]TOSONI A,GALATI G,ROMANI G L,et al.Sensory-motor mechanisms in human parietal cortex underlie arbitrary visual decisions[J].Nature Neuroscience,2008,11(12):1446-1453. [80]BURBECK S L,LUCE R D.Evidence from auditory simple reaction times for both change and level detectors[J].Perception &Psychophysics,1982,32(2):117-133. [81]PALMER J,HUK A C,SHADLEN M N.The effect of stimulus strength on the speed and accuracy of a perceptual decision[J].Journal of Vision,2005,5(5):1-1. [82]YUHAS B P,GOLDSTEIN M H,SEJNOWSKI T J.Integration of acoustic and visual speech signals using neural networks[J].IEEE Communications Magazine,1989,27(11):65-71. [83]HODGKIN A L,HUXLEY A F.Propagation of electrical signals along giant nervefibres[J].Proceedings of the Royal Society of London.Series B-Biological Sciences,1952,140(899):177-183. [84]SHIN H C,ROTH H R,GAO M,et al.Deep convolutional neural networks for computer-aided detection:CNN architectures,dataset characteristics and transfer learning[J].IEEE Transactions on Medical Imaging,2016,35(5):1285-1298. [85]LI C N,SHAO Y H,YIN W,et al.Robust and sparse linear discriminant analysis via an alternating direction method of multipliers[J].IEEE Transactions on Neural Networks and Learning Systems,2019,31(3):915-926. [86]HU R,CHANG S,WANG H,et al.Efficientmultispike learning for spiking neural networks using probability-modulated timing method[J].IEEE Transactions on Neural Networks and Lear-ning Systems,2018,30(7):1984-1997. [87]LIU Q,PAN G,RUAN H,et al.Unsupervised AER Object Recognition Based on Multiscale Spatio-Temporal Features and Spiking Neurons[J].IEEE Transactions on Neural Networks and Learning Systems,2020,31(12):5300-5311. [88]WADE J J,MCDAID L J,SANTOS J A,et al.SWAT:a spiking neural network training algorithm for classification problems[J].IEEE Transactions on Neural Networks,2010,21(11):1817-1830. [89]TAVANAEI A,MAIDA A S.A spiking network that learns to extract spike signatures from speech signals[J].Neurocompu-ting,2017,100(240):191-199. [90]TAVANAEI A,MAIDA A S.Training a hidden Markov model with a Bayesian spiking neural network[J].Journal of Signal Processing Systems,2018,90(2):211-220. [91]TAVANAEI A,MAIDA A.Bio-inspired multi-layer spikingneural network extracts discriminative features from speech signals[C]//International Conference on Neural Information Processing.Cham:Springer,2017:899-908. [92]RATHI N,ROY K.Stdp-based unsupervised multimodal lear-ning with cross-modal processing in spiking neural network[J].IEEE Transactions on Emerging Topics in Computational Intelligence,2018,5(1):143-153. [93]ZHANG M,LUO X,CHEN Y,et al.An efficient threshold-driven aggregate-label learning algorithm for multimodal information processing[J].IEEE Journal of Selected Topics in Signal Processing,2020,14(3):592-602. [94]NGIAM J,KHOSLA A,KIM M,et al.Multimodal deep learning[C]//The 28th International Conference on Machine Learning.ICML,2011. [95]GURBAN M,THIRAN J P,DRUGMAN T,et al.Dynamic modality weighting for multi-streamhmms inaudio-visual speech recognition[C]//Proceedings of the 10th International Confe-rence on Multimodal Interfaces.2008:237-240. [96]EVANGELOPOULOS G,ZLATINTSI A,POTAMIANOS A,et al.Multimodal saliency and fusion for movie summarization based on aural,visual,and textual attention[J].IEEE Transactions on Multimedia,2013,15(7):1553-1568. [97]GUTIG R.Spiking neurons can discover predictive features by aggregate-label learning[J/OL].Science,2016,351(6277):aab4113.https://ww-w.science.org/doi/abs/10.1126/science.aab4113. [98]ZHANG M,WU J,CHUA Y,et al.Mpd-al:an efficient membrane potential driven aggregate-label learning algorithm for spiking neurons[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2019,33:1327-1334. [99]XIAO R,YU Q,YAN R,et al.Fast and Accurate Classification with a Multi-Spike Learning Algorithm for Spiking Neurons[C]//IJCAI.2019:1445-1451. [100]GU P,XIAO R,PAN G,et al.STCA:Spatio-Temporal Credit Assignment with Delayed Feedback in Deep Spiking Neural Networks[C]//IJCAI.2019:1366-1372. [101]YU Q,LI H,TAN K C.Spike timing or rate? neurons learn to make decisions for both through threshold-driven plasticity[J].IEEE Transactions on Cybernetics,2018,49(6):2178-2189. [102]ZHANG M,LUO X,CHEN Y,et al.An efficient threshold-driven aggregate-label learning algorithm for multimodal information processing[J].IEEE Journal of Selected Topics in Signal Processing,2020,14(3):592-602. [103]RATHI N,ROY K.Stdp-based unsupervised multimodal lear-ning with cross-modal processing in spiking neural network[J].IEEE Transactions on Emerging Topics in Computational Intelligence,2018,5(1):143-153. [104]DENG F,ZHU D,LV J,et al.FMRI Signal Analysis Using Em-pirical Mean Curve Decomposition[J].IEEE Transactions on Biomedical Engineering,2013,60(1):42-54. [105]CHIANG C Y,CHANG N F,CHEN T C,et al.Seizure prediction based on classification of EEG synchronization patterns with on-line retraining and post-processing scheme[C]//2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.IEEE,2011:7564-7569. [106]AWATE,SUYASH P,ZHANG H,et al.A Fuzzy,Nonparame-tric Segmentation Framework for DTI and MRI Analysis:With Applications to DTI-Tract Extraction[J].IEEE Transactions on Medical Imaging,2007,26(11):1525-1536. [107]SUI J,ADALI T,YU Q,et al.A review of multivariate methods for multimodal fusion of brain imaging data[J].Journal of neuroscience methods,2012,204(1):68-81. [108]GREICIUS M D,SUPEKAR K,MENON V,et al.Resting-state functional connectivity reflects structural connectivity in the default mode network[J].Cerebral cortex,2009,19(1):72-78. [109]PATEL M J,ANDREESCU C,PRICE J C,et al.Machine lear-ning approaches for integrating clinical and imaging features in late-life depression classification and response prediction[J].International Journal of Geriatric Psychiatry,2015,30(10):1056-1067. [110]SENGUPTA N,MCNABB C B,KASABOV N,et al.Integrating space,time,and orientation in spiking neural networks:A case study on multimodal brain data modeling[J].IEEE Transactions on Neural Networks and Learning Systems,2018,29(11):5249-5263. [111]KASABOV N K.NeuCube:A spiking neural network architecture for mapping,learning and understanding of spatio-temporal brain data[J/OL].Neural Networks,2014,52:62-76.https://www.s-ciencedirect.com/science/article/pii/S0893608014000070. [112]YANG Y L,BI Z Z.Network Anomaly Detection Based on Deep Learning[J].Computer Science,2021,48(11A):540-546. [113]QI B L,ZHONG K H,CHEN Y W.Semi-supervised Surgical Video Workflow Recognition Based on Convolution Neural Network[J].Computer Science,2020,47(6A):172-175. [114]DEVLIN J,CHANG M W,LEE K,et al.Bert:Pre-training of deep bidirectional transformers for language understanding[J].arXiv:1810.04805,2018. [115]PROSPERI M,MIN J S,BIAN J,et al.Big data hurdles in precision medicine and precision public health[J].BMC Medical Informatics and Decision Making,2018,18(1):1-15. [116]ZHAO C,HE S,LI L,et al.Convergence Stability of SpikingNeural Networks with Stochastic Fluctuations[C]//2019 IEEE 13th International Conference on Anticounterfeiting,Security,and Identification(ASID).IEEE,2019:163-167. [117]GAL Y,GHAHRAMANI Z.Dropout as a bayesian approximation:Representing model uncertainty in deep learning[C]//International Conference on Machine Learning.PMLR,2016:1050-1059. [118]KENDALL A,GAL Y.What uncertainties do we need inbayesian deep learning for computer vision?[C]//Advances in Neural Information Processing Systems.2017:5574-5584. [119]HELMREICH R.Applied social psychology:Theunfulfilledpromise[J].Personality and Social Psychology Bulletin,1975,1(4):548-560. [120]KULLBACK S.Information theory and statistics[M].Courier Corporation,1997. [121]NUZZO R.Scientific method:statistical errors[J].NatureNews,2014,506(7487):150. [122]CHAI R,TRAN Y,NAIK G R,et al.Classification of EEGbased-mental fatigue using principal component analysis and Bayesian neural network[C]//2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society(EMBC).IEEE,2016:4654-4657. [123]JORDAN M I,GHAHRAMANI Z,JAAKKOLA T S,et al.An introduction tovariational methods for graphical models[J].Machine Learning,1999,37(2):183-233. [124]HINTON G E,VAN CAMP D.Keeping the neural networks simple by minimizing the description length of the weights[C]//Proceedings of the Sixth Annual Conference on Computational Learning Theory.1993:5-13. [125]BARBER D,BISHOP C M.Ensemble learning in Bayesian neural networks[J].Nato ASI Series F Computer and Systems Sciences,1998,168:215-238.http://research.microsoft.com/apps/pub-s/default.aspx?id=67172. [126]GRAVES A.Practicalvariational inference for neural networks[C]//Proceedings of the 24th International Conference on Neural Information Processing Systems.2011:2348-2356. [127]OPPER M,ARCHAMBEAU C.The variational Gaussian ap-proximation revisited[J].Neural Computation,2009,21(3):786-792. [128]HERNÁNDEZ-LOBATO J M,ADAMS R.Probabilistic back-propagation for scalable learning ofbayesian neural networks[C]//International Conference on Machine Learning.2015:1861-1869. [129]GRAVES A.Practical variational inference for neural networks[C]//Advances in Neural Information Processing Systems.2011:2348-2356. [130]FUNAMIZU A,KUHN B,DOYA K.Neural substrate of dy-namic Bayesian inference in the cerebral cortex[J].Nature Neuroscience,2016,19(12):1682-1689. [131]ERNST M O,BANKS M S.Humans integrate visual and haptic information in a statistically optimal fashion[J].Nature,2002,415(6870):429-433. [132]CHATER N,MANNING C D.Probabilistic models of language processing and acquisition[J].Trends in Cognitive Sciences,2006,10(7):335-344. [133]YU Z,CHEN F,DONG J,et al.Sampling-based causal inference in cue combination and its neural implementation[J/OL].Neurocomputing,2016,175:155-165.https://www.sciencedirect.com/scienc-e/article/abs/pii/S0925231215015040. [134]BECK J M,MA W J,KIANI R,et al.Probabilistic populationcodes for Bayesian decision making[J].Neuron,2008,60(6):1142-1152. [135]LEE T S,MUMFORD D.Hierarchical Bayesian inference in the visual cortex[J].JOSA A,2003,20(7):1434-1448. [136]DAN Y,POO M.Spike timing-dependent plasticity of neural circuits[J].Neuron,2004,44(1):23-30. [137]FELDMAN D E.The spike-timing dependence of plasticity[J].Neuron,2012,75(4):556-571. [138]NESSLER B,PFEIFFER M,BUESING L,et al.Bayesian computation emerges in generic cortical microcircuits through spike-timing-dependent plasticity[J].PLoS Comput. Biol.,2013,9(4):1-30. [139]GUO S,YU Z,DENG F,et al.Hierarchicalbayesian inference and learning in spiking neural networks[J].IEEE Transactions on Cybernetics,2017,49(1):133-145. [140]RAO R P N.Bayesian computation in recurrent neural circuits[J].Neural Computation,2004,16(1):1-38. [141]BUESING L,BILL J,NESSLER B,et al.Neural dynamics as sampling:a model for stochastic computation in recurrent networks of spiking neurons[J].PLoS Comput.Biol.,2011,7(11):1-25. [142]PECEVSKI D,BUESING L,MAASS W.Probabilistic inference in general graphical models through sampling in stochastic networks of spiking neurons[J].PLoS Comput. Biol.,2011,7(12):1-25. [143]POUGET A,DAYAN P,ZEMEL R S.Inference and computation with population codes[J].Annual Review of Neuroscience,2003,26(1):381-410. [144]HUANG Y,RAO R P N.Bayesian inference and online learning inpoisson neuronal networks[J].Neural Computation,2016,28(8):1503-1526. [145]KIM S,PARK S,NA B,et al.Spiking-YOLO:spiking neuralnetwork for energy-efficient object detection[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2020:11270-11277. [146]SENGUPTA A,YE Y,WANG R,et al.Going deeper in spiking neural networks:VGG and residual architectures[J/OL].Frontiers in Neuroscience,2019,13:95.https://www.frontiersin.org/articles/10.3389/fnins.2019.00095/full. [147]KIM S,PARK S,NA B,et al.Towards fast and accurate object detection in bio-inspired spiking neural networks through Baye-sian optimization[J/OL].IEEE Access,2020,9:2633-2643.https://ieeexplore.ieee.org/abstract/document/9306772. [148]HAN B,ROY K.Deep Spiking Neural Network:Energy Efficiency Through Time based Coding[C]//European Conference on Computer Vision.Cham:Springer,2020:388-404. [149]HAN B,SRINIVASAN G,ROY K.Rmp-snn:Residual mem-brane potential neuron for enabling deeper high-accuracy and low-latency spiking neural network[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:13558-13567. [150]JANG H,SKATCHKOVSKY N,SIMEONE O.BiSNN:Trai-ning Spiking Neural Networks with Binary Weights via Bayesian Learning[J].arXiv:2012.08300,2020. [151]DU C,DU C,HUANG L,et al.Reconstructing perceived images from human brain activities with Bayesian deepmultiview lear-ning[J].IEEE Transactions on Neural Networks and Learning Systems,2018,30(8):2310-2323. [152]ROY K,JAISWAL A,PANDA P.Towards spike-based machine intelligence with neuromorphic computing[J].Nature,2019,575(7784):607-617. [153]GAUVAIN J L,LEE C H.Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains[J].IEEE Transactions on Speech and Audio Processing,1994,2(2):291-298. [154]MEYER S.Literatur-Berichte:Elementary principles in statistical mechanics[J].Monatsh.Math.Phys,1903,14(1):A55-A59. [155]ZOU D X.GlobalAttractivity in Delayed Hopfield Neural Network Models[J].Siam Journal on Applied Mathematics,1998,58(6):1878-1890. [156]GLAUBER R J.Time ependent Statistics of the Ising Model[J].Journal of Mathematical Physics,1963,4(2):294-307. [157]JOHN A K,SHAH S,CHAKRABORTY S,et al.Skolem functions for factored formulas[C]//2015 Formal Methods in Computer-Aided Design(FMCAD).IEEE,2015:73-80. [158]AJI S M,MCELIECE R J.The generalized distributive law[J].IEEE Transactions on Information Theory,2000,46(2):325-343. [159]BHARATHI M,WANG Z,GUO B,et al.Memristors:Understanding,utilization and upgradation for neuromorphic computing[J].NANO,2020,15(11):2030005. [160]YI G S,WANG J,WEI X L,et al.Exploring how extracellular electric field modulates neuron activity through dynamical analysis of a two-compartment neuron model[J].Journal of Computational Neuroscience,2014,36(3):383-399. |
[1] | 马玮琦, 袁家斌, 查可可, 范利利. 一种基于脉冲神经网络的星体表面岩石检测算法 Onboard Rock Detection Algorithm Based on Spiking Neural Network 计算机科学, 2023, 50(1): 98-104. https://doi.org/10.11896/jsjkx.211100149 |
[2] | 孔芳, 李奇之, 李帅. 在线影响力最大化研究综述 Survey on Online Influence Maximization 计算机科学, 2020, 47(5): 7-13. https://doi.org/10.11896/jsjkx.200200071 |
[3] | 李思瑶, 周海芳, 方民权. 基于GPU的图像监督分类算法的研究 Research of Image Classification Algorithm Based on GPU 计算机科学, 2018, 45(6A): 143-145. |
[4] | 顾哲彬, 曹飞龙. 多层前向人工神经网络图像分类算法 Algorithm of Multi-layer Forward Artificial Neural Network for Image Classification 计算机科学, 2018, 45(11A): 238-243. |
[5] | 吴鲁辉,李凡长,张莉. 多李群覆盖学习优化算法 Optimization Algorithm of Multiply Lie Group Covering Learning Algorithm 计算机科学, 2018, 45(1): 108-112. https://doi.org/10.11896/j.issn.1002-137X.2018.01.017 |
[6] | 边宅安,李慧嘉,陈俊华,马雨晗,赵丹. 多智能体系构架下的属性图分布式聚类算法 Distributed and Heterogeneous Multi-agent System for Attributed Graph Clustering 计算机科学, 2017, 44(Z6): 407-413. https://doi.org/10.11896/j.issn.1002-137X.2017.6A.092 |
[7] | 王雨辰,胡华. 类脑计算新发展——“TrueNorth”神经元芯片 New Development of Artificial Cognitive Computation:TrueNorth Neuron Chip 计算机科学, 2016, 43(Z6): 17-20. https://doi.org/10.11896/j.issn.1002-137X.2016.6A.002 |
[8] | 宦若虹,陈月. 一种基于特征增强和决策融合的人体行为识别方法 Method of Human Activity Recognition Based on Feature Enhancement and Decision Fusion 计算机科学, 2016, 43(Z11): 151-155. https://doi.org/10.11896/j.issn.1002-137X.2016.11A.033 |
[9] | 杨明浩,陶建华,李昊,巢林林. 面向自然交互的多通道人机对话系统 Nature Multimodal Human-Computer-Interaction Dialog System 计算机科学, 2014, 41(10): 12-18. https://doi.org/10.11896/j.issn.1002-137X.2014.10.003 |
[10] | 肖倩,周永权,陈振. 基函数可递归的泛函神经元网络学习算法 Functional Network Learning Algorithm with Recursively Base Functions 计算机科学, 2013, 40(1): 203-207. |
[11] | 郑绪枝,雷靖,夏薇. 基于快速确定隐层神经元数的BP神经网络算法 Algorithm for BP Neural Networks by Identifying Numbers of Hidden Layer Neurons Quickly 计算机科学, 2012, 39(Z6): 432-436. |
[12] | 乔林,罗杰. MAS中基于多奖惩标准的Q学习算法研究 Research on任learning Algorithm Based 计算机科学, 2012, 39(Z6): 235-237. |
[13] | 乔林,罗杰. 学习过程中共享经验的Q学习算法的研究 Research on Q Learning Algorithm with Sharing Experience in Learning Process 计算机科学, 2012, 39(5): 213-216. |
[14] | 孙霞,王小凤,董乐红,吴江. 术语关系自动抽取方法研究 Study on Term Relation Extraction from Domain Text 计算机科学, 2010, 37(2): 189-191. |
[15] | 曾水玲,杨静宇,徐蔚鸿. 一种模糊Hopfield网络的学习算法及性质 Learning Algorithm and Properties on a Class of Fuzzy Hopfield Networks 计算机科学, 2010, 37(12): 206-208. |
|