Computer Science ›› 2024, Vol. 51 ›› Issue (3): 141-146.doi: 10.11896/jsjkx.230600166

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Multi-view Autoencoder-based Functional Alignment of Multi-subject fMRI

HUANG Shuo, SUN Liang, WANG Meiling, ZHANG Daoqiang   

  1. Key Laboratory of Brain-Machine Intelligence Technology Ministry of Education, Nanjing University of Aeronautics, Astronautics, Nanjing 211106, China
    College of Computer Science and Technology,Nanjing University of Aeronautics and Astronautics,Nanjing 211106,China
  • Received:2023-06-21 Revised:2023-11-30 Online:2024-03-15 Published:2024-03-13
  • About author:HUANG Shuo,born in 1992,Ph.D.His main research interests include neural computing and pattern recognition.ZHANG Daoqiang,born in 1978,Ph.D,professor,Ph.D supervisor,is a senior member of CCF(No.28051S).His main research interests include machine learning,pattern recognition,data mi-ning,and medical image analysis.
  • Supported by:
    National Natural Science Foundation of China(62136004,61732006,62006115,62106104),National Key R&D Program of China(2018YFC2001600,2018YFC2001602),China Postdoctoral Science Foundation(2022T150320) and Chinese Association for Artificial Intelligence(CAAI)-Huawei MindSpore Open Fund.

Abstract: One of the major challenges in functional magnetic resonance imaging(fMRI) research is the heterogeneity of fMRI data across different subjects.On the one hand,analyzing multi-subject data is crucial for determining the generalizability and effectiveness of the generated results across subjects.On the other hand,analyzing multi-subject fMRI data requires accurate anatomical and functional alignment among the neural activities of different subjects to enhance the performance of the final results.However,most existing functional alignment studies employ shallow models to handle the complex relationships among multiple subjects,severely limiting the modeling capacity for multi-subject information.To solve this problem,this paper proposes a multi-view auto-encoder functional alignment(MAFA) method based on multi-view auto-encoders.Specifically,our method learns node embedding by reconstructing the response spaces of different subjects,capturing shared feature representations among subjects,and creating a common response space.We also introduce the graph clustering process by introducing self-training clustering objectives using high-confidence nodes as soft labels.Experimental results on four datasets demonstrate that the proposed method achieves the best decoding accuracy compared to other multi-subject fMRI functional alignment methods.

Key words: Functional magnetic resonance imaging, Functional alignment, Multi-view representation learning, Multi-subject analysis, Brain decoding

CLC Number: 

  • TP391
[1]HAXBY V J,CONNOLLY C A,GUNTUPALLI J S.Decoding Neural Representational Spaces Using Multivariate Pattern Analysis[J].Annual Review of Neuroscience,2014,37:435-456.
[2]ZHANG Y,YU Z,LIU J,et al.Neural Decoding of Visual Information Across Different Neural Recording Modalities and Approaches [J].Machine Intelligence Research,2022,19(5):350-365.
[3]CAI M,SCHUCK W N,PILLOW W J,et al.A Bayesian Me-thod for Reducing Bias in Neural Representational Similarity Analysis [C]//Proceedings of the 30th International Conference on Neural Information Processing Systems.2016.
[4]LORBERT A,RAMADGE J P.Kernel Hyperalignment [C]//Proceedings of the 25th International Conference on Neural Information Processing Systems-Volume 2.2012:1790-1798.
[5]HAXBY V J,GUNTUPALLI J S,CONNOLLY C A,et al.A Common,High-dimensional Model of the Representational Space in Human Ventral Temporal Cortex [J].Neuron,2011,72(2):404-416.
[6]KRIEGESKORTE N,GOEBEL R,BANDETTINI P.Information-based Functional Brain Mapping [J].Proceedings of the National Academy of Sciences of the United States of America,2006,103(10):3863-3868.
[7]YOUSEFNEZHAD M,ZHANG D.Multi-Region Neural Representation:A Novel Model for Decoding Visual Stimuli in Human Brains [C]//Proceedings of the 2017 SIAM International Conference on Data Mining.Society for Industrial and Applied Mathematics.2017:54-62.
[8]XU H,LORBERT A,RAMADGE J P,et al.Regularized Hyperalignment of Multi-set fMRI Data [C]//2012 IEEE Statistical Signal Processing Workshop(SSP).IEEE,2012:229-232.
[9]CHEN P H,GUNTUPALLI J S,HAXBY V J,et al.Joint SVD-Hyperalignment for Multi-subject fMRI Data Alignment [C]//2014 IEEE International Workshop on Machine Learning for Signal Processing(MLSP).IEEE,2014:1-6.
[10]GUNTUPALLI J S,HANKE M,HALCHENKO O Y,et al.A Model of Representational Spaces in Human Cortex [J].Cerebral Cortex,2016,26(6):2919-2934.
[11]TALAIRACH J.Co-Planar Stereotaxic Atlas of the HumanBrain:3-Dimensional Proportional System:An Approach to Cere-bral Imaging[M].G.Thieme,1988.
[12]ANDREW G,ARORA R,BILMES J,et al.Deep Canonical Correlation Analysis [C]//Proceedings of the International Confe-rence on Machine Learning.New York:ACM Press,2013.
[13]BENTON A,KHAYRALLAH H,GUJRAL B,et al.Deep Ge-neralized Canonical Correlation Analysis [C]//Proceedings of the International Conference on Learning Representations.ICLR Press,2017.
[14]YOUSEFNEZHAD M,ZHANG D.Deep Hyperalignment [C]//Advances in Neural Information Processing Systems.MIT Press,2017:1603-1611.
[15]YOUSEFNEZHAD M,ZHANG D.Local Discriminant Hyperalignment for Multi-subject fMRI Data Alignment [C]//Proceedings of the AAAI Conference on Artificial Intelligence.2017:59-65.
[16]YOUSEFNEZHAD M,SELVITELLA A,HAN L X,et al.Supervised Hyperalignment for Multi-subject fMRI Data Alignment [J].IEEE Transactions on Cognitive and Developmental Systems,2020,13(3):475-490.
[17]CHEN P H,CHEN J,YESHURUN Y,et al.A Reduced Dimension fMRI Shared Response Model[C]//Proceedings of the Annual Conference on Neural Information Processing Systems.MIT Press,2015:460-468.
[18]CHEN P H,ZHU X,ZHANG H,et al.A Convolutional Au-toencoder for Multi-Subject fMRI Data Aggregation [C]//29th Workshop of Representation Learning in Artificial and Biological Neural Networks.2016.
[19]FAN S,WANG X,SHI C,et al.One2multi Graph Autoencoder for Multi-view Graph Clustering [C]//Proceedings of the Web Conference 2020.2020:3070-3076.
[20]XIE J,GIRSHICK R,FARHADI A.Unsupervised Deep Embedding for Clustering Analysis [C]//International Conference on Machine Learning.PMLR,2016:478-487.
[21]LAURENS V D M,HINTON G.Visualizing Data Using t-SNE [J].Journal of Machine Learning Research,2008,9(2605):2579-2605.
[22]TOM S M,FOX C R,TREPEL C,et al.The neural basis of loss aversion in decision-making under risk[J].Science,2007,315(5811):515-518.
[23]DUNCAN K J,PATTAMADILOK C,KNIERIM I,et al.Consistency and Variability in Functional Localisers [J].Neuro- Image,2009,46(4):1018-1026.
[24]WAKEMAN D G,HENSON R N.A Multi-subject,Multi-modal Human Neuroimaging Dataset [J].Scientific Data,2015,2:150001.
[1] CUI Bingjing, ZHANG Yipu, WANG Biao. Multimodal Data Fusion Algorithm Based on Hypergraph Regularization [J]. Computer Science, 2023, 50(6): 167-174.
[2] LI Yao, LI Tao, LI Qi-fan, LIANG Jia-rui, Ibegbu Nnamdi JULIAN, CHEN Jun-jie, GUO Hao. Construction and Multi-feature Fusion Classification Research Based on Multi-scale Sparse Brain Functional Hyper-network [J]. Computer Science, 2022, 49(8): 257-266.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!