计算机科学 ›› 2021, Vol. 48 ›› Issue (10): 107-113.doi: 10.11896/jsjkx.200900178

• 人工智能* 上一篇    下一篇

基于多模态表示学习的阿尔兹海默症诊断算法

樊连玺1, 刘彦北2,3, 王雯2, 耿磊2, 吴骏1, 张芳2, 肖志涛2   

  1. 1 天津工业大学电子与信息工程学院 天津300387
    2 天津工业大学生命科学学院 天津300387
    3 天津光电检测技术与系统重点实验室 天津300387
  • 收稿日期:2020-09-25 修回日期:2020-11-26 出版日期:2021-10-15 发布日期:2021-10-18
  • 通讯作者: 刘彦北(liuyanbei@tiangong.edu.cn)
  • 作者简介:1831095395@tiangong.edu.cn
  • 基金资助:
    国家自然基金项目(61901297);天津市科学技术重大专项与工程(17ZXSCSY00060)

Multimodal Representation Learning for Alzheimer's Disease Diagnosis

FAN Lian-xi1, LIU Yan-bei2,3, WANG Wen2, GENG Lei2, WU Jun1, ZHANG Fang2, XIAO Zhi-tao2   

  1. 1 School of Electronics and Information Engineering,Tiangong University,Tianjin 300387,China
    2 School of Life Sciences,Tiangong University,Tianjin 300387,China
    3 Tianjin Key Laboratory of Optoelectronic Detection Technology and Systems,Tianjin 300387,China
  • Received:2020-09-25 Revised:2020-11-26 Online:2021-10-15 Published:2021-10-18
  • About author:FAN Lian-xi,born in 1995,postgra-duate.His main research interests include medical data analysis,multi-view learning,and graph representation learning.
    LIU Yan-bei,born in 1985,Ph.D,lectu-rer.His main research interests include network embedding,clustering analysis,machine learning and data mining.
  • Supported by:
    National Natural Science Foundation of China (61901297) and Tianjin Science and Technology Major Projects and Engineering(17ZXSCSY00060).

摘要: 阿尔茨海默症是一种典型的涉及多种致病因素的神经系统退行性疾病。然而,阿尔茨海默症的病因尚不明确,病程不可逆转,且无治愈方法,因此其早期诊断和治疗一直是人们关注的重点。受试者的神经影像数据对于该疾病的诊断具有重要的辅助作用,而结合多个模态的数据可进一步提高诊断效果。目前,联合该疾病的多模态数据进行辅助诊断逐渐成为一个新兴的研究领域。在此提出了一种基于自编码器的多模态表示学习方法,用于阿尔茨海默症的诊断。首先将多个模态的数据进行初步融合,得到初级的共同表示;然后将其送入自编码器网络,学习隐空间中的共同表示;最后对隐空间中的共同表示进行分类,得到疾病的诊断结果。在国际公开ADNI数据集上,所提算法对患病和健康受试者的诊断准确率达到88.9%,与同类算法相比取得了最好的诊断效果。实验结果验证了所提算法对阿尔茨海默症诊断的有效性。

关键词: 阿尔兹海默症, 表示学习, 多模态融合, 疾病诊断, 自编码器网络

Abstract: Alzheimer's disease (AD) is a complex neurodegenerative disease involving a variety of pathogenic factors.So far,the cause of Alzheimer's disease is not clear,the course of the disease is irreversible,and there is no cure.Its early diagnosis and treatment have always been the focus of attention.The neuroimaging data of subjects has an important auxiliary role in the diagnosis of this disease,and the combination of multimodal data can further improve the diagnostic effect.At present,the multimodal data representation learning of the disease has gradually become an emerging research field,which has attracted wide attention from researchers.An autoencoder based multimodal representation learning method for Alzheimer's disease diagnosis is proposed.Firstly,the multimodal data are initially fused to obtain the primary common representation.Then,it is input into the autoencoder network to learn the final common representation in latent space.Finally,the common representation in latent space is classified to obtain the disease result.The proposed method,which achieves the best diagnostic results compared with comparison algorithms,has an accuracy of 88.9% in the classification of AD and healthy subjects in the ADNI dataset.Extensive experimental results verify its effectiveness.

Key words: Alzheimer's disease, Autoencoder network, Disease diagnosis, Multimodal fusion, Representation learning

中图分类号: 

  • TP183
[1]WEINER M W,VEITCH D P,AISEN P S,et al.Recent publications from the alzheimer's disease neuroimaging initiative:reviewing progress toward improved ad clinical trials[J].Alzheimer's & Dementia,2017,13(4):1-85.
[2]ZHANG J,YUE G,GAO Y,et al.Detecting anatomical landmarks for fast Alzheimer's disease diagnosis[J].IEEE Transactions on Medical Imaging,2016,35(12):2524-2533.
[3]LIAN C,LIU M,ZHANG J,et al.Hierarchical fully convolutional network for joint atrophy localization and Alzheimer's Disease diagnosis using structural MRI[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,42(4):880-893.
[4]LIN W,YUAN J,FENG C,et al.Computer-Aided Diagnosis of Alzheimer's Disease Based on Extreme Learning Machine[J].Chinese Journal of Biomedical Engineering,2020,39(3):288-294.
[5]ZENG A,ZOU C,PAN D.Diagnosis of Alzheimer's diseasebased on 3D convolutional neural network-regions of interest[J].Journal of Biomedical Engineering Research,2020,39(2):133-138,144.
[6]ZHANG D,WANG Y,ZHOU L,et al.Multimodal classification of alzheimer's disease and mild cognitive impairment[J].Neuroimage,2011,55(3):856-867.
[7]KUMAR A,RAI P,DAUME H.Co-regularized multi-viewspectral clustering[C]//Advances in Neural Information Processing Systems.2011:1413-1421.
[8]HOTELLING H.Relations between two sets of variates[M]//Breakthroughs in Statistics.Springer,New York,NY,1992:162-190.
[9]AKAHO S.A kernel method for canonical correlation analysis[J].arXiv preprint cs/0609071,2006.
[10]ANDREW G,ARORA R,BILMES J,et al.Deep canonical correlation analysis[C]//International Conference on Machine Learning.2013:1247-1255.
[11]ZHU X,SUK H I,SHEN D.Multi-modality canonical featureselection for alzheimer's disease diagnosis[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention.2014:162-169.
[12]ZHU X,SUK H I,LEE S W,et al.Canonical feature selection for joint regression and multi-class identification in alzheimer's disease diagnosis[J].Brain Imaging and Behavior,2016,10(3):818-828.
[13]ZIEN A,ONG C S.Multiclass multiple kernel learning[C]//International Conference on Machine Learning.2007:1191-1198.
[14]LIU X,ZHU X,LI M,et al.Multiple kernel k-means with incomplete kernels[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2019.
[15]ZHOU T,LIU M,THUNG K H,et al.Latent representation learning for Alzheimer's disease diagnosis with incomplete multi-modality neuroimaging and genetic data[J].IEEE Transac-tions on Medical Imaging,2019,38(10):2411-2422.
[16]SHI Y,SUK H I,GAO Y,et al.Leveraging Coupled Interaction for Multimodal Alzheimer's Disease Diagnosis[J].IEEE Transac-tions on Neural Networks and Learning Systems,2019,31(1):186-200.
[17]LI C,FAN C.Classification and prediction of Alzheimer'sdisease based on machine learning[J].Chinese Journal of Medical Physics,2020,37(3):379-384.
[18]LIU M,ZHANG J,ADELI E,et al.Joint classification and regression via deep multi-task multi-channel learning for Alzheimer's disease diagnosis[J].IEEE Transactions on Biomedical Engineering,2018,66(5):1195-1206.
[19]PAN Z J,LIU N,ZHANG W,et al.MTHAM:MultitaskDisease Progression Modeling Based on Hierarchical Attention Mechanism[J].Computer Science,2020,47(9):185-189.
[20]VON LUXBURG U.A tutorial on spectral clustering[J].Statistics and Computing,2007,17(4):395-416.
[21]STEINWART I.Fully adaptive density-based clustering[J].The Annals of Statistics,2015,43(5):2132-2167.
[22]ZHANG C,ADELI E,ZHOU T,et al.Multi-layer multi-view classification for alzheimer's disease diagnosis[C]//AAAI Conference on Artificial Intelligence.2018.
[23]SUN S.A survey of multi-view machine learning[J].Neural Computing and Applications,2013,23(7/8):2031-2038.
[24]SA V R D.Spectral clustering with two views[C]//ICMLWorkshop on Learning with Multiple Views.2005:20-27.
[25]XU J,HAN J,NIE F.Discriminatively embedded k-means for multi-view clustering[C]//IEEE Conference on Computer Vision and Pattern Recognition.2016:5356-5364.
[26]WANG H,WENG C,YUAN J.Multi-feature spectral clustering with minimax optimization[C]//IEEE Conference on Computer Vision and Pattern Recognition.2014:4106-4113.
[27]ELHAMIFAR E,VIDAL R.Sparse subspace clustering:algorithm,theory,and applications[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(11):2765-2781.
[28]HU H,LIN Z,FENG J,et al.Smooth representation clustering[C]//IEEE Conference on Computer Vision and Pattern Recognition.2014:3834-3841.
[29]JIAO L,YANG S,LIU F,et al.Seventy Years beyond Neural Networks:Retrospect and Prospect[J].Chinese Journal of Computers,2016,8(39):1697-1716.
[30]WANG W,ARORA R,LIVESCU K,et al.On deep multi-view representation learning[C]//International Conference on Machine Learning.2015:1083-1092.
[31]ZHANG C,FU H,HU Q,et al.Flexible multi-view dimensiona-lity co-reduction[J].IEEE Transactions on Image Processing,2016,26(2):648-659.
[1] 宋杰, 梁美玉, 薛哲, 杜军平, 寇菲菲.
基于无监督集群级的科技论文异质图节点表示学习方法
Scientific Paper Heterogeneous Graph Node Representation Learning Method Based onUnsupervised Clustering Level
计算机科学, 2022, 49(9): 64-69. https://doi.org/10.11896/jsjkx.220500196
[2] 徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺.
时序知识图谱表示学习
Temporal Knowledge Graph Representation Learning
计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[3] 黄璞, 杜旭然, 沈阳阳, 杨章静.
基于局部正则二次线性重构表示的人脸识别
Face Recognition Based on Locality Regularized Double Linear Reconstruction Representation
计算机科学, 2022, 49(6A): 407-411. https://doi.org/10.11896/jsjkx.210700018
[4] 周海榆, 张道强.
面向多中心数据的超图卷积神经网络及应用
Multi-site Hyper-graph Convolutional Neural Networks and Application
计算机科学, 2022, 49(3): 129-133. https://doi.org/10.11896/jsjkx.201100152
[5] 蒋宗礼, 樊珂, 张津丽.
基于生成对抗网络和元路径的异质网络表示学习
Generative Adversarial Network and Meta-path Based Heterogeneous Network Representation Learning
计算机科学, 2022, 49(1): 133-139. https://doi.org/10.11896/jsjkx.201000179
[6] 王营丽, 姜聪聪, 冯小年, 钱铁云.
时间感知的兴趣点推荐方法
Time Aware Point-of-interest Recommendation
计算机科学, 2021, 48(9): 43-49. https://doi.org/10.11896/jsjkx.210400130
[7] 赵金龙, 赵中英.
基于异质信息网络表示学习与注意力神经网络的推荐算法
Recommendation Algorithm Based on Heterogeneous Information Network Embedding and Attention Neural Network
计算机科学, 2021, 48(8): 72-79. https://doi.org/10.11896/jsjkx.200800226
[8] 杨如涵, 戴毅茹, 王坚, 董津.
基于表示学习的工业领域人机物本体融合
Humans-Cyber-Physical Ontology Fusion of Industry Based on Representation Learning
计算机科学, 2021, 48(5): 190-196. https://doi.org/10.11896/jsjkx.200500023
[9] 武阿明, 姜品, 韩亚洪.
基于视觉和语言的跨媒体问答与推理研究综述
Survey of Cross-media Question Answering and Reasoning Based on Vision and Language
计算机科学, 2021, 48(3): 71-78. https://doi.org/10.11896/jsjkx.201100176
[10] 王树徽, 闫旭, 黄庆明.
跨媒体分析与推理技术研究综述
Overview of Research on Cross-media Analysis and Reasoning Technology
计算机科学, 2021, 48(3): 79-86. https://doi.org/10.11896/jsjkx.210200086
[11] 钱胜胜, 张天柱, 徐常胜.
多媒体社会事件分析综述
Survey of Multimedia Social Events Analysis
计算机科学, 2021, 48(3): 97-112. https://doi.org/10.11896/jsjkx.210200023
[12] 李鑫超, 李培峰, 朱巧明.
一种基于层级信息优化的有向网络表示学习方法
Directed Network Representation Method Based on Hierarchical Structure Information
计算机科学, 2021, 48(2): 100-104. https://doi.org/10.11896/jsjkx.191200033
[13] 王雪岑, 张昱, 刘迎婕, 于戈.
基于表示学习的在线学习交互质量评价方法
Evaluation of Quality of Interaction in Online Learning Based on Representation Learning
计算机科学, 2021, 48(2): 207-211. https://doi.org/10.11896/jsjkx.201000042
[14] 富坤, 赵晓梦, 付紫桐, 高金辉, 马浩然.
基于不完全信息的深度网络表示学习方法
Deep Network Representation Learning Method on Incomplete Information Networks
计算机科学, 2021, 48(12): 212-218. https://doi.org/10.11896/jsjkx.201000015
[15] 潘雨, 邹军华, 王帅辉, 胡谷雨, 潘志松.
基于网络表示学习的深度社团发现方法
Deep Community Detection Algorithm Based on Network Representation Learning
计算机科学, 2021, 48(11A): 198-203. https://doi.org/10.11896/jsjkx.210200113
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!