Computer Science ›› 2023, Vol. 50 ›› Issue (11A): 221100232-6.doi: 10.11896/jsjkx.221100232

• Big Data & Data Science • Previous Articles     Next Articles

Diagnosis Prediction Based on Graph Convolutional Network and Attention Mechanism

YANG Xianming, ZHAN Xianchun, CHEN Hengliang, DING Haiyan   

  1. School of Information Science and Engineering,Yunnan University,Kunming 650504,China
  • Published:2023-11-09
  • About author:YANG Xianming,born in 1999,postgraduate.Her main research interests include deep learning and bioinforma-tics.
    DING Haiyan,born in 1974,master,associate professor.Her main research interest is intelligent data processing.
  • Supported by:
    National Natural Science Foundation of China(32060151).

Abstract: Diagnosis prediction is an important prediction task in healthcare,which aims to predict the future diagnosis of patients based on their historical health records.Predictive models based on attention mechanisms and recurrent neural network are widely used to solve this task,but they are easy to be affected by insufficient data.In addition,medical domain knowledge plays an important role in improving the performance of diagnosis prediction,but existing methods still cannot make full use of those know-ledge.Therefore,a diagnostic prediction model based on graph convolutional network and attention mechanism is designed.Firstly,the medical ontology is used to model the correlation between medical concepts,then the patient visit information is modeled as a graph.Secondly,the graph convolution module is used to obtain the spatial features between the medical codes in each visit of the patient.Finally,a multi-head attention mechanism is used to model the interrelationship between visit features and multi-level medical knowledge to predict the future health status of patients.Experimental results on two publicly available medical datasets show that the diagnosis prediction performance of the model is better than that of the existing diagnostic prediction models,and the potential information in the medical knowledge graph can beused more effectively.

Key words: Diagnostic prediction, Electronic health record, Medical domain knowledge, Graph convolutional network, Attention mechanism

CLC Number: 

  • TP391
[1]YADAV P,STEINBACH M,KUMAR V,et al.Mining Elec-tronic Health Records(EHRs):A Survey[J].ACM Comput.Surv.,2018,50(6):85.
[2]BOTSI T,HARTVIGSENG G,CHEN F,et al.Secondary use of EHR:data quality issues and informatics opportunitie[J/OL].https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3041534/.
[3]JENSEN P B,JENSEN L J,BRUNAK S.Mining electronichealth records:towards better research applications and clinical care[J].Nature Reviews Genetics,2012,13(6):395-405.
[4]KRUSE C S,STEIN A,THOMAS H,et al.The use of Elec-tronic Health Records to Support Population Health:A Systematic Review of the Literature[J].Journal of Medical Systems,2018,42(11):214.
[5]CHOI E,BAHADORI M T,SCHUETZA,et al.Doctor ai:Predicting clinical events via recurrent neural networks[C]//Machine Learning for Healthcare Conference.PMLR,2016:301-318.
[6]CHOI E,BAHADORI M T,SUN J,et al.Retain:An interpretable predictive model for healthcare using reverse time attention mechanism[J].arXiv:1608.05745,2016.
[7]MA F,CHITTA R,ZHOU J,et al.Dipole:Diagnosis prediction in healthcare via attention-based bidirectional recurrent neural networks[C]//Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.2017:1903-1911.
[8]CHOI E,BAHADORI M T,SONG L,et al.GRAM:graph-based attention model for healthcare representation learning[C]//Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.2017:787-795.
[9]MA F,YOU Q,XIAO H,et al.Kame:Knowledge-based attention model for diagnosis prediction in healthcare[C]//Procee-dings of the 27th ACM International Conference on Information and Knowledge Management.2018:743-752.
[10]GAO J,WANG X,WANG Y,et al.Camp:Co-attention memory networks for diagnosis prediction in healthcare[C]//2019 IEEE International Conference on Data Mining(ICDM).IEEE,2019:1036-1041.
[11]LI H,LI W H,CHEN W,et al.Diagnostic prediction based on Node2vec and knowledge attention mechanisms[J].Computer Science,2021,48(S2):630-637.
[12]LI Y,QIAN B,ZHANG X,et al.Knowledge guided diagnosisprediction via graph spatial-temporal network[C]//Proceedings of the 2020 SIAM International Conference on Data Mining.2020:19-27.
[13]TROTT P.International classification of diseases for oncology[J].Journal of Clinical Pathology,1977,30(8):782.
[14]COST H,PROJECT U.Clinical classifications software(CCS) for ICD-9-CM[J].www hcup-us.ahrq.gov/toolssoftware/ccs/ccs.jsp.
[15]BENGIO Y,COURVILLE A,VINCENT P.RepresentationLearning:A Review and New Perspectives[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(8):1798-1828.
[16]KIPF T N,WELLING M.Semi-supervised classification withgraph convolutional networks[J].arXiv:1609.02907,2016.
[17]VASWANI A,SHAZEER N,PARMAR N,et al.Attention isall you need[J].arXiv:1706.03762,2017.
[18]JOHNSON A E W,POLLARD T J,SHEN L,et al.MIMIC-III,a freely accessible critical care database[J].Scientific Data,2016,3(1):1-9.
[19]JOHNSON A,BULGARELLI L,POLLARD T,et al.MIMIC-IV,a freely accessible electronic health record dataset[J/OL].https://physionet.org/content/mimiciv/1.0/.
[20]SRIVASTAVA N,HINTON G,KRIZHEVSKY A,et al.Dropout:a simple way to prevent neural networks from overfitting[J].The journal of machine learning research,2014,15(1):1929-1958.
[21]KINGMA D P,BA J.Adam:A method for stochastic optimization[J].arXiv:1412.6980,2014.
[22]LI M,ZHANG T,CHEN Y,et al.Efficient mini-batch training for stochastic optimization[C]//Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.2014:661-670.
[1] YI Liu, GENG Xinyu, BAI Jing. Hierarchical Multi-label Text Classification Algorithm Based on Parallel Convolutional Network Information Fusion [J]. Computer Science, 2023, 50(9): 278-286.
[2] LUO Yuanyuan, YANG Chunming, LI Bo, ZHANG Hui, ZHAO Xujian. Chinese Medical Named Entity Recognition Method Incorporating Machine ReadingComprehension [J]. Computer Science, 2023, 50(9): 287-294.
[3] LI Ke, YANG Ling, ZHAO Yanbo, CHEN Yonglong, LUO Shouxi. EGCN-CeDML:A Distributed Machine Learning Framework for Vehicle Driving Behavior Prediction [J]. Computer Science, 2023, 50(9): 318-330.
[4] WANG Jiahao, ZHONG Xin, LI Wenxiong, ZHAO Dexin. Human Activity Recognition with Meta-learning and Attention [J]. Computer Science, 2023, 50(8): 193-201.
[5] WANG Yu, WANG Zuchao, PAN Rui. Survey of DGA Domain Name Detection Based on Character Feature [J]. Computer Science, 2023, 50(8): 251-259.
[6] ZHANG Yian, YANG Ying, REN Gang, WANG Gang. Study on Multimodal Online Reviews Helpfulness Prediction Based on Attention Mechanism [J]. Computer Science, 2023, 50(8): 37-44.
[7] TENG Sihang, WANG Lie, LI Ya. Non-autoregressive Transformer Chinese Speech Recognition Incorporating Pronunciation- Character Representation Conversion [J]. Computer Science, 2023, 50(8): 111-117.
[8] YAN Mingqiang, YU Pengfei, LI Haiyan, LI Hongsong. Arbitrary Image Style Transfer with Consistent Semantic Style [J]. Computer Science, 2023, 50(7): 129-136.
[9] GAO Xiang, TANG Jiqiang, ZHU Junwu, LIANG Mingxuan, LI Yang. Study on Named Entity Recognition Method Based on Knowledge Graph Enhancement [J]. Computer Science, 2023, 50(6A): 220700153-6.
[10] ZHANG Tao, CHENG Yifei, SUN Xinxu. Graph Attention Networks Based on Causal Inference [J]. Computer Science, 2023, 50(6A): 220600230-9.
[11] CUI Lin, CUI Chenlu, LIU Zhengwei, XUE Kai. Speech Emotion Recognition Based on Improved MFCC and Parallel Hybrid Model [J]. Computer Science, 2023, 50(6A): 220800211-7.
[12] DUAN Jianyong, YANG Xiao, WANG Hao, HE Li, LI Xin. Document-level Relation Extraction of Graph Attention Convolutional Network Based onInter-sentence Information [J]. Computer Science, 2023, 50(6A): 220800189-6.
[13] YANG Xing, SONG Lingling, WANG Shihui. Remote Sensing Image Classification Based on Improved ResNeXt Network Structure [J]. Computer Science, 2023, 50(6A): 220100158-6.
[14] ZHANG Shunyao, LI Huawang, ZHANG Yonghe, WANG Xinyu, DING Guopeng. Image Retrieval Based on Independent Attention Mechanism [J]. Computer Science, 2023, 50(6A): 220300092-6.
[15] LIU Haowei, YAO Jingchi, LIU Bo, BI Xiuli, XIAO Bin. Two-stage Method for Restoration of Heritage Images Based on Muti-scale Attention Mechanism [J]. Computer Science, 2023, 50(6A): 220600129-8.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!