Computer Science ›› 2020, Vol. 47 ›› Issue (2): 150-156.doi: 10.11896/jsjkx.190100150

• Artificial Intelligence • Previous Articles     Next Articles

Survey on Computerized Neurocognitive Assessment System

ZHANG Zheng-lin1,2,ZHANG Li-wei1,WANG Wen-juan2,3,XIA Li1,FU Hao1,2,WANG Hong-zhi1,YANG Li-zhuang1 and
LI Hai1   

  1. (Center of Medical Physics and Technology,Hefei Institutes of Physical Science,Chinese Acadency of Sciences,Hefei 230031,China)1;
    (University of Science and Technology of China,Hefei 230026,China)2;
    (School of Science,Anhui Agricultural University,Hefei 230036,China)3
  • Received:2019-01-18 Online:2020-02-15 Published:2020-03-18
  • About author:ZHANG Zheng-lin,born in 1995,postgraduate.His main research interests include pattern recognition and intelligent system;LI Hai,born in 1981,Ph.D,research fellow,Ph.D supervisor.His main research interests include artificial intelligence and medical image analysis.
  • Supported by:
    This work was supported by the National Natural Science Foundation of China (81401483, 31500917, 81571653), Natural Science Fund of Anhui Province (1708085MF141), Hefei Foreign Cooperation Project (ZR201801020002), Key R&D Program of Anhui Province (201904a07020104) and Director’s Fund of Hefei Cancer Hospital of CAS (YZJJ2019C14, YZJJ2019A04).

Abstract: Neurological and psychiatric disorders,surgical injuries,tumors,and aging can lead to neurocognitive decline in humans.Intervention and rehabilitation require specialized neurocognitive assessment tools to evaluate cognitive decline and track cognitive changes.In order to promote the research and development of computerized neurocognitive assessment system suitable for Chinese population and improve the clinical application level of cognitive neuropsychology in China,firstly,the research background and development history of neurocognitive assessment were summarized.Secondly,the computerized neurocognitive assessment system with empirical evidences supporting its reliability and validity over the past decade at home and abroad was investigated and its characteristics were compared.Then,this paper demonstrated the necessity of developing a computerized neurocognitive assessment system suitable for Chinese people,introduced its development process and put forward the computer adaptive testing strategy for the assessment system.Subsequently,the main problems of the current computerized neurocognitive assessment system were analyzed.On this basis,the application of modern information technology such as virtual reality,brain cognitive computing model and online assessment in the future computerized neurocognitive assessment system was prospected.Finally,a commercial model of computerized neurocognitive assessment system based on artificial intelligence,mobile medicine and digital medicine was proposed.

Key words: Commercialization, Computerized adaptive test, Computerized neurocognitive assessment system, Neuropsychology, Reliability and validity, Virtual reality

CLC Number: 

  • TP391
[1]BAUER R M,IVERSON G L,CERNICH A N,et al.Compute-rized Neuropsychological Assessment Devices:Joint Position Paper of the American Academy of Clinical Neuropsychology and the National Academy of Neuropsychology[J].The Clinical Neuropsychologist,2012,26(2):177-196.
[2]EDWARDS J,VESS J,REGER G,et al.The Use of Virtual Rea-lity in the Military’s Assessment of Service Members With Traumatic Brain Injury:Recent Developments and Emerging Opportunities[J].Applied Neuropsychology:Adult,2014,21(3):220-230.
[3]TEEL E,GAY M,JOHNSON B,et al.Determining sensitivity/specificity of virtual reality-based neuropsychological tool for detecting residual abnormalities following sport-related concussion[J].Neuropsychology,2016,30(4):474-483.
[4]RUST J,GOLOMBOK S.现代心理测量学(第3版)[M].李晓,等译.北京:中国人民大学出版社,2011.
[5]CLAESSEN M H G,HAM I J M V D,ZANDVOORT M J E V.Computerization of the Standard Corsi Block-Tapping Task Affects Its Underlying Cognitive Concepts:A Pilot Study[J].Applied Neuropsychology:Adult,2015,22(3):180-188.
[6]KESSELS R P C.Improving precision in neuropsychological assessment:bridging the gap between classic paper-and-pencil tests and paradigms from cognitive neuroscience[J].The Clinical Neuropsychologist,2019,33(2):357-368.
[8]GUR R C,RICHARD J,HUGHETT P,et al.A cognitive neuroscience based computerized battery for efficient measurement of individual differences:Standardization and initial construct validation[J].Journal of Neuroscience Methods,2010,187(2):254-262.
[9]SWAGERMAN S C,DE GEUS E J C,KAN K J,et al.The Computerized Neurocognitive Battery:Validation,aging effects,and heritability across cognitive domains[J].Neuropsychology,2016,30(1):53-64.
[10]GUR R E.Psychometric Properties of the Penn Computerized Neurocognitive Battery[J].Neuropsychology,2015,29(2):235-246.
[11]CARLOZZI N E,GOODNIGHT S,CASALETTO K B,et al.Validation of the NIH Toolbox in Individuals with Neurologic Disorders[J].Archives of Clinical Neuropsychology the Official Journal of the National Academy of Neuropsychologists,2017,32(5):555-573.
[12]BABAKHANYAN I,MCKENNA B S,CASALETTO K B, et al.National Institutes of Health,Toolbox Emotion Battery for English- and Spanish-speaking adults:normative data and factor-based summary scores[J].Patient Related Outcome Measures,2018,9:115-127.
[13]HESSL D,SANSONE S M,BERRYKRAVIS E,et al.The NIH Toolbox Cognitive Battery for intellectual disabilities:three preliminary studies and future directions[J].Journal of Neurodevelopmental Disorders,2016,8(1):35.
[14]TULSKY D S,HOLDNACK J A,COHEN M L,et al.Factor structure of the NIH Toolbox Cognition Battery in individuals with acquired brain injury[J].Rehabilitation Psychology,2017,62(4):435-442.
[15]EDWARDS M K,LOPRINZI P D.Experimental Effects of Acute Exercise and Meditation on Parameters of Cognitive Function[J].Journal of Clinical Medicine,2018,7(6):125.
[16]ZHANG N,JIANG H F,WU J,et al.Reliability and Validity of the CogState Battery Chinese Language Version in Schizophrenia[J].PLoS ONE,2013,8(9):e74258.
[17]CABEÇA H L S,ROCHA L C,SABBÁ A F,et al.The subtleties of cognitive decline in multiple sclerosis:an exploratory study using hierarchichal cluster analysis of CANTAB results[J].Bmc Neurology,2018,18(1):140.
[18]COTTER J,VITHANAGE N,COLVILLE S,et al.Investigating Domain-Specific Cognitive Impairment Among Patients With Multiple Sclerosis Using Touchscreen Cognitive Testing in Routine Clinical Care[J].Frontiers in Neurology,2018,9:331.
[19]CLAESDOTTER E,CERVINM,ÅKERLUND S,et al.The effects of ADHD on cognitive performance[J].Nordic Journal of Psychiatry,2018,72(3):158-163.
[20]CACCIAMANI F,SALVADORI N,EUSEBI P,et al.Evidence of practice effect in CANTAB spatial working memory test in a cohort of patients with mild cognitive impairment[J].Applied Neuropsychology:Adult,2018,25(3):237-248.
[21]KOPF T,GALIC S,MATESIC K.The Efficiency of MMPI-2 Validity Scales in Detecting Malingering of Mixed Anxiety-Depressive Disorder[J].Alcoholism & Psychiatric Research Journal of Psychiatric Research & Addictions,2016,52(1):33-50.
[22]SELLBOM M,WAUGH M H,HOPWOOD C J.Development and Validation of Personality Disorder Spectra Scales for the MMPI-2-RF[J].Journal of Personality Assessment,2018,100(4):406-420.
[23]WU Y C,ZOU Z K,SUN J J,et al.Value of Vienna Test System in psychological screening of flying cadets[J].Military Me-dical Sciences,2015,39(2):97-100.
[24]STUBBS B,KU P W,CHUNG M S,et al.Relationship Between Objectively Measured Sedentary Behavior and Cognitive Performance in Patients With Schizophrenia Vs Controls[J].Schizophrenia Bulletin,2017,43(3):566-574.
[25]GIGLER K L,BLOMEKE K,SHATIL E,et al.Preliminary evidence for the feasibility of at-home online cognitive training with older adults[J].Gerontechnology,2013,12(1):26-35.
[26]SHEA T,KANE C,MICKENS M.A review of the use and psychometric properties of the cognistat/neurobehavioral cognitive status examination in adults post-cerebrovascular accident[J].Rehabil Psychol,2017,62(2):221-222.
[27]GATES N J,KOCHAN N A.Computerized and on-line neuropsychological testing for late-life cognition and neurocognitive disorders:are we there yet?[J].Current Opinion in Psychiatry,2015,28(2):165-172.
[28]DEDE E,ZALONIS I,GATZONIS S,et al.Integration of computers in cognitive assessment and level of comprehensiveness of frequently used computerized batteries[J].Neurology,Psychiatry and Brain Research,2015,21(3):128-135.
[29]CANINI M,BATTISTA P,ROSA P A D,et al.Computerized Neuropsychological Assessment in Aging:Testing Efficacy and Clinical Ecology of Different Interfaces[J].Computational and Mathematical Methods in Medicine,2014,2014:804723.
[31]HODGES J R.临床神经心理学认知评估手册(第2版)[M].熊丽,等译.武汉:华中科技大学出版社,2014.
[32]GIBBONS R D,WEISS D J,KUPFER D J,et al.Using Computerized Adaptive Testing to Reduce the Burden of Mental Health Assessment[J].Psychiatric Services,2008,59(4):361-368.
[33]CAI Y,MIAO Y,TU D B.The polytomously scored cognitive diagnosis computerized adaptive testing[J].Acta Psychologica Sinica,2016,48(10):1338-1346.
[35]BILDER R M.Neuropsychology 3.0:Evidence-Based Science and Practice[J].Journal of the International Neuropsychological Society,2011,17(1):7-13.
[36]WOO E.Computerized Neuropsychological Assessments[J]. CNS Spectrums,2008,13(S16):14-17.
[37]PICARD R W,KLEIN J.Computers that recognize and respond to user emotion:theoretical and practical implications[J].Interacting with Computers,2002,14(2):141-169.
[38]PARSONS T D,CARLEW A R,MAGTOTO J,et al.The potential of function-led virtual environments for ecologically valid measures of executive function in experimental and clinical neuropsychology[J].Neuropsychological Rehabilitation,2017,27(5):777-807.
[39]OLIVEIRA C R,LOPES F B J P,SUGARMAN M A,et al.Development and Feasibility of a Virtual Reality Task for the Cognitive Assessment of Older Adults:The ECO-VR[J].The Spa-nish Journal of Psychology,2016,19:E95.
[40]BOTTIROLI S,TASSORELLI C,LAMONICA M,et al.Smart Aging Platform for Evaluating Cognitive Functions in Aging:A Comparison with the MoCA in a Normal Population[J].Frontiers in Aging Neuroscience,2017,9:379.
[41]CÂNOVAS R,LEÓN I,SERRANO P,et al.Spatial navigation impairment in patients with refractory temporal lobe epilepsy:Evidence from a new virtual reality-based task[J].Epilepsy & Behavior,2011,22(2):364-369.
[42]ALEJANDRO T L,VALERO-AGUAYO L,DE L R E J.Visuospatial Orientation Learning through Virtual Reality for People with Severe Disability[J].International Journal of Disability,Development and Education,2017,64(4):420-435.
[43]PHILIP P,MICOULAUD-FRANCHI J A,SAGASPE P,et al.Virtual human as a new diagnostic tool,a proof of concept study in the field of major depressive disorders[J].Scientific Reports,2017,7:42656.
[44]GREWE P,LAHR D,KOHSIK A,et al.Real-life memory and spatial navigation in patients with focal epilepsy:Ecological validity of a virtual reality supermarket task[J].Epilepsy & Behavior,2014,31:57-66.
[45]JOVANOVSKI D,ZAKZANIS K,CAMPBELL Z,et al.Deve-lopment of a Novel,Ecologically Oriented Virtual Reality Mea-sure of Exe-cutive Function:The Multitasking in the City Test[J].Applied Neuropsychology Adult,2012,19(3):171-182.
[46]PARSONS T D,MCMAHAN T.An Initial Validation of the Virtual of the Virtual Environment Grocery Store[J].Journal of Neuroscience Methods,2017,291:13-19.
[47]RENISON B,PONSFORD J,TESTA R,et al.The Ecological and Construct Validity of a Newly Developed Measure of Executive Function:The Virtual Library Task[J].Journal of the International Neuropsychological Society,2012,18(3):440-450.
[48]LI M Y,WU H N,KUAI S G,et al.Application of virtual rea-lity technology in assessment of executive function[J].Advances in Psychological Science,2017,25(6):933-942.
[49]SUN J L,DU Y S.Application of virtual reality technology in diagnosis and treatment of attention deficit hyperactivity disorder[J].Chinese Journal of Child Health Care,2018,26(1):37-39.
[50]POLLAK Y,WEISS P L,RIZZO A A,et al.The Utility of a Continuous Performance Test Embedded in Virtual Reality in Measuring ADHD-Related Deficits[J].Journal of Developmental and Behavioral Pediatrics,2009,30(1):2-6.
[51]KAPLAN R M,SACCUZZO D P.心理测验:原理,应用和争论(第6版)[M].陈国鹏,等译.上海:上海人民出版社,2010.
[52]NEGUT A,MATU S,SAVA F A,et al.Task difficulty of vir-tual reality-based assessment tools compared to classical paper-and-pencil or computerized measures:A meta-analytic approach[J].Computers in Human Behavior,2016,54:414-424.
[54]凤凰网.“人工智能(AI)+医疗”,市场蛋糕巨大,门槛难迈[EB/OL].(2017-10-10) [2019-01-05].
[56]KRAUSE F,LINDEMANN O.Expyriment:A Python library for cognitive and neuroscientificexperiments[J].Behavior Research Methods,2014,46(2):416-428.
[57]MATHÔT S,SCHREIJ D,THEEUWES J.OpenSesame:An open-source,graphical experiment builder for the social sciences[J].Behavior Research Methods,2012,44(2):314-324.
[58]MUELLER S T,PIPER B J.The Psychology Experiment Buil-ding Language (PEBL) and PEBL Test Battery[J].Journal of Neuroscience Methods,2014,222:250-259.
[59]SHIELDS G S,MOONS W G,SLAVICH G M.Better executive function under stress mitigates the effects of recent life stress exposure on health in young adults[J].Stress,2017,20(1):92-102.
[60]PEIRCE J W.PsychoPy—Psychophysics software in Python.[J].J. Neurosci. Methods,2007,162(1/2):8-13.
[61]CAVDAROGLU S,KNOPS A.Mental subtraction and multiplication recruit both phonological and visuospatial resources:evidence from a symmetric dual-task design[J].Psychological Research,2016,80(4):608-624.
[62]NUUTINEN M,MUSTONEN T,HKKINEN J.CFS MAT-LAB toolbox:An experiment builder for continuous flash suppression (CFS) task[J].Behavior Research Methods,2018,50(5):1933-1942.
[63]MACWHINNEY B,COHEN J,PROVOST J.The PsyScopeexperiment-building system[J].Spat Vis,1997,11(1):99-101.
[1] QU Qian-wen, CHE Xiao-ping, QU Chen-xin, LI Jin-ru. Study on Information Perception Based User Presence in Virtual Reality [J]. Computer Science, 2022, 49(9): 146-154.
[2] LIU Yue-hong, NIU Shao-hua, SHEN Xian-hao. Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(7): 127-131.
[3] ZHANG Ji-kai, LI Qi, WANG Yue-ming, LYU Xiao-qi. Survey of 3D Gesture Tracking Algorithms Based on Monocular RGB Images [J]. Computer Science, 2022, 49(4): 174-187.
[4] ZHU Chen-shuang, CHENG Shi-wei. Prediction and Assistance of Navigation Demand Based on Eye Tracking in Virtual Reality Environment [J]. Computer Science, 2021, 48(8): 315-321.
[5] MA Si-qi, CHE Xiao-ping, YU Qi, YUE Chen-feng. Event-based User Experience Evaluation Method for Virtual Reality Applications [J]. Computer Science, 2021, 48(2): 167-174.
[6] ZHANG Yu-xiang, REN Shuang. Overview of Application of Positioning Technology in Virtual Reality [J]. Computer Science, 2021, 48(1): 308-318.
[7] JI Li-xia, LIU Cheng-ming. Fuzzy Static Image Target Reproduction Method Based on Virtual Reality Technology [J]. Computer Science, 2018, 45(7): 248-251.
[8] ZHANG Ning, LIU Ying-chun, SHEN Zhi-peng and GUO Chen. Review of Virtual Reality Technology Based Application Research in English Teaching for Special Purposes [J]. Computer Science, 2017, 44(Z6): 43-47.
[9] PAN Ren-yu, SUN Chang-le, XIONG Wei and WANG Hai-tao. Survey and Prospect of Collision Detection Based on Virtual Assembly Environment [J]. Computer Science, 2016, 43(Z11): 136-139.
[10] LI Dai-wei and SUN Jian-shun. Design and Implementation of Explosive Devices Exclude Virtual Simulation Training System [J]. Computer Science, 2013, 40(9): 302-306.
[11] . Simulated Data Generation for Information System: A Survey [J]. Computer Science, 2012, 39(Z6): 322-324.
[12] . Motion Path Planning Method for 3D Virtual Characters with Different Motion Modes [J]. Computer Science, 2012, 39(1): 268-272.
[13] LI Lin-yao,ZHANG Zhao-xiang,WANG Yun-hong,WANG Chao. Motion-based 3D Reconstruction and Applications to Virtual Reality [J]. Computer Science, 2011, 38(7): 273-276.
[14] ZHOU Jun,CHEN Lei-ting,LIU Qi-he,LI Yan-mei,RAO Yun-bo. Review and Prospect of Tree Modeling Techniques [J]. Computer Science, 2010, 37(6): 17-22.
[15] TAN Liang,LUO Yi-fan. Simulation of Precipitation Phenomenon Based on Particle System Method [J]. Computer Science, 2010, 37(1): 271-274.
Full text



No Suggested Reading articles found!