Computer Science ›› 2025, Vol. 52 ›› Issue (6A): 240500089-8.doi: 10.11896/jsjkx.240500089

• Intelligent Medical Engineering • Previous Articles     Next Articles

Position-aware Based Multi-modality Lung Cancer Survival Prediction Method

WANG Yicheng, NING Tai, LIU Xinyu, LUO Ye   

  1. School of Computer Science and Technology,Tongji University,Shanghai 201804,China
  • Online:2025-06-16 Published:2025-06-12
  • About author:WANG Yicheng,born in 1999,master.His main research interests include machine learning and survival analysis.
    LUO Ye,born in 1984,associate professor,Ph.D supervisor,is a senior member of CCF(No.78398M).Her main research interests include medical image processing and analysis,computer vision,machine learning,etc.
  • Supported by:
    National Natural Science Foundation of China(62276189).

Abstract: Whole slide images(WSIs) of lung cancer play a pivotal role in prognostic diagnosis.However,survival analysis for lung cancer without pixel-level annotations still encounters numerous challenges.Existing methods often overlook information from clinical feature modalities,spatial information of patches,and the heterogeneity between WSIs and natural images.To address these hurdles,a position-aware based multi-modality lung cancer survival prediction method PSMMSurv is proposed.This approach effectively leverages whole slide images and clinical features through multi-modality fusion and multi-task learning.Furthermore,the proposed whole slide image feature learning network achieves position awareness by interacting with information from adjacent locations.Moreover,data heterogeneity issues are overcome through self-supervised learning.Experimental results on a large lung cancer dataset demonstrate that the proposed method surpasses existing approaches in terms of the C-index metric,enabling more accurate prediction of lung cancer patients’ survival outcomes and providing reliable support for better lung cancer prognosis.

Key words: Survival analysis, Whole slide images, Multi-modality fusion, Self-supervised learning, Multi-scale fusion, Multi-task learning

CLC Number: 

  • TP391
[1]BADE B C,CRUZC S D.Lung cancer 2020:epidemiology,etiology,and prevention[J].Clinics in Chest Medicine,2020,41(1):1-24.
[2]HOGG J C,CHU F S F,TAN W C,et al.Survival after lungvolume reduction in chronic obstructive pulmonary disease:insights from small airway pathology[J].American Journal of Respiratory and Critical Care Medicine,2007,176(5):454-459.
[3]CHEN J M,QU A P,WANG L W,et al.New breast cancer prognostic factors identified by computer-aided image analysis of HE stained histopathology images[J].Scientific Reports,2015,5(1):1-13.
[4]COMES M C,FUCCI L,MELE F,et al.A deep learning model based on whole slide images to predict disease-free survival in cutaneous melanoma patients[J].Scientific Reports,2022,12(1):20366.
[5]ZHU X,YAO J,ZHU F,et al.Wsisa:Making survival prediction from whole slide histopathological images[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:7234-7242.
[6]YAO J,ZHU X,HUANG J.Deep multi-instance learning forsurvival prediction from whole slide images[C]//Medical Image Computing and Computer Assisted Intervention-MICCAI 2019,Proceedings,Part I 22.Springer International Publishing,2019:496-504.
[7]YAO J,ZHU X,JONNAGADDALA J,et al.Whole slide images based cancer survival prediction using attention guided deep multiple instance learning networks[J].Medical Image Analysis,2020,65:101789-101803.
[8]DENG J,DONG W,SOCHER R,et al.Imagenet:A large-scale hierarchical image database[C]//2009 IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2009:248-255.
[9]OTSUN.A threshold selection method from gray-level histo-grams[J].IEEE Transactions on Systems,Man,and Cybernetics,1979,9(1):62-66.
[10]CHEN T,KORNBLITH S,NOROUZI M,et al.A simple frame-work for contrastive learning of visual representations[C]//International Conference on Machine Learning.PMLR,2020:1597-1607.
[11]KAPLAN E L,MEIER P.Nonparametric estimation from in-complete observations[J].Journal of the American Statistical Association,1958,53(282):457-481.
[12]MANTEL N.Evaluation of survival data and two new rank order statistics arising in its consideration[J].Cancer Chemother Rep,1966,50(3):163-170.
[13]DE TORRES J P,BASTARRIKA G,WISNIVESKY J P,et al.Assessing the relationship between lung cancer risk and emphysema detected on low-dose CT of the chest[J].Chest,2007,132(6):1932-1938.
[14]KRAVCHENKO J,BERRY M,ARBEEV K,et al.Cardiovascular comorbidities and survival of lung cancer patients:Medicare data based analysis[J].Lung Cancer,2015,88(1):85-93.
[15]National Lung Screening Trial Research Team.The nationallung screening trial:overview and study design[J].Radiology,2011,258(1):243-253.
[16]TIBSHIRANI R.The lasso method for variable selection in the Cox model[J].Statistics in medicine,1997,16(4):385-395.
[17]PÖLSTERL S,NAVAB N,KATOUZIAN A.Fast training ofsupport vector machines for survival analysis[C]//Machine Learning and Knowledge Discovery in Databases:European Conference,ECML PKDD 2015,2015,Proceedings,Part II 15.Springer International Publishing,2015:243-259.
[18]ISHWARAN H,KOGALUR U B,BLACKSTONE E H,et al.Random survival forests[J].Ann Appl Stat,2008,2:841-860.
[19]YAO J,ZHU X,ZHU F,et al.Deep correlational learning for survival prediction from multimodality data[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention.Cham:Springer International Publishing,2017:406-414.
[20]CHEN R J,LU M Y,WANG J,et al.Pathomic fusion:an integrated framework for fusing histopathology and genomic features for cancer diagnosis and prognosis[J].IEEE Transactions on Medical Imaging,2020,41(4):757-770.
[1] ZHANG Hang, WEI Shoulin, YIN Jibin. TalentDepth:A Monocular Depth Estimation Model for Complex Weather Scenarios Based onMultiscale Attention Mechanism [J]. Computer Science, 2025, 52(6A): 240900126-7.
[2] ZHANG Jiaxiang, PAN Min, ZHANG Rui. Study on EEG Emotion Recognition Method Based on Self-supervised Graph Network [J]. Computer Science, 2025, 52(5): 122-127.
[3] PENG Linna, ZHANG Hongyun, MIAO Duoqian. Complex Organ Segmentation Based on Edge Constraints and Enhanced Swin Unetr [J]. Computer Science, 2025, 52(4): 177-184.
[4] ZHAO Qian, GUO Bin, LIU Yubo, SUN Zhuo, WANG Hao, CHEN Mengqi. Generation of Enrich Semantic Video Dialogue Based on Hierarchical Visual Attention [J]. Computer Science, 2025, 52(1): 315-322.
[5] HAN Bing, DENG Lixiang, ZHENG Yi, REN Shuang. Survey of 3D Point Clouds Upsampling Methods [J]. Computer Science, 2024, 51(7): 167-196.
[6] ZHANG Haoyan, DUAN Liguo, WANG Qinchen, GAO Hao. Long Text Multi-entity Sentiment Analysis Based on Multi-task Joint Training [J]. Computer Science, 2024, 51(6): 309-316.
[7] CHEN Wenzhong, CHEN Hongmei, ZHOU Lihua, FANG Yuan. Time-aware Pre-training Method for Sequence Recommendation [J]. Computer Science, 2024, 51(5): 45-53.
[8] LIU Zeyu, LIU Jianwei. Video and Image Salient Object Detection Based on Multi-task Learning [J]. Computer Science, 2024, 51(4): 217-228.
[9] ZHANG Xue, TIAN Lan, ZENG Ming, LIU Junhui, ZONG Shaoguo. Multitask Classification Algorithm of ECG Signals Based on Radient Magnitude Direction Adjustment [J]. Computer Science, 2024, 51(12): 174-180.
[10] FU Mingrui, LI Weijiang. Multi-task Emotion-Cause Pair Extraction Method Based on Position-aware Interaction Network [J]. Computer Science, 2024, 51(11A): 231000086-9.
[11] WANG Kunyang, LIU Yang, YE Ning, ZHANG Kai. Road Extraction from Complex Urban Remote Sensing Images Based on Multi-task Learning [J]. Computer Science, 2024, 51(11A): 240300095-8.
[12] HUANG Lingwa, CUI Wencheng, SHAO Hong. Study on Pedestrian Detection Method Based on Multi-level Feature Fusion [J]. Computer Science, 2024, 51(11A): 231000106-7.
[13] XU Bei, XU Peng. Emotion Elicited Question Generation Model in Dialogue Scenarios [J]. Computer Science, 2024, 51(11): 265-272.
[14] ZHANG Xiaoyun, ZHAO Hui. Study on Multi-task Student Emotion Recognition Methods Based on Facial Action Units [J]. Computer Science, 2024, 51(10): 105-111.
[15] LI Xiang, FAN Zhiguang, LIN Nan, CAO Yangjie, LI Xuexiang. Self-supervised Learning for 3D Real-scenes Question Answering [J]. Computer Science, 2023, 50(9): 220-226.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!