Computer Science ›› 2022, Vol. 49 ›› Issue (2): 69-82.doi: 10.11896/jsjkx.210900140
• Computer Vision: Theory and Application • Previous Articles Next Articles
YAN Rui1,2, LIANG Zhi-yong3, LI Jin-tao1, REN Fei1
CLC Number:
[1]ZHOU S K,GREENSPAN H,DAVATZIKOS C,et al.A re-view of deep learning in medical imaging:Image traits,technology trends,case studies with progress highlights,and future promises[J].arXiv:2008.09104,2020. [2]DENG S,ZHANG X,YAN W,et al.Deep learning in digital pathology image analysis:A survey[J].Frontiers of Medicine,2020,14(4):18. [3]ECHLE A,RINDTORFF N T,BRINKER T J,et al.Deeplearning in cancer pathology:A new generation of clinical biomarkers[J].British Journal of Cancer,2020,124:1-11. [4]YAN R,CHEN L M,LI J T,et al.Research progress of cancer classification based on deep learning and histopathological images[J].Medical Journal of Peking Union Medical College Hospital,2021,12:742-748. [5]LITJENS G,KOOI T,BEJNORDI B E,et al.A survey on deep learning in medical image analysis[J].Med. Image. Anal.,2017,42:60-88. [6]SIMONYAN K,ZISSERMAN A.Very deep convolutional networks for large-scale image recognition[J].arXiv:1409.1556,2014. [7]HE K,ZHANG X,REN S,et al.Deep residual learning forimage recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:770-778. [8]SZEGEDY C,VANHOUCKE V,IOFFE S,et al.Rethinking the inception architecture for computer vision[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:2818-2826. [9]HUANG G,LIU Z,MAATEN L V D,et al.Densely connected convolutional networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:4700-4708. [10]RONNEBERGER O,FISCHER P,BROX T.U-net:Convolu-tional networks for biomedical image segmentation[C]//International Conference on Medical Image Computing and Compu-ter-assisted Intervention.Springer,2015:234-241. [11]CHEN L C,PAPANDREOU G,KOKKINOS I,et al.Deeplab:Semantic image segmentation with deep convolutional nets,atrous convolution,and fully connected crfs[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,40:834-848. [12]CHEN L C,PAPANDREOU G,KOKKINOS I,et al.Semanticimage segmentation with deep convolutional nets and fully connected crfs[J].arXiv:1412.7062,2014. [13]DOSOVITSKIY A,BEYER L,KOLESNIKOV A,et al.Animage is worth 16x16 words:Transformers for Image Recognition at Scale[J].arXiv:2010.11929,2020. [14]WANG X,YANG S,ZHANG J,et al.Transpath:Transformer-based self-supervised learning for histopathological image classification[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention.Springer,2021:186-195. [15]GAO Z,HONG B,ZHANG X,et al.Instance-based vision trans-former for subtyping of papillary renal cell carcinoma in histopathological image[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention.Springer,2021:299-308. [16]LI H,YANG F,ZHAO Y,et al.Dt-mil:Deformable transformer for multi-instance learning on histopathological image[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention.Springer,2021:206-216. [17]WU Z,PAN S,CHEN F,et al.A comprehensive survey ongraph neural networks[J].IEEE Transactions on Neural Networks and Learning Systems,2020,32:4-24. [18]ILSE M,TOMCZAK J,WELLING M.Attention-based deepmultiple instance learning[C]//International Conference on Machine Learning.PMLR,2018:2127-2136. [19]PRADHAN A,PAUDYAL P,SINHA A,et al.Grading,staging and nottingham prognostic index scoring of breast carcinoma[J].Journal of Pathology of Nepal,2017,7:1078-1083. [20]LOEFFLER C M L,BRUECHLE N O,JUNG M,et al.Artificial intelligence-based detection of fgfr3 mutational status directly from routine histology in bladder cancer:A possible preselection for molecular testing?[J].European Urology Focus,2021. [21]KATHER J N,HEIJ L R,GRABSCH H I,et al.Pan-cancerimage-based detection of clinically actionable genetic alterations[J].Nature Cancer,2020,1:789-799. [22]SPANHOL F A,OLIVEIRA L S,PETITJEAN C,et al.Breast cancer histopathological image classification using convolutional neural networks[C]//International Joint Conference on Neural Networks.2016:717-726. [23]BAYRAMOGLU N,KANNALA J,HEIKKIL J.Deep learningfor magnification independent breast cancer histopathology image classification[C]//International Conference on Pattern Recognition.2017:2440-2445. [24]ARAÚJO T,ARESTA G,CASTRO E,et al.Classification ofbreast cancer histology images using convolutional neural networks[J].Plos One,2017,12(6):e0177544. [25]JIANG Y,CHEN L,ZHANG H,et al.Breast cancer histopathological image classification using convolutional neural networks with small se-resnet module[J].PloS one,2019,14:e0214587. [26]VESAL S,RAVIKUMAR N,DAVARI A A,et al.Classification of breast cancer histology images using transfer learning[C]//International Conference Image Analysis and Recognition.2018:812-819. [27]VANG Y S,CHEN Z,XIE X.Deep learning framework formulti-class breast cancer histology image classification[C]//International Conference Image Analysis and Recognition.2018:914-922. [28]RAKHLIN A,SHVETS A,IGLOVIKOV V,et al.Deep convolutional neural networks for breast cancer histology image analysis[C]//International Conference Image Analysis and Recognition.2018:737-744. [29]SHABAN M,AWAN R,FRAZ M M,et al.Context-aware convolutional neural network for grading of colorectal cancer histo-logy images[J].IEEE Transactions on Medical Imaging,2020,39(7):2395-2405. [30]YAN R,REN F,WANG Z,et al.Breast cancer histopathological image classification using a hybrid deep neural network[J].Methods,2020,173:52-60. [31]GAO Z,SHI J,WANG J.Gq-gcn:Group quadratic graph convolutional network for classification of histopathological images[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention.Springer,2021:121-131. [32]COUDRAY N,OCAMPO P S,SAKELLAROPOULOS T,et al.Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning[J].Nature Medicine,2018,24:1559-1567. [33]TAKAHAMA S,KUROSE Y,MUKUTA Y,et al.Multi-stage pathological image classification using semantic segmentation[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2019:10702-10711. [34]ADNAN M,KALRA S,TIZHOOSH H R.Representationlearning of histopathology images using graph neural networks[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops.2020:988-989. [35]TELLEZ D,LITJENS G,LAAK J V D,et al.Neural imagecompression for gigapixel histopathology image analysis[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2019,43:567-578. [36]CAMPANELLA G,HANNA M G,GENESLAW L,et al.Clinical-grade computational pathology using weakly supervised deep learning on whole slide images[J].Nature Medicine,2019,25:1301-1309. [37]WANG X,CHEN H,GAN C,et al.Weakly supervised deeplearning for whole slide lung cancer image analysis[J].IEEE Transactions on Cybernetics,2019,50:3950-3962. [38]WANG S,ZHU Y,YU L,et al.Rmdl:Recalibrated multi-instance deep learning for whole slide gastric image classification[J].Medical Image Analysis,2019,58:101549. [39]LI B,LI Y,ELICEIRI K W.Dual-stream multiple instancelearning network for whole slide image classification with self-supervised contrastive learning[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:14318-14328. [40]KÄLLÉN H,MOLIN J,HEYDEN A,et al.Towards gradinggleason score using generically trained deep convolutional neural networks[C]//2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).IEEE,2016:1163-1167. [41]WAN T,CAO J,CHEN J,et al.Automated grading of breastcancer histopathology using cascaded ensemble with combination of multi-level image features[J].Neurocomputing,2017,229:34-44. [42]YAN R,LI J,RAO X,et al.Nanet:Nuclei-aware network for grading of breast cancer in he stained pathological images[C]//2020 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).IEEE,2020:865-870. [43]AWAN R,SIRINUKUNWATTANA K,EPSTEIN D,et al.Glandular morphometrics for objective grading of colorectal adenocarcinoma histology images[J].Scientific Reports,2017,7:1-12. [44]ZHOU Y,GRAHAM S,KOOHBANANI N A,et al.Cgcnet:Cell graph convolutional network for grading of colorectal cancerhistology images[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops.2019. [45]STRÖM P,KARTASALO K,OLSSON H,et al.Artificial intelligence for diagnosis and grading of prostate cancer in biopsies:A population-based,diagnostic study[J].The Lancet Oncology,2020,21:222-232. [46]BULTEN W,PINCKAERS H,BOVEN H V,et al.Automated deep-learning system for gleason grading of prostate cancer using biopsies:A diagnostic study[J].The Lancet Oncology,2020,21:233-241. [47]BULTEN W,BALKENHOL M,BELINGA J J A,et al.Artificial intelligence assistance significantly improves gleason grading of prostate biopsies by pathologists[J].Modern Pathology,2021,34:660-671. [48]NAGPAL K,FOOTE D,TAN F,et al.Development and validation of a deep learning algorithm for gleason grading of prostate cancer from biopsy specimens[J].JAMA Oncology,2020,6:1372-1380. [49]RAJU A,YAO J,HAQ M M,et al.Graph attention multi-in-stance learning for accurate colorectal cancer staging[C]//International Conference on Medical Image Compu-ting and Compu-ter-Assisted Intervention.Springer,2020:529-539. [50]WANG D,KHOSLA A,GARGEYA R,et al.Deep learning for identifying metastatic breast cancer[J].arXiv:1606.05718,2016. [51]LIU Y,GADEPALLI K,NOROUZI M,et al.Detecting cancer metastases on gigapixel pathology images[J].arXiv:1703.02442,2017. [52]LI Y,PING W.Cancer metastasis detection with neural condi-tional random field[J].arXiv:1806.07064,2018. [53]GUO Z,LIU H,NI H,et al.A fast and refined cancer regions segmentation framework in whole-slide breast pathological images[J].Scientific Reports,2019,9:1-10. [54]LE H,SAMARAS D,KURC T,et al.Pancreatic cancer detection in whole slide images using noisy label annotations[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention.Springer,2019:541-549. [55]TOLKACH Y,RGEN T D,TOMA M,et al.High-accuracyprostate cancer pathology using deep learning[J].Nature Machine Intelligence,2020,2:411-418. [56]SCHAUMBERG A J,RUBIN M A,FUCHS T J.H&E-stained whole slide image deep learning predicts spop mutation state in prostate cancer[J].BioRxiv,2018:064279. [57]DING K,LIU Q,LEE E,et al.Feature-enhanced graph net-works for genetic mutational prediction using histopathological images in colon cancer[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention.Sprin-ger,2020:294-304. [58]KATHER J N,PEARSON A T,HALAMA N,et al.Deeplearning can predict microsatellite instability directly from histology in gastrointestinal cancer[J].Nature Medicine,2019,25:1054-1056. [59]YAMASHITA R,LONG J,LONGACRE T,et al.Deep learning model for the prediction of microsatellite instability in colorectal cancer:A diagnostic study[J].The Lancet Oncology,2021,22:132-141. [60]XU H,PARK S,LEE S H,et al.Using transfer learning on whole slide images to predict tumor mutational burden in bladder cancer patients[J].BioRxiv,2019:554527. [61]WOERL A C,ECKSTEIN M,GEIGER J,et al.Deep learning predicts molecular subtype of muscle-invasive bladder cancer from conventional histopathological slides[J].European Urology,2020,78:256-264. [62]RAWAT R R,ORTEGA I,ROY P,et al.Deep learned tissue“fingerprints” classify breast cancers by er/pr/her2 status from H&E images[J].Scientific Reports,2020,10:1-13. [63]HU J,CUI C,YANG W,et al.Using deep learning to predictanti-pd-1 response in melanoma and lung cancer patients from histopathology images[J].Translational Oncology,2021,14:100921. [64]JOHANNET P,COUDRAY N,DONNELLY D M,et al.Usingmachine learning algorithms to predict immunotherapy response in patients with advanced melanoma[J].Clinical Cancer Research,2021,27:131-140. [65]BARRERA C,VELU P,BERA K,et al.Computer-extractedfeatures relating to spatial arrangement of tumor infiltrating lymphocytes to predict response to nivolumab in non-small cell lung cancer (nsclc)[C]//American Society of Clinical Oncology.2018:12115. [66]JOHANNET P,COUDRAY N,JOUR G,et al.Using machine learning algorithms to predict response and toxicity to immune checkpoint inhibitors (icis) in melanoma patients[C]//American Society of Clinical Oncology.2019:2581. [67]LIU K,XIA W,QIANG M,et al.Deep learning pathological microscopic features in endemic nasopharyngeal cancer:Prognostic value and protentional role for individual induction chemotherapy[J].Cancer Medicine,2020,9:1298-1306. [68]LI X,TANG Q,YU J,et al.Microvascularity detection andquantification in glioma:A novel deep-learning-based framework[J].Laboratory Investigation,2019,99:1515-1526. [69]ZHU X,YAO J,HUANG J.Deep convolutional neural network for survival analysis with pathological images[C]//2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).IEEE,2016:544-547. [70]ZHU X,YAO J,ZHU F,et al.Wsisa:Making survival prediction from whole slide histopathological images[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:7234-7242. [71]LI R,YAO J,ZHU X,et al.Graph cnn for survival analysis on whole slide pathological images[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention.Springer,2018:174-182. [72]YAO J,ZHU X,JONNAGADDALA J,et al.Whole slide images based cancer survival prediction using attention guided deep multiple instance learning networks[J].Medical Image Analysis,2020,65:101789. [73]KOOHBANANI N A,UNNIKRISHNAN B,KHURRAM S A,et al.Self-path:Self-supervision for classification of pathology images with limited annotations[J].IEEE Transactions on Me-dical Imaging,2021,40:2845-2856. [74]SELVARAJU R R,COGSWELL M,DAS A,et al.Grad-cam:Visual explanations from deep networks via gradient-based localization[C]//Proceedings of the IEEE International Confe-rence on Computer Vision.2017:618-626. |
[1] | XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171. |
[2] | RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207. |
[3] | TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305. |
[4] | SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177. |
[5] | WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293. |
[6] | HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329. |
[7] | JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335. |
[8] | HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78. |
[9] | CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126. |
[10] | HOU Yu-tao, ABULIZI Abudukelimu, ABUDUKELIMU Halidanmu. Advances in Chinese Pre-training Models [J]. Computer Science, 2022, 49(7): 148-163. |
[11] | ZHOU Hui, SHI Hao-chen, TU Yao-feng, HUANG Sheng-jun. Robust Deep Neural Network Learning Based on Active Sampling [J]. Computer Science, 2022, 49(7): 164-169. |
[12] | SU Dan-ning, CAO Gui-tao, WANG Yan-nan, WANG Hong, REN He. Survey of Deep Learning for Radar Emitter Identification Based on Small Sample [J]. Computer Science, 2022, 49(7): 226-235. |
[13] | LIU Wei-ye, LU Hui-min, LI Yu-peng, MA Ning. Survey on Finger Vein Recognition Research [J]. Computer Science, 2022, 49(6A): 1-11. |
[14] | SUN Fu-quan, CUI Zhi-qing, ZOU Peng, ZHANG Kun. Brain Tumor Segmentation Algorithm Based on Multi-scale Features [J]. Computer Science, 2022, 49(6A): 12-16. |
[15] | KANG Yan, XU Yu-long, KOU Yong-qi, XIE Si-yu, YANG Xue-kun, LI Hao. Drug-Drug Interaction Prediction Based on Transformer and LSTM [J]. Computer Science, 2022, 49(6A): 17-21. |
|