Computer Science ›› 2024, Vol. 51 ›› Issue (11A): 230900116-6.doi: 10.11896/jsjkx.230900116

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Classification of Thoracic Diseases Based on Attention Mechanisms and Two-branch Networks

SONG Ziyan1, LUO Chuan1, LI Tianrui2, CHEN Hongmei2   

  1. 1 College of Computer Science,Sichuan University,Chengdu 610065,China
    2 School of Computing and Artificial Intelligence,Southwest Jiaotong University,Chengdu 611756,China
  • Online:2024-11-16 Published:2024-11-13
  • About author:SONG Ziyan,born in 1999,postgra-duate.His main research interest is medical image processing and analysis.
    LUO Chuan,born in 1987,Ph.D,asso-ciate professor,Ph.D supervisor,is a member of CCF(No.45031M).His mainresearch interests include data mining and machine learning.
  • Supported by:
    National Natural Science Foundation of China(62076171,62376230) and Natural Science Foundation of Sichuan Province,China(2022NSFSC0898).

Abstract: Thoracic disease classification based on chest radiographs is important to improve diagnostic accuracy and reduce the pressure on the healthcare system.The huge variation in the size of the regions of different thoracic diseases is the main challenge in the chest radiograph-based classification of thoracic diseases.When classifying diseases with small onset regions,most of the regions in the image are noisy regions,and it is difficult for traditional methods to cope with the huge size differences among di-seases effectively.To address this problem,a mask construction method combining multi-scale features is proposed,using DenseNet-121 as the feature extractor,a two-branch network is constructed,in which the global network is used for the overall classification,and tiny lesion regions are fed into the local branches to mitigate the interference of noisy regions.The branch feature fusion module based on the attentional mechanism is used to fuse the classification features from the two branches' information adaptively.Comparison experiments,ablation experiments,and parameter sensitivity analyses are performed on the ChestX-ray14 dataset.The experimental results show that the average AUC of the proposed method for classifying 14 thoracic diseases is higher than that of the existing methods,which is effective and parameter insensitive.

Key words: Thoracic disease classification, Deep learning, Chest radiographs, Attention mechanism, Feature fusion

CLC Number: 

  • TP391
[1]MA X Q,ZHU L L,KURCHE J S,et al.Global and regionalburden of interstitial lung disease and pulmonary sarcoidosis from 1990 to 2019:results from the global burden of disease study 2019[J].Thorax,2022,77(6):596-605.
[2]MCLAUGHLIN L,BOND R,HUGHES C,et al.Computing eyegaze metrics for the automatic assessment of radiographer performance during x-ray image interpretation [J].International Journal of Medical Informatics,2017,105:11-21.
[3]HOSSAIN M I,HOSSAIN S M,ZUNAED M,et al.A novel attention mechanism using anatomical prior probability maps for thoracic disease classification from x-ray images [J].arXiv:2210.02998,2022.
[4]WANG H Y,WANG S S,QIN Z B,et al.Triple attention lear-ning for classification of 14 thoracic diseases using chest radiography[J].Medical Image Analysis,2021,67:101846.
[5]GUAN Q J,HUANG Y P,ZHONG Z,et al.Thorax diseaseclassification with attention guided convolutional neural network[J].Pattern Recognition Letters,2020,131:38-45.
[6]ÇALLI E,SOGANCIOGLU E,VAN G B,et al.Deep learning for chest x-ray analysis:a survey [J].Medical Image Analysis,2021,72:102125.
[7]WANG X S,PENG Y F,LU L,et al.Chestx-ray8:hospital-scale chest x-ray database andbenchmarks on weakly-supervised classification and localization of common thorax diseases[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:2097-2106.
[8]RAJPURKAR P,IRVINJ,ZHU K,et al.Chexnet:radiologist-level pneumonia detection on chest x-rays with deep learning [J].arXiv:1711.05225,2017.
[9]HUANG G,LIU Z,VAN DER MAATEN L,et al.Densely connected convolutional networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:4700-4708.
[10]IOFFEG S,SZEGEDY C.Batch normalization:accelerating deep network training by reducing internal covariate shift[C]//International Conference on Machine Learning.2015:448-456.
[11]BALTRUSCHAT I M,NICKISCH H,GRASS M,et al.Com-parison of deep learning approaches for multi-label chest x-ray classification[J].Scientific Reports,2019,9(1):6381.
[12]GUAN Q J,HUANG Y P.Multi-label chest x-ray image classification via category-wise residual attention learning [J].Pattern Recognition Letters,2020,130:259-266.
[13]GE Z Y,MAHAPATRA D,CHANG X J,et al.Improvingmulti-label chest x-ray disease diagnosis by exploiting disease and health labels dependencies [J].Multimedia Tools and Applications,2020,79:14889-14902.
[14]CAI J Z,LU L,HARRISON A P,et al.Iterative attention mi-ning for weakly supervised thoracic disease pattern localization in chest x-rays[C]// Medical Image Computing and Computer Assisted Intervention.2018:589-598.
[15]LI B C,KANG G X,CHENG K,et al.Attention-guided convolutional neural network for detecting pneumonia on chest x-rays[C]//2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society.2019:4851-4854.
[16]HU J,SHEN L,SUN G.Squeeze-and-excitation networks[C]//Proceedings of the IEEE Conference on ComputerVision and Pattern Recognition.2018:7132-7141.
[17]SAEDNIA K,JALALIFAR A,EBRAHIMI S,et al.An atten-tion-guided deep neural network for annotating abnormalities in chestx-ray images:visualization of network decision basis[C]//2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society.2020:1258-1261.
[18]WANG H Y,JIA H Z,LU L,et al.Thorax-net:an attentionregularized deep neural network for classification of thoracic diseases on chest radiography [J].IEEE Journal of Biomedical and Health Informatics,2019,24(2):475-485.
[19]KAMAL U,ZUNAED M,NIZAM N B,et al.Anatomy-xnet:an anatomy aware convolutional neural network for thoracic disease classification in chest x-rays [J].IEEE Journal of Biomedical and Health Informatics,2022,26(11):5518-5528.
[20]CHEN B Z,ZHANG Z,LIN J Y,et al.Two-stream collaborativenetwork for multi-label chest x-ray Image classification with lung segmentation [J].Pattern Recognition Letters,2020,135:221-227.
[21]RUSSAKOVSKY O,DENG J,SU H,et al.Imagenet large scale visual recognition challenge [J].International Journal of Computer Vision,2015,115:211-252.
[22]WOO S,PARK J,LEE J Y,et al.Cbam:convolutional block attention module[C]//Proceedings of the European Conference on Computer Vision.2018:3-19.
[23]YAO L,POBLENZE,DAGUNTS D,et al.Learning to diagnose from scratch by exploiting dependencies among labels [J].ar-Xiv:1710.10501,2017.
[24]LI Z,WANG C,HAN M,et al.Thoracic disease identification and localization with limited supervision[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:8290-8299.
[1] DU Yu, YU Zishu, PENG Xiaohui, XU Zhiwei. Padding Load:Load Reducing Cluster Resource Waste and Deep Learning Training Costs [J]. Computer Science, 2024, 51(9): 71-79.
[2] XU Jinlong, GUI Zhonghua, LI Jia'nan, LI Yingying, HAN Lin. FP8 Quantization and Inference Memory Optimization Based on MLIR [J]. Computer Science, 2024, 51(9): 112-120.
[3] LI Xin, PU Yuanyuan, ZHAO Zhengpeng, LI Yupan, XU Dan. Image Arbitrary Style Transfer via Artistic Aesthetic Enhancement [J]. Computer Science, 2024, 51(9): 129-139.
[4] LI Yunchen, ZHANG Rui, WANG Jiabao, LI Yang, WANG Ziqi, CHEN Yao. Re-parameterization Enhanced Dual-modal Realtime Object Detection Model [J]. Computer Science, 2024, 51(9): 162-172.
[5] HU Pengfei, WANG Youguo, ZHAI Qiqing, YAN Jun, BAI Quan. Night Vehicle Detection Algorithm Based on YOLOv5s and Bistable Stochastic Resonance [J]. Computer Science, 2024, 51(9): 173-181.
[6] LIU Qian, BAI Zhihao, CHENG Chunling, GUI Yaocheng. Image-Text Sentiment Classification Model Based on Multi-scale Cross-modal Feature Fusion [J]. Computer Science, 2024, 51(9): 258-264.
[7] LI Zhe, LIU Yiyang, WANG Ke, YANG Jie, LI Yafei, XU Mingliang. Real-time Prediction Model of Carrier Aircraft Landing Trajectory Based on Stagewise Autoencoders and Attention Mechanism [J]. Computer Science, 2024, 51(9): 273-282.
[8] LIU Qilong, LI Bicheng, HUANG Zhiyong. CCSD:Topic-oriented Sarcasm Detection [J]. Computer Science, 2024, 51(9): 310-318.
[9] YAO Yao, YANG Jibin, ZHANG Xiongwei, LI Yihao, SONG Gongkunkun. CLU-Net Speech Enhancement Network for Radio Communication [J]. Computer Science, 2024, 51(9): 338-345.
[10] SUN Yumo, LI Xinhang, ZHAO Wenjie, ZHU Li, LIANG Ya’nan. Driving Towards Intelligent Future:The Application of Deep Learning in Rail Transit Innovation [J]. Computer Science, 2024, 51(8): 1-10.
[11] KONG Lingchao, LIU Guozhu. Review of Outlier Detection Algorithms [J]. Computer Science, 2024, 51(8): 20-33.
[12] LIU Sichun, WANG Xiaoping, PEI Xilong, LUO Hangyu. Scene Segmentation Model Based on Dual Learning [J]. Computer Science, 2024, 51(8): 133-142.
[13] TANG Ruiqi, XIAO Ting, CHI Ziqiu, WANG Zhe. Few-shot Image Classification Based on Pseudo-label Dependence Enhancement and NoiseInterferenceReduction [J]. Computer Science, 2024, 51(8): 152-159.
[14] ZHANG Rui, WANG Ziqi, LI Yang, WANG Jiabao, CHEN Yao. Task-aware Few-shot SAR Image Classification Method Based on Multi-scale Attention Mechanism [J]. Computer Science, 2024, 51(8): 160-167.
[15] WANG Qian, HE Lang, WANG Zhanqing, HUANG Kun. Road Extraction Algorithm for Remote Sensing Images Based on Improved DeepLabv3+ [J]. Computer Science, 2024, 51(8): 168-175.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!