Computer Science ›› 2023, Vol. 50 ›› Issue (6A): 220200108-6.doi: 10.11896/jsjkx.220200108

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Multimodal MRI Brain Tumor Segmentation Based on Multi-encoder Architecture

DAI Tianhong, SONG Jieqi   

  1. College of Mechanical and Electrical Engineering,Northeast Forestry University,Harbin 150040,China
  • Online:2023-06-10 Published:2023-06-12
  • About author:DAI Tianhong,born in 1963,Ph.D,professor,master supervisor.His main research interests include image proces-sing and computer control. SONG Jieqi,born in 1996,postgra-duate,Her main research interests include deep learning and image proces-sing.
  • Supported by:
    Fundamental Research Funds for the Central Universities(2572019CP17),Natural Science Foundation of Heilongjiang Province,China(C201414) and Harbin Science and Technology Innovation Project(2014RFXXJ086).

Abstract: Glioma is a primary tumor originating from glial cells in the brain,accounting for about 45% of all intracranial tumors.Accurate segmentation of brain tumor in magnetic resonance imaging(MRI) images is of great clinical significance.In this paper,an automatic brain tumor segmentation method based on multi-encoder architecture is proposed.The model adopts a U-shaped network structure which expands the single contracting path into multiple paths to deeply exploit semantic information of diffe-rent modalities.In order to obtain the multiscale features of images,an inception module combined with dilated convolution is designed as the basic convolutional layer;a lightweight attention mechanism known as efficient channel attention(ECA) block is then introduced into the bottleneck layer and the decoder,so that the model pays more attention to the segmentation-related information and ignores the redundancy of the channel dimension,thereby further improving the segmentation results.Using the Brain Tumor Segmentation Challenge 2018(BraTS 2018) dataset for verification,the proposed model gets average Dice coefficientvalues of 0.880,0.784,and 0.757 for the whole tumor,tumor core and enhancing tumor respectively.Experiment results show that the proposed method achieves accurate and effective multimodal MRI brain tumor segmentation.

Key words: Image processing, Brain tumor segmentation, Muti-encoder, Dilated convolution, Channel attention mechanism

CLC Number: 

  • TP391
[1]KAMNITSAS K,LEDIG C,NEWCOMBE V F,et al.Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation[J].Medical Image Analysis,2017,36:61-78.
[2]MYRONENKO A.3D MRI brain tumor segmentation using autoencoder regularization[C]//International MICCAI Brainlesion Workshop.Cham:Springer,2018:311-320.
[3]ISENSEE F,JAEGER P F,KOHL S A,et al.nnU-Net:a self-configuring method for deep learning-based biomedical image segmentation[J].Nature methods,2021,18(2):203-211.
[4]HATAMIZADEH A,TANG Y,NATH V,et al.Unetr:Transformers for 3d medical image segmentation[C]//Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision(WACV).2022:574-584.
[5]NIE D,WANG L,GAO Y Z,et al.Fully convolutional networks for multi-modality isointense infant brain image segmentation[C]//2016 IEEE 13th International Symposium on Biomedical Imaging(ISBI).IEEE,2016:1342-1345.
[6]DOLZ J,AYED I B,DESROSIERS C.Dense multi-path U-Net for ischemic stroke lesion segmentation in multiple image moda-lities[C]//International MICCAI Brainlesion Workshop.Cham:Springer,2018:271-282.
[7]WANG G,LI W,OURSELIN S,et al.Automatic brain tumor segmentation based on cascaded convolutional neural networks with uncertainty estimation[J].Frontiers in Computational Neuroscience,2019,13:56.
[8]HU J,SHEN L,SUN G.Squeeze-and-excitation networks[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR).IEEE,2018:7132-7141.
[9]WANG Q L,WU B G,ZHU P F,et al.ECA-Net:efficient channel attention for deep convolutional neural networks[C]//2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR).IEEE,2020:11531-11539.
[10]MENZE B H,JAKAB A,BAUER S,et al.The multimodal brain tumor image segmentation benchmark(BRATS)[J].IEEE Transactions on Medical Imaging,2014,34(10):1993-2024.
[11]BAKAS S,AKBARI H,SOTIRAS A,et al.Advancing the can-cer genome atlas glioma MRI collections with expert segmentation labels and radiomic features[J].Scientific Data,2017,4(1):1-3.
[12]BAKAS S,REYES M,JAKAB A,et al.Identifying the best machine learning algorithms for brain tumor segmentation,progression assessment,and overall survival prediction in the BRATS challenge[J].arXiv:1811.02629,2019.
[13]ÇIÇEK Ö,ABDULKADIR A,LIENKAMP S S,et al.3D U-Net:learning dense volumetric segmentation from sparse annotation[C]//International Conference on Medical Image Computing and Computer-assisted Intervention.Cham:Springer,2016:424-432.
[14]MA J,YANG X P.Automatic brain tumor segmentation by exploring the multi-modality complementary information and cascaded 3D lightweight CNNs[C]//International MICCAI Brainlesion Workshop.Cham:Springer,2018:25-36.
[15]ALBIOL A,ALBIOL A,ALBIOL F.Extending 2D deep lear-ning architectures to 3D image segmentation problems[C]//International MICCAI Brainlesion Workshop.Cham:Springer,2018:73-82.
[16]HU K,GAN Q H,ZHANG Y,et al.Brain tumor segmentation using multi-cascaded convolutional neural networks and conditional random field[J].IEEE Access,2019,7:92615-92629.
[17]ZHOU Z,HE Z,JIA Y.AFPNet:A 3D fully convolutional neural network with atrous-convolution feature pyramid for brain tumor segmentation via MRI images[J].Neurocomputing,2020,402:235-244.
[18]AKBAR A S,FATICHAH C,SUCIATI N.SDA-UNET2.5D:Shallow Dilated with Attention Unet2.5D for Brain Tumor Segmentation[J].International Journal of Intelligent Engineering and Systems,2022,15(2):135-149.
[1] YU Jiuyang, ZHANG Dean, DAI Yaonan, HU Tianhao, XIA Wenfeng. Image Super-resolution Reconstruction Based on Structured Fusion Attention Network [J]. Computer Science, 2023, 50(6A): 220600240-5.
[2] LI Han, HOU Shoulu, TONG Qiang, CHEN Tongtong, YANG Qimin, LIU Xiulei. Entity Relation Extraction Method in Weapon Field Based on DCNN and GLU [J]. Computer Science, 2023, 50(6A): 220200112-7.
[3] YIN Heng, ZHANG Fan, LI Tianrui. Short-time Traffic Flow Forecasting Based on Multi-adjacent Graph and Multi-head Attention Mechanism [J]. Computer Science, 2023, 50(4): 40-46.
[4] QU Zhong, WANG Caiyun. Crack Detection of Concrete Pavement Based on Attention Mechanism and Lightweight DilatedConvolution [J]. Computer Science, 2023, 50(2): 231-236.
[5] LIU Wei-ye, LU Hui-min, LI Yu-peng, MA Ning. Survey on Finger Vein Recognition Research [J]. Computer Science, 2022, 49(6A): 1-11.
[6] LAI Teng-fei, ZHOU Hai-yang, YU Fei-hong. Real-time Extend Depth of Field Algorithm for Video Processing [J]. Computer Science, 2022, 49(6A): 314-318.
[7] SUN Fu-quan, CUI Zhi-qing, ZOU Peng, ZHANG Kun. Brain Tumor Segmentation Algorithm Based on Multi-scale Features [J]. Computer Science, 2022, 49(6A): 12-16.
[8] QU Zhong, CHEN Wen. Concrete Pavement Crack Detection Based on Dilated Convolution and Multi-features Fusion [J]. Computer Science, 2022, 49(3): 192-196.
[9] PAN Ze-min, QIN Ya-li, ZHENG Huan, WANG Rong-fang, REN Hong-liang. Block-based Compressed Sensing of Image Reconstruction Based on Deep Neural Network [J]. Computer Science, 2022, 49(11A): 210900118-9.
[10] HE Huang-xing, CHEN Ai-guo, WANG Jiao-long. Handwritten Image Binarization Based on Background Estimation and Local Adaptive Integration [J]. Computer Science, 2022, 49(11): 163-169.
[11] WANG Shi-yun, YANG Fan. Remote Sensing Image Semantic Segmentation Method Based on U-Net Feature Fusion Optimization Strategy [J]. Computer Science, 2021, 48(8): 162-168.
[12] ZHAN Rui, LEI Yin-jie, CHEN Xun-min, YE Shu-han. Street Scene Change Detection Based on Multiple Difference Features Network [J]. Computer Science, 2021, 48(2): 142-147.
[13] ZHANG Yu-long, WANG Qiang, CHEN Ming-kang, SUN Jing-tao. Survey of Intelligent Rain Removal Algorithms for Cloud-IoT Systems [J]. Computer Science, 2021, 48(12): 231-242.
[14] GONG Hang, LIU Pei-shun. Detection Method of High Beam in Night Driving Vehicle [J]. Computer Science, 2021, 48(12): 256-263.
[15] XIE Hai-ping, LI Gao-yuan, YANG Hai-tao, ZHAO Hong-li. Classification Research of Remote Sensing Image Based on Super Resolution Reconstruction [J]. Computer Science, 2021, 48(11A): 424-428.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!