计算机科学 ›› 2023, Vol. 50 ›› Issue (6A): 220200108-6.doi: 10.11896/jsjkx.220200108

• 图像处理&多媒体技术 • 上一篇    下一篇

基于多编码器的多模态MRI脑肿瘤分割

戴天虹, 宋洁绮   

  1. 东北林业大学机电工程学院 哈尔滨 150040
  • 出版日期:2023-06-10 发布日期:2023-06-12
  • 通讯作者: 宋洁绮(jqsong96@foxmail.com)
  • 作者简介:(th_2000@sina.com)
  • 基金资助:
    中央高校基本科研业务费专项资金(2572019CP17);黑龙江省自然科学基金(C201414);哈尔滨市科技创新人才项目(2014RFXXJ086)

Multimodal MRI Brain Tumor Segmentation Based on Multi-encoder Architecture

DAI Tianhong, SONG Jieqi   

  1. College of Mechanical and Electrical Engineering,Northeast Forestry University,Harbin 150040,China
  • Online:2023-06-10 Published:2023-06-12
  • About author:DAI Tianhong,born in 1963,Ph.D,professor,master supervisor.His main research interests include image proces-sing and computer control. SONG Jieqi,born in 1996,postgra-duate,Her main research interests include deep learning and image proces-sing.
  • Supported by:
    Fundamental Research Funds for the Central Universities(2572019CP17),Natural Science Foundation of Heilongjiang Province,China(C201414) and Harbin Science and Technology Innovation Project(2014RFXXJ086).

摘要: 脑胶质瘤是起源于脑神经胶质细胞的原发性肿瘤,发病率约占全部颅内肿瘤的45%,其核磁共振图像(MRI)的精准分割有着非常重要的临床意义。文中提出了一种基于多编码器的脑肿瘤自动分割方法,模型采用U型网络结构,扩充单收缩路径为多路径以深度挖掘不同模态语义信息;提出结合空洞卷积的Inception模块作为网络基础卷积层以获取图像多尺度特征;在网络瓶颈层和解码器中引入轻量型通道注意力Efficient Channel Attention(ECA)模块,使得模型更多地关注与分割相关的信息,忽略通道维度的信息冗余,从而进一步提高网络分割的精确率。在Brain Tumor Segmentation Challenge 2018(BraTS 2018)数据集上进行验证,提出的网络在整体肿瘤、肿瘤核心、增强肿瘤3个区域的平均Dice系数分别为0.880,0.784,0.757,结果表明所提算法实现了准确有效的多模态MRI脑肿瘤分割。

关键词: 图像处理, 脑肿瘤分割, 多编码器, 空洞卷积, 通道注意力

Abstract: Glioma is a primary tumor originating from glial cells in the brain,accounting for about 45% of all intracranial tumors.Accurate segmentation of brain tumor in magnetic resonance imaging(MRI) images is of great clinical significance.In this paper,an automatic brain tumor segmentation method based on multi-encoder architecture is proposed.The model adopts a U-shaped network structure which expands the single contracting path into multiple paths to deeply exploit semantic information of diffe-rent modalities.In order to obtain the multiscale features of images,an inception module combined with dilated convolution is designed as the basic convolutional layer;a lightweight attention mechanism known as efficient channel attention(ECA) block is then introduced into the bottleneck layer and the decoder,so that the model pays more attention to the segmentation-related information and ignores the redundancy of the channel dimension,thereby further improving the segmentation results.Using the Brain Tumor Segmentation Challenge 2018(BraTS 2018) dataset for verification,the proposed model gets average Dice coefficientvalues of 0.880,0.784,and 0.757 for the whole tumor,tumor core and enhancing tumor respectively.Experiment results show that the proposed method achieves accurate and effective multimodal MRI brain tumor segmentation.

Key words: Image processing, Brain tumor segmentation, Muti-encoder, Dilated convolution, Channel attention mechanism

中图分类号: 

  • TP391
[1]KAMNITSAS K,LEDIG C,NEWCOMBE V F,et al.Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation[J].Medical Image Analysis,2017,36:61-78.
[2]MYRONENKO A.3D MRI brain tumor segmentation using autoencoder regularization[C]//International MICCAI Brainlesion Workshop.Cham:Springer,2018:311-320.
[3]ISENSEE F,JAEGER P F,KOHL S A,et al.nnU-Net:a self-configuring method for deep learning-based biomedical image segmentation[J].Nature methods,2021,18(2):203-211.
[4]HATAMIZADEH A,TANG Y,NATH V,et al.Unetr:Transformers for 3d medical image segmentation[C]//Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision(WACV).2022:574-584.
[5]NIE D,WANG L,GAO Y Z,et al.Fully convolutional networks for multi-modality isointense infant brain image segmentation[C]//2016 IEEE 13th International Symposium on Biomedical Imaging(ISBI).IEEE,2016:1342-1345.
[6]DOLZ J,AYED I B,DESROSIERS C.Dense multi-path U-Net for ischemic stroke lesion segmentation in multiple image moda-lities[C]//International MICCAI Brainlesion Workshop.Cham:Springer,2018:271-282.
[7]WANG G,LI W,OURSELIN S,et al.Automatic brain tumor segmentation based on cascaded convolutional neural networks with uncertainty estimation[J].Frontiers in Computational Neuroscience,2019,13:56.
[8]HU J,SHEN L,SUN G.Squeeze-and-excitation networks[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR).IEEE,2018:7132-7141.
[9]WANG Q L,WU B G,ZHU P F,et al.ECA-Net:efficient channel attention for deep convolutional neural networks[C]//2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR).IEEE,2020:11531-11539.
[10]MENZE B H,JAKAB A,BAUER S,et al.The multimodal brain tumor image segmentation benchmark(BRATS)[J].IEEE Transactions on Medical Imaging,2014,34(10):1993-2024.
[11]BAKAS S,AKBARI H,SOTIRAS A,et al.Advancing the can-cer genome atlas glioma MRI collections with expert segmentation labels and radiomic features[J].Scientific Data,2017,4(1):1-3.
[12]BAKAS S,REYES M,JAKAB A,et al.Identifying the best machine learning algorithms for brain tumor segmentation,progression assessment,and overall survival prediction in the BRATS challenge[J].arXiv:1811.02629,2019.
[13]ÇIÇEK Ö,ABDULKADIR A,LIENKAMP S S,et al.3D U-Net:learning dense volumetric segmentation from sparse annotation[C]//International Conference on Medical Image Computing and Computer-assisted Intervention.Cham:Springer,2016:424-432.
[14]MA J,YANG X P.Automatic brain tumor segmentation by exploring the multi-modality complementary information and cascaded 3D lightweight CNNs[C]//International MICCAI Brainlesion Workshop.Cham:Springer,2018:25-36.
[15]ALBIOL A,ALBIOL A,ALBIOL F.Extending 2D deep lear-ning architectures to 3D image segmentation problems[C]//International MICCAI Brainlesion Workshop.Cham:Springer,2018:73-82.
[16]HU K,GAN Q H,ZHANG Y,et al.Brain tumor segmentation using multi-cascaded convolutional neural networks and conditional random field[J].IEEE Access,2019,7:92615-92629.
[17]ZHOU Z,HE Z,JIA Y.AFPNet:A 3D fully convolutional neural network with atrous-convolution feature pyramid for brain tumor segmentation via MRI images[J].Neurocomputing,2020,402:235-244.
[18]AKBAR A S,FATICHAH C,SUCIATI N.SDA-UNET2.5D:Shallow Dilated with Attention Unet2.5D for Brain Tumor Segmentation[J].International Journal of Intelligent Engineering and Systems,2022,15(2):135-149.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!