Computer Science ›› 2021, Vol. 48 ›› Issue (9): 187-193.doi: 10.11896/jsjkx.200800099

Special Issue: Medical Imaging

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Glioma Segmentation Network Based on 3D U-Net++ with Fusion Loss Function

ZHANG Xiao-yu1, WANG Bin 1, AN Wei-chao1, YAN Ting2, XIANG Jie1   

  1. 1 College of Information and Computer,Taiyuan University of Technology,Taiyuan 030606,China
    2 Shanxi Key Laboratory of Carcinogenesis and Translational Research,Shanxi Medical University,Taiyuan 030606,China
  • Received:2020-08-16 Revised:2020-09-21 Online:2021-09-15 Published:2021-09-10
  • About author:ZHANG Xiao-yu,born in 1996,postgraduate.His main research interests include deep learning and medical imaging analysis.
    WANG Bin,born in 1983,Ph.D,asso-ciate professor,is a member of China Computer Federation.His main research interests include medical imaging analysis and neuroimaging.
  • Supported by:
    National Natural Science Foundation of China(81702449) and National Key R&D Program of China(2018AAA0102604)

Abstract: Glioma is the most common primary brain tumor caused by cancerous glial cells in the brain and spinal cord.Reliable segmentation of glioma tissue from multi-mode MRI is of great clinical value.However,due to the complexity of glioma itself and surrounding tissues and the blurring of boundary caused by invasion,automatic segmentation of glioma is difficult.In this paper,a 3D U-Net++ network using the fusion loss function is constructed to segment different areas of glioma.The network uses different levels of U-Net models for densely nested connections,and uses the output results of the four branches of the network as depth supervision so that the combination of deep and shallow features can be better used for segmentation,and combines Dice loss function and cross entropy loss function as a fusion loss function to improve the segmentation accuracy of small regions.In the independent test set divided by the public data set of the 2019 Multimodal Brain Tumor Segmentation Challenge (BraTs),the proposed method is evaluated with Dice coefficient,95% Hausdorff distance,mIoU(mean intersection over union),and PPV(precision) indicators.The whole tumor,the core region and the enhancing tumor region of Dice coefficient are 0.873,0.814,0.709;the 95% Hausdorff coefficient are 15.455,12.475,12.309 respectively;the mIoU are 0.789,0.720,0.601 respectively;the PPV are 0.898,0.846 and 0.735 respectively.Compared with the basis of 3D U-Net and 3D U-Net with depth of supervision,the proposed method can make use of more effective modal of the deep and shallow information,effectively use the space information.And the fusion loss function combined by the dice coefficient and the cross-entropy loss function can effectively enhance tumor segmentation accuracy of each area,especially the segmentation accuracy of small tumor areas such as enhancing tumor.

Key words: 3D U-Net++, Fusion loss function, Glioma, Multimodal magnetic resonance imaging, Tumor segmentation

CLC Number: 

  • TP391
[1]China Society for Radiation Oncology Expert Consensus of Glioma Radiotherapy in China (2017)[J].Chinese Journal of Radiation Oncology,2018(2):123-131.
[2]LEE C,HUH S,KETTER T A,et al.Unsupervised connectivity-based thresholding segmentation of midsagittal brain MR ima-ges[J].Computers in Biology and Medicine,1998,28(3):309-338.
[3]STADLBAUER A,MOSER E,GRUBER S,et al.Improved delineation of brain tumors:an automated method for segmentation based on pathologic changes of 1H-MRSI metabolites in glio-mas[J].Neuroimage,2004,23(2):454-461.
[4]DENG W K,XIAO W,DENG H,et al.MRI brain tumor segmentation with region growing method based on the gradients and variances along and inside of the boundary curve[C]//International Conference on Biomedical Engineering & Informatics.IEEE,2010.
[5]JAYADEVAPPA D,KUMAR S S,MURTY D S.A HybridSegmentation Model based on Watershed and Gradient Vector Flow for the Detection of Brain Tumor[J].International Journal of Signal Processing Image Processing & Pattern Recognition,2009,2(3):29-42.
[6]ZHAO Z,YANG G,LIN Y,et al.Automated glioma detection and segmentation using graphical models[J].PLOS ONE,2018,13(8):e0200745.
[7]GEREMIA E,CLATZ O,MENZE B H,et al.Spatial Decision Forests for Glioma Segmentation in Multi-Channel MR Images[J].NeuroImage,2011,57(2):378-390.
[8]SÉRGIO P,PINTO A,ALVES V,et al.Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images[J].IEEE Transactions on Medical Imaging,2016,35(5):1240-1251.
[9]RIVERA L C,CASTILLO L,DAZA L A,et al.Volumetric multimodality neural network for brain tumor segmentation[C]//13th International Symposium on Medical Information Proces-sing and Analysis.2017.
[10]LONG J,SHELHAMER E,DARRELL T.Fully Convolutional Networks for Semantic Segmentation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,39(4):640-651.
[11]JESSON A,ARBEL T.Brain Tumor Segmentation Using a 3D FCN with Multi-scale Loss[M]//Brainlesion:Glioma,Multiple Sclerosis,Stroke and Traumatic Brain Injuries.2018.
[12]RONNEBERGER O,FISCHER P,BROX T,et al.U-Net:Convolu-tional Networks for Biomedical Image Segmentation[C]//Medical Image Computing and Computer Assisted Intervention.2015:234-241.
[13]WANG C,SMEDBY O.Automatic brain tumor segmentationusing 2.5 D U-nets[C]//6th MICCAI BraTS Challenge.2017:292-296.
[14]ZHOU Z W,RAHMAN S M M.UNet++:Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentation[J].IEEE Transactions on Medical Imaging,2020,39(6):1856-1867.
[15]KAMNITSAS K,LEDIG C,NEWCOMBE V F J,et al.Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentation[J].Medical Image Analysis,2016,36:61.
[16]MENZE B H,JAKAB A,BAUER S,et al.The MultimodalBrain Tumor Image Segmentation Benchmark (BRATS)[J].IEEE Transactions on Medical Imaging,2015,34(10):1993-2024.
[17]BAKAS S,REYES M,JAKAB A,et al.Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation,Progression Assessment,and Overall Survival Prediction in the BRATS Challenge[J].arXiv:1811.02629,2018.
[18]BAKAS S,AKBARI H,SOTIRAS A,et al.Advancing TheCancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic features[J].Scientific Data,2017,4:170117.
[19]BAKAS S,AKBARI H,SOTIRAS A,et al.Segmentation labels and radiomic features for the pre-operative scans of the TCGA-GBM collection[EB/OL].(2020-03-11)[2020-09-21].https://wiki.cancerimagingarchive.net/pages/viewpage.action?pageId=24282666.
[20]BAKAS S,AKBARI H,SOTIRAS A,et al.Segmentation labels and radiomic features for the pre-operative scans of the TCGA-LGG collection[EB/OL].(2020-04-09)[2020-09-21].https://wiki.cancerimagingarchive.net/pages/viewpage.action?pageId=24282668.
[21]AVANTS B B,TUSTISON N,SONG G.Advanced normalization tools (ANTS)[J].Or Insight,2008,11:1-35.
[22]ISENSEE F,KICKINGEREDER P,WICK W,et al.BrainTumor Segmentation and Radiomics Survival Prediction:Contribution to the BRATS 2017 Challenge[C]//Medical Image Computing and Computer Assisted Intervention.2017:287-297.
[23]PRASANNA P,KARNAWAT A,ISMAIL M,et al.Radiomics-based convolutional neural network for brain tumor segmentation on multiparametric magnetic resonance imaging[J].Journal of Medical Imaging,2019,6:e024005.
[24]ZHAO X,HE L,WANG Y,et al.An Efficient Method for Connected-Component Labeling in 3D Binary Images[C]//2018 International Conference on Robots & Intelligent System (ICRIS).IEEE Computer Society,2018.
[1] SUN Fu-quan, CUI Zhi-qing, ZOU Peng, ZHANG Kun. Brain Tumor Segmentation Algorithm Based on Multi-scale Features [J]. Computer Science, 2022, 49(6A): 12-16.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!