Computer Science ›› 2023, Vol. 50 ›› Issue (6A): 220600047-9.doi: 10.11896/jsjkx.220600047

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Cardiac MRI Image Segmentation Based on Faster R-CNN and U-net

HAN Junling1, LI Bo2, KANG Xiaodong1, YANG Jingyi1, LIU Hanqing1, WANG Xiaotian1   

  1. 1 School of Medical Image,Tianjin Medical University,Tianjin 300202,China;
    2 Department of the Third Central Clinical College of Tianjin Medical University,Tianjin 300170,China
  • Online:2023-06-10 Published:2023-06-12
  • About author:HAN Junling,born in 1999,undergra-duate.Her main research interest is medical image processing. KANG Xiaodong,born in 1964,Ph.D, professor,is a member of China Computer Federation.His main research interests include medical image proces-sing and medical information system integration.
  • Supported by:
    Beijing Tianjin Hebei Collaborative Innovation Project(17YEXTZC00020).

Abstract: In order to solve the problem that the segmentation accuracy of the existing MRI neural network is reduced due to the diversity of input image information.An MRI image segmentation method using Faster R-CNN and U-net mechanism is proposed.Selecting the public cardiac MRI segmentation challenge datasets ACDC and SCD,cleaning and modifing the format of the dataset and sending them to the subsequent neural network.First,Faster R-CNN is applied to target image detection to preprocess the original input image and remove redundant background information.Second,performing U-net segmentation on the preprocessed images.At the same time,in order to test whether the performance and accuracy of the segmentation network are improved after the introduction of Faster R-CNN,ablation experiments and comparison experiments are conducted.In the ablation experiment,the detection and cropping module in the U-net segmentation network is removed,and the U-net and its improved network are selected to do a set of ablation experiments respectively.Experiments show that the average intersection ratio and Dice coefficient of the new method is 0.89 and 0.94 on the ACDC dataset,respectively,which is 7.3% and 5% higher.On the SCD dataset,it is 0.96 and 0.98,which is 5% and 3% higher,respectively.Automatic preprocessing and segmentation of MRI images is achieved.

Key words: U-net, Faster R-CNN, MRI, Segmentation algorithm, Deep learning

CLC Number: 

  • TP391
[1]KANG X D.Medical Image Processing[M].People’s MedicalPublishing House.2009:200.
[2]SUTTON R T,PINCOCK D,BAUMGART D C,et al.An overview of clinical decision support systems:benefits,risks,and strategies for success[J].Npj Digital Medicine,2020,17(2020):3.
[3]HESAMIAN M H,JIA W,HE X,et al.Deep Learning Tech-niques for Medical Image Segmentation:Achievements and Challenges[J].Journal of Digital Imaging,2019,32(4):582-96.
[4]KRIZHEVSKY A,SUTSKEVER I,HINTON G.ImageNetClassification with Deep Convolutional Neural Networks[J].Communications of the ACM,2012,60(6):84-90.
[5]HAVAEI M,DAVY A,WARDE-FARLEY D,et al.Braintumor segmentation with Deep Neural Networks[J].Medical Image Analysis,2017,35:18-31.
[6]SHELHAMER E,LONG J,DARRELL T.Fully Convolutional Networks for Semantic Segmentation[J].Ieee Transactions on Pattern Analysis and Machine Intelligence,2017,39(4):640-51.
[7]CHRIST P F,ELSHAER M,ETTLINGER F,et al.Automatic Liver and Lesion Segmentation in CT Using Cascaded Fully Convolutional Neural Networks and 3D Conditional Random Fields[C]//proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention-MICCAI.2016:415-423.
[8]RONNEBERGER O,FISCHER P,BROX T.U-Net:Convolu-tional Networks for Biomedical Image Segmentation[J].Medical Image Computing and Computer-Assisted Intervention-MICCAI 2015 Lecture Notes in Computer Science,2015,9351:234-241.
[9]TIAN X,WANG L,DING Q.Overview of Image Semantic Segmentation Methods Based on Deep Learning[J].Journal of Software Science,2019,30(2):440-468.
[10]WANG B,YUAN F Q,CHEN Z R,et al.Automatic segmentation method for multi-level U-Net thyroid ultrasound images[J].Computer Engineering and Applications,2023,59(5):205-212.
[11]IOFFE S,SZEGEDY C.Batch Normalization:Accelerating Deep Network Training by Reducing Internal Covariate Shift[J].JMLRorg,2015,37:448-56.
[12]AMMAR A,BOUATTANE O,YOUSSFI M.Automatic cardiac cine MRI segmentation and heart disease classification[J].Comput Med Imaging Graph,2021,88:101864.
[13]WANG X Y,YANG S,FANG Y Q,et al.SK-Unet:An Im-proved U-Net Model With Selective Kernel for the Segmentation of LGE Cardiac MR Images[J].IEEE Sensors Journal,2021,21(10):11643-53.
[14]LIU C,LIN N,CAO Y J,et al.Seg-CapNet:Neural Network Model for Cardiac MRI Image Segmentation[J].Chinese Journal of Imaging and Graphics,2021,26(2):452-463.
[15]ZOU Z,SHI Z,GUO Y,et al.Object Detection in 20 Years:A Survey[J].arXiv:1905.05055,2019.
[16]LIU T,TIAN Y,ZHAO S F,et al.Automatic Whole Heart Segmentation Using a Two-Stage U-Net Framework and an Adaptive Threshold Window[J].IEEE Access,2019,7:83628-83636.
[17]REN S Q,HE K M,GIRSHICK R,et al.Faster R-CNN:To-wards Real-Time Object Detection with Region Proposal Networks[J].Ieee Transactions on Pattern Analysis and Machine Intelligence,2017,39(6):1137-1149.
[18]HE K,ZHANG X,REN S,et al.Deep Residual Learning for Image Recognition[J].IEEE,2016:1063-6919.
[19]YANG H J,WANG E S,SUI Y X,et al.Simplified residual structure and fast deep residual network[J].Journal of Jilin University(Engineering Edition),2022,52(6):1413-1421.
[20]HINTON G E,KRIZHEVSKY A,WANG S D.Transforming Auto-Encoders[C]//Proceedings of the Artificial Neural Networks and Machine Learning-ICANN 2011-21st International Conference on Artificial Neural Networks.Berlin:Springer,2011,6791:44-51.
[21]ZHANG X Y,WANG B,AN W C,et al.3D U-Net++ glioma segmentation network based on fusion loss function[J].Computer Science,2021,48(9):187-193.
[1] ZHANG Yian, YANG Ying, REN Gang, WANG Gang. Study on Multimodal Online Reviews Helpfulness Prediction Based on Attention Mechanism [J]. Computer Science, 2023, 50(8): 37-44.
[2] SONG Xinyang, YAN Zhiyuan, SUN Muyi, DAI Linlin, LI Qi, SUN Zhenan. Review of Talking Face Generation [J]. Computer Science, 2023, 50(8): 68-78.
[3] WANG Xu, WU Yanxia, ZHANG Xue, HONG Ruize, LI Guangsheng. Survey of Rotating Object Detection Research in Computer Vision [J]. Computer Science, 2023, 50(8): 79-92.
[4] ZHOU Ziyi, XIONG Hailing. Image Captioning Optimization Strategy Based on Deep Learning [J]. Computer Science, 2023, 50(8): 99-110.
[5] ZHANG Xiao, DONG Hongbin. Lightweight Multi-view Stereo Integrating Coarse Cost Volume and Bilateral Grid [J]. Computer Science, 2023, 50(8): 125-132.
[6] WANG Yu, WANG Zuchao, PAN Rui. Survey of DGA Domain Name Detection Based on Character Feature [J]. Computer Science, 2023, 50(8): 251-259.
[7] LI Kun, GUO Wei, ZHANG Fan, DU Jiayu, YANG Meiyue. Adversarial Malware Generation Method Based on Genetic Algorithm [J]. Computer Science, 2023, 50(7): 325-331.
[8] WANG Mingxia, XIONG Yun. Disease Diagnosis Prediction Algorithm Based on Contrastive Learning [J]. Computer Science, 2023, 50(7): 46-52.
[9] SHEN Zhehui, WANG Kailai, KONG Xiangjie. Exploring Station Spatio-Temporal Mobility Pattern:A Short and Long-term Traffic Prediction Framework [J]. Computer Science, 2023, 50(7): 98-106.
[10] HUO Weile, JING Tao, REN Shuang. Review of 3D Object Detection for Autonomous Driving [J]. Computer Science, 2023, 50(7): 107-118.
[11] ZHOU Bo, JIANG Peifeng, DUAN Chang, LUO Yuetong. Study on Single Background Object Detection Oriented Improved-RetinaNet Model and Its Application [J]. Computer Science, 2023, 50(7): 137-142.
[12] MAO Huihui, ZHAO Xiaole, DU Shengdong, TENG Fei, LI Tianrui. Short-term Subway Passenger Flow Forecasting Based on Graphical Embedding of Temporal Knowledge [J]. Computer Science, 2023, 50(7): 213-220.
[13] LI Yuqiang, LI Linfeng, ZHU Hao, HOU Mengshu. Deep Learning-based Algorithm for Active IPv6 Address Prediction [J]. Computer Science, 2023, 50(7): 261-269.
[14] GAO Xiang, TANG Jiqiang, ZHU Junwu, LIANG Mingxuan, LI Yang. Study on Named Entity Recognition Method Based on Knowledge Graph Enhancement [J]. Computer Science, 2023, 50(6A): 220700153-6.
[15] ZENG Wu, MAO Guojun. Few-shot Learning Method Based on Multi-graph Feature Aggregation [J]. Computer Science, 2023, 50(6A): 220400029-10.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!