Computer Science ›› 2023, Vol. 50 ›› Issue (11A): 220900059-7.doi: 10.11896/jsjkx.220900059

• Interdiscipline & Application • Previous Articles     Next Articles

Medical Image Segmentation Based on Multi-scale Edge Guidance

JIANG Haotian1, WANG Qizhi1, HUANG Yanglin1, ZHANG Yaqin2 andHU Kai1   

  1. 1 School of Computer Science & School of Cyberspace Science,Xiangtan University,Xiangtan,Hunan 411105,China
    2 Department of Radiology,The Third Xiangya Hospital,Central South University,Changsha 410013,China
  • Published:2023-11-09
  • About author:JIANG Haotian,born in 2001,undergraduate.His main research interests include deep learning and medical image processing.
    HU Kai,born in 1984,Ph.D,associate professor,is a member of China Computer Federation.His main research intserests include machine learning,pattern recognition,bioinformatics,and medical image processing.
  • Supported by:
    National Natural Science Foundation of China(61802328) and College Students’ Innovation and Entrepreneurship Project in China(S202110530024).

Abstract: Medical images have small gray-scale changes,and segmentation targets and backgrounds are not easy to distinguish,thus image segmentation is full of challenging problems.Most of the existing models unify the segmented high-frequency edges with the low-frequency subjects for learning,ignoring the difference between high-frequency information and low-frequency information and the difference in the proportion of both in the image.To address this problem,edge guided V-shape network(EGV-Net),a multi-scale convolutional neural network based on edge guidance,is proposed to perform targeted learning from two feature perspectives:low-frequency segmented subjects and high-frequency segmented edges.Among them,the low-frequency features are passed through the feature transfer by the encoder-decoder connection method to learn the main part of the segmentation target.The high-frequency features are firstly extracted from the segmentation mapping by edge extraction method,and then the segmentation edges are filtered and separated from it.The segmented edges of high frequency are guided by edge guidance module to make accurate segmentation of low frequency segmented edges and recover edge detail accuracy.Experimental results in liver images and ISIC2016 show that the proposed algorithm has better control over the overall segmentation and better segmentation effect at the edge details than other models.

Key words: Deep learning, Medical image segmentation, Multi-scale features, Edge extraction, Edge guidance

CLC Number: 

  • TP391
[1]ZHENG G Y,LIU X B,HAN G H.A review of computer-aided detection and diagnosis systems for medical imaging[J].Journal of Software,2018,29(5):1471-1514.
[2]LIN Y,TIAN J.A review of medical image segmentation me-thods[J].Pattern Recognition and Artificial Intelligence,2002,15(2):192-204.
[3]CHIEN Y.Pattern classification and scene analysis[J].IEEETransactions on Automatic Control,1974,19(4):462-463.
[4]PREWITT J M S.Object enhancement and extraction[J].Picture Processing and Psychopictorics,1970,10(1):15-19.
[5]CANNY J.A computational approach to edge detection[J].IEEE Transactionson Pattern Analysis and Machine Intelligence,1986(6):679-698.
[6]SIVAKUMAR V,MURUGESH V.A brief study of image seg-mentation using thresholding technique on a noisy image[C]//International Conference on Information Communication and Embedded Systems(ICICES2014).IEEE,2014:1-6.
[7]OTSU N.A threshold selection method from gray-level histograms[J].IEEE Transactions on Systems,Man,and Cyberne-tics,1979,9(1):62-66.
[8]LEVINE B F,BETHEA C G,THURMOND C D,et al.An organic crystal with an exceptionally large optical second-harmonic coefficient:2-methyl-4-nitroaniline[J].Journal of Applied Phy-sics,1979,50(4):2523-2527.
[9]PITMAN J.Poisson-Dirichlet and GEM invariant distributionsfor split-and-merge transformations of an interval partition[J].Combinatorics,Probability and Compu-ting,2002,11(5):501-514.
[10]LONG J,SHELHAMER E,DARRELL T.Fully convolutional networks for semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:3431-3440.
[11]RONNEBERGER O,FISCHER P,BROX T.U-net:Convolu-tional networks for biomedical image segmentation[C]//International Conference on Medical Image Computing and Compu-ter-assisted Intervention.Cham:Springer,2015:234-241.
[12]ZHOU Z,RAHMAN SIDDIQUEE M M,TAJBAKHSH N,et al.Unet++:A nested u-net architecture for medical image segmentation[M]//Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support.Cham:Springer,2018:3-11.
[13]HUANG H,LIN L,TONG R,et al.Unet 3+:A full-scale connected unet for medical image segmentation[C]//ICASSP 2020-2020 IEEE International Conference on Acoustics,Speech and Signal Processing(ICASSP).IEEE,2020:1055-1059.
[14]ZHANG Z,FU H,DAI H,et al.Et-net:A generic edge-attention guidance network for medical image segmentation[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention.Cham:Springer,2019:442-450.
[15]SUN J M,GE Q Q,LI X M,et al.A medical image segmentation network with edge enhancement feature[J].Journal of Electro-nics & Information Technology,2022,44:1-10.
[16]VALANARASU J M J,SINDAGI V A,HACIHALILOGLU I,et al.Kiu-net:Overcomplete convolutional architectures for biomedical image and volumetric segmentation[J].IEEE Transactions on Medical Imaging,2021,41(4):965-976.
[17]MILLETARI F,NAVAB N,AHMADI S A.V-net:Fully convolutional neural networks for volumetric medical image segmentation[C]//2016 fourth international conference on 3D vision(3DV).IEEE,2016:565-571.
[18]LIN T Y,GOYAL P,GIRHICK R,et al.Focal loss for dense object detection[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:2980-2988.
[19]HE K,ZHANG X,REN S,et al.Spatial pyramid pooling in deep cosssssnvolutional networks for visual recognition[J].IEEE transactions on pattern analysis and machine intelligence,2015,37(9):1904-1916.
[20]GUTMAN D,CODELLA N,CELEBI E,et al.Skin lesion analysis toward melanoma detection:A challenge at the international symposium on biomedical imaging (ISBI) 2016[C]//Hosted by the International Skin Imaging Collaboration (ISIC).2016.
[21]XIAO X,LIAN S,LUO Z,et al.Weighted res-unet for high-quality retina vessel segmentation[C]//2018 9th International Conference on Information Technology in Medicine and Education(ITME).IEEE,2018:327-331.
[22]HU J,SHEN L,SUN G.Squeeze-and-excitation networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:7132-7141.
[23]TAKIKAWA T,ACUNA D,JAMPANI V,et al.Gated-scnn:Gated shape cnns for semantic segmentation[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2019:5229-5238.
[1] ZHAO Mingmin, YANG Qiuhui, HONG Mei, CAI Chuang. Smart Contract Fuzzing Based on Deep Learning and Information Feedback [J]. Computer Science, 2023, 50(9): 117-122.
[2] LI Haiming, ZHU Zhiheng, LIU Lei, GUO Chenkai. Multi-task Graph-embedding Deep Prediction Model for Mobile App Rating Recommendation [J]. Computer Science, 2023, 50(9): 160-167.
[3] HUANG Hanqiang, XING Yunbing, SHEN Jianfei, FAN Feiyi. Sign Language Animation Splicing Model Based on LpTransformer Network [J]. Computer Science, 2023, 50(9): 184-191.
[4] ZHU Ye, HAO Yingguang, WANG Hongyu. Deep Learning Based Salient Object Detection in Infrared Video [J]. Computer Science, 2023, 50(9): 227-234.
[5] ZHANG Yian, YANG Ying, REN Gang, WANG Gang. Study on Multimodal Online Reviews Helpfulness Prediction Based on Attention Mechanism [J]. Computer Science, 2023, 50(8): 37-44.
[6] SONG Xinyang, YAN Zhiyuan, SUN Muyi, DAI Linlin, LI Qi, SUN Zhenan. Review of Talking Face Generation [J]. Computer Science, 2023, 50(8): 68-78.
[7] WANG Xu, WU Yanxia, ZHANG Xue, HONG Ruize, LI Guangsheng. Survey of Rotating Object Detection Research in Computer Vision [J]. Computer Science, 2023, 50(8): 79-92.
[8] ZHOU Ziyi, XIONG Hailing. Image Captioning Optimization Strategy Based on Deep Learning [J]. Computer Science, 2023, 50(8): 99-110.
[9] ZHANG Xiao, DONG Hongbin. Lightweight Multi-view Stereo Integrating Coarse Cost Volume and Bilateral Grid [J]. Computer Science, 2023, 50(8): 125-132.
[10] WANG Yu, WANG Zuchao, PAN Rui. Survey of DGA Domain Name Detection Based on Character Feature [J]. Computer Science, 2023, 50(8): 251-259.
[11] WANG Mingxia, XIONG Yun. Disease Diagnosis Prediction Algorithm Based on Contrastive Learning [J]. Computer Science, 2023, 50(7): 46-52.
[12] SHEN Zhehui, WANG Kailai, KONG Xiangjie. Exploring Station Spatio-Temporal Mobility Pattern:A Short and Long-term Traffic Prediction Framework [J]. Computer Science, 2023, 50(7): 98-106.
[13] HUO Weile, JING Tao, REN Shuang. Review of 3D Object Detection for Autonomous Driving [J]. Computer Science, 2023, 50(7): 107-118.
[14] ZHOU Bo, JIANG Peifeng, DUAN Chang, LUO Yuetong. Study on Single Background Object Detection Oriented Improved-RetinaNet Model and Its Application [J]. Computer Science, 2023, 50(7): 137-142.
[15] MAO Huihui, ZHAO Xiaole, DU Shengdong, TENG Fei, LI Tianrui. Short-term Subway Passenger Flow Forecasting Based on Graphical Embedding of Temporal Knowledge [J]. Computer Science, 2023, 50(7): 213-220.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!