Computer Science ›› 2024, Vol. 51 ›› Issue (6A): 230500004-6.doi: 10.11896/jsjkx.230500004

• Image Processing & Multimedia Technolog • Previous Articles     Next Articles

Multiple Attention-guided Mechanisms for Ultrasound Breast Cancer Tumor Image Segmentation

GUO Hongyang1, CHENG Qian2, KANG Xiaodong1, YANG Jingyi1, YANG Shuqi1, LI Fang1,3, ZHANG Rui1   

  1. 1 School of Medical Image,Tianjin Medical University,Tianjin 300202,China
    2 Chongqing University Qianjiang Hospital,Chongqing 409000,China
    3 Beijing Chemical Occupational Disease Control Hospital,Beijing 100093,China
  • Published:2024-06-06
  • About author:GUO Hongyang,born in 2002,undergraduates.His main research interests include medical imaging diagnosis and so on.
    KANG Xiaodong,born in 1964,Ph.D,professor.His main research interests include medical image processing and medical information system integration.
  • Supported by:
    Beijing-Tianjin-Hebei Collaborative Innovation Project(17YEXTZC00020).

Abstract: There are some problems such as single prediction scale and information loss in traditional U-Net ultrasound breast image segmentation tasks.To solve these problems,a multi-attention-guided U-Net ultrasound image segmentation method for breast tumors is proposed.Firstly,multiple SEattention module are introduced into the encoding structure of U-Net to extract multi-level semantic information from the input breast tumor images,which guides the encoder to focus on the features of breast tumor and reduces the interference caused by redundant background information.Secondly,by designing a feature fusion processing module,the complex semantic feature fusion processing is carried out on the feature graph from the encoder.Finally,in the decoder part,the pyramid structure is added to capture global spatial information to improve the multi-scale feature extraction ability of the model for tumor images,so as to improve the expression ability and segmentation performance of the whole network.The proposed method is simulated on breast tumor image data set,and the results show that compared with other U-Net improved strategies,the proposed method has better accuracy and robustness.

Key words: Multiple attention guidance, Mammary gland, U-Net, Ultrasound, Image segmentation

CLC Number: 

  • TP391
[1]REBECCAR L,MILLER K D,JEMAL A.Cancer statistics,2019[J].CA:A Cancer Journal for Clinicians,20222,6(1):7-34.
[2]XIAO D,LI W B,ZHANG H M.Tumor Segmentation in Breast Ultrasound Images by Fusing Efficient-Net and U-Net[J].Chinese Medical Equipment Journal,2022,43(11):8-13.
[3]KANG X D.Medical Image Processing.[M].Beijing:People’s Health Publishing House,2009.
[4]XU M L,LI F,ZENG S,et al.Correlation Between the Characteristics of Ultrasound Gray Histogram and HER-2 Expression in Invasive Ductal Carcinoma of Breast[J].Chinese Journal of Medical Imaging,2022,30(12):1224-1229.
[5]GOMEZ W,LEJIA L A.Computerized lesion segmentation of breast ultrasound based on marker-controlled watershed transformation[J].Medical Physics,2010,37(1):82-95.
[6]HUANG Y L,CHEN D R.Watershed segmentation for breast tumor in 2-D sonography[J].Ultrasound in Medicine & Biology,2004,30(5):625-632.
[7]LONG J,SHELHAMER E,DARRELL T.Fully convolutional networks for semantic segmentation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,39(4):640-651.
[8]ZHAO H S,SHI J P,QI X J,et al.Pyramid scene parsing network[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition.2017:6230-6239.
[9]BADRINARAYANAN V,KENDALL A,CIPOLLA R.Seg-Net:a deep convolutional encoder-decoder architecture for image segmentation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,39(12):2481-2495.
[10]RONNEBERGER O,FISCHER P,BROX T.U-Net:convolu-tional networks for biomedical image segmentation[C]//18th International Conference on Medical Image Computing and Computer-Assisted Intervention.Cham:Springer,2015:234-241.
[11]CHEN L C,PAPANDREOU G,KKINOS I,et al.Semantic image segmentation with deep convolutional nets and fully connected CRFs[J].Computer Science,2014(4):357-361.
[12]CHEN L C,PAPANDREOU G,KKINOS I,et al.Deep-Lab:semantic image segmentation with deep convolutional nets,atrous convolution,and fully connected CRFs[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2018,40(4):834-848.
[13]CHEN L C,PAPANDREOU G,SCHROFF F,et al.Rethinking atrous convolution for semantic image segmentation[J].arXiv:1706.05587,2017.
[14]ZHOU Y W,LIU Z Q,WANG Q F,et al.Breast Mass Image Segmentation Algorithm Based on Improved Residual U-Net[J].Journal of Southwest University,2021,36(2):68-74.
[15]ZHAO J Y,QUE D S,TAN J Q,et al.Automated breast lesion segmentation from ultrasound images based on PPU-Net[C]//Proceedings of the 2019 International Conference on Medical Imaging Physics and Engineering.Piscataway:IEEE,2019:19725937.
[16]ALEKSANDAR V,MIN X,PHOEBE E F.Attention-enriched deep learning model for breast tumor segmentation in ultrasound images[J].Ultrasound in Medicine and Biology,2020,46(10):2819-2833.
[17]CHEN X,LIU Q,DENG X B,et al.Enhanced Network for Ultrasound Breast Tumor Segmentation Based on U-Net[J].Computer Engineering and Applications,2022,58(22):219-228.
[18]CHEN X,CAI Y J,RAN W B,et al.SECU-Net:A skin disease images segmentation network combining SE with CRF[J].Intelligent Computer And Applications,2022,12(11):71-77,86.
[19]CHANG H.Continuous blood pressure prediction based on deep learning[D].Lanzhou:Lanzhou University of Technology,2020.
[20]WANG X,YU M,REN H E.Remote sensing image semantic segmentation combining UNET and FPN[J].Chinese Journal of Liquid Crystals and Displays,2021,36(3):475-483.
[21]ZHANG F C,ZHONG G Q,MAO Y X.Neural Architecture Search for Light-weight Medical Image Segmentation Network[J].Computer Science,2022,49(10):183-190.
[1] YANG Shuqi, HAN Junling, KANG Xiaodong, YANG Jingyi, GUO Hongyang, LI Bo. Improved vnet Model for 3D Liver CT Image Segmentation [J]. Computer Science, 2024, 51(6A): 230400038-6.
[2] SHAN Xinxin, LI Kai, WEN Ying. Medical Image Segmentation Network Integrating Full-scale Feature Fusion and RNN with Attention [J]. Computer Science, 2024, 51(5): 100-107.
[3] WU Xiaoqin, ZHOU Wenjun, ZUO Chenglin, WANG Yifan, PENG Bo. Salient Object Detection Method Based on Multi-scale Visual Perception Feature Fusion [J]. Computer Science, 2024, 51(5): 143-150.
[4] LI Yu, YANG Xiangli, ZHANG Le, LIANG Yalin, GAO Xian, YANG Jianxi. Combined Road Segmentation and Contour Extraction for Remote Sensing Images Based on Cascaded U-Net [J]. Computer Science, 2024, 51(3): 174-182.
[5] HUANG Wenke, TENG Fei, WANG Zidan, FENG Li. Image Segmentation Based on Deep Learning:A Survey [J]. Computer Science, 2024, 51(2): 107-116.
[6] DING Tianshu, CHEN Yuanyuan. Medical Image Segmentation Algorithm Based on Self-attention and Multi-scale Input-Output [J]. Computer Science, 2024, 51(2): 135-141.
[7] ZHAO Ran, YUAN Jiabin, FAN Lili. Medical Ultrasound Image Super-resolution Reconstruction Based on Video Multi-frame Fusion [J]. Computer Science, 2023, 50(7): 143-151.
[8] HAN Junling, LI Bo, KANG Xiaodong, YANG Jingyi, LIU Hanqing, WANG Xiaotian. Cardiac MRI Image Segmentation Based on Faster R-CNN and U-net [J]. Computer Science, 2023, 50(6A): 220600047-9.
[9] QI Xuanlong, CHEN Hongyang, ZHAO Wenbing, ZHAO Di, GAO Jingyang. Study on BGA Packaging Void Rate Detection Based on Active Learning and U-Net++ Segmentation [J]. Computer Science, 2023, 50(6A): 220200092-6.
[10] LIU Yao, GUAN Lihe. Superpixel Segmentation Iterative Algorithm Based on Ball-k-means Clustering [J]. Computer Science, 2023, 50(6A): 220600114-7.
[11] YANG Jingyi, LI Fang, KANG Xiaodong, WANG Xiaotian, LIU Hanqing, HAN Junling. Ultrasonic Image Segmentation Based on SegFormer [J]. Computer Science, 2023, 50(6A): 220400273-6.
[12] BAI Xuefei, JIN Zhichao, WANG Wenjian, MA Yanan. Skin Lesion Segmentation Combining Boundary Enhancement and Multi-scale Attention [J]. Computer Science, 2023, 50(4): 96-102.
[13] BAI Xuefei, MA Yanan, WANG Wenjian. Segmentation Method of Edge-guided Breast Ultrasound Images Based on Feature Fusion [J]. Computer Science, 2023, 50(3): 199-207.
[14] CHEN Luoxuan, LIN Chengchuang, ZHENG Zhaoliang, MO Zefeng, HUANG Xinyi, ZHAO Gansen. Review of Transformer in Computer Vision [J]. Computer Science, 2023, 50(12): 130-147.
[15] SUN Kaixin, LIU Bin, SU Shuguang. Medical Microscopic Image Segmentation Model Based on CNN Structure and Swin Transformer [J]. Computer Science, 2023, 50(11A): 230200119-8.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!