Computer Science ›› 2026, Vol. 53 ›› Issue (3): 277-286.doi: 10.11896/jsjkx.250200049

• Computer Graphics & Multimedia • Previous Articles     Next Articles

CA-SFTNet:Skin Lesion Segmentation Model Based on Spatial Feature Transformation and Concentrated Attention Mechanism

ZHANG Wei1,2,3, LIANG Dunying1, ZHOU Wanting1, CHENG Xiang1   

  1. 1 College of Artificial Intelligence, Hubei University, Wuhan 430062, China
    2 Key Laboratory of Intelligent Perception Systems and Security of Ministry of Education, Wuhan 430062, China
    3 Hubei Provincial Engineering Research Center for Smart Government Affairs and Artificial Intelligence Application, Wuhan 430062, China
  • Received:2025-02-12 Revised:2025-05-14 Published:2026-03-12
  • About author:ZHANG Wei,born in 1979,associate professor,master’s supervisor,is a member of CCF(No.Y8013M).His main research interests include compu-ter vision,image processing and artificial intelligence.
    LIANG Dunying,born in 2000,postgraduate,is a member of CCF(No.W0351G).His main research interests include image processing and so on.
  • Supported by:
    National Natural Science Foundation of China(62273135).

Abstract: To address issues such as blurry skin lesion boundaries,noise caused by hair,incomplete segmentation of lesion regions,and significant differences in lesion feature distribution,this paper proposes CA-SFTNet,a U-Net-based algorithm integrating a condensed attention neural block and residual spatial feature transformation.Firstly,feature segmentation during downsampling preserves shallow semantic lesion information.Secondly,condensed attention neural block in skip connections enhances focus on lesion regions by adaptively weighting critical features.Finally,a residual spatial feature transformation module is integra-ted at the network’s tail,enabling adaptive adjustment for spatially heterogeneous regions and enhancing recognition of lesions with heterogeneous feature distributions.Experiments conducted on the ISIC2017 and ISIC2018 datasets demonstrate that CA-SFTNet outperforms the conventional U-Net in skin lesion segmentation.Specifically,it achieves Dice coefficients of 93.12% and 92.36%,representing improvements of 7.15 and 4.81 percentage points over U-Net,respectively.The corresponding IoU values are 82.59% and 82.31%,which constitute gains of 6.23 and 4.45 percentage points.Moreover,when compared with state-of-the-art Transformer-based architectures such as TransUNet and Swin-UNet,CA-SFTNet consistently improves the Dice coefficient by 2~6 percentage points and the IoU by 1.8~4.0 percentage points.These results collectively demonstrate the superiority of the proposed method in skin lesion segmentation and its effectiveness in enhancing segmentation accuracy.

Key words: Skin lesion, U-Net, Condensed attention neural block, Residual spatial feature transformation, Semantic segmentation

CLC Number: 

  • TP391
[1]SUNG H,FERLAY J,SIEGEL R L,et al.Global cancer statistics 2020:GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries[J].CA:A Cancer Journal for Clinicians,2021,71(3):209-249.
[2]FONTANILLAS P,ALIPANAHI B,FURLOTTE N A,et al.Disease risk scores for skin cancers[J].Nature Communications,2021,12(1):160.
[3]YEN J C,CHANG F J,CHANG S.A new criterion for auto-matic multilevel thresholding[J].IEEE Transactions on Image Processing,1995,4(3):370-378.
[4]TREMEAUA,BOREL N.A region growing and merging algorithm to color segmentation[J].Pattern Recognition,1997,30(7):1191-1203.
[5]ADAMS R,BISCHOF L.Seeded region growing[J].IEEETransactions on Pattern Analysis and Machine Intelligence,1994,16(6):641-647.
[6]HEARST M A,DUMAIS S T,OSUNA E,et al.Support vector machines[J].IEEE Intelligent Systems and Their Applications,1998,13(4):18-28.
[7]FUKUSHIMA K.Neocognitron:A self-organizing neural net-work model for a mechanism of pattern recognition unaffected by shift in position[J].Biological Cybernetics,1980,36(4):193-202.
[8]SIDDIQUE N,PAHEDING S,ELKIN C P,et al.U-net and its variants for medical image segmentation:A review of theory and applications[J].IEEE Access,2021,9:82031-82057.
[9]RONNEBERGER O,FISCHER P,BROX T.U-net:Convolu-tional networks for biomedical image segmentation[C]//Medical Image Computing and Computer-assisted Intervention-MICCAI 2015:18th International Conference.Springer,2015:234-241.
[10]ZHAO H,GOU Y,LI B,et al.Comprehensive and delicate:An efficient transformer for image restoration[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2023:14122-14132.
[11]AZAD R,AGHDAM E K,RAULAND A,et al.Medical image segmentation review:The success of u-net[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2024,46(12):10076-10095.
[12]LONG J,SHELHAMER E,DARRELL T.Fully convolutional networks for semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:3431-3440.
[13]JAFARI M H,NASR-ESFAHANI E,KARIMI N,et al.Extraction of skin lesions from non-dermoscopic images for surgical excision of melanoma[J].International Journal of Computer Assisted Radiology and Surgery,2017,12:1021-1030.
[14]YUAN Y,CHAO M,LO Y C.Automatic skin lesion segmentation using deep fully convolutional networks withjaccard distance[J].IEEE Transactions on Medical Imaging,2017,36(9):1876-1886.
[15]ZHOU Z,RAHMAN SIDDIQUEE M M,TAJBAKHSH N,et al.Unet++:A nested u-net architecture for medical image segmentation[C]//Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support:4th International Workshop.Springer,2018:3-11.
[16]OKTAY O,SCHLEMPER J,FOLGOC L L,et al.Attentionu-net:Learning where to look for the pancreas[J].arXiv:1804.03999,2018.
[17]JHA D,RIEGLER M A,JOHANSEN D,et al.Doubleu-net:A deep convolutional neural network for medical image segmentation[C]//2020 IEEE 33rd International Symposium on Computer-based Medical Systems(CBMS).IEEE,2020:558-564.
[18]YU C,GAO C,WANG J,et al.Bisenet v2:Bilateral networkwith guided aggregation for real-time semantic segmentation[J].International Journal of Computer Vision,2021,129:3051-3068.
[19]CHEN J,LU Y,YU Q,et al.Transunet:Transformers make strong encoders for medical image segmentation[J].arXiv:2102.04306,2021.
[20]LIANG L M,ZHOU L S,YIN J,et al.Fusion multi-scale Transformer skin lesion segmentation algorithm[J].Journal of Jilin University(Engineering and Technology Edition),2024,54(4):1086-1098.
[21]CAO H,WANG Y,CHEN J,et al.Swin-unet:Unet-like puretransformer for medical image segmentation[C]//European Conference on Computer Vision.Cham:Springer,2022:205-218.
[22]XU Q,MA Z,NA H E,et al.DCSAU-Net:A deeper and more compact split-attention U-Net for medical image segmentation[J].Computers in Biology and Medicine,2023,154:106626.
[23]ULYANOV D.Instance normalization:The missing ingredientfor fast stylization[J].arXiv:1607.08022,2016.
[24]IOFFE S.Batch normalization:Accelerating deep network training by reducing internal covariate shift[J].arXiv:1502.03167,2015.
[25]HE K,ZHANG X,REN S,et al.Deep residual learning forimage recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:770-778.
[26]SHI W,CABALLERO J,HUSZÁR F,et al.Real-time singleimage and video super-resolution using an efficient sub-pixel convolutional neural network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:1874-1883.
[1] YU Ding, LI Zhangwei. Prediction Method of RNA Secondary Structure Based on Transformer Architecture [J]. Computer Science, 2026, 53(3): 375-382.
[2] JI Sai, QIAO Liwei, SUN Yajie. Semantic-guided Hybrid Cross-feature Fusion Method for Infrared and Visible Light Images [J]. Computer Science, 2026, 53(2): 253-263.
[3] WANG Yongquan, SU Mengqi, SHI Qinglei, MA Yining, SUN Yangfan, WANG Changmiao, WANG Guoyou, XI Xiaoming, YIN Yilong, WAN Xiang. Research Progress of Machine Learning in Diagnosis and Treatment of Esophageal Cancer [J]. Computer Science, 2025, 52(9): 4-15.
[4] ZENG Xinran, LI Tianrui, LI Chongshou. Active Learning for Point Cloud Semantic Segmentation Based on Dynamic Balance and DistanceSuppression [J]. Computer Science, 2025, 52(8): 180-187.
[5] SHI Xincheng, WANG Baohui, YU Litao, DU Hui. Study on Segmentation Algorithm of Lower Limb Bone Anatomical Structure Based on 3D CTImages [J]. Computer Science, 2025, 52(6A): 240500119-9.
[6] CHEN Xianglong, LI Haijun. LST-ARBunet:An Improved Deep Learning Algorithm for Nodule Segmentation in Lung CT Images [J]. Computer Science, 2025, 52(6A): 240600020-10.
[7] WANG Jiamin, WU Wenhong, NIU Hengmao, SHI Bao, WU Nier, HAO Xu, ZHANG Chao, FU Rongsheng. Review of Concrete Defect Detection Methods Based on Deep Learning [J]. Computer Science, 2025, 52(6A): 240900137-12.
[8] ZHANG Xinyan, TANG Zhenchao, LI Yifu, LIU Zhenyu. Two-stage Left Atrial Scar Segmentation Based on Multi-scale Attention and Uncertainty Loss [J]. Computer Science, 2025, 52(6): 264-273.
[9] GENG Sheng, DING Weiping, JU Hengrong, HUANG Jiashuang, JIANG Shu, WANG Haipeng. FDiff-Fusion:Medical Image Diffusion Fusion Network Segmentation Model Driven Based onFuzzy Logic [J]. Computer Science, 2025, 52(6): 274-285.
[10] JIANG Wenwen, XIA Ying. Improved U-Net Multi-scale Feature Fusion Semantic Segmentation Network for RemoteSensing Images [J]. Computer Science, 2025, 52(5): 212-219.
[11] ZHOU Yi, MAO Kuanmin. Research on Individual Identification of Cattle Based on YOLO-Unet Combined Network [J]. Computer Science, 2025, 52(4): 194-201.
[12] WANG Tao, BAI Xuefei, WANG Wenjian. Selective Feature Fusion for 3D CT Image Segmentation of Renal Cancer Based on Edge Enhancement [J]. Computer Science, 2025, 52(3): 41-49.
[13] HUANG Kun, HE Lang, WANG Zhanqing. Railway Fastener Segmentation Method Based on Sc-DeepLabV3+ Model [J]. Computer Science, 2025, 52(12): 166-174.
[14] SONG Lei, WANG Baohui, DU Hui. Optimization Study of Segmentation Algorithms for Lower Limb Bone on 3D CT Slices [J]. Computer Science, 2025, 52(11A): 240900072-7.
[15] WANG Qian, HE Lang, WANG Zhanqing, HUANG Kun. Road Extraction Algorithm for Remote Sensing Images Based on Improved DeepLabv3+ [J]. Computer Science, 2024, 51(8): 168-175.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!