Computer Science ›› 2023, Vol. 50 ›› Issue (12): 279-284.doi: 10.11896/jsjkx.221000245

• Artificial Intelligence • Previous Articles     Next Articles

Semi-supervised Semantic Segmentation Method Based on Multiple Teacher Network Model

XU Huajie1,2,3,4, XIAO Yifeng1   

  1. 1 College of Computer and Electronic Information,Guangxi University,Nanning 530004,China
    2 Guangxi Key Laboratory of Multimedia Communications and Network Technology,Nanning 530004,China
    3 Key Laboratory of Parallel,Distributed and Intelligent Computing,Nanning 530004,China
    4 Guangxi Intelligent Digital Services Research Center of Engineering Technology,Nanning 530004,China
  • Received:2022-10-31 Revised:2023-03-29 Online:2023-12-15 Published:2023-12-07
  • About author:XU Huajie,born in 1974,Ph.D,associate professor,is a senior member of China Computer Federation.His main research interests include artificial intelligence and machine vision.
  • Supported by:
    Science and Technology Plan Project of Guangxi(2017AB15008) and Science and Technology Plan Project of Chongzuo(FB2018001).

Abstract: The methods based on consistency regularization show better performance in semi-supervised semantic segmentation task.Such methods usually involve two roles,an explicit or implicit teacher network,and a student network which is trained by minimizing the consistency loss between the prediction results of two networks for different perturbation samples.But unreliable predictions from a single-teacher network may cause the student network to learn wrong information.By extending the mean teacher(MT) model to the multiple teacher network,multiplemeanteacher network(MMTNet) is proposed to make the student network learn from the average prediction results of multiple teacher networks,which can effectively reduce the impact of single-teacher network prediction errors.In addition,MMTNet implements data perturbation of unlabeled data by applying strong data augmentation and weak data augmentation to the unlabeled data,which increases the diversity of unlabeled data,alleviates the coupling problem between student network and teacher network to a certain extent and avoids the overfitting of student network to teacher network,so as to further reduce the impact of pseudo-label prediction errors in the teacher network.Experimental results on VOC 2012 augmented dataset show that the proposed multiple mean teacher network model MMTNet can achieve higher mean intersection over union than other mainstream semi-supervised semantic segmentation methods,and the actual segmentation performance is better.

Key words: Semi-supervised learning, Semantic segmentation, Mean teacher model, Multi-teacher network, Consistency regularization

CLC Number: 

  • TP391
[1]CHEN L C,ZHU Y,PAPANDREOU G,et al.Encoder-decoder with atrous separable convolution for semantic image segmentation[C]//European Conference on Computer Vision(ECCV).2018:801-818.
[2]TIAN X,WANG L,DING Q.Review of Image Semantic Seg-mentation Based on Deep Learning[J].Journal of Software,2019,30(2):440-468.
[3]BEARMAN A,RUSSAKOVSKY O,FERRARI V,et al.What'sthe point:Semantic segmentation with point supervision[C]//European Conference on Computer Vision.Cham:Springer,2016:549-565.
[4]FRENCH G,LAINE S,AILA T,et al.Semi-supervised semantic segmentation needs strong,varied perturbations[C]//British Machine Vision Conference.2020:1-7.
[5]CHEN X,YUAN Y,ZENG G,et al.Semi-supervised semantic segmentation with cross pseudo supervision[C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:2613-2622.
[6]OUALI Y,HUDELOT C,TAMI M.Semi-supervised semantic segmentation with cross-consistency training[C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:12674-12684.
[7]TARVAINEN A,VALPOLA H.Mean teachers are better role models:Weight-averaged consistency targets improve semi-supervised deep learning results[J].Advances in Neural Information Processing Systems,2017,30:2-7.
[8]REN Z,YEH R,SCHWING A.Not all unlabeled data areequal:Learning to weight data in semi-supervised learning[J].Advances in Neural Information Processing Systems,2020,33:21786-21797.
[9]YANG L,ZHUO W,QI L,et al.St++:Make self-trainingwork better for semi-supervised semantic segmentation[C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition.2022:4268-4277.
[10]SOHN K,BERTHELOT D,CARLINI N,et al.Fixmatch:Simplifying semi-supervised learning with consistency and confidence[J].Advances in Neural Information Processing Systems,2020,33:596-608.
[11]XU Y,SHANG L,YE J,et al.Dash:Semi-supervised learning with dynamic thresholding[C]//International Conference on Machine Learning.PMLR,2021:11525-11536.
[12]LIU S P,HONG J M,LIANG J P,et al.Medical Image Segmentation Using Semi-supervised Conditional Generative Adversa-rial Nets[J].Journal of Software,2020,31(8):2588-2602.
[13]LI Z X,ZHANG J,WU J L,et al.Semi-supervised adversarial learning based semantic image segmentation[J].Journal ofImage and Graphics,2022,27(7):2157-2170.
[14]GUAN D,HUANG J,XIAO A,et al.Unbiased subclass regularization for semi-supervised semantic segmentation[C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition.2022:9968-9978.
[15]KWON D,KWAK S.Semi-supervised semantic segmentationwith error localization network[C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition.2022:9957-9967.
[16]KE R,AVILES-RIVERO A I,PANDEY S,et al.A three-stage self-training framework for semi-supervised semantic segmentation[J].IEEE Transactions on Image Processing,2022,31:1805-1815.
[17]WANG Y,WANG H,SHEN Y,et al.Semi-supervised semantic segmentation using unreliable pseudo-labels[C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition.2022:4248-4257.
[18]ZOU Y,ZHANG Z,ZHANG H,et al.PseudoSeg:DesigningPseudo Labels for Semantic Segmentation[C]//International Conference on Learning Representations.2021:1-8.
[19]EVERINGHAM M,ESLAMI S A,VAN GOOL L,et al.Thepascal visual object classes challenge:A retrospective[J].International Journal of Computer Vision,2015,111(1):98-136.
[20]YUN S,HAN D,OH S J,et al.Cutmix:Regularization strategy to train strong classifiers with localizable features[C]//IEEE/CVF International Conference on Computer Vision.2019:6023-6032.
[1] LI Hui, LI Wengen, GUAN Jihong. Dually Encoded Semi-supervised Anomaly Detection [J]. Computer Science, 2023, 50(7): 53-59.
[2] LUO Huilan, YE Ju. Study of Multi-task Learning with Joint Semantic Segmentation and Depth Estimation [J]. Computer Science, 2023, 50(6A): 220100111-10.
[3] SUN Kaiwei, LIU Hu, RAN Xue, GUO Hao. Few-shot Segmentation Based on Multi-scale Prototype Hierarchical Matching [J]. Computer Science, 2023, 50(6A): 220300275-7.
[4] GU Yuhang, HAO Jie, CHEN Bing. Semi-supervised Semantic Segmentation for High-resolution Remote Sensing Images Based on DataFusion [J]. Computer Science, 2023, 50(6A): 220500001-6.
[5] WANG Qingyu, WANG Hairui, ZHU Guifu, MENG Shunjian. Study on SQL Injection Detection Based on FlexUDA Model [J]. Computer Science, 2023, 50(6A): 220600172-6.
[6] BAI Zhengyao, FAN Shenglan, LU Qianjie, ZHOU Xue. COVID-19 Instance Segmentation and Classification Network Based on CT Image Semantics [J]. Computer Science, 2023, 50(6A): 220600142-9.
[7] CHEN Qiaosong, ZHANG Yu, PU Liu, TAN Chongchong, DENG Xin, WANG Jin, SUN Kaiwei, OUYANG Weihua. Multi-path Semantic Segmentation Based on Edge Optimization and Global Modeling [J]. Computer Science, 2023, 50(6A): 220700137-7.
[8] QIN Liang, XIE Liang, CHEN Shengshuang, XU Haijiao. Online Semi-supervised Cross-modal Hashing Based on Anchor Graph Classification [J]. Computer Science, 2023, 50(6): 183-193.
[9] ZHANG Renbin, ZUO Yicong, ZHOU Zelin, WANG Long, CUI Yuhang. Multimodal Generative Adversarial Networks Based Multivariate Time Series Anomaly Detection [J]. Computer Science, 2023, 50(5): 355-362.
[10] LI Yang, HAN Ping. Human Parsing Model Combined with Regional Sampling and Inter-class Loss [J]. Computer Science, 2023, 50(4): 103-109.
[11] LI Haitao, WANG Ruimin, DONG Weiyu, JIANG Liehui. Semi-supervised Network Traffic Anomaly Detection Method Based on GRU [J]. Computer Science, 2023, 50(3): 380-390.
[12] WANG Xiangwei, HAN Rui, Chi Harold LIU. Hierarchical Memory Pool Based Edge Semi-supervised Continual Learning Method [J]. Computer Science, 2023, 50(2): 23-31.
[13] ZHANG Xinfeng, BIAN Haonan, ZHANG Bo, ZHANG Jiaming, LIANG Yuqing. Rail Light Band Detection Algorithm Based on Deep Learning [J]. Computer Science, 2023, 50(11A): 230200146-6.
[14] WANG Yan, XIA Chuangshuai, WANG Na, NAN Peiqi. Real-time Image Semantic Segmentation Algorithm Based on Hybrid Attention [J]. Computer Science, 2023, 50(11A): 230200010-6.
[15] SONG Faxing, MIAO Duoqian, ZHANG Hongyun. Semi-supervised Object Detection with Sequential Three-way Decision [J]. Computer Science, 2023, 50(10): 1-6.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!