Computer Science ›› 2026, Vol. 53 ›› Issue (6): 315-319.doi: 10.11896/jsjkx.250600161

• Database & Big Data & Data Science • Previous Articles     Next Articles

Semi-supervised Learning Method Enhanced by Prototype Loss

NIU Jilong, GUAN Wenhui, ZONG Chenchen, HUANG Shengjun   

  1. College of Computer Science and Technology,Nanjing University of Aeronautics and Astronautics,Nanjing 211106,China
  • Received:2025-06-24 Revised:2025-08-26 Online:2026-06-15 Published:2026-06-09
  • About author:NIU Jilong,born in 2000,postgraduate.His main research interest is semi-supervised learning.
    HUANG Shengjun,born in 1987,Ph.D,professor,Ph.D supervisor,is a member of CCF(No.42916S).His main research interests include machine lear-ning and pattern recognition.
  • Supported by:
    National Natural Science Fund for Excellent Young Scholars(62222605) and YQS Foundation(U2441285).

Abstract: Semi-supervised learning methods can significantly improve the generalization ability of models while reducing labeling costs by utilizing a small amount of labeled data together with a large amount of unlabeled data.However,most existing methods rely on confidence thresholds to select unlabeled samples,causing some samples to remain underutilized in the later stages of training,which leads to information waste and limits further performance improvement.In addition,hard samples often have a negative impact on the training process,resulting in reduced model robustness.To address these issues,this paper proposes a semi-supervised learning method enhanced with prototype loss.By designing a dual-head training framework,the proposed method fully exploits the latent information in unlabeled data and effectively mitigates the negative impact of hard samples on model performance.Specifically,it employs consistency regularization to enforce prediction consistency for unlabeled samples under different perturbations,and introduces a prototype-based surrogate loss that measures the similarity between sample features and class prototypes to guide unlabeled samples toward the correct categories.Experimental results show that the proposed me-thod achieves significant performance improvements on multiple datasets,fully validating its effectiveness and robustness.In particular,on the CIFAR-10 and CIFAR-100 datasets with only 4 labeled samples per class,the proposed method improves classification accuracy by 1.82 percentage points and 1.07 percentage points compared to the best baseline methods,respectively.

Key words: Semi-supervised learning, Feature prototype, Dual-head training framework, Information mining, Consistency regularization

CLC Number: 

  • TP181
[1]CARNEIRO G,DA SILVA N P,DEL BUE A,et al.Artisticimage classification:An analysis on the printart database[C]//Computer Vision-ECCV 2012:12th European Conference on Computer Vision.Berlin:Springer,2012:143-157.
[2]CHENG J,ZHANG L,CHEN Q,et al.A review of visualSLAM methods for autonomous driving vehicles[J].Enginee-ring Applications of Artificial Intelligence,2022,114:104992.
[3]SHEN D,WU G,SUK H I.Deep learning in medical image ana-lysis[J].Annual Review of Biomedical Engineering,2017,19(1):221-248.
[4]XU Y,SHANG L,YE J,et al.Dash:Semi-supervised learning with dynamic thresholding[C]//International Conference on Machine Learning.PMLR,2021:11525-11536.
[5]LI J,XIONG C,HOI S C H.Comatch:Semi-supervised learning with contrastive graph regularization[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2021:9475-9484.
[6]KIM J,MIN Y,KIM D,et al.Conmatch:Semi-supervised lear-ning with confidence-guided consistency regularization[C]//European Conference on Computer Vision.Cham:Springer,2022:674-690.
[7]PHAM H,DAI Z,XIE Q,et al.Meta pseudo labels[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:11557-11568.
[8]HU Z,YANG Z,HU X,et al.Simple:Similar pseudo label exploitation for semi-supervised classification[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:15099-15108.
[9]TAHERKHANI F,DABOUEI A,SOLEYMANI S,et al.Self-supervised wasserstein pseudo-labeling for semi-supervised image classification[C]//Proceedings of the IEEE/CVF Confe-rence on Computer Vision and Pattern Recognition.2021:12267-12277.
[10]LEE D H.Pseudo-label:The simple and efficient semi-super-vised learning method for deep neural networks[C]//Workshop on Challenges in Representation Learning.2013:896.
[11]NASSAR I,HERATH S,ABBASNEJAD E,et al.All labels are not created equal:Enhancing semi-supervision via label grouping and co-training[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:7241-7250.
[12]LAINE S,AILA T.Temporal ensembling for semi-supervised learning[J].arXiv:1610.02242,2016.
[13]CHEN Y,TAN X,ZHAO B,et al.Boosting semi-supervisedlearning by exploiting all unlabeled data[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2023:7548-7557.
[14]XIA S,LYU J,XU N,et al.Towards effective visual representations for partial-label learning[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2023:15589-15598.
[15]RIZVE M N,DUARTE K,RAWAT Y S,et al.In defense of pseudo-labeling:An uncertainty-aware pseudo-label selection framework for semi-supervised learning[J].arXiv:2101.06329,2021.
[16]ABUDUWEILI A,LI X,SHI H,et al.Adaptive consistency re-gularization for semi-supervised transfer learning[C]//Procee-dings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:6923-6932.
[17]BERTHELOT D,CARLINI N,GOODFELLOW I,et al.Mixma-tch:A holistic approach to semi-supervised learning[C]//NeurIPS 2019.2019.
[18]BERTHELOT D,CARLINI N,CUBUK E D,et al.Remix-match:Semi-supervised learning with distribution alignment and augmentation anchoring[J].arXiv:1911.09785,2019.
[19]SOHN K,BERTHELOT D,CARLINI N,et al.Fixmatch:Simplifying semi-supervised learning with consistency and confidence[J].Advances in Neural Information Processing Systems,2020,33:596-608.
[20]ZHANG B,WANG Y,HOU W,et al.Flexmatch:Boostingsemi-supervised learning with curriculum pseudo labeling[J].Advances in Neural Information Processing Systems,2021,34:18408-18419.
[21]DUAN Y,ZHAO Z,QI L,et al.Mutexmatch:Semi-supervised learning with mutex-based consistency regularization[J].IEEE Transactions on Neural Networks and Learning Systems,2022,35(6):8441-8455.
[22]YANG L,ZHAO Z,QI L,et al.Shrinking class space for enhanced certainty in semi-supervised learning[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2023:16187-16196.
[23]CUBUK E D,ZOPH B,SHLENS J,et al.Randaugment:Practical automated data augmentation with a reduced search space[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops.2020:702-703.
[24]ZAGORUYKO S,KOMODAKIS N.Wide residual networks[J].arXiv:1605.07146,2016.
[1] ZHANG Run, LI Xiaobin, XU Yamin. Review of Uniform Manifold Approximation and Projection [J]. Computer Science, 2026, 53(5): 109-118.
[2] XU Yamin, LI Xiaobin, ZHANG Run. Semi-supervised Learning Algorithm Based on Pointwise Manifold Structures and Uniform Regularity Constraints [J]. Computer Science, 2026, 53(4): 173-179.
[3] GE Zeqing, HUANG Shengjun. Semi-supervised Learning Method for Multi-label Tabular Data [J]. Computer Science, 2026, 53(3): 151-157.
[4] WANG Yiming, JIAO Min, ZHAO Suyun, CHEN Hong, LI Cuiping. Prompt-conditioned Representation Learning with Diffusion Models for Semi-supervised Clustering [J]. Computer Science, 2026, 53(3): 158-165.
[5] DU Yuanhua, CHEN Pan, ZHOU Nan, SHI Kaibo, CHEN Eryang, ZHANG Yuanpeng. Correntropy Based Multi-view Low-rank Matrix Factorization and Constraint Graph Learning for Multi-view Data Clustering [J]. Computer Science, 2025, 52(6A): 240900131-10.
[6] BAO Shenghong, YAO Youjian, LI Xiaoya, CHEN Wen. Integrated PU Learning Method PUEVD and Its Application in Software Source CodeVulnerability Detection [J]. Computer Science, 2025, 52(6A): 241100144-9.
[7] CHEN Qirui, WANG Baohui, DAI Chencheng. Research on Electrocardiogram Classification and Recognition Algorithm Based on Transfer Learning [J]. Computer Science, 2025, 52(6A): 240900073-8.
[8] WANG Xiao, LI Guanxiong, LI Na, YUAN Dongfeng. Semi-supervised Learning Flow Field Prediction Method Based on Gaussian Mixture Discrimination [J]. Computer Science, 2025, 52(6): 88-95.
[9] WU You, WANG Jing, LI Peipei, HU Xuegang. Semi-supervised Partial Multi-label Feature Selection [J]. Computer Science, 2025, 52(4): 161-168.
[10] SHEN Yaxin, GAO Lijian , MAO Qirong. Semi-supervised Sound Event Detection Based on Meta Learning [J]. Computer Science, 2025, 52(3): 222-230.
[11] KANG Wei, LI Lihui, WEN Yimin. Semi-supervised Classification of Data Stream with Concept Drift Based on Clustering Model Reuse [J]. Computer Science, 2024, 51(4): 124-131.
[12] DAI Wei, CHAI Jing, LIU Yajiao. Semi-supervised Learning Algorithm Based on Maximum Margin and Manifold Hypothesis [J]. Computer Science, 2024, 51(2): 259-267.
[13] LI Hui, LI Wengen, GUAN Jihong. Dually Encoded Semi-supervised Anomaly Detection [J]. Computer Science, 2023, 50(7): 53-59.
[14] GU Yuhang, HAO Jie, CHEN Bing. Semi-supervised Semantic Segmentation for High-resolution Remote Sensing Images Based on DataFusion [J]. Computer Science, 2023, 50(6A): 220500001-6.
[15] WANG Qingyu, WANG Hairui, ZHU Guifu, MENG Shunjian. Study on SQL Injection Detection Based on FlexUDA Model [J]. Computer Science, 2023, 50(6A): 220600172-6.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!