计算机科学 ›› 2026, Vol. 53 ›› Issue (6): 315-319.doi: 10.11896/jsjkx.250600161

• 数据库&大数据&数据科学 • 上一篇    下一篇

基于原型损失增强的半监督学习方法

牛纪龙, 管文辉, 宗辰辰, 黄圣君   

  1. 南京航空航天大学计算机科学与技术学院 南京 211106
  • 收稿日期:2025-06-24 修回日期:2025-08-26 出版日期:2026-06-15 发布日期:2026-06-09
  • 通讯作者: 黄圣君(huangsj@nuaa.edu.cn)
  • 作者简介:(niujilong@nuaa.edu.cn)
  • 基金资助:
    国家自然科学基金优秀青年基金(62222605);叶企孙基金(U2441285)

Semi-supervised Learning Method Enhanced by Prototype Loss

NIU Jilong, GUAN Wenhui, ZONG Chenchen, HUANG Shengjun   

  1. College of Computer Science and Technology,Nanjing University of Aeronautics and Astronautics,Nanjing 211106,China
  • Received:2025-06-24 Revised:2025-08-26 Published:2026-06-15 Online:2026-06-09
  • About author:NIU Jilong,born in 2000,postgraduate.His main research interest is semi-supervised learning.
    HUANG Shengjun,born in 1987,Ph.D,professor,Ph.D supervisor,is a member of CCF(No.42916S).His main research interests include machine lear-ning and pattern recognition.
  • Supported by:
    National Natural Science Fund for Excellent Young Scholars(62222605) and YQS Foundation(U2441285).

摘要: 半监督学习方法利用少量标注数据和大量无标注数据,能够在减少标注成本的同时,显著提升模型的泛化能力。然而,现有方法通常依赖置信度阈值来筛选无标注样本,导致部分无标注样本在训练后期仍未被充分利用,造成信息浪费并限制了模型性能的进一步提升。此外,难样本往往会对训练过程产生不利影响,导致模型的鲁棒性不足。为此,提出了一种基于原型损失增强的半监督学习方法,通过设计双头训练框架充分挖掘无标注数据中的潜在信息,并有效减轻难样本对模型性能的不利影响。该方法一方面利用一致性正则化约束无标注样本在不同扰动条件下的预测一致性;另一方面,设计基于原型的替代损失,通过度量样本特征与类别原型之间的相似度,引导无标注样本向正确类别聚集。实验结果表明,此方法在多个数据集上均取得了显著的性能提升,充分验证了其有效性和鲁棒性。特别地,在每个类别仅有4个标注数据的CIFAR-10和CIFAR-100数据集上,分类准确率相比最优基线方法分别提升了1.82个百分点和1.07个百分点。

关键词: 半监督学习, 特征原型, 双头训练框架, 信息挖掘, 一致性正则化

Abstract: Semi-supervised learning methods can significantly improve the generalization ability of models while reducing labeling costs by utilizing a small amount of labeled data together with a large amount of unlabeled data.However,most existing methods rely on confidence thresholds to select unlabeled samples,causing some samples to remain underutilized in the later stages of training,which leads to information waste and limits further performance improvement.In addition,hard samples often have a negative impact on the training process,resulting in reduced model robustness.To address these issues,this paper proposes a semi-supervised learning method enhanced with prototype loss.By designing a dual-head training framework,the proposed method fully exploits the latent information in unlabeled data and effectively mitigates the negative impact of hard samples on model performance.Specifically,it employs consistency regularization to enforce prediction consistency for unlabeled samples under different perturbations,and introduces a prototype-based surrogate loss that measures the similarity between sample features and class prototypes to guide unlabeled samples toward the correct categories.Experimental results show that the proposed me-thod achieves significant performance improvements on multiple datasets,fully validating its effectiveness and robustness.In particular,on the CIFAR-10 and CIFAR-100 datasets with only 4 labeled samples per class,the proposed method improves classification accuracy by 1.82 percentage points and 1.07 percentage points compared to the best baseline methods,respectively.

Key words: Semi-supervised learning, Feature prototype, Dual-head training framework, Information mining, Consistency regularization

中图分类号: 

  • TP181
[1]CARNEIRO G,DA SILVA N P,DEL BUE A,et al.Artisticimage classification:An analysis on the printart database[C]//Computer Vision-ECCV 2012:12th European Conference on Computer Vision.Berlin:Springer,2012:143-157.
[2]CHENG J,ZHANG L,CHEN Q,et al.A review of visualSLAM methods for autonomous driving vehicles[J].Enginee-ring Applications of Artificial Intelligence,2022,114:104992.
[3]SHEN D,WU G,SUK H I.Deep learning in medical image ana-lysis[J].Annual Review of Biomedical Engineering,2017,19(1):221-248.
[4]XU Y,SHANG L,YE J,et al.Dash:Semi-supervised learning with dynamic thresholding[C]//International Conference on Machine Learning.PMLR,2021:11525-11536.
[5]LI J,XIONG C,HOI S C H.Comatch:Semi-supervised learning with contrastive graph regularization[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2021:9475-9484.
[6]KIM J,MIN Y,KIM D,et al.Conmatch:Semi-supervised lear-ning with confidence-guided consistency regularization[C]//European Conference on Computer Vision.Cham:Springer,2022:674-690.
[7]PHAM H,DAI Z,XIE Q,et al.Meta pseudo labels[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:11557-11568.
[8]HU Z,YANG Z,HU X,et al.Simple:Similar pseudo label exploitation for semi-supervised classification[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:15099-15108.
[9]TAHERKHANI F,DABOUEI A,SOLEYMANI S,et al.Self-supervised wasserstein pseudo-labeling for semi-supervised image classification[C]//Proceedings of the IEEE/CVF Confe-rence on Computer Vision and Pattern Recognition.2021:12267-12277.
[10]LEE D H.Pseudo-label:The simple and efficient semi-super-vised learning method for deep neural networks[C]//Workshop on Challenges in Representation Learning.2013:896.
[11]NASSAR I,HERATH S,ABBASNEJAD E,et al.All labels are not created equal:Enhancing semi-supervision via label grouping and co-training[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:7241-7250.
[12]LAINE S,AILA T.Temporal ensembling for semi-supervised learning[J].arXiv:1610.02242,2016.
[13]CHEN Y,TAN X,ZHAO B,et al.Boosting semi-supervisedlearning by exploiting all unlabeled data[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2023:7548-7557.
[14]XIA S,LYU J,XU N,et al.Towards effective visual representations for partial-label learning[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2023:15589-15598.
[15]RIZVE M N,DUARTE K,RAWAT Y S,et al.In defense of pseudo-labeling:An uncertainty-aware pseudo-label selection framework for semi-supervised learning[J].arXiv:2101.06329,2021.
[16]ABUDUWEILI A,LI X,SHI H,et al.Adaptive consistency re-gularization for semi-supervised transfer learning[C]//Procee-dings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:6923-6932.
[17]BERTHELOT D,CARLINI N,GOODFELLOW I,et al.Mixma-tch:A holistic approach to semi-supervised learning[C]//NeurIPS 2019.2019.
[18]BERTHELOT D,CARLINI N,CUBUK E D,et al.Remix-match:Semi-supervised learning with distribution alignment and augmentation anchoring[J].arXiv:1911.09785,2019.
[19]SOHN K,BERTHELOT D,CARLINI N,et al.Fixmatch:Simplifying semi-supervised learning with consistency and confidence[J].Advances in Neural Information Processing Systems,2020,33:596-608.
[20]ZHANG B,WANG Y,HOU W,et al.Flexmatch:Boostingsemi-supervised learning with curriculum pseudo labeling[J].Advances in Neural Information Processing Systems,2021,34:18408-18419.
[21]DUAN Y,ZHAO Z,QI L,et al.Mutexmatch:Semi-supervised learning with mutex-based consistency regularization[J].IEEE Transactions on Neural Networks and Learning Systems,2022,35(6):8441-8455.
[22]YANG L,ZHAO Z,QI L,et al.Shrinking class space for enhanced certainty in semi-supervised learning[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2023:16187-16196.
[23]CUBUK E D,ZOPH B,SHLENS J,et al.Randaugment:Practical automated data augmentation with a reduced search space[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops.2020:702-703.
[24]ZAGORUYKO S,KOMODAKIS N.Wide residual networks[J].arXiv:1605.07146,2016.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!