计算机科学 ›› 2026, Vol. 53 ›› Issue (6): 315-319.doi: 10.11896/jsjkx.250600161
牛纪龙, 管文辉, 宗辰辰, 黄圣君
NIU Jilong, GUAN Wenhui, ZONG Chenchen, HUANG Shengjun
摘要: 半监督学习方法利用少量标注数据和大量无标注数据,能够在减少标注成本的同时,显著提升模型的泛化能力。然而,现有方法通常依赖置信度阈值来筛选无标注样本,导致部分无标注样本在训练后期仍未被充分利用,造成信息浪费并限制了模型性能的进一步提升。此外,难样本往往会对训练过程产生不利影响,导致模型的鲁棒性不足。为此,提出了一种基于原型损失增强的半监督学习方法,通过设计双头训练框架充分挖掘无标注数据中的潜在信息,并有效减轻难样本对模型性能的不利影响。该方法一方面利用一致性正则化约束无标注样本在不同扰动条件下的预测一致性;另一方面,设计基于原型的替代损失,通过度量样本特征与类别原型之间的相似度,引导无标注样本向正确类别聚集。实验结果表明,此方法在多个数据集上均取得了显著的性能提升,充分验证了其有效性和鲁棒性。特别地,在每个类别仅有4个标注数据的CIFAR-10和CIFAR-100数据集上,分类准确率相比最优基线方法分别提升了1.82个百分点和1.07个百分点。
中图分类号:
| [1]CARNEIRO G,DA SILVA N P,DEL BUE A,et al.Artisticimage classification:An analysis on the printart database[C]//Computer Vision-ECCV 2012:12th European Conference on Computer Vision.Berlin:Springer,2012:143-157. [2]CHENG J,ZHANG L,CHEN Q,et al.A review of visualSLAM methods for autonomous driving vehicles[J].Enginee-ring Applications of Artificial Intelligence,2022,114:104992. [3]SHEN D,WU G,SUK H I.Deep learning in medical image ana-lysis[J].Annual Review of Biomedical Engineering,2017,19(1):221-248. [4]XU Y,SHANG L,YE J,et al.Dash:Semi-supervised learning with dynamic thresholding[C]//International Conference on Machine Learning.PMLR,2021:11525-11536. [5]LI J,XIONG C,HOI S C H.Comatch:Semi-supervised learning with contrastive graph regularization[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2021:9475-9484. [6]KIM J,MIN Y,KIM D,et al.Conmatch:Semi-supervised lear-ning with confidence-guided consistency regularization[C]//European Conference on Computer Vision.Cham:Springer,2022:674-690. [7]PHAM H,DAI Z,XIE Q,et al.Meta pseudo labels[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:11557-11568. [8]HU Z,YANG Z,HU X,et al.Simple:Similar pseudo label exploitation for semi-supervised classification[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:15099-15108. [9]TAHERKHANI F,DABOUEI A,SOLEYMANI S,et al.Self-supervised wasserstein pseudo-labeling for semi-supervised image classification[C]//Proceedings of the IEEE/CVF Confe-rence on Computer Vision and Pattern Recognition.2021:12267-12277. [10]LEE D H.Pseudo-label:The simple and efficient semi-super-vised learning method for deep neural networks[C]//Workshop on Challenges in Representation Learning.2013:896. [11]NASSAR I,HERATH S,ABBASNEJAD E,et al.All labels are not created equal:Enhancing semi-supervision via label grouping and co-training[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:7241-7250. [12]LAINE S,AILA T.Temporal ensembling for semi-supervised learning[J].arXiv:1610.02242,2016. [13]CHEN Y,TAN X,ZHAO B,et al.Boosting semi-supervisedlearning by exploiting all unlabeled data[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2023:7548-7557. [14]XIA S,LYU J,XU N,et al.Towards effective visual representations for partial-label learning[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2023:15589-15598. [15]RIZVE M N,DUARTE K,RAWAT Y S,et al.In defense of pseudo-labeling:An uncertainty-aware pseudo-label selection framework for semi-supervised learning[J].arXiv:2101.06329,2021. [16]ABUDUWEILI A,LI X,SHI H,et al.Adaptive consistency re-gularization for semi-supervised transfer learning[C]//Procee-dings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:6923-6932. [17]BERTHELOT D,CARLINI N,GOODFELLOW I,et al.Mixma-tch:A holistic approach to semi-supervised learning[C]//NeurIPS 2019.2019. [18]BERTHELOT D,CARLINI N,CUBUK E D,et al.Remix-match:Semi-supervised learning with distribution alignment and augmentation anchoring[J].arXiv:1911.09785,2019. [19]SOHN K,BERTHELOT D,CARLINI N,et al.Fixmatch:Simplifying semi-supervised learning with consistency and confidence[J].Advances in Neural Information Processing Systems,2020,33:596-608. [20]ZHANG B,WANG Y,HOU W,et al.Flexmatch:Boostingsemi-supervised learning with curriculum pseudo labeling[J].Advances in Neural Information Processing Systems,2021,34:18408-18419. [21]DUAN Y,ZHAO Z,QI L,et al.Mutexmatch:Semi-supervised learning with mutex-based consistency regularization[J].IEEE Transactions on Neural Networks and Learning Systems,2022,35(6):8441-8455. [22]YANG L,ZHAO Z,QI L,et al.Shrinking class space for enhanced certainty in semi-supervised learning[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2023:16187-16196. [23]CUBUK E D,ZOPH B,SHLENS J,et al.Randaugment:Practical automated data augmentation with a reduced search space[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops.2020:702-703. [24]ZAGORUYKO S,KOMODAKIS N.Wide residual networks[J].arXiv:1605.07146,2016. |
|
||