Computer Science ›› 2026, Vol. 53 ›› Issue (4): 173-179.doi: 10.11896/jsjkx.250300086

• Database & Big Data & Data Science • Previous Articles     Next Articles

Semi-supervised Learning Algorithm Based on Pointwise Manifold Structures and Uniform Regularity Constraints

XU Yamin, LI Xiaobin, ZHANG Run   

  1. School of Mathematics, Southwest Jiaotong University, Chengdu 611756, China
  • Received:2025-03-17 Revised:2025-06-16 Online:2026-04-15 Published:2026-04-08
  • About author:XU Yamin,postgraduate,is a member of CCF(No.Z1659G).Her main research interests include semi-supervised learning and so on.
    LI Xiaobin,born in 1983,Ph.D,master’ssupervisor,is a member of CCF(No.Z1644M).His main research interests include geometric topology and its applications,and so on.
  • Supported by:
    Fundamental Research Funds for the Central Universities(2682021ZTPY043,2682025ZTPY001) and National Natural Science Foundation of China(11501470,11426187).

Abstract: MR(Manifold Regularization) provides a powerful framework for semi-supervised classification using labeled and unlabeled datasets.Under the assumption of manifold,it enforces that similar instances should have similar classification results on the sample graph.It is notable that the core of MR lies in the pairwise smoothing on the sample graph,where smoothing constraints are applied to all instance pairs,treating each pair of instances as a whole.However,the smoothness can be point-to-point in essence,meaning that smoothness should be “everywhere” to correlate the behavior of each point or instance with that of its neighboring points.Therefore,this paper proposes a novel semi-supervised learning algorithm based on pointwise manifold and uniform regularity constraints(URC-PW-MR),which achieves semi-supervised learning by constraining individual local instances and introducing a fusion consistency regularization.This approach not only contains the pointwise nature of smoothness but also introduces the importance of individual instance by considering each instance rather than pairs of instances.The significance can be quantitatively characterized through factors such as local density.URC-PW-MR proposes a novel manifold smoothness realization approach that achieves semi-supervised learning through dual constraints:individual local instance regularization and fusion consistency regularization.Empirical evaluations demonstrate that URC-PW-MR exhibits more refined performance characteristics compared with conventional MR frameworks.

Key words: Manifold regularization, Pointwise manifold regularization, Uniform regularity constraints, Semi-supervised learning

CLC Number: 

  • TP311
[1]HE Q,LI N,LUO W J,et al.A Survey of Machine Learning Algorithms for Big Data[J].Pattern Recognition and Artificial Intelligence,2014,27(4):327-336.
[2]LIU J W,LIU Y,LUO X L.Semi-supervised Learning Methods[J],2015,38(8):1592-1617.
[3]YANG J C.Design and implementation of a semi-supervisedcontinuous learning framework[D].Nanjing:Nanjing University of Posts and Telecommunications,2020.
[4]宋雨,许王琴,李荣鹏,等.基于自适应流形正则化自表示的无监督特征选择算法[J].重庆工商大学学报(自然科学版),2023,40(6):44-52.
[5]JIA M J,LI X,KONG L,et al.Research on the Application of Deep Learning in Big Data Analysis[J].Software Engineering and Application,2022,11(3):549-557.
[6]YAO K,CAO F,LEUNG Y,et al.Deep neural network compression through interpretability-based filter pruning[J].Pattern Recognition,2021,119:108056.
[7]LIANG J Y,GAO J W,CHANG Y.Research Progress in Semi-supervised Learning[J].Shanxi University(Natural Science Edition),2009,32(4):528-534.
[8]LEI Y K.Research on manifold learning algorithm and its application[D].Hefei:University of Science and Technology of China,2011.
[9]WANG Y,HAN J,SHEN Y,et al.Pointwise manifold regularization for semi-supervised learning[J].Frontiers of Computer Science,2021,15(1):1-8.
[10]WANG J,ZHANG S Y,LIANG J Y.Semi-supervised DeepLearning Algorithm Integrating Consensus Regulars and Manifold Regulars[J].Big Data Research,2022,8(3):103-114.
[11]LI Y F,KWOK J T,ZHOU Z H.Semi-supervised learning using label mean[C]//Proceedings of the 26th International Confe-rence on Machine Learning.ACM,2009.
[12]ZHU X J,GHAHRAMANI Z.Learning from labeled and unlabeled data with label propagation[C]//NIPS 2002.2002:1-8.
[13]BELKIN M,NIYOGI P,SINDHWANI V.Manifold Regularization:A Geometric Framework for Learning from Labeled and Unlabeled Examples[J].Journal of Machine Learning Research,2006,7(1):2399-2434.
[14]WANG J,LIANG J,CUI J,et al.Semi-supervised Learning with Mixed-order Graph Convolutional Networks[J].Information Sciences,2021,573(8):171-181.
[15]LIANG J Y,CUI J B,WANG J,et al.Graph-based semi-supervised learning via improving the quality of the graph dynamically[J].Machine Learning,2021,110(6):1345-1388.
[16]LU C H.Euclid and Geometry(Part II)[M]//Science World.2019:126-127.
[17]MEI X M,HE L G.Differential manifold and Riemannian geometry[M].Beijing:Beijing Normal University Press,1987.
[18]LIU W H,QIN B Z.Mapping properties of Meso compact space and Hausdorff space[J].Journal of Texas College,2005,4(2):21-22.
[19]CHEN W H.Differential manifold preliminary.2nd edition[M].Beijing:Higher Education Press,2001.
[20]MIYATO T,MAEDASI,KOYAMA M,et al.Virtual adversarial training:aregularization method for supervised and semi-supervised learning[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2019,41(8):1979-1993.
[21]VERMA V,KAWAGUCHI K,LAMB A,et al.Interpolationconsistency training for semi-supervised learning[J].Neural Networks,2022,145:90-106.
[22]BERTHELOT D,CARLINI N,GOODFELLOW I,et al.Mix-match:A holistic approach to semi-supervised learning[J].Advances in Neural Information Processing Systems,2019,32:1-11.
[23]LAINE S,AILA T.Temporal Ensembling for Semi-Supervised Learning[C]//International Conference on Learning Representations.2017:1-13.
[24]TARVAINEN A,VALPOLA H.Mean teachers are better role models:Weight-averaged consistency targets improve semi-supervised deep learning results[J].arXiv:1703.01780,2017.
[25]OLIVER A,ODENA A,RAFFEL C A,et al.Realistic evaluation of deep semi-supervised learning algorithms[C]//Procee-dings of the 32nd International Conference on Neural Information Processing Systems.2018:3239-3250.
[1] GE Zeqing, HUANG Shengjun. Semi-supervised Learning Method for Multi-label Tabular Data [J]. Computer Science, 2026, 53(3): 151-157.
[2] WANG Yiming, JIAO Min, ZHAO Suyun, CHEN Hong, LI Cuiping. Prompt-conditioned Representation Learning with Diffusion Models for Semi-supervised Clustering [J]. Computer Science, 2026, 53(3): 158-165.
[3] CHEN Qirui, WANG Baohui, DAI Chencheng. Research on Electrocardiogram Classification and Recognition Algorithm Based on Transfer Learning [J]. Computer Science, 2025, 52(6A): 240900073-8.
[4] DU Yuanhua, CHEN Pan, ZHOU Nan, SHI Kaibo, CHEN Eryang, ZHANG Yuanpeng. Correntropy Based Multi-view Low-rank Matrix Factorization and Constraint Graph Learning for Multi-view Data Clustering [J]. Computer Science, 2025, 52(6A): 240900131-10.
[5] BAO Shenghong, YAO Youjian, LI Xiaoya, CHEN Wen. Integrated PU Learning Method PUEVD and Its Application in Software Source CodeVulnerability Detection [J]. Computer Science, 2025, 52(6A): 241100144-9.
[6] WANG Xiao, LI Guanxiong, LI Na, YUAN Dongfeng. Semi-supervised Learning Flow Field Prediction Method Based on Gaussian Mixture Discrimination [J]. Computer Science, 2025, 52(6): 88-95.
[7] WU You, WANG Jing, LI Peipei, HU Xuegang. Semi-supervised Partial Multi-label Feature Selection [J]. Computer Science, 2025, 52(4): 161-168.
[8] SHEN Yaxin, GAO Lijian , MAO Qirong. Semi-supervised Sound Event Detection Based on Meta Learning [J]. Computer Science, 2025, 52(3): 222-230.
[9] KANG Wei, LI Lihui, WEN Yimin. Semi-supervised Classification of Data Stream with Concept Drift Based on Clustering Model Reuse [J]. Computer Science, 2024, 51(4): 124-131.
[10] DAI Wei, CHAI Jing, LIU Yajiao. Semi-supervised Learning Algorithm Based on Maximum Margin and Manifold Hypothesis [J]. Computer Science, 2024, 51(2): 259-267.
[11] LI Hui, LI Wengen, GUAN Jihong. Dually Encoded Semi-supervised Anomaly Detection [J]. Computer Science, 2023, 50(7): 53-59.
[12] GU Yuhang, HAO Jie, CHEN Bing. Semi-supervised Semantic Segmentation for High-resolution Remote Sensing Images Based on DataFusion [J]. Computer Science, 2023, 50(6A): 220500001-6.
[13] WANG Qingyu, WANG Hairui, ZHU Guifu, MENG Shunjian. Study on SQL Injection Detection Based on FlexUDA Model [J]. Computer Science, 2023, 50(6A): 220600172-6.
[14] CUI Bingjing, ZHANG Yipu, WANG Biao. Multimodal Data Fusion Algorithm Based on Hypergraph Regularization [J]. Computer Science, 2023, 50(6): 167-174.
[15] QIN Liang, XIE Liang, CHEN Shengshuang, XU Haijiao. Online Semi-supervised Cross-modal Hashing Based on Anchor Graph Classification [J]. Computer Science, 2023, 50(6): 183-193.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!