计算机科学 ›› 2024, Vol. 51 ›› Issue (11): 157-165.doi: 10.11896/jsjkx.231000209
杨希洪1, 郑群2, 章佳欣1, 王沛1, 祝恩1
YANG Xihong1, ZHENG Qun2, ZHANG Jiaxin1, WANG Pei1, ZHU En1
摘要: Mixup是图像领域中一种有效的数据增强方法,它通过对输入图像以及标签进行插值来合成新的样本进而扩大训练分布。然而,在图节点聚类任务中,由于图数据拓扑结构的不规则性和连通性以及无监督的场景,设计有效的插值方法成为一项具有挑战性的任务。为了解决上述问题,首先通过设计不共享参数的编码器来获取视图的嵌入特征,有效融合节点的特征和结构信息。然后将视图的嵌入特征及其对应的伪标签进行混合插值,从而将Mixup引入聚类任务中。为了确保伪标签的可靠性,设置了阈值来筛选高置信度的伪标签,并通过EMA的方式更新模型参数,使模型平稳优化的同时考虑了训练的历史信息。此外,设计了一个图对比学习模块,以保证特征在不同视图下的一致性,从而减少信息冗余,提高模型的判别能力。最终,通过在6个数据集上的大量实验证明了所提方法的有效性。
中图分类号:
[1] HUANG Y J,CHEN M,ZHENG Y,et al.Text Classification Based on Weakened Graph Convolutional Networks[J].Computer Science,2023,50(S1):220700039-5. [2] LI F,JIA D L,YAO Y,et al.Graph Neural Network Few Shot Image Classification Network Based on Residual and Self-attention Mechanism[J].Computer Science,2023,50(S1):220500104-5. [3] YANG Y,ZHANG F,LI T R.Aspect-based Sentiment AnalysisBased on Dual-channel Graph Convolutional Network with Sentiment Knowledge[J].Computer Science,2023,50(5):230-237. [4] WANG Y L,ZHANG F,YU Z,et al.Aspect-level Sentiment Classification Based on Interactive Attention and Graph Convolutional Network[J].Computer Science,2023,50(4):196-203. [5] YANG X,LIU Y,ZHOU S,et al.Cluster-guided ContrastiveGraph Clustering Network[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2023:10834-10842. [6] XU D,CHENG W,LUO D,et al.Spatio-Temporal Attentive RNN for Node Classification in Temporal Attributed Graphs[C]//IJCAI.2019:3947-3953. [7] XIE J,GIRSHICK R,FARHADI A.Unsupervised Deep Embedding for Clustering Analysis[C]//International Conference on Machine Learning.PMLR,2016:478-487. [8] YANG B,FU X,SIDIROPOULOS N D,et al.Towards K-means-friendly Spaces:Simultaneous Deep Learning and Clustering[C]//International Conference on Machine Learning.PMLR,2017:3861-3870. [9] WANG C,PAN S,LONG G,et al.Mgae:Marginalized Graph Autoencoder for Graph Clustering[C]//Proceedings of the 2017 ACM Conference on Information and Knowledge Management.2017:889-898. [10] PAN S,HU R,FUNG S,et al.Learning Graph Embedding with Adversarial Training Methods[J].IEEE Transactions on Cybernetics,2019,50(6):2475-2487. [11] LI X,ZHANG H,ZHANG R.Adaptive Graph Auto-encoder for General Data Clustering[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2021,44(12):9725-9732. [12] ZHU Y,XU Y,YU F,et al.Graph Contrastive Learning with Adaptive Augmentation[C]//Proceedings of the Web Confe-rence 2021.2021:2069-2080. [13] LEE N,LEE J,PARK C.Augmentation-free Self-supervisedLearning on Graphs[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2022:7372-7380. [14] JIN W,LIU X,ZHAO X,et al.Automated Self-SupervisedLearning for Graphs[J].arXiv:2106.05470,2021. [15] PAN E,KANG Z.Multi-view Contrastive Graph Clustering[J].Advances in Neural Information ProcessingSystems,2021,34:2148-2159. [16] LIU Y,TU W,ZHOU S,et al.Deep Graph Clustering via Dual Correlation Reduction[C]//Proceedings of the AAAI Confe-rence on Artificial Intelligence.2022:7603-7611. [17] YANG X,HU X,ZHOU S,et al.Interpolation-based Contrastive Learning for Few-label Semi-Supervised Learning[J].IEEE Transactions on Neural Networks and Learning Systems,2024,35(2):2054-2065. [18] GAO C,WANG X,HE X,et al.Graph Neural Networks forRecommender System[C]//Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining.2022:1623-1625. [19] WANG C,PAN S,HU R,et al.Attributed Graph Clustering:A Deep Attentional Embedding Approach[C]//Proceedings of the 28th International Joint Conference on Artificial Intelligence.2019:3670-3676. [20] VASWANI A,SHAZEER N,PARMAR N,et al.Attention isAll You Need[J].Advances in Neural Information Processing Systems,2017,30:1-11. [21] BO D,WANG X,SHI C,et al.Structural Deep Clustering Network[C]//Proceedings of the Web Conference 2020.2020:1400-1410. [22] LIU Y,YANG X,ZHOU S,et al.Hard Sample Aware Network for Contrastive Deep Graph Clustering[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2023:8914-8922. [23] HASSANI K,KHASAHMADI A H.Contrastive Multi-viewRepresentation Learning on Graphs[C]//International Confe-rence on Machine Learning.PMLR,2020:4116-4126. [24] ZHAO H,YANG X,WANG Z,et al.Graph Debiased Contrastive Learning with Joint Representation Clustering[C]//IJCAI.2021:3434-3440. [25] XIA W,WANG Q,GAO Q,et al.Self-consistent ContrastiveAttributed Graph Clustering with Pseudo-label Prompt[J].IEEE Transactions on Multimedia,2023,25:6665-6677. [26] CUI G,ZHOU J,YANG C,et al.Adaptive Graph Encoder for Attributed Graph Embedding[C]//Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Disco-very & Data Mining.2020:976-985. [27] WANG Y,WANG W,LIANG Y,et al.Mixup for Node and Graph Classification[C]//Proceedings of the Web Conference 2021.2021:3663-3674. [28] VERMA V,KAWAGUCHI K,LAMB A,et al.InterpolationConsistency Training for Semi-Supervised Learning[J].Neural Networks,2022,145:90-106. [29] HE K,FAN H,WU Y,et al.Momentum Contrast for Unsupervised Visual Representation Learning[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:9729-9738. [30] PLUMMER M D,LOV’ASZ L.Matching theory[M].Elsevier,1986. |
|