Computer Science ›› 2024, Vol. 51 ›› Issue (11): 157-165.doi: 10.11896/jsjkx.231000209

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Feature Interpolation Based Deep Graph Contrastive Clustering Algorithm

YANG Xihong1, ZHENG Qun2, ZHANG Jiaxin1, WANG Pei1, ZHU En1   

  1. 1 College of Computer Science and Technology,National University of Defense Technology,Changsha 410073,China
    2 School of Earth and Space Sciences,University of Science and Technology of China,Hefei 230001,China
  • Received:2023-10-30 Revised:2024-04-05 Online:2024-11-15 Published:2024-11-06
  • About author:YANG Xihong,born in 1999,Ph.D candidate.His main research interests include self supervised graph representation learning,recommendation system,deep multi-view learning,etc.
    ZHU En,born in 1976, professor,Ph.D supervisor, is a senior member of CCF(No.16689D).His main research in-terests include clustering, anomaly detection,computer vision,medical image analysis,etc.
  • Supported by:
    National Science and Technology Major Project (2022ZD0209103).

Abstract: Mixup is an effective data augmentation technique in the field of computer vision.It is widely used for expanding the training distribution by interpolating input images and labels to generate new samples.However,in the context of graph node clustering tasks,designing robust interpolation methods poses challenges due to the irregularity and connectivity of graph data,as well as the unsupervised nature of the problem.To address these challenges,we propose a novel approach that leverages a dedicated encoder with non-shared parameters to extract embedding features from different views of graph.This allows us to effectively integrate both the node features and structural information.We then introduce Mixup into the clustering task by performing mixed interpolation on the embedding features along with their corresponding pseudo-labels.To ensure the reliability of these pseudo-labels,we apply a threshold to filter out high-confidence predictions,while incorporating an exponential moving average(EMA) mechanism for updating model parameters and considering the historical information during training.Furthermore,we incorporate a graph contrastive learning module to enhance feature consistency across different views,reducing information redundancy and improving the discriminative power of the model.Extensive experiments on six datasets demonstrate the effectiveness of the proposed method.

Key words: Data augmentation, Graph contrastive clustering, EMA, Mixup, Graph neural network

CLC Number: 

  • TP391
[1] HUANG Y J,CHEN M,ZHENG Y,et al.Text Classification Based on Weakened Graph Convolutional Networks[J].Computer Science,2023,50(S1):220700039-5.
[2] LI F,JIA D L,YAO Y,et al.Graph Neural Network Few Shot Image Classification Network Based on Residual and Self-attention Mechanism[J].Computer Science,2023,50(S1):220500104-5.
[3] YANG Y,ZHANG F,LI T R.Aspect-based Sentiment AnalysisBased on Dual-channel Graph Convolutional Network with Sentiment Knowledge[J].Computer Science,2023,50(5):230-237.
[4] WANG Y L,ZHANG F,YU Z,et al.Aspect-level Sentiment Classification Based on Interactive Attention and Graph Convolutional Network[J].Computer Science,2023,50(4):196-203.
[5] YANG X,LIU Y,ZHOU S,et al.Cluster-guided ContrastiveGraph Clustering Network[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2023:10834-10842.
[6] XU D,CHENG W,LUO D,et al.Spatio-Temporal Attentive RNN for Node Classification in Temporal Attributed Graphs[C]//IJCAI.2019:3947-3953.
[7] XIE J,GIRSHICK R,FARHADI A.Unsupervised Deep Embedding for Clustering Analysis[C]//International Conference on Machine Learning.PMLR,2016:478-487.
[8] YANG B,FU X,SIDIROPOULOS N D,et al.Towards K-means-friendly Spaces:Simultaneous Deep Learning and Clustering[C]//International Conference on Machine Learning.PMLR,2017:3861-3870.
[9] WANG C,PAN S,LONG G,et al.Mgae:Marginalized Graph Autoencoder for Graph Clustering[C]//Proceedings of the 2017 ACM Conference on Information and Knowledge Management.2017:889-898.
[10] PAN S,HU R,FUNG S,et al.Learning Graph Embedding with Adversarial Training Methods[J].IEEE Transactions on Cybernetics,2019,50(6):2475-2487.
[11] LI X,ZHANG H,ZHANG R.Adaptive Graph Auto-encoder for General Data Clustering[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2021,44(12):9725-9732.
[12] ZHU Y,XU Y,YU F,et al.Graph Contrastive Learning with Adaptive Augmentation[C]//Proceedings of the Web Confe-rence 2021.2021:2069-2080.
[13] LEE N,LEE J,PARK C.Augmentation-free Self-supervisedLearning on Graphs[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2022:7372-7380.
[14] JIN W,LIU X,ZHAO X,et al.Automated Self-SupervisedLearning for Graphs[J].arXiv:2106.05470,2021.
[15] PAN E,KANG Z.Multi-view Contrastive Graph Clustering[J].Advances in Neural Information ProcessingSystems,2021,34:2148-2159.
[16] LIU Y,TU W,ZHOU S,et al.Deep Graph Clustering via Dual Correlation Reduction[C]//Proceedings of the AAAI Confe-rence on Artificial Intelligence.2022:7603-7611.
[17] YANG X,HU X,ZHOU S,et al.Interpolation-based Contrastive Learning for Few-label Semi-Supervised Learning[J].IEEE Transactions on Neural Networks and Learning Systems,2024,35(2):2054-2065.
[18] GAO C,WANG X,HE X,et al.Graph Neural Networks forRecommender System[C]//Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining.2022:1623-1625.
[19] WANG C,PAN S,HU R,et al.Attributed Graph Clustering:A Deep Attentional Embedding Approach[C]//Proceedings of the 28th International Joint Conference on Artificial Intelligence.2019:3670-3676.
[20] VASWANI A,SHAZEER N,PARMAR N,et al.Attention isAll You Need[J].Advances in Neural Information Processing Systems,2017,30:1-11.
[21] BO D,WANG X,SHI C,et al.Structural Deep Clustering Network[C]//Proceedings of the Web Conference 2020.2020:1400-1410.
[22] LIU Y,YANG X,ZHOU S,et al.Hard Sample Aware Network for Contrastive Deep Graph Clustering[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2023:8914-8922.
[23] HASSANI K,KHASAHMADI A H.Contrastive Multi-viewRepresentation Learning on Graphs[C]//International Confe-rence on Machine Learning.PMLR,2020:4116-4126.
[24] ZHAO H,YANG X,WANG Z,et al.Graph Debiased Contrastive Learning with Joint Representation Clustering[C]//IJCAI.2021:3434-3440.
[25] XIA W,WANG Q,GAO Q,et al.Self-consistent ContrastiveAttributed Graph Clustering with Pseudo-label Prompt[J].IEEE Transactions on Multimedia,2023,25:6665-6677.
[26] CUI G,ZHOU J,YANG C,et al.Adaptive Graph Encoder for Attributed Graph Embedding[C]//Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Disco-very & Data Mining.2020:976-985.
[27] WANG Y,WANG W,LIANG Y,et al.Mixup for Node and Graph Classification[C]//Proceedings of the Web Conference 2021.2021:3663-3674.
[28] VERMA V,KAWAGUCHI K,LAMB A,et al.InterpolationConsistency Training for Semi-Supervised Learning[J].Neural Networks,2022,145:90-106.
[29] HE K,FAN H,WU Y,et al.Momentum Contrast for Unsupervised Visual Representation Learning[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:9729-9738.
[30] PLUMMER M D,LOV’ASZ L.Matching theory[M].Elsevier,1986.
[1] CHEN Liang, SUN Cong. Deep-learning Based DKOM Attack Detection for Linux System [J]. Computer Science, 2024, 51(9): 383-392.
[2] LI Yongjun, ZHU Yuefei, BAI Lifang. Enhanced Location K-anonymity Privacy Protection Scheme Based on Geohash [J]. Computer Science, 2024, 51(9): 393-400.
[3] DAI Chaofan, DING Huahua. Domain-adaptive Entity Resolution Algorithm Based on Semi-supervised Learning [J]. Computer Science, 2024, 51(9): 214-222.
[4] ZHANG Tianzhi, ZHOU Gang, LIU Hongbo, LIU Shuo, CHEN Jing. Text-Image Gated Fusion Mechanism for Multimodal Aspect-based Sentiment Analysis [J]. Computer Science, 2024, 51(9): 242-249.
[5] MO Shuyuan, MENG Zuqiang. Multimodal Sentiment Analysis Model Based on Visual Semantics and Prompt Learning [J]. Computer Science, 2024, 51(9): 250-257.
[6] TANG Ying, WANG Baohui. Study on SSL/TLS Encrypted Malicious Traffic Detection Algorithm Based on Graph Neural Networks [J]. Computer Science, 2024, 51(9): 365-370.
[7] WANG Qian, HE Lang, WANG Zhanqing, HUANG Kun. Road Extraction Algorithm for Remote Sensing Images Based on Improved DeepLabv3+ [J]. Computer Science, 2024, 51(8): 168-175.
[8] TIAN Sicheng, HUANG Shaobin, WANG Rui, LI Rongsheng, DU Zhijuan. Contrastive Learning-based Prompt Generation Method for Large-scale Language Model ReverseDictionary Task [J]. Computer Science, 2024, 51(8): 256-262.
[9] CHEN Shanshan, YAO Subin. Study on Recommendation Algorithms Based on Knowledge Graph and Neighbor PerceptionAttention Mechanism [J]. Computer Science, 2024, 51(8): 313-323.
[10] LIU Yumeng, ZHAO Yijing, WANG Bicong, WANG Chao, ZHANG Baomin. Advances in SQL Intelligent Synthesis Technology [J]. Computer Science, 2024, 51(7): 40-48.
[11] HU Haibo, YANG Dan, NIE Tiezheng, KOU Yue. Graph Contrastive Learning Incorporating Multi-influence and Preference for Social Recommendation [J]. Computer Science, 2024, 51(7): 146-155.
[12] WEI Ziang, PENG Jian, HUANG Feihu, JU Shenggen. Text Classification Method Based on Multi Graph Convolution and Hierarchical Pooling [J]. Computer Science, 2024, 51(7): 303-309.
[13] FAN Yi, HU Tao, YI Peng. Host Anomaly Detection Framework Based on Multifaceted Information Fusion of SemanticFeatures for System Calls [J]. Computer Science, 2024, 51(7): 380-388.
[14] ZHANG Xiaoqing, WANG Qingwang, QU Xin, SHEN Shiquan, WU Changyi, LIU Ju. Direction-aware Pyramidal Aggregation Network for Road Centerline Extraction [J]. Computer Science, 2024, 51(6A): 230400101-7.
[15] XIAO Yahui, ZHANG Zili, HU Xinrong, PENG Tao, ZHANG Jun. Clothing Image Segmentation Method Based on Deeplabv3+ Fused with Attention Mechanism [J]. Computer Science, 2024, 51(6A): 230900153-7.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!