Computer Science ›› 2026, Vol. 53 ›› Issue (10): 242-253.doi: 10.11896/jsjkx.250700037

• Database & Big Data & Data Science • Previous Articles     Next Articles

Diffusion Graph Clustering with Evolving Novel Structure

SHEN Shengtao, ZHAO Jieyu   

  1. School of Information Science and Engineering,Ningbo University,Ningbo,Zhejiang 315211, China
  • Received:2025-07-08 Revised:2025-10-10 Published:2026-10-13
  • About author:SHEN Shengtao,born in 2000,postgra-duate.His main research interests include graph learning and nonparametric clustering.
    ZHAO Jieyu,born in 1965,Ph.D,professor.His main research interests include image graphics technology,natural interaction,machine learning,and computer vision.
  • Supported by:
    National Natural Science Foundation of China(62471266,62006131,62071260),Natural Science Foundation of Zhejiang Province(LQ21F020009,LGF21F020008,LQ22F020020) and Ningbo 2025 Key Technology Innovation Project(2023Z224).

Abstract: Deep convolutional graph learning has demonstrated effectiveness in various graph clustering tasks.However,when applied to clustering,traditional GCNs( Graph Convolutional Networks ) are designed specifically for processing static graphs.In complex,dynamically changing real-world scenarios,the graph topology evolves over time,giving rise to the scenario of dynamic graph learning,which presents the following challenges:owing to limited labeling capabilities and environmental dynamics,newly emerging nodes may either belong to known categories or fall outside all pre-existing categories.To address this issue,this paper proposes a novel open graph diffusion clustering(OGDC) model.Firstly,a Graph Deviation Diffusion(GDD) approach is put forward,which integrates variance into graph convolutional networks.In this approach,fluctuations in the standard deviation of embedding vectors are used to distinguish unlabeled nodes,while the model is trained under the guidance of the expectation-maximization(EM) algorithm.Subsequently,the diffusion model is extended and integrated with the proposed OGDC model using the Tweedie formula.This integration aims to constrain the standard deviation range in low-probability regions.Furthermore,by pulling data toward high-density regions,the model mitigates training challenges posed by edge data.Meanwhile,it generates similar samples to alleviate training difficulties caused by small-sized class samples.Experimental results confirm the effectiveness of the proposed algorithm,which outperforms baseline methods.Specifically,it achieves 1%~8% performance gains in metrics like F1-score on datasets(e.g.,Cora).

Key words: Graph clustering, Dynamic graph learning, Generative model, Deep learning, Unsupervised learning

CLC Number: 

  • TP391
[1] L ID Y,KOSUGI S,ZHANG Y,et al.Revisiting Dynamic Graph Clustering via Matrix Factorization[C]//Proceedings of the ACM on Web Conference.2025:1342-1352.
[2] YAO Y H,JOE-WONG C.Interpretable Clustering on Dynamic Graphs with Recurrent Graph Neural Networks[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2021:4608-4616.
[3] PENG Z H,LIU H,JIA Y H,et al.Deep attention-guided graph clustering with dual self-supervision[J] IEEE Transactions on Circuits and Systems for Video Technology,2023,33(7):3296-3307.
[4] MRABAH N,BOUGUESSA M,KSANTINI R.A contrastivevariational graph auto-encoder for node clustering[J].Pattern Jecognition,2024,149:110209.
[5] MRABAH N,BOUGUESSA M,KSANTINI R.Escaping fea-ture twist:A variational graph auto-encoder for node clustering[C]//Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence.2022:3351-3357.
[6] SHI H,FAN H Z,JAMES T.Kwok.Effective decoding in graph auto-encoder using triadic closure[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2020:906-913.
[7] MANESSI F,ROZZA A,MANZO M.Dynamic graph convolutional networks [J].Pattern Recognition,2020,97:107000.
[8] KAZEMI S M,GOEL R,JAIN K,et al.Representation learning for dynamic graphs:A survey[J].Journal of Machine Learning Research,2020,21(70):1-73.
[9] BENDALE A,BOULT T.Towards open world recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:1893-1902.
[10] PAREJA A,DOMENICONI G,CHEN J,et al.Evolvegcn:Evolving graph convolutional networks for dynamic graphs [C]//Proceedings of the AAAI Conference on Artificial Intelligence.2020:5363-5370.
[11] WU Y,FANG Y,LIAO L.On the feasibility of simple transformer for dynamic graph modeling[C]//Proceedings of the ACM Web Conference 2024.2024:870-880.
[12] ZHOU L,YANG Y,REN X,et al.Dynamic network embedding by modeling triadic closure process[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2018.
[13] ZHOU D W,YE H J,ZHAN D C.Learning placeholders foropen-set recognition[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:4401-4410.
[14] JOSEPH K J,KHAN S,KHAN F S,et al.Towards open world object detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:5830-5840.
[15] GENG C,HUANG S,CHEN S.Recent advances in open set recognition:A survey[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,43(10):3614-3631.
[16] CAO K D,BRBIC M,LESKOVEC J.Open-world semi-supervised learning[C]//International Conference on Learning Representations.2022.
[17] DORNAIKA F,EL HAJJAR S.An end-to-end approach forgraph-based multi-view data clustering[J].IEEE Transactions on Big Data,2024,10(5):644-654.
[18] XIAO S,WANG S,GUO W.SGAE:Stacked graph autoencoder for deep clustering[J].IEEE Transactions on Big Data,2022,9(1):254-266.
[19] SHAO M,WU X,FU Y.Scalable nearest neighbor sparse graph approximation by exploiting graph structure[J].IEEE Transactions on Big Data,2016,2(4):365-380.
[20] XIE Y,LV S,QIAN Y,et al.Active and semi-supervised graph neural networks for graph classification[J].IEEE Transactions on Big Data,2022,8(4):920-932.
[21] SCARSELLI F,GORI M,TSOI A C,et al.The graph neural network model[J].IEEE Transactions on Neural Networks,2008,20(1):61-80.
[22] TIAN Y,CHEN H,XU C,et al.Image processing gnn:Breaking rigidity in super-resolution[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2024:24108-24117.
[23] CHEN F,SHAO J,ZHU S,et al.Multivariate,multi-frequency and multimodal:Rethinking graph neural networks for emotion recognition in conversation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2023:10761-10770.
[24] LIU J,ONG G P,CHEN X.GraphSAGE-based traffic speedforecasting for segment network with sparse data[J].IEEE Transactions on Intelligent Transportation Systems,2020,23(3):1755-1766.
[25] ZHANG X,LIU H,LI Q,et al.Attributed graph clustering via adaptive graph convolution[C]//28th International Joint Conference on Artificial Intelligence(IJCAI 2019). International Joint Conferences on Artificial Intelligence,2019:4327-4333..
[26] LIU Y,YANG X,ZHOU S,et al.Simple contrastive graph clustering[J].IEEE Transactions on Neural Networks and Learning Systems,2023,35(10):13789-13800.
[27] LI J,YU Z,ZHU Z,et al.Scaling up dynamic graph representation learning via spiking neural networks[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2023:8588-8596.
[28] GAO C,ZHU J,ZHANG F,et al.A novel representation lear-ning for dynamic graphs based on graph convolutional networks[J].IEEE Transactions on Cybernetics,2022,53(6):3599-3612.
[29] ZHUANG D,CHANG J M,LI M.DynaMo:Dynamic community detection by incrementally maximizing modularity[J].IEEE Transactions on Knowledge and Data Engineering,2019,33(5):1934-1945.
[30] FOROOTANI A,IERVOLINO R,TIPALDI M,et al.Approximate dynamic programming for stochastic resource allocation problems[J].IEEE/CAA Journal of Automatica Sinica,2020,7(4):975-990.
[31] MA H X,WU K,WANG H D,et al.Higher Order Knowledge Transfer for Dynamic Community Detection With Great Changes[J].IEEE Transactions on Evolutionary Computation,2024:28(1):90-104.
[32] YAN J N,GU J,RUSH A M.Diffusion models without attention[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2024:8239-8249.
[33] KWON D,FAN Y,LEE K.Score-based generative modeling secretly minimizes the wasserstein distance[J].Advances in Neural Information Processing Systems,2022,35:20205-20217.
[34] SOHL-DICKSTEIN J,WEISS E,MAHESWARANATHAN N,et al.Deep unsupervised learning using nonequilibrium thermodynamics[C]//International Conference on Machine Learning.PMLR,2015:2256-2265.
[35] SONG Y,ERMON S.Generative modeling by estimating gradients of the data distribution[C]NeurIPS 2019.2019.
[36] SONG Y,DURKAN C,MURRAY I,et al.Maximum likelihood training of score-based diffusion models[J].Advances in Neural Information Processing Systems,2021,34:1415-1428.
[37] LI A C,PRABHUDESAI M,DUGGAL S,et al.Your diffusion model is secretly a zero-shot classifier[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2023:2206-2217.
[38] YANG B,FU X,SIDIROPOULOS N D,et al.Towards k-means-friendly spaces:Simultaneous deep learning and clustering[C]//International Conference on Machine Learning.PMLR,2017:3861-3870.
[39] GUO X,GAO L,LIU X,et al.Improved deep embedded clustering with local structure preservation[C]//IJCAI.2017:1753-1759.
[40] WANG C,PAN S R,HU R Q,et al.Attributed graph clustering:a deep attentional embedding approach.[C]//Proceedings of the 28th International Joint Conference on Artificial Intelligence.2019:3670-3676.
[41] JIN W, LIU X R,ZHAO X Y,et al.Automated self-supervised learning for graphs.[C]//International Conference on Learning Representations.2022.
[42] LIU Y,ZHENG Y,ZHANG D,et al.Towards unsuperviseddeep graph structure learning[C]//Proceedings of the ACM Web Conference 2022.2022:1392-1403.
[43] TSITSULIN A,PALOWITCH J,PEROZZI B,et al.Graph clustering with graph neural networks[J].Journal of Machine Learning Research,2023,24(127):1-21.
[44] WANG T,MIRZAZADEH F,ZHANG X,et al.Gc-flow:Agraph-based flow network for effective clustering[C]//International Conference on Machine Learning.PMLR,2023:36157-36173.
[45] YANG X,LIU Y,ZHOU S,et al.Cluster-guided contrastive graph clustering network[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2023:10834-10842.
[46] YANG X,MIN E,LIANG K,et al.Graphlearner:Graph node clustering with fully learnable augmentation[C]//Proceedings of the 32nd ACM International Conference on Multimedia.2024:5517-5526.
[47] AHMADI M,SAFAYANI M,MIRZAEI A.Deep graph clustering via mutual information maximization and mixture model[J].Knowledge and Information Systems,2024,66(8):4549-4572.
[48] CHEN J,LING Y,XU J,et al.Variational graph generator for multiview graph clustering[J].IEEE Transactions on Neural Networks and Learning Systems,2025,36(6):11078-11091.
[1] HE Yuhuang, WANG Qianlei DAI Yuntong DU Wu, QIN Xiaolin. Six Degrees of Freedom Pose Estimation Method Fusing Spectral and Geometric Features [J]. Computer Science, 2026, 53(9): 209-218.
[2] CHEN Yarui, HONG Lehan, SHAO Jianlin, YANG Jianning, LIAO Yun, SHI Yancui. Multimodal Probabilistic Generative Model Based on Cross-modal Consistency Constraints [J]. Computer Science, 2026, 53(9): 291-298.
[3] REN Yanzhang, GAO Tai, LI Ying, WANG Bin. Gated Bidirectional Mamba Multimodal Feature Fusion Framework for Drug-Target InteractionPrediction [J]. Computer Science, 2026, 53(8): 326-335.
[4] LI Xiaochao, YUAN Zisu, LI Qianmu, LIU Fan, CHE Xun. Survey on Code Representation Learning for Vulnerability Detection [J]. Computer Science, 2026, 53(8): 388-402.
[5] JIANG Lingla, CHEN Wen, SUN Wei, ZHAO Kui. Research on Deep Learning-based Side-channel Analysis Method with Dynamically ComposableMulti-head Attention [J]. Computer Science, 2026, 53(8): 437-445.
[6] PAN Yuquan, YUAN Deyu, WANG Anran, JIA Yuan. Enhanced GNNs Across Social Networks User Identity Linkage Algorithm Based on HiddenFeatures [J]. Computer Science, 2026, 53(8): 50-60.
[7] WU Shuiqing, QIU Jihao, LIU Xiang, DONG Yuxi, WEN Yimin. Proxy-based Source-free Domain Adaptation for EEG Emotion Recognition Method [J]. Computer Science, 2026, 53(8): 94-102.
[8] CAI Yi, WANG Xiaobin, CHEN Ruili, XU Jinfeng. Handwriting Gender Recognition Method Based on Multi-scale Directional Attention Transformer [J]. Computer Science, 2026, 53(8): 156-164.
[9] CHEN Yifan, DING Cong, CAO Min. Image Anomaly Detection Based on Masked Convolutional Kernel [J]. Computer Science, 2026, 53(7): 45-53.
[10] JIAO Hanbing, KANG Junhua, XIAO Teng, DENG Fei. Low-light Image Enhancement Network Based on Multi-level Illumination Excitation and JointLoss Constraint [J]. Computer Science, 2026, 53(7): 62-70.
[11] NING Shiqiang, ZHOU Lianzhen, ZHANG Lifeng. Identification of Authentic and Forged Paper-based Fingerprints Based on LG-GFNet Feature Fusion Network [J]. Computer Science, 2026, 53(7): 91-100.
[12] JI Wendi, WANG Yongquan. Autoregressive Sequence Reconstruction for Unsupervised Anomaly Detection in Medical Insurance [J]. Computer Science, 2026, 53(7): 298-307.
[13] ZHU Yifei, LIU Tianpeng, SUN Tengzhong, LI Yanchen, CHEN Zhihong, FANG Pengfei. Survey of Hyperbolic Geometry in Computer Vision [J]. Computer Science, 2026, 53(7): 9-23.
[14] LIU Zixuan, TANG Xiaoyong. PID-Dynamic LSTM Generation Model for MCU Driver Code Based on Dynamically-tuned Cross-entropy Loss [J]. Computer Science, 2026, 53(6A): 250800005-9.
[15] LI Qin, WU Siyuan, YANG Haoyuan, DU Qin, LING Xu, XIAO Guoqing. Conjugate Gradient Preconditioner Adaptive Selection Algorithm via Deep Learning [J]. Computer Science, 2026, 53(6A): 250900126-6.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!