计算机科学 ›› 2026, Vol. 53 ›› Issue (10): 242-253.doi: 10.11896/jsjkx.250700037

• 数据库 & 大数据 & 数据科学 • 上一篇    下一篇

处理演化新结构的扩散图聚类方法

沈盛涛, 赵杰煜   

  1. 宁波大学信息科学与工程学院 浙江 宁波 315211
  • 收稿日期:2025-07-08 修回日期:2025-10-10 发布日期:2026-10-13
  • 通讯作者: 赵杰煜( zhao_jieyu@nbu.edu.cn)
  • 作者简介:(sstshenshengtao@163.com)
  • 基金资助:
    国家自然科学基金(62471266,62006131,62071260);浙江省自然科学基金(LQ21F020009,LGF21F020008,LQ22F020020);宁波市2025关键技术创新项目(2023Z224)

Diffusion Graph Clustering with Evolving Novel Structure

SHEN Shengtao, ZHAO Jieyu   

  1. School of Information Science and Engineering,Ningbo University,Ningbo,Zhejiang 315211, China
  • Received:2025-07-08 Revised:2025-10-10 Online:2026-10-13
  • About author:SHEN Shengtao,born in 2000,postgra-duate.His main research interests include graph learning and nonparametric clustering.
    ZHAO Jieyu,born in 1965,Ph.D,professor.His main research interests include image graphics technology,natural interaction,machine learning,and computer vision.
  • Supported by:
    National Natural Science Foundation of China(62471266,62006131,62071260),Natural Science Foundation of Zhejiang Province(LQ21F020009,LGF21F020008,LQ22F020020) and Ningbo 2025 Key Technology Innovation Project(2023Z224).

摘要: 深度卷积图学习在许多图聚类任务中展现了其有效性。然而,传统的图卷积网络(GCN)设计用于聚类任务时,要求图是静态的。现实世界复杂多变,图会随时间发生变化。这种动态图学习问题面临以下挑战:由于标记能力有限以及环境的动态变化,新出现的节点可能属于已知类别,也可能不属于任何已知类别。为此,提出一种新颖的开放图扩散聚类模型(OGDC)。首先,使用一种方差波动学习方法(GDD),该方法将方差与图卷积网络相结合。在这种方法中,嵌入向量造成的标准差波动被用于对未标记节点的区分,并基于期望最大(EM)算法指导模型学习。然后,扩展扩散模型,基于Tweedie公式将其与模型结合,以引导低概率区域内标准差的范围;并通过将数据牵引至高密度区域的方式,减轻边缘数据带来的难以训练的问题并生成同类样本,从而减小小类样本带来的难以训练的影响。实验结果证明了所提算法的有效性,其与基线方法相比表现良好,在Cora等数据集上F1等各项指标有1%~8%的提升。

关键词: 图聚类, 动态图学习, 生成模型, 深度学习, 无监督学习

Abstract: Deep convolutional graph learning has demonstrated effectiveness in various graph clustering tasks.However,when applied to clustering,traditional GCNs( Graph Convolutional Networks ) are designed specifically for processing static graphs.In complex,dynamically changing real-world scenarios,the graph topology evolves over time,giving rise to the scenario of dynamic graph learning,which presents the following challenges:owing to limited labeling capabilities and environmental dynamics,newly emerging nodes may either belong to known categories or fall outside all pre-existing categories.To address this issue,this paper proposes a novel open graph diffusion clustering(OGDC) model.Firstly,a Graph Deviation Diffusion(GDD) approach is put forward,which integrates variance into graph convolutional networks.In this approach,fluctuations in the standard deviation of embedding vectors are used to distinguish unlabeled nodes,while the model is trained under the guidance of the expectation-maximization(EM) algorithm.Subsequently,the diffusion model is extended and integrated with the proposed OGDC model using the Tweedie formula.This integration aims to constrain the standard deviation range in low-probability regions.Furthermore,by pulling data toward high-density regions,the model mitigates training challenges posed by edge data.Meanwhile,it generates similar samples to alleviate training difficulties caused by small-sized class samples.Experimental results confirm the effectiveness of the proposed algorithm,which outperforms baseline methods.Specifically,it achieves 1%~8% performance gains in metrics like F1-score on datasets(e.g.,Cora).

Key words: Graph clustering, Dynamic graph learning, Generative model, Deep learning, Unsupervised learning

中图分类号: 

  • TP391
[1] L ID Y,KOSUGI S,ZHANG Y,et al.Revisiting Dynamic Graph Clustering via Matrix Factorization[C]//Proceedings of the ACM on Web Conference.2025:1342-1352.
[2] YAO Y H,JOE-WONG C.Interpretable Clustering on Dynamic Graphs with Recurrent Graph Neural Networks[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2021:4608-4616.
[3] PENG Z H,LIU H,JIA Y H,et al.Deep attention-guided graph clustering with dual self-supervision[J] IEEE Transactions on Circuits and Systems for Video Technology,2023,33(7):3296-3307.
[4] MRABAH N,BOUGUESSA M,KSANTINI R.A contrastivevariational graph auto-encoder for node clustering[J].Pattern Jecognition,2024,149:110209.
[5] MRABAH N,BOUGUESSA M,KSANTINI R.Escaping fea-ture twist:A variational graph auto-encoder for node clustering[C]//Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence.2022:3351-3357.
[6] SHI H,FAN H Z,JAMES T.Kwok.Effective decoding in graph auto-encoder using triadic closure[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2020:906-913.
[7] MANESSI F,ROZZA A,MANZO M.Dynamic graph convolutional networks [J].Pattern Recognition,2020,97:107000.
[8] KAZEMI S M,GOEL R,JAIN K,et al.Representation learning for dynamic graphs:A survey[J].Journal of Machine Learning Research,2020,21(70):1-73.
[9] BENDALE A,BOULT T.Towards open world recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:1893-1902.
[10] PAREJA A,DOMENICONI G,CHEN J,et al.Evolvegcn:Evolving graph convolutional networks for dynamic graphs [C]//Proceedings of the AAAI Conference on Artificial Intelligence.2020:5363-5370.
[11] WU Y,FANG Y,LIAO L.On the feasibility of simple transformer for dynamic graph modeling[C]//Proceedings of the ACM Web Conference 2024.2024:870-880.
[12] ZHOU L,YANG Y,REN X,et al.Dynamic network embedding by modeling triadic closure process[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2018.
[13] ZHOU D W,YE H J,ZHAN D C.Learning placeholders foropen-set recognition[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:4401-4410.
[14] JOSEPH K J,KHAN S,KHAN F S,et al.Towards open world object detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:5830-5840.
[15] GENG C,HUANG S,CHEN S.Recent advances in open set recognition:A survey[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,43(10):3614-3631.
[16] CAO K D,BRBIC M,LESKOVEC J.Open-world semi-supervised learning[C]//International Conference on Learning Representations.2022.
[17] DORNAIKA F,EL HAJJAR S.An end-to-end approach forgraph-based multi-view data clustering[J].IEEE Transactions on Big Data,2024,10(5):644-654.
[18] XIAO S,WANG S,GUO W.SGAE:Stacked graph autoencoder for deep clustering[J].IEEE Transactions on Big Data,2022,9(1):254-266.
[19] SHAO M,WU X,FU Y.Scalable nearest neighbor sparse graph approximation by exploiting graph structure[J].IEEE Transactions on Big Data,2016,2(4):365-380.
[20] XIE Y,LV S,QIAN Y,et al.Active and semi-supervised graph neural networks for graph classification[J].IEEE Transactions on Big Data,2022,8(4):920-932.
[21] SCARSELLI F,GORI M,TSOI A C,et al.The graph neural network model[J].IEEE Transactions on Neural Networks,2008,20(1):61-80.
[22] TIAN Y,CHEN H,XU C,et al.Image processing gnn:Breaking rigidity in super-resolution[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2024:24108-24117.
[23] CHEN F,SHAO J,ZHU S,et al.Multivariate,multi-frequency and multimodal:Rethinking graph neural networks for emotion recognition in conversation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2023:10761-10770.
[24] LIU J,ONG G P,CHEN X.GraphSAGE-based traffic speedforecasting for segment network with sparse data[J].IEEE Transactions on Intelligent Transportation Systems,2020,23(3):1755-1766.
[25] ZHANG X,LIU H,LI Q,et al.Attributed graph clustering via adaptive graph convolution[C]//28th International Joint Conference on Artificial Intelligence(IJCAI 2019). International Joint Conferences on Artificial Intelligence,2019:4327-4333..
[26] LIU Y,YANG X,ZHOU S,et al.Simple contrastive graph clustering[J].IEEE Transactions on Neural Networks and Learning Systems,2023,35(10):13789-13800.
[27] LI J,YU Z,ZHU Z,et al.Scaling up dynamic graph representation learning via spiking neural networks[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2023:8588-8596.
[28] GAO C,ZHU J,ZHANG F,et al.A novel representation lear-ning for dynamic graphs based on graph convolutional networks[J].IEEE Transactions on Cybernetics,2022,53(6):3599-3612.
[29] ZHUANG D,CHANG J M,LI M.DynaMo:Dynamic community detection by incrementally maximizing modularity[J].IEEE Transactions on Knowledge and Data Engineering,2019,33(5):1934-1945.
[30] FOROOTANI A,IERVOLINO R,TIPALDI M,et al.Approximate dynamic programming for stochastic resource allocation problems[J].IEEE/CAA Journal of Automatica Sinica,2020,7(4):975-990.
[31] MA H X,WU K,WANG H D,et al.Higher Order Knowledge Transfer for Dynamic Community Detection With Great Changes[J].IEEE Transactions on Evolutionary Computation,2024:28(1):90-104.
[32] YAN J N,GU J,RUSH A M.Diffusion models without attention[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2024:8239-8249.
[33] KWON D,FAN Y,LEE K.Score-based generative modeling secretly minimizes the wasserstein distance[J].Advances in Neural Information Processing Systems,2022,35:20205-20217.
[34] SOHL-DICKSTEIN J,WEISS E,MAHESWARANATHAN N,et al.Deep unsupervised learning using nonequilibrium thermodynamics[C]//International Conference on Machine Learning.PMLR,2015:2256-2265.
[35] SONG Y,ERMON S.Generative modeling by estimating gradients of the data distribution[C]NeurIPS 2019.2019.
[36] SONG Y,DURKAN C,MURRAY I,et al.Maximum likelihood training of score-based diffusion models[J].Advances in Neural Information Processing Systems,2021,34:1415-1428.
[37] LI A C,PRABHUDESAI M,DUGGAL S,et al.Your diffusion model is secretly a zero-shot classifier[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2023:2206-2217.
[38] YANG B,FU X,SIDIROPOULOS N D,et al.Towards k-means-friendly spaces:Simultaneous deep learning and clustering[C]//International Conference on Machine Learning.PMLR,2017:3861-3870.
[39] GUO X,GAO L,LIU X,et al.Improved deep embedded clustering with local structure preservation[C]//IJCAI.2017:1753-1759.
[40] WANG C,PAN S R,HU R Q,et al.Attributed graph clustering:a deep attentional embedding approach.[C]//Proceedings of the 28th International Joint Conference on Artificial Intelligence.2019:3670-3676.
[41] JIN W, LIU X R,ZHAO X Y,et al.Automated self-supervised learning for graphs.[C]//International Conference on Learning Representations.2022.
[42] LIU Y,ZHENG Y,ZHANG D,et al.Towards unsuperviseddeep graph structure learning[C]//Proceedings of the ACM Web Conference 2022.2022:1392-1403.
[43] TSITSULIN A,PALOWITCH J,PEROZZI B,et al.Graph clustering with graph neural networks[J].Journal of Machine Learning Research,2023,24(127):1-21.
[44] WANG T,MIRZAZADEH F,ZHANG X,et al.Gc-flow:Agraph-based flow network for effective clustering[C]//International Conference on Machine Learning.PMLR,2023:36157-36173.
[45] YANG X,LIU Y,ZHOU S,et al.Cluster-guided contrastive graph clustering network[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2023:10834-10842.
[46] YANG X,MIN E,LIANG K,et al.Graphlearner:Graph node clustering with fully learnable augmentation[C]//Proceedings of the 32nd ACM International Conference on Multimedia.2024:5517-5526.
[47] AHMADI M,SAFAYANI M,MIRZAEI A.Deep graph clustering via mutual information maximization and mixture model[J].Knowledge and Information Systems,2024,66(8):4549-4572.
[48] CHEN J,LING Y,XU J,et al.Variational graph generator for multiview graph clustering[J].IEEE Transactions on Neural Networks and Learning Systems,2025,36(6):11078-11091.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!