计算机科学 ›› 2022, Vol. 49 ›› Issue (4): 43-48.doi: 10.11896/jsjkx.210800276

• 基于社会计算的多学科交叉融合专题* 上一篇    下一篇

融合快速注意力机制的节点无特征网络链路预测算法

李勇, 吴京鹏, 张钟颖, 张强   

  1. 西北师范大学计算机科学与工程学院 兰州 730070
  • 收稿日期:2021-08-31 修回日期:2021-12-12 发布日期:2022-04-01
  • 通讯作者: 吴京鹏(wu.jing.peng@qq.com)
  • 作者简介:(facingworld@nwnu.edu.cn)
  • 基金资助:
    国家自然科学基金(72161034, 61863032); 西北师范大学重大科研项目(NWNU-LKZD2021-06); 全国高等院校计算机基础教育教学研究项目(2020-AFCEC-355); 甘肃省教育科学规划课题研究项目(GS[2018]GHBBKZ021)

Link Prediction for Node Featureless Networks Based on Faster Attention Mechanism

LI Yong, WU Jing-peng, ZHANG Zhong-ying, ZHANG Qiang   

  1. College of Computer Science and Engineering, Northwest Normal University, Lanzhou 730070, China
  • Received:2021-08-31 Revised:2021-12-12 Published:2022-04-01
  • About author:LI Yong,born in 1979,Ph.D,associate professor,is a member of China Computer Federation.His main research interests include social computing and data analytics.WU Jing-peng,born in 1998,postgra-duate.His main research interests include machine learning,link prediction in complex networks and graph neural networks.
  • Supported by:
    This work was supported by the National Natural Science Foundation of China(72161034,61863032),Major Scientific Research Projects of Northwest Normal University(NWNU-LKZD2021-06),Research Project on Association of Fundamental Computing Education in Chinese Universities(2020-AFCEC-355) and Research Project on Educational Science Planning of Gansu(GS[2018]GHBBKZ021).

摘要: 链路预测是网络科学的一个重要研究分支,旨在推断网络中节点对间存在连边的可能性。现实生活中很多事物关系都能够通过网络科学进行描述,很多实际问题都可以转化为链路预测问题。节点无特征网络链路预测算法可向有向网络、加权网络、时序网络等更复杂的网络推广。但现有的链路预测算法面临着网络结构信息挖掘不够深入、特征提取过程受人为主观意识影响、算法很难迁移到其他网络中、算法复杂度过高而无法在大型真实工业网络中应用等诸多问题。针对上述问题,文中基于图注意力网络的基本结构,采用图嵌入表示技术采集节点特征,类比神经图灵机中的内存寻址策略,结合复杂网络重要节点发现的相关工作,设计了一种快速高效的注意力计算方式,提出了一种融合快速注意力机制的节点无特征网络链路预测算法(Faster Attention Mechanism Link Prediction Algorithm,FALP)。在3个公开数据集和1个私有数据集上进行实验,结果表明,FALP算法有效避免了上述问题,同时具有优异的预测性能。

关键词: 链路预测, 图嵌入表示, 图神经网络, 网络科学, 注意力机制

Abstract: Link prediction is an important task in network science.It aims to predict the link existence probabilities of two nodes.There are many relations between substances in real word, which can be described by network science in computers.There are many problems of daily life, which can be transformed to link prediction tasks.Link prediction algorithms for node featureless networks are convenient to migrate in directed networks, weighted networks, time networks, and so on.However, the traditional link prediction algorithms are faced with many problems as follows.The network structures information mining is not deep enough.The feature extraction processes depend on subjective consciousness.The algorithms are short of universality, and the time complexity and space complexity are flawed, which cause that they are difficult to be applied to real industry networks.In order to effectively avoid the above problems, based on the basic structure of graph attention network, graph embedding representation technology is used to collect node characteristics, analogy with the memory addressing strategy in neural turing machine, and combined with the relevant work of important node discovery in complex network, a fast and efficient attention calculation method is designed, and a node featureless network link prediction algorithm FALP integrating fast attention mechanism is proposed.Experiment on three public datasets and a private dataset show that the FALP effectively avoids these problems and has excellent predictive performance.

Key words: Attention mechanism, Graph embedding, Graph neural networks (GNNs), Link prediction, Network science

中图分类号: 

  • TP312
[1] LI M,MENG X M,ZHENG F X,et al.Identification of Protein Complexes by Using a Spatial and Temporal Active Protein Interaction Network[J].IEEE/ACM Transactions on Computational Biology and Bioinformatics,2020,17(3):817-827.
[2] YASUNAGA M,KASAI J,ZHANG R,et al.A Large Annotated Corpus and Content-Impact Models for Scientific Paper Summarization with Citation Networks[C]//The AAAI Confe-rence on Artificial Intelligence.2019:7386-7393.
[3] MANGIONI G,JURMAN G,DEDOMENICO M.MultilayerFlows in Molecular Networks Identify Biological Modules in the Human Proteome[J].IEEE Transactions on Network Science and Engineering,2018,7(1):411-420.
[4] ZHOU F,YANG Q,ZHONG T,et al.Variational Graph Neural Networks for Road Traffic Prediction in Intelligent Transportation Systems[J].IEEE Transactions on Industrial Informatics,2021,17(4):2802-2812.
[5] LUO J W,LONG Y H.NTSHMDA:Prediction of Human Mi-crobe-Disease Association Based on Random Walk by Integrating Network Topological Similarity[J].IEEE/ACM Transactions on Computational Biology and Bioinformatics,2020,17(4):1341-1351.
[6] CALDERONI F,CATANESE S,MEOP D,et al.Robust linkprediction in criminal networks:A case study of the Sicilian Mafia[J].Expert Systems with Applications,2020,161(3):113666.
[7] HWANG D,YANG S,KWON Y,et al.Comprehensive Study onMolecular Supervised Learning with Graph Neural Networks[J].Journal of Chemical Information and Modeling,2020,60(12):5936-5945.
[8] MOLZAHND K,WANG J.Detection and Characterization ofIntrusions to Network Parameter Data in Electric Power Systems[J].IEEE Transactions on Smart Grid,2019,10(4):3919-3928.
[9] WU S W,ZHANG W T,SUN F,et al.Graph Neural Networks in Recommender Systems:A Survey [EB/OL].(2020-11-04)[2021-08-30].https://arxiv.org/abs/2011.02260.
[10] KUMAR A,SING H S,SINGH K,et al.Link prediction techniques,applications,and performance:A survey[J].Physica A:Statistical Mechanics and its Applications,2020,553(6):124289.
[11] ZHANG M H,CHEN Y X.Link Prediction Based on GraphNeural Networks[C]//The Advances in Neural Information Processing Systems 31 (NeurIPS).2018:5165-5175.
[12] ZHANG M,LIANG Y Y,HUANG X J.Link prediction and analysis of formation mechanism of complex networks based on ensemble learning[J].Journal of Chongqing University of Posts and Telecommunications(Natural Science Edition),2020,32(5):759-768.
[13] GOYAL P,FERRARAE.Graph Embedding Techniques,Applications,and Performance:A Survey[J].Knowledge-Based Systems,2017,151:78-94.
[14] PEROZZI B,AL-RFOU R,SKIENA S.Deepwalk:Online learning of social representations[C]//20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.2014:701-710.
[15] GROVER A,LESKOVEC J.node2vec:Scalable Feature Lear-ning for Networks[C]//22th ACM SIGKDD International Confe-rence on Knowledge Discovery and Data Mining.2016:855-864.
[16] MIKOLOV T,CHEN K,CORRADOG S,et al.Efficient Esti-mation of Word Representations in Vector Space[C]//International Conference on Learning Representations (ICLR).2013.
[17] OUM D,CUI P,PEI J,et al.Asymmetric Transitivity Preserving Graph Embedding[C]//22th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.2016:1105-1114.
[18] ZHANG J,DONG Y,WANG Y,et al.ProNE:Fast and Scalable Network Representation Learning[C]//28th International Joint Conference on Artificial Intelligence (IJCAI).2019:4278-4284.
[19] KIPF T,WELLING M.Semi-Supervised Classification withGraph Convolutional Networks[C]//International Conference on Learning Representations (ICLR).2016.
[20] HAMILTON W,YING R,LESKOVEC J.Inductive Represen-tation Learning on Large Graphs[C]//31th Conference on Neural Information Processing Systems (NeurIPS).2017:1024-1034.
[21] YING R,HE R,CHEN K,et al.Graph Convolutional Neural Networks for Web-Scale Recommender Systems[C]//24th ACM SIGKDD International Conference on Knowledge Disco-very and Data Mining.2018:947-983.
[22] VELICKOVIC P,CUCURULL G,CASANOV A A,et al.Graph Attention Networks[C]//International Conference on Learning Representations (ICLR).2018.
[23] GRAVES A,WAYNE G,DANIHELKA L.Neural Turing Machines [EB/OL].(2014-12-10)[2021-08-30].https://arXiv.org/abs/1410.5401.
[24] TANG L,LIU H.Relational learning via latent social dimensions[C]//15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.2009:817-826.
[25] LESKOVEC J,HUTTENLOCHER D,KLEINBERG J.Predicting Positive and Negative Links in Online Social Networks[C]//19th International Conference on World Wide Web (WWW).2010:641-650.
[26] YIN H,BENSON A,LESKOVEC J,et al.Local Higher-OrderGraph Clustering[C]//23th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.2017:555-564.
[27] LI Y,MENG X F,ZHANG Q,et al.Common patterns of online collective attention flow[J].Science China Information Sciences,2017,60(5):059102.
[28] TANG J,QU M,WANG M Z,et al.LINE:Large-scale Information Network Embedding[C]//24th International Conference on World Wide Web (WWW).2015:1067-1077.
[1] 饶志双, 贾真, 张凡, 李天瑞.
基于Key-Value关联记忆网络的知识图谱问答方法
Key-Value Relational Memory Networks for Question Answering over Knowledge Graph
计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[2] 周芳泉, 成卫青.
基于全局增强图神经网络的序列推荐
Sequence Recommendation Based on Global Enhanced Graph Neural Network
计算机科学, 2022, 49(9): 55-63. https://doi.org/10.11896/jsjkx.210700085
[3] 戴禹, 许林峰.
基于文本行匹配的跨图文本阅读方法
Cross-image Text Reading Method Based on Text Line Matching
计算机科学, 2022, 49(9): 139-145. https://doi.org/10.11896/jsjkx.220600032
[4] 周乐员, 张剑华, 袁甜甜, 陈胜勇.
多层注意力机制融合的序列到序列中国连续手语识别和翻译
Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion
计算机科学, 2022, 49(9): 155-161. https://doi.org/10.11896/jsjkx.210800026
[5] 熊丽琴, 曹雷, 赖俊, 陈希亮.
基于值分解的多智能体深度强化学习综述
Overview of Multi-agent Deep Reinforcement Learning Based on Value Factorization
计算机科学, 2022, 49(9): 172-182. https://doi.org/10.11896/jsjkx.210800112
[6] 姜梦函, 李邵梅, 郑洪浩, 张建朋.
基于改进位置编码的谣言检测模型
Rumor Detection Model Based on Improved Position Embedding
计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046
[7] 朱承璋, 黄嘉儿, 肖亚龙, 王晗, 邹北骥.
基于注意力机制的医学影像深度哈希检索算法
Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism
计算机科学, 2022, 49(8): 113-119. https://doi.org/10.11896/jsjkx.210700153
[8] 孙奇, 吉根林, 张杰.
基于非局部注意力生成对抗网络的视频异常事件检测方法
Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection
计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[9] 闫佳丹, 贾彩燕.
基于双图神经网络信息融合的文本分类方法
Text Classification Method Based on Information Fusion of Dual-graph Neural Network
计算机科学, 2022, 49(8): 230-236. https://doi.org/10.11896/jsjkx.210600042
[10] 汪鸣, 彭舰, 黄飞虎.
基于多时间尺度时空图网络的交通流量预测模型
Multi-time Scale Spatial-Temporal Graph Neural Network for Traffic Flow Prediction
计算机科学, 2022, 49(8): 40-48. https://doi.org/10.11896/jsjkx.220100188
[11] 金方焱, 王秀利.
融合RACNN和BiLSTM的金融领域事件隐式因果关系抽取
Implicit Causality Extraction of Financial Events Integrating RACNN and BiLSTM
计算机科学, 2022, 49(7): 179-186. https://doi.org/10.11896/jsjkx.210500190
[12] 熊罗庚, 郑尚, 邹海涛, 于化龙, 高尚.
融合双向门控循环单元和注意力机制的软件自承认技术债识别方法
Software Self-admitted Technical Debt Identification with Bidirectional Gate Recurrent Unit and Attention Mechanism
计算机科学, 2022, 49(7): 212-219. https://doi.org/10.11896/jsjkx.210500075
[13] 彭双, 伍江江, 陈浩, 杜春, 李军.
基于注意力神经网络的对地观测卫星星上自主任务规划方法
Satellite Onboard Observation Task Planning Based on Attention Neural Network
计算机科学, 2022, 49(7): 242-247. https://doi.org/10.11896/jsjkx.210500093
[14] 齐秀秀, 王佳昊, 李文雄, 周帆.
基于概率元学习的矩阵补全预测融合算法
Fusion Algorithm for Matrix Completion Prediction Based on Probabilistic Meta-learning
计算机科学, 2022, 49(7): 18-24. https://doi.org/10.11896/jsjkx.210600126
[15] 杨炳新, 郭艳蓉, 郝世杰, 洪日昌.
基于数据增广和模型集成策略的图神经网络在抑郁症识别上的应用
Application of Graph Neural Network Based on Data Augmentation and Model Ensemble in Depression Recognition
计算机科学, 2022, 49(7): 57-63. https://doi.org/10.11896/jsjkx.210800070
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!