计算机科学 ›› 2021, Vol. 48 ›› Issue (7): 118-123.doi: 10.11896/jsjkx.200600155

• 数据库&大数据&数据科学 • 上一篇    下一篇

社交网络中基于注意力机制的网络舆情事件演化趋势预测

桑春艳1, 胥文1, 贾朝龙1, 文俊浩2   

  1. 1 重庆邮电大学软件工程学院 重庆400065
    2 重庆大学大数据与软件学院 重庆401331
  • 收稿日期:2020-06-24 修回日期:2020-10-09 出版日期:2021-07-15 发布日期:2021-07-02
  • 通讯作者: 桑春艳(sangcy@cqupt.edu.cn)
  • 基金资助:
    国家自然科学基金(61672117);重庆市自然科学基金面上项目(cstc2019jcyj-msxmX0588)

Prediction of Evolution Trend of Online Public Opinion Events Based on Attention Mechanism in Social Networks

SANG Chun-yan1, XU Wen1, JIA Chao-long1, WEN Jun-hao2   

  1. 1 School of Software Engineering,Chongqing University of Posts and Telecommunications,Chongqing 400065,China
    2 School of Big Data & Software Engineering,Chongqing University,Chongqing 401331,China
  • Received:2020-06-24 Revised:2020-10-09 Online:2021-07-15 Published:2021-07-02
  • About author:SANG Chun-yan,born in 1983,Ph.D,associate professor.Her main research interests include service recommendation and data mining.
  • Supported by:
    National Natural Science Foundation of China(61672117) and Research project of Chongqing CSTC(cstc2019jcyj-msxmX0588).

摘要: 与传统媒体相比,社交网络在传播新闻、思想、观点等方面发挥着突出的作用,同时也是传播谣言、虚假新闻等负面信息的最佳途径。因此,对网络舆情演化趋势的准确预测和有效控制已成为重要的研究话题。目前,大多数研究从理论建模的角度对网络舆情事件的演化特性和发展趋势进行预测,基于用户行为特征的信息传播演化趋势预测模型的建模及分析有待进一步研究。考虑到信息传播过程中用户之间的相互影响,文中提出一种基于注意力机制的方法,旨在探究社交网络中用户在信息传播过程中的影响来预测信息的传播趋势。首先,利用基于长短时记忆神经网络(Long Shot-Term Memory,LSTM)的网络架构来获取信息传播的轨迹特征。其次,考虑到信息传播和用户行为的复杂性,利用注意力机制挖掘用户之间的依赖性来预测真实的信息传播过程。最后,综合考虑影响信息传播的驱动因素,得到一种基于注意力机制的信息传播演化趋势预测模型(Attention Diffusion Neural Network,ADNN)。在4个对比数据集上的实验结果显示,ADNN模型优于流行的序列模型,该模型能够有效利用驱动因素对信息传播的影响,更准确地预测社交网络中信息的传播趋势。

关键词: 趋势预测, 深度学习, 信息传播, 注意力机制

Abstract: Compared with traditional media,social networks play a prominent role in disseminating news,ideas,and opinions,and are also the best way to spread negative information such as rumors and false news.Therefore,accurate prediction and effective control of the evolution trend of online public opinion have become important research topics.At present,most studies predict the evolution characteristics and development trends of online public opinion events from the perspective of theoretical modeling.The modeling and analysis of information dissemination evolution trend prediction models based on user behavior characteristics need to be further studied.Considering the interaction between users in the process of information dissemination,this paper proposes a method based on the attention mechanism,which aims to explore the evolution trend prediction of information dissemination in social networks.Firstly,a network architecture based on long shot-term memory (LSTM) is used to obtain the trajectory characteristics of information propagation.Secondly,considering the complexity of information dissemination and user behavior,the attention mechanism is used to mine the dependence between users to predict the real information dissemination process.Finally,we comprehensively consider the driving factors that affect information dissemination,and obtain an attention diffusion neural network (ADNN) based on the attention mechanism.The experimental results on the four comparative data sets show that the ADNN model is better than the popular sequence model.This model can effectively use the influence of driving factors on information dissemination,and more accurately predict the trend of information dissemination in social networks.

Key words: Attention mechanism, Deep learning, Information dissemination, Trend prediction

中图分类号: 

  • TP311
[1]STAI E,MILAIOU E,KARYOTIS V,et al.Temporal dynamics of information diffusion in twitter:Modeling and experimentation[J].IEEE Transactions on Computational Social Systems,2018,5(1):256-264.
[2]KUHNLE A,ALIM M A,LI X,et al.Multiplex influence maximization in online social networks with heterogeneous diffusion models[J].IEEE Transactions on Computational Social Systems,2018,5(2):418-429.
[3]MATSUBARA Y,SAKURAI Y,PRAKASH B A,et al.Nonli-near dynamics of information diffusion in social networks[J].ACM Transactions on the Web (TWEB),2017,11(2):1-40.
[4]JIANG Y,JIANG J C.Understanding social networks from a multiagent perspective[J].IEEE Transactions on Parallel and Distributed Systems,2013,25(10):2743-2759.
[5]XIONG F,WANG X M,CHENG J J.Subtle role of latency for information diffusion in online social neworks [J].Chinese Physics B,2016,25(10):108904.
[6]LAGNIER C,DENOYER L,GAUSSIER E,et al.Predicting information diffusion in social networks using content and user’s profiles[C]//European Conference on Information Retrieval.Berlin,Heidelberg:Springer,2013:74-85.
[7]WANG Z,CHEN C,LI W.A Sequential Neural InformationDiffusion Model with Structure Attention[C]//Proceedings of the 27th ACM International Conference on Information and Knowledge Management.2018:1795-1798.
[8]WANG J,ZHENG V W,LIU Z,et al.Topological recurrentneural network for diffusion prediction[C]//2017 IEEE International Conference on Data Mining (ICDM).IEEE,2017:475-484.
[9]BOURIGAULT S,LAGNIER C,LAMPRIER S,et al.Learning social network embeddings for predicting information diffusion[C]//Proceedings of the 7th ACM International Conference on Web Search and Data Mining.2014:393-402.
[10]SUBBIAN K,PRAKASH B A,ADAMIC L.Detecting large reshare cascades in social networks[C]//Proceedings of the 26th International Conference on World Wide Web.2017:597-605.
[11]ANDERSON P,HE X,BUEHLER C,et al.Bottom-up and top-down attention for image captioning and visual question answe-ring[C]//Proceedings of the IEEE Confe-rence on Computer Vision and Pattern Recognition.2018:6077-6086.
[12]WANG F,JIANG M,QIAN C,et al.Residual attention network for image classification[C]//Proceedings of the IEEE Confe-rence on Computer Vision and Pattern Recognition.2017:3156-3164.
[13]LUONG M T,PHAM H,MANNING C D.Effective approaches to attention-based neural machine translation[C]// Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing.2015:1412-1421.
[14]PARK S H,KIM B D,KANG C M,et al.Sequence-to-sequence prediction of vehicle trajectory via LSTM encoder-decoder architecture[C]//2018 IEEE Intelligent Vehicles Symposium (IV).IEEE,2018:1672-1678.
[15]GASKÓN,KÉPES T,SUCIU M A,et al.Considerations about using the Shapley Value for Influence Maximization in the case of the Weighted Cascade Model[C]//2020 IEEE 18th World Symposium on Applied Machine Intelligence and Informatics (SAMI).IEEE,2020:257-262.
[16]BOZORGI A,SAMET S,KWISTHOUT J,et al.Community-based influence maximization in social networks under a compe-titive linear threshold model[J].Knowledge-Based Systems,2017,134:149-158.
[17]GOMEZ-RODRIGUEZ M,BALDUZZI D,SCHÖLKOPF B.Uncovering the temporal dynamics of diffusion networks[C]// Proceedings of the 28th International Conference on Internatio-nal Conference on Machine Learning.2011:561-568.
[18]GOMEZ-RODRIGUEZ M,LESKOVEC J,KRAUSE A.Infer-ring networks of diffusion and influence[J].ACM Transactions on Knowledge Discovery from Data (TKDD),2012,5(4):1-37.
[19]BOURIGAULT S,LAMPRIER S,GALLINARI P.Representation learning for information diffusion through social networks:an embedded cascade model[C]//Proceedings of the Ninth ACM international conference on Web Search and Data Mining.2016:573-582.
[20]SAGHEER A,KOTB M.Time series forecasting of petroleum production using deep LSTM recurrent networks[J].Neurocomputing,2019,323:203-213.
[21]WANG H,ZHANG F,ZHANG M,et al.Knowledge-awaregraph neural networks with label smoothness regularization for recommender systems[C]//Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining.2019:968-977.
[22]WANG Z,LI W.Hierarchical Diffusion Attention Network[C]//IJCAI.2019:3828-3834.
[23]YANG C,SUN M,LIU H,et al.Neural Diffusion Model for Microscopic Cascade Study[J].IEEE Transactions on Knowledge and Data Engineering,2021,33(3):1128-1139.
[24]OPSAHL T,PANZARASA P.Clustering in weighted networks[J].Social networks,2009,31(2):155-163.
[25]DU N,DAI H,TRIVEDI R,et al.Recurrent marked temporal point processes:Embedding event history to vector[C]//Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.2016:1555-1564.
[26]HU W,SINGH K K,XIAO F,et al.Who will share my image? Predicting the content diffusion path in online social networks[C]//Proceedings of the Eleventh ACM International Confe-rence on Web Search and Data Mining.2018:252-260.
[27]DEY R,SALEMT F M.Gate-variants of gated recurrent unit(GRU) neural networks[C]//2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS).IEEE,2017:1597-1600.
[28]VASWANI A,SHAZEER N,PARMAR N,et al.Attention is all you need[C]//Advances in Neural Information Processing Systems.2017:5998-6008.
[1] 饶志双, 贾真, 张凡, 李天瑞.
基于Key-Value关联记忆网络的知识图谱问答方法
Key-Value Relational Memory Networks for Question Answering over Knowledge Graph
计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[2] 汤凌韬, 王迪, 张鲁飞, 刘盛云.
基于安全多方计算和差分隐私的联邦学习方案
Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy
计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108
[3] 周芳泉, 成卫青.
基于全局增强图神经网络的序列推荐
Sequence Recommendation Based on Global Enhanced Graph Neural Network
计算机科学, 2022, 49(9): 55-63. https://doi.org/10.11896/jsjkx.210700085
[4] 戴禹, 许林峰.
基于文本行匹配的跨图文本阅读方法
Cross-image Text Reading Method Based on Text Line Matching
计算机科学, 2022, 49(9): 139-145. https://doi.org/10.11896/jsjkx.220600032
[5] 周乐员, 张剑华, 袁甜甜, 陈胜勇.
多层注意力机制融合的序列到序列中国连续手语识别和翻译
Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion
计算机科学, 2022, 49(9): 155-161. https://doi.org/10.11896/jsjkx.210800026
[6] 徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺.
时序知识图谱表示学习
Temporal Knowledge Graph Representation Learning
计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[7] 熊丽琴, 曹雷, 赖俊, 陈希亮.
基于值分解的多智能体深度强化学习综述
Overview of Multi-agent Deep Reinforcement Learning Based on Value Factorization
计算机科学, 2022, 49(9): 172-182. https://doi.org/10.11896/jsjkx.210800112
[8] 王剑, 彭雨琦, 赵宇斐, 杨健.
基于深度学习的社交网络舆情信息抽取方法综述
Survey of Social Network Public Opinion Information Extraction Based on Deep Learning
计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099
[9] 郝志荣, 陈龙, 黄嘉成.
面向文本分类的类别区分式通用对抗攻击方法
Class Discriminative Universal Adversarial Attack for Text Classification
计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[10] 姜梦函, 李邵梅, 郑洪浩, 张建朋.
基于改进位置编码的谣言检测模型
Rumor Detection Model Based on Improved Position Embedding
计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046
[11] 朱承璋, 黄嘉儿, 肖亚龙, 王晗, 邹北骥.
基于注意力机制的医学影像深度哈希检索算法
Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism
计算机科学, 2022, 49(8): 113-119. https://doi.org/10.11896/jsjkx.210700153
[12] 孙奇, 吉根林, 张杰.
基于非局部注意力生成对抗网络的视频异常事件检测方法
Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection
计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[13] 闫佳丹, 贾彩燕.
基于双图神经网络信息融合的文本分类方法
Text Classification Method Based on Information Fusion of Dual-graph Neural Network
计算机科学, 2022, 49(8): 230-236. https://doi.org/10.11896/jsjkx.210600042
[14] 汪鸣, 彭舰, 黄飞虎.
基于多时间尺度时空图网络的交通流量预测模型
Multi-time Scale Spatial-Temporal Graph Neural Network for Traffic Flow Prediction
计算机科学, 2022, 49(8): 40-48. https://doi.org/10.11896/jsjkx.220100188
[15] 侯钰涛, 阿布都克力木·阿布力孜, 哈里旦木·阿布都克里木.
中文预训练模型研究进展
Advances in Chinese Pre-training Models
计算机科学, 2022, 49(7): 148-163. https://doi.org/10.11896/jsjkx.211200018
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!