Computer Science ›› 2022, Vol. 49 ›› Issue (8): 330-335.doi: 10.11896/jsjkx.210600046

• Information Security • Previous Articles     Next Articles

Rumor Detection Model Based on Improved Position Embedding

JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng   

  1. Institute of Information Technology,PLA Strategic Support Force Information Engineering University, Zhengzhou 450000,China
  • Received:2021-06-07 Revised:2021-10-20 Published:2022-08-02
  • About author:JIANG Meng-han,born in 1996,postgraduate.Her main research interests include natural language processing and so on.
    LI Shao-mei,born in 1982,Ph.D,asso-ciate professor.Her main research in-terests include natural language processing and so on.
  • Supported by:
    Young Scientists Funds of the National Natural Science Foundation of China(62002384),Zhengzhou Collaborative Innovation Major Project(162/32410218) and China Postdoctoral Science Foundation(47698).

Abstract: With the rise of online social networks,the way people disseminate and obtain information has changed drastically.While social media facilitates people’s lives,it also accelerates the generation and spread of rumors.For this reason,detect rumors accurately and efficiently becomes an urgent problem to be solved.In order to improve the accuracy of rumor detection,the rumor detection model based on the global-local attention network has been improved.Taking into account the influence of the positional relationship between words in the text on rumor detection,a new relative position encoding method is introduced to improve the local feature extraction module of the original model.This method can more accurately extract and aggregate the semantic information and location information of the text in the rumor,and obtain better text features that distinguish between rumors and non-rumors.The combination of features and global features describing forwarding behavior improves the detection effect of rumors.Experimental results show that,compared with other mainstream detection methods,the F1 value of the proposed method can reach 95.0% on the Microblog data set,which has a better detection effect.

Key words: Attention mechanism, Deep learning, Relative position embedding, Rumor detection, Rumor text features

CLC Number: 

  • TP391
[1]LIU Z Y,ZHANG L,TU C C,et al.Statistical and SemanticAnalysis of Rumors in Chinese Social Media[J].Scientia Sinica Informationis,2015,45(12):1536-1546.
[2]LIU Z Y,SONG C H,YANG C.Early Detection of Rumors in Social Media[J].Global Media Journal,2018,5(4):65-80.
[3]China Internet Network Information Center.The 47th statistical report on internet development in China[R].Beijing:CNNIC,2020.
[4]CASTILLO C,MENDOZA M,POBLETE B.Information Credibility on Twitter[C]//Proceedings of the 20th International Conference on World Wide Web.ACM,2011:675-684.
[5]YANG F,LIU Y,YU X,et al.Automatic Detection of Rumor on Sina Weibo[C]//Proceedings of the ACM SIGKDD Workshop on Mining Data Semantics.ACM,2012:13-20.
[6]KWON S,CHA M,JUNG K,et al.ProminentFeatures of Rumor Propagation in Online Social Media[C]//Proceedings of the 13th IEEE International Conference on Data Mining.ICDM,2013:1103-1108.
[7]WU K,YANG S,ZHU K Q.False Rumors Detection on Sina Weibo by Propagation Structures[C]//Proceedings of the 31st IEEE International Conferenceon Data Engineering.ICDE,2015:651-662.
[8]MA J,GAO W,WONG K F.Detect Rumors in Microblog Posts Using Propagation Structure via Kernel Leaming[C]//Procee-dings of the 55th Annual Meeting of the Association for Computational Linguistics.ACL,2017:708-717.
[9]MA J,GAO W,MITRA P,et al.Detecting Rumors from Microblogs with Recurrent Neural Networks[C]//Proceedings of the 25th International Joint Conference on Artificial Intelligence.IJCAI,2016:3818-3824.
[10]MA J,GAO W,WONG K F.Rumor Detection on Twitter with Tree Structured Recursive Neural Networks[C]//Proceedings of the 56th Annual Meeting of the Association for ComputationalLinguistics.Melbourne.ACL,2018:1980-1989.
[11]MA J,GAO W.Debunking Rumors on Twitter with Tree Trans-former[C]//Proceedings of the 28th International Conference on Computational Linguistics.COLING,2020:5455-5466.
[12]BIAN T,XIAO X,XU T Y,et al.Rumor Detection on Social Media with Bi-directional Graph Convolutional Networks[C]//Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence.AAAI,2020:549-556.
[13]YUAN C Y,MA Q W,ZHOU W,et al.Jointly Embedding the Local and Global Relations of Heterogeneous Graph for Rumor Detection[C]//Proceedings of the 19th IEEE International Conference on Data Mining.ICDM,2019:796-805.
[14]VASWANI A,SHAZEER N,PARMAR N,et al.Attention isAll You Need[C]//Proceedings of the 31st International Conference on Neural Information Processing Systems.NIPS,2017:5998-6008.
[15]VELICKOVIC P,GUILLEM C,CASANOVA A,et al.GraphAttention Networks[J].arXiv:1710.10903,2017.
[16]DAI Z H,YANF Z L,YANG Y M,et al.Transformer-XL:Attentive Language Models Beyond a Fixed-length Context[C]//Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics.ACL,2019:2978-2989.
[17]MA J,GAO W,WEI Z Y,et al.Detect Rumors Using Time Series of Social Context Information on Microblogging Websites[C]//Proceedings of the 24th ACM International Conference on Information and Knowledge Management.ACM,2015:1751-1754.
[18]LIU Y,WU Y F B.Early Detection of Fake News on SocialMedia through Propagation Path Classification with Recurrent and Convolutional Networks[C]//Proceedings of the 32nd AAAI Conference on Artificial Intelligence.AAAI,2018:354-361.
[1] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[2] TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[3] ZHOU Fang-quan, CHENG Wei-qing. Sequence Recommendation Based on Global Enhanced Graph Neural Network [J]. Computer Science, 2022, 49(9): 55-63.
[4] DAI Yu, XU Lin-feng. Cross-image Text Reading Method Based on Text Line Matching [J]. Computer Science, 2022, 49(9): 139-145.
[5] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[6] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[7] XIONG Li-qin, CAO Lei, LAI Jun, CHEN Xi-liang. Overview of Multi-agent Deep Reinforcement Learning Based on Value Factorization [J]. Computer Science, 2022, 49(9): 172-182.
[8] WANG Ming, PENG Jian, HUANG Fei-hu. Multi-time Scale Spatial-Temporal Graph Neural Network for Traffic Flow Prediction [J]. Computer Science, 2022, 49(8): 40-48.
[9] WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[10] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[11] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[12] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[13] YAN Jia-dan, JIA Cai-yan. Text Classification Method Based on Information Fusion of Dual-graph Neural Network [J]. Computer Science, 2022, 49(8): 230-236.
[14] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[15] ZHANG Ying-tao, ZHANG Jie, ZHANG Rui, ZHANG Wen-qiang. Photorealistic Style Transfer Guided by Global Information [J]. Computer Science, 2022, 49(7): 100-105.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!