社交媒体虚假信息检测研究综述

doi:10.11896/jsjkx.240700101

摘要/Abstract

摘要： 社交媒体上的虚假信息不仅危害网络空间安全,还在重大事件中扮演着关键角色,严重误导公众,对政治和社会秩序造成负面影响。为此,围绕面向社交媒体的虚假信息检测技术研究展开综述,为构建高效检测技术和遏制社交媒体虚假信息泛滥奠定理论基础。首先,深入剖析虚假信息的内涵本质,探讨其在社交平台上的产生机理、具体表现形式,并界定检测任务的基础框架与目标;其次,从语义一致性视角出发,专注内容语义、社交上下文感知和知识驱动三大层面,对比梳理典型检测方法;在此基础之上,深入探究增强检测算法可解释性最新研究成果;进一步,从对抗博弈视角,深度剖析当前社交媒体虚假信息检测任务面临的挑战以及大型语言模型为虚假信息检测技术研究带来的机遇;最后,对社交媒体虚假信息检测技术未来的发展进行了展望。

关键词: 虚假信息检测, 跨模态关联, 社交上下文感知, 知识驱动, 大语言模型

Abstract: Fake news on social media not only jeopardizes cyberspace security,but also plays a pivotal role in major events,severely misleads the public and has a negative affect on political and social order.Therefore,this paper outlines social media fake news detection techniques,establishing a theoretical foundation for building efficient detection technology and curbing the proli-feration of fake news on social media.Firstly,it deeply analyzes the connotation and essence of fake news,explores its generation mechanism and specific manifestations on social platforms,and defines the basic framework and objectives of the detection task.Next,from the perspective of semantic consistency,it focuses on three major levels:content semantics,social context awareness,and knowledge-driven,and compares and combs typical detection methods.On this basis,it deeply explores the latest research advancements in enhancing the explainability of detection algorithms.Furthermore,from the adversarial perspective,it deeply analyzes the challenges faced by current social media fake news detection tasks and the opportunities brought to research detection technology by large-scale language models.Finally,the future development of social media fake news detection technology is prospected.

Key words: Fake news detection, Cross-modal correlation, Social context awareness, Knowledge-driven, Large language model

中图分类号:

TP391

陈静, 周刚, 李顺航, 郑嘉丽, 卢记仓, 郝耀辉. 社交媒体虚假信息检测研究综述[J]. 计算机科学, 2024, 51(11): 1-14. https://doi.org/10.11896/jsjkx.240700101

CHEN Jing, ZHOU Gang, LI Shunhang, ZHENG Jiali, LU Jicang, HAO Yaohui. Review of Fake News Detection on Social Media[J]. Computer Science, 2024, 51(11): 1-14. https://doi.org/10.11896/jsjkx.240700101

参考文献

[1] HU Z R,HUANG C X,YAN S J.China New Media Development Report No.14(2023) News,Communication[M].Beijing:Social Sciences Academic Press,2023.
[2] GUO B,DING Y S,YAO L N.The future of false information detection on social media:New perspectives and trends[J].The Future of False Information Detection on Social Media:New Perspectives and Trends,2020,53(4):1-36.
[3] ZHANG Z Y,JIN J C,LI F,et al.A Review of Online SocialNetwork False Information Detection,Transmission,and Control Research from the Perspective of Artificial Intelligence[J].Journal of Computer Science and Technology,2021,44(11):2:2261-2282.
[4] BHATTACHARJEE A,SHU K,GAO M,et al.Disinformation in the Online Information Ecosystem:Detection,Mitigation and Challenges[J].Journal of Computer Research and Development,2021,58(7):1353-1365.
[5] ALAM F,CRESCI S,CHAKRABORTY T,et al.A Survey on Multimodal Disinformation Detection[C]//Proceedings of the 29th International Conference on Computational Linguistics.International Committee on Computational Linguistics,2022:6625-6643.
[6] HARDALOV M,ARORA A,NAKOV P,et al.A Survey onStance Detection for Mis- and Disinformation Identification[C]//Findings of the Association for Computational Linguistics:NAACL.2022:1259-1277.
[7] VOSOUGHI S,ROY D,ARAL S L.The spread of true and false news online[J].Science,2018,359(6380):1146-1151.
[8] ZELLERS R,HOLTZMAN A,RASHKIN H,et al.Defendingagainst neural fake news[C]//Advances in Neural Information Processing Systems.2019:9054-9065.
[9] FUNG Y,THOMAS C,REDDY R G,et al.InfoSurgeon:Cross-Media Fine-grained Information Consistency Checking for Fake News Detection[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing(Volume 1:Long Papers).2021:1683-1698.
[10] SHU K,LI Y,DING K,et al.Fact-enhanced synthetic newsgeneration[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2021:13825-13833.
[11] HUANG K H,MCKEOWN K,NAKOV P,et al.Faking fake news for real fake news detection:Propaganda-loaded training data generation[J].arXiv:2203.05386,2022.
[12] WANG W Y,CHANG C Y,PENG W C.Style-News:Incorporating Stylized News Generation and Adversarial Verification for Neural Fake News Detection[C]//Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics.2024:1531-1541.
[13] RENNIE S J,MARCHERET E,MROUEH Y,et al.Self-critical sequence training for image captioning[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:7008-7024.
[14] TRUEMAN T E,KUMAR A,NARAYANASAMYP,et al.Attention-based C-BiLSTM for fake news detection[J].Applied Soft Computing,2021,110:107600.
[15] WANG Y,WANG L,YANG Y,et al.SemSeq4FD:Integrating global semantic relationship and local sequential order to enhance text representation for fake news detection[J].Expert Systems with Applications,2021,166:114090.
[16] XU F,LI M H,HUANG Q,et al.Knowledge Graph Driven Graph Convolutional Neural Network Rumor Detection Model[J].Chinese Science:Information Science,2023,53(4):663-681.
[17] LIANG X,ZHANG Q,SHI C,et al.MSynFD:Multi-hop Syntax aware Fake News Detection[C]//Proceedings of the ACM on Web Conference 2024.2024:4128-4137.
[18] ZHOU X Y,WU J D,ZAFARANI R.SAFE:Similarity-Aware Multi-modal Fake News Detection[C]//Pacific-Asia Conference on Knowledge Discovery and Data Mining.2020:354-367.
[19] XUE J,WANG Y,TIAN Y,et al.Detecting fake news by exploring the consistency of multimodal data[J].Information Processing & Management,2021,58(5):102610.
[20] FUNG Y,THOMAS C,REDDYR G,et al.Infosurgeon:Cross-media fine-grained information consistency checking for fake news detection[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing(Volume 1:Long Papers).2021:1683-1698.
[21] BANARESCU L,BONIAL C,CAI S,et al.Abstract meaning representation for sembanking[C]//Proceedings of the 7th linguistic Annotation Workshop and Interoperability with Discourse.2013:178-186.
[22] THOMAS C,ZHANG Y,CHANG S F.Fine-grained visual entailment[C]//European Conference on Computer Vision.Cham:Springer Nature Switzerland,2022:398-416.
[23] ZHOU Y,YANG Y,YING Q,et al.Multimodal fake news detection via clip-guided learning[C]//2023 IEEE International Conference on Multimedia and Expo(ICME).IEEE,2023:2825-2830.
[24] YING Q,HU X,ZHOU Y,et al.Bootstrap multi-view representations for fake news detection[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2023:5384-5392.
[25] MA J,ZHAO Z,YI X,et al.Modeling task relationships inmulti-task learning with multi-gate mixture-of-experts[C]//Proceedings of the 24th ACM SIGKDD International Confe-rence on Knowledge Discovery & Data Mining.2018:1930-1939.
[26] JIN Z W,CAO J,GUO H,et al.Multimodal fusion with recurrent neural networks for rumor detection on microblogs[C]//Proceedings of the 25th ACM International Conference on Multimedia.2017:795-816.
[27] SONG C,NING N,ZHANG Y,et al.A multimodal fake news detection model based on crossmodal attention residual and multichannel convolutional neural networks[J].Information Processing & Management,2021,58(1):102437.
[28] WANG Y,QIAN S,HU J,et al.Fake news detection via know-ledge-driven multimodal graph convolutional networks[C]//Proceedings of the 2020 International Conference on Multimedia Retrieval.2020:540-547.
[29] LI P,SUN X,YU H,et al.Entity-oriented multi-modal align-ment and fusion network for fake news detection[J].IEEE Transactions on Multimedia,2021,24:3455-3468.
[30] QIAN S,WANG J,HU J,et al.Hierarchical multi-modal contextual attention network for fake news detection[C]//Procee-dings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval.2021:153-162.
[31] QI P,CAO J,LI X,et al.Improving fake news detection byusing an entity-enhanced framework to fuse diverse multimodal clues[C]//Proceedings of the 29th ACM International Confe-rence on Multimedia.2021:1212-1220.
[32] SHU K,WANG S,LIU H.Understanding user profiles on social media for fake news detection[C]//2018 IEEE Conference on Multimedia Information Processing and Retrieval(MIPR).IEEE,2018:430-435.
[33] LONG Y,LU Q,XIANG R,et al.Fake news detection through multi-perspective speaker profiles[C]//Proceedings of the Eighth International Joint Conference on Natural Language Processing(Volume 2:Short papers).2017:252-256.
[34] YANG S,SHU K,WANG S,et al.Unsupervised fake news detection on social media:A generative approach[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2019:5644-5651.
[35] SHU K,CUI L,WANG S,et al.defend:Explainable fake news detection[C]//Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining.2019:395-405.
[36] WU L,RAO Y,ZHAO Y,et al.DTCA:Decision tree-based co-attention networks for explainable claim verification[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.2020:1024-1035.
[37] ZHANG X,CAO J,LI X,et al.Mining Dual Emotion for Fake News Detection[C]//Proceedings of the Web Conference 2021.2021:3465-3476.
[38] WU L,RAO Y,LAN Y,et al.Unified Dual-view Cognitive Mo-del for Interpretable Claim Verification[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing(Volume 1:Long Papers).2021:59-68.
[39] LIU Y,WU Y F.Early detection of fake news on social media through propagation path classification with recurrent and con-volutional networks[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2018.
[40] KHOO L M S,CHIEU H L,QIAN Z,et al.Interpretable rumor detection in microblogs by attending to user interactions[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2020:8783-8790.
[41] MA J,GAO W,WONG K F.Rumor detection on twitter with tree-structured recursive neural networks[C]//Association for Computational Linguistics.2018:1980-1989.
[42] MA J,GAO W.Debunking Rumors on Twitter with TreeTransformer[C]//Proceedings of the 28th International Confe-rence on Computational Linguistics.2020:5455-5466.
[43] HU D,WEI L,ZHOU W,et al.A rumor detection approachbased on multi-relational propagation tree[J].Journal of Computer Research and Development,2021,58(7):1395-1411.
[44] CUI C,JIA C.Propagation Tree Is Not Deep:Adaptive Graph Contrastive Learning Approach for Rumor Detection[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2024:73-81.
[45] BIAN T,XIAO X,XU T,et al.Rumor detection on social media with bi-directional graph convolutional networks[C]//Procee-dings of the AAAI Conference on Artificial Intelligence.2020:549-556.
[46] HE Z,LI C,ZHOU F,et al.Rumor detection on social mediawith event augmentations[C]//Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval.2021:2020-2024.
[47] SONG C,SHU K,WU B.Temporally evolving graph neural network for fake news detection[J].Information Processing & Management,2021,58(6):102712.
[48] SUN M,ZHANG X,ZHENG J,et al.Ddgcn:Dual dynamicgraph convolutional networks for rumor detection on social media[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2022:4611-4619.
[49] YUAN C,MA Q,ZHOU W,et al.Jointly embedding the localand global relations of heterogeneous graph for rumor detection[C]//2019 IEEE International Conference on Data Mining(ICDM).IEEE,2019:796-805.
[50] KANG Z,CAO Y,SHANG Y,et al.Fake news detection with heterogenous deep graph convolutional network[C]//Pacific-Asia Conference on Knowledge Discovery and Data Mining.Cham:Springer International Publishing,2021:408-420.
[51] LU Y J,LI C T.GCAN:Graph-aware co-attention networks for explainable fake news detection on social media[C]//Procee-dings of the 58th Annual Meeting of the Association for Computational Linguistics.2020:505-514.
[52] DOU Y,SHU K,XIA C,et al.User preference-aware fake news detection[C]//Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval.2021:2051-2055.
[53] SUN L,RAO Y,LAN Y,et al.Hg-sl:Jointly learning of global and local user spreading behavior for fake news early detection[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2023:5248-5256.
[54] GHOSH S,MITRA P.How early can we detect? detecting misinformation on social media using user profiling and network characteristics[C]//Joint European Conference on Machine Learning and Knowledge Discovery in Databases.Cham:Sprin-ger Nature Switzerland,2023:174-189.
[55] SHI B,WENINGER T.Discriminative predicate path mining for fact checking in knowledge graphs[J].Knowledge-based Systems,2016,104:123-133.
[56] HU L,YANG T,ZHANG L,et al.Compare to the knowledge:Graph neural fake news detection with external knowledge[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing(Volume 1:Long Papers).2021:754-763.
[57] VO N,LEE K.Hierarchical Multi-head Attentive Network forEvidence-aware Fake News Detection[C]//Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics:Main Volume(Online).Association for Computational Linguistics,2021:965-975.
[58] SOLEIMANI A,MONZ C,WORRINGM.Bert for evidence retrieval and claim verification[C]//Advances in Information Retrieval:42nd European Conference on IR Research,ECIR 2020,Lisbon,Portugal,April 14－17,2020,Proceedings,Part II 42.Springer International Publishing,2020:359-366.
[59] LEE N,LI B Z,WANG S,et al.Language Models as Fact Che-ckers?[C]//Proceedings of the Third Workshop on Fact Extraction and VERification(FEVER).2020:36.
[60] HU B,SHENG Q,CAO J,et al.Bad actor,good advisor:Exploring the role of large language models in fake news detection[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2024:22105-22113.
[61] ZHANG X,GAO W.Towards LLM-based Fact Verification on News Claims with a Hierarchical Step-by-Step Prompting Me-thod[C]//Proceedings of the 13th International Joint Confe-rence on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics(Volume 1:Long Papers).2023:996-1011.
[62] ROSNOW R L.Inside rumor:A personal journey[J].American Psychologist,1991,46(5):484.
[63] BASTINGS J,FILIPPOVA K.The elephant in the interpre-tability room:Why use attention as explanation when we have saliency methods?[C]//Proceedings of the Third Blackbox NLP Workshop on Analyzing and Interpreting Neural Networks for NLP.2020:149-155.
[64] CHEN T,LI X,YIN H,et al.Call attention to rumors:Deep at-tention based recurrent neural networks for early rumor detection[C]//Trends and Applications in Knowledge Discovery and Data Mining:PAKDD 2018 Workshops,BDASC,BDM,ML4Cyber,PAISI,DaMEMO,Melbourne,VIC,Australia,June 3,2018,Revised Selected Papers 22.Springer International Publishing,2018:40-52.
[65] YANG R,WANG X,JIN Y Q,et al.Reinforcement subgraph reasoning for fake news detection[C]//Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining.2022:2253-2262.
[66] GAD-ELRAB M H,STEPANOVA D,URBANI J,et al.Ex-fakt:A framework for explaining facts over knowledge graphs and text[C]//Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining.2019:87-95.
[67] ATANASOVAP.Generating fact checking explanations[M] //Accountable and Explainable Methods for Complex Reasoning over Text.Cham:Springer Nature Switzerland,2024:83-103.
[68] ALTHABITI S,ALSALKA M A,ERIC A.Ta'keed:The First Generative Fact-Checking System[C]//Computer Science & Information Technology(CS & IT).AIRCC,2024.
[69] SU J,CARDIE C,NAKOVP.Adapting Fake News Detection to the Era of Large Language Models[C]//Findings of the Asso-ciation for Computational Linguistics:NAACL 2024.2024:1473-1490.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed