Computer Science ›› 2025, Vol. 52 ›› Issue (11): 1-12.doi: 10.11896/jsjkx.250700034

• Research and Application of Large Language Model Technology • Previous Articles     Next Articles

Large Language Models and Rumors:A Survey on Generation and Detection

PAN Jie, WANG Juan, WANG Nan   

  1. Smart Policing and Big Data Technology Research Center,China People's Police University,Langfang,Hebei 065000,China
  • Received:2025-07-07 Revised:2025-08-29 Online:2025-11-15 Published:2025-11-06
  • About author:PAN Jie,born in 1998,postgraduate.His main research interests include natural language processing and rumor detection.
    WANG Juan,born in 1979,Ph.D,associate professor.Her main research interests include crime prediction and online public opinion analysis.
  • Supported by:
    Social Science Foundation of Hebei(HB22SH011).

Abstract: Rumor detection has been an interdisciplinary research topic since the mid-20th century.The rapid rise of social-media platforms such as Weibo and Twitter has kept the task in the spotlight,and the surge of rumors during the 2016 U.S.presidential election brought it to wider public attention.Breakthroughs in LLMs have dramatically advanced natural-language understanding and generation,catalyzing profound changes in the field of rumor detection.This paper presents a systematic survey of the latest studies on rumor generation and detection in the LLM era.It firstly revisits the concept of social-media rumors and summarizes widely used benchmark datasets,tracing the evolution of detection frameworks from traditional machine learning to deep learning and graph neural networks.It then analyzes in depth the four core roles that LLMs play in rumor detection,parameter fine-tu-ning,zero/few-shot prompting,knowledge augmentation and multimodal fusion.In addition,it catalogs datasets containing LLM-generated rumors and examines emerging detection techniques for AI-generated content,such as watermarking,linguistic fingerprints,and semantic-entropy-based methods.This paper concludes by outlining future research directions and the key challenges that remain.

Key words: Rumor, Large Language Models(LLMs), Deep learning, Detection techniques

CLC Number: 

  • TP311
[1]WAN Q B,HU F,ZHOU M T,et al.A survey of rumor detection oriented to Twitter platform [J].Information & Communications,2019(12):137-139
[2]TASNIM S,HOSSAIN M M,MAZUMDER H.Impact of ru-mors and misinformation on COVID-19 in social media[J].Journal of preventive medicine and public health,2020,53(3):171-174.
[3]LIU X N,HONG X Y,CAO Z Y,et al.Rumor detection on social media:methods,challenges,and trends [J].Computer Engineering and Applications,2025,61(11):31-50.
[4]ZHOU H H.Research on rumor detection and harmfulness prediction in social networks [D].Nanjing:Nanjing University of Information Science and Technology,2022.
[5]XU J,XIAN L,LIU Z,et al.The future of combating rumors? Retrieval,discrimination,and generation [J].arXiv:2403.20204,2024.
[6]LU H Y,FAN C Y,WU X J.Few-shot COVID-19 rumor detection for online social media [J].Journal of Chinese Information Processing,2022,36(1):135-144,172.
[7]AL-SAREM M,ALSAEEDI A,SAEED F,et al.A novel hybrid deep learning model for detecting COVID-19-related rumors on social media based on LSTM and concatenated parallel CNNs [J].Applied Sciences,2021,11(17):7940.
[8]TAHA M A,JABAR H D A,MOHAMMED W K.Fake news detection model basing on machine learning algorithms [J].Baghdad Science Journal,2024,21(8):2771-2781.
[9]WU S Y,DONG Q X,SONG Z J,et al.A review of misinformation detection methods on social media [J].Journal of the China Society for Scientific and Technical Information,2022,41(6):651-661.
[10]LIU Z Y,SONG C H,YANG C.Early automatic detection ofrumors on social media platforms [J].Global Media Journal,2018,5(4):65-80.
[11]LIN H,ZHANG X,FU X.A graph convolutional encoder and decoder model for rumor detection [C]//2020 IEEE 7th International Conference on Data Science and Advanced Analytics(DSAA).IEEE,2020:300-306.
[12]MA J,GAO W,WEI Z,et al.Detect rumors using time series of social context information on microblogging websites[C]//Proceedings of the 24th ACM International Conference on Information and Knowledge Management.ACM,2015:1751-1754.
[13]HUANG D,YANG S,GAO S.Rumor detection in networksbased on the BERT-CNN approach[J].Applied and Computational Engineering,2024,77(1):1-6.
[14]ZHONG W,XIAO Y,XU M,et al.VMID:A Multimodal Fusion LLM Framework for Detecting and Identifying Misinformation of Short Videos [J].arXiv:2411.10032,2024.
[15]GE X Y,ZHANG M S,WEI B,et al.Explainable rumor detection based on dual sentiment perception [J].Journal of Chinese Information Processing,2022,36(9):129-138.
[16]LAI J,YANG X,LUO W,et al.Rumorllm:A rumor large language model-based fake-news-detection data-augmentation approach [J].Applied Sciences,2024,14(8):3532.
[17]LUO Y,LI Y,WEN D,et al.Message Injection Attack on Rumor Detection under the Black-Box Evasion Setting Using Large Language Model [C]//Proceedings of the ACM Web Confe-rence.ACM,2024:4512-4522.
[18]CHEN C Y,SHU K.CAN LLM-Generated Misinformation Be Detected?[EB/OL].(2023-09-25)[2025-07-06].https://ar-xiv.org/abs/2309.13788.
[19]YANG Z,LIN J,GUO Z,et al.Towards rumor detection with multi-granularity evidences:A dataset and benchmark [J].IEEE Transactions on Knowledge and Data Engineering,2024,36(11):7188-7200.
[20]ZUBIAGA A,AKER A,BONTCHEVA K,et al.Detection and resolution of rumours in social media:A survey [J].ACM Computing Surveys,2018,51(2):1-36.
[21]GAILDRAUD L,SAMIER H,BRUNEAU J M.The generation of a rumour:from emergence to percolation [C]//Proceedings of the European Symposium of Competitive Intelligence.2009.
[22]ALLPORT G W,POSTMAN L.The psychology of rumor [M].New York:Henry Holt and Company,1947.
[23]BONSTEEL S.APA PsycNET [J].The Charleston Advisor,2012,14(1):16-19.
[24]LI Q,ZHANG Q,SI L,et al.Rumor detection on social media:Datasets,methods and opportunities [J].arXiv:1911.07199,2019.
[25]DERCZYNSKI L,BONTCHEVA K,LUKASIK M,et al.PHEME:computing veracity—the fourth challenge of big social data[C]//European Semantic Web Conference(ESWC).2014.
[26]KOCHKINA E,LIAKATA M,ZUBIAGA A.All-in-one:Multi-task learning for rumour verification [J].arXiv:1806.03713,2018.
[27]MA J,GAO W,WONG K F.Detect rumors in microblog posts using propagation structure via kernel learning [C]//Procee-dings of the 55th Annual Meeting of the Association for Computational Linguistics.Association for Computational Linguistics,2017:708-717.
[28]SHU K,MAHUDESWARAN D,WANG S,et al.Fakenewsnet:A data repository with news content,social context,and spatiotemporal information for studying fake news on social media [J].Big Data,2020,8(3):171-188.
[29]JIN Z,CAO J,GUO H,et al.Multimodal fusion with recurrent neural networks for rumor detection on microblogs [C]//Proceedings of the 25th ACM International Conference on Multimedia.ACM,2017:795-816.
[30]NAN Q,CAO J,ZHU Y,et al.MDFEND:Multi-domain fakenews detection [C]//Proceedings of the 30th ACM Interna-tional Conference on Information and Knowledge Management.ACM,2021:3343-3347.
[31]SILVERMAN C.This analysis shows how viral fake election news stories outperformed real news on Facebook[EB/OL].(2016-11-16)[2025-06-28].https://www.buzzfeednews.com/article/craigsilverman/viral-fake-election-news-outperformed-real-news-on-facebook.
[32]CAO Y P,NAIR A M,SOOF N J,et al.CoSMis:A Hybrid Human-LLM COVID Related Scientific Misinformation Dataset and LLM pipelines for Detecting Scientific Misinformation in the Wild [C]//Proceedings of the AAAI Conference on Artificial Intelligence.AAAI,2025.
[33]SUN Y S,HE J F,CUI L M,et al.Exploring the Deceptive Power of LLM-Generated Fake News:A Study of Real-World Detection Challenges [J].arXiv:2403.18249,2024.
[34]ZHANG Z,ZHANG Y,ZHOU X,et al.From Generation to Detection:A Multimodal Multi-Task Dataset for Benchmarking Health Misinformation [J].arXiv:2505.18685,2025.
[35]SUN Y,HE J,LEI S,et al.Med-MMHL:A Multi-Modal Dataset for Detecting Human- and LLM-Generated Misinformation in the Medical Domain [J].arXiv:2306.08871,2023.
[36]WANG L Z,MA Y,GAO R,et al.MegaFake:A Theory-Driven Dataset of Fake News Generated by Large Language Models [J].arXiv:2408.11871,2024.
[37]CASTILLO C,MENDOZA M,POBLETE B.Information credibility on Twitter [C]//Proceedings of the 20th International Conference on World Wide Web.ACM,2011:675-684.
[38]JAHANBAKHSH-NAGADEH Z,FEIZI-DERAKHSHI M R,RAMEZANI M,et al.A model to measure the spread power of rumors [J].Journal of Ambient Intelligence and Humanized Computing,2023,14:13787-13811.
[39]PI D C,WU Z Y,CAO J J.Early rumor detection method based on knowledge graph representation learning [J].Acta Electronica Sinica,2023,51(2):385-395.
[40]RANI P,JAIN V,SHOKEEN J,et al.Blockchain-based rumor detection approach for COVID-19 [J].Journal of Ambient Intelligence and Humanized Computing,2024,15(1):435-449.
[41]KHAN S,KAMAL A,FAZIL M,et al.HCovBi-caps:hatespeech detection using convolutional and Bi-directional gated recurrent unit with Capsule network [J].IEEE Access,2022,10:7881-7894.
[42]CHEN L W,SONG Y R,SONG B.Temporal-aware heterogeneous graph neural network for rumor detection [J].Mini-micro Systems,2024,45(1):45-51.
[43]JIANG W,CHEN T,GAO X,et al.Epidemiology-informed network for robust rumor detection [C] //Proceedings of the ACM on Web Conference 2025.ACM,2025:3618-3627.
[44]LI H.Research on key issues of concept-aware rumor detection in English texts on social media [D].Guilin:Guilin University of Electronic Technology,2023.
[45]HAN X M,JIA C Y,LI X Y,et al.Rumor detection model basedon dual attention to nodes and paths in propagation tree structures [J].Computer Science,2023,50(4):22-31.
[46]TAO X,ZHU Y,LI C P.Rumor detection method based on attention and multimodal hybrid fusion [J].Computer Enginee-ring,2021,47(12):71-77.
[47]YANG R,MA J,LIN H,et al.A weakly supervised propagation model for rumor verification and stance detection with multiple instance learning [C]//Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval.ACM,2022:1761-1772.
[48]JING Q,YAO D,FAN X,et al.TRANSFAKE:multi-tasktransformer for multimodal enhanced fake news detection [C]//2021 International Joint Conference on Neural Networks(IJCNN).IEEE,2021:1-8.
[49]HUANG Y,GAO H,GAO D,et al.Research on Tibetan Rumor Detection Method Based on Word2Vec-BiLSTM-Att [C]//2024 5th International Symposium on Computer Engineering and Intelligent Communications(ISCEIC).IEEE,2024:331-337.
[50]VASWANI A,SHAZEER N,PARMAR N,et al.Attention is all you need [C]//Proceedings of the 31st International Confe-rence on Neural Information Processing Systems.2017:6000-6010.
[51]JIN W,WANG N,TAO T,et al.A veracity dissemination consistency-based few-shot fake news detection framework by synergizing adversarial and contrastive self-supervised learning [J].Scientific Reports,2024,14(1):19470.
[52]HOWARD J,RUDER S.Universal language model fine-tuning for text classification[J].arXiv:1801.06146,2018.
[53]LI X L,LIANG P.Prefix-tuning:Optimizing continuous pro-mpts for generation[EB/OL].(2021-01-01)[2025-07-06].https://arxiv.org/abs/2101.00190.
[54]HU E J,SHEN Y,WALLIS P,et al.Lora:Low-rank adaptation of large language models[C]//Proceedings of the 10th International Conference on Learning Representations.ICLR,2022.
[55]PAVLYSHENKO B M.Analysis of disinformation and fakenews detection using fine-tuned large language model[EB/OL].(2023-09-08)[2025-07-06].https://arxiv.org/abs/2309.04704.
[56]LIU Z,ZHANG X,YANG K,et al.Fmdllama:Financial misinformation detection based on large language models[C]//Companion Proceedings of the ACM on Web Conference 2025.ACM,2025:1153-1157.
[57]LIN H,YI P,MA J,et al.Zero-shot rumor detection with propagation structure via prompt learning[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2023:5213-5221.
[58]PENDYALA V S,HALL C E.Explaining Misinformation Detection Using Large Language Models[J].Electronics,2024,13(9):1673.
[59]PATTANAIK B,MANDAL S,TRIPATHY R M,et al.Rumor detection using dual embeddings and text-based graph convolutional network[J].Discover Artificial Intelligence,2024,4(1):86.
[60]CHEN M,WEI L,CAO H,et al.Explore the potential of LLMs in misinformation detection:An empirical study[C]//AAAI 2025 Workshop on Preventing and Detecting LLM Misinformation(PDLM).AAAI,2025.
[61]HAN S,GAO J,CIRAVEGNA F.Neural language model based training data augmentation for weakly supervised early rumor detection [C]//Proceedings of the 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining(ASONAM).IEEE,2019:105-112.
[62]ASKARIZADE M.Enhancing rumor detection with data aug-mentation and generative pre-trained transformer[J].Expert Systems with Applications,2025,262:125649.
[63]DAI H,LIU Z,LIAO W,et al.AugGPT:Leveraging ChatGPT for Text Data Augmentation[J].IEEE Transactions on Big Data,2025,11(3):907-918.
[64]WANG J,ZHU Z,LIU C,et al.LLM-enhanced multimodal detection of fake news [J].PLoS ONE,2024,19(10):e0312240.
[65]ZENG F,LI W,GAO W,et al.Multimodal misinformation detection by learning from synthetic data with multimodal LLMs[EB/OL].(2024-09-30)[2025-07-06].https://arxiv.org/abs/2409.19656.
[66]HANG C N,YU P D,TAN C W.TrumorGPT:Graph-BasedRetrieval-Augmented Large Language Model for Fact-Checking[J].IEEE Transactions on Artificial Intelligence,2025,1:1-15.
[67]SHAO Z J,CAI G Y,LIU Q H,et al.Iterative rumor detection method enhanced by large language models and authoritative news [J].Journal of Nanjing University(Natural Sciences),2024,60(6):970-980.
[68]ZHU Y,WANG G S,JIN W W,et al.Online rumor detection based on text semantic enhancement and comment stance weighting [J].Journal of Frontiers of Computer Science and Technology,2024,18(12):3311-3323.
[69]GALLEGOS I O,ROSSI R A,BARROW J,et al.Bias and fairness in large language models:A survey[J].Computational Linguistics,2024,50(3):1097-1179.
[70]ATALLAH M J,RASKIN V,CROGAN M,et al.Natural language watermarking:Design,analysis,and a proof-of-concept implementation [C]//Information Hiding:4th International Workshop(IH 2001).Pittsburgh,PA,USA,Berlin:Springer,2001:185-200.
[71]ABDELNABI S,FRITZ M.Adversarial watermarking trans-former:Towards tracing text provenance with data hiding [C]//2021 IEEE Symposium on Security and Privacy(SP).IEEE,2021:121-140.
[72]KIRCHENBAUER J,GEIPING J,WEN Y,et al.A watermark for large language models [C]//International Conference on Machine Learning.PMLR,2023:17061-17084.
[73]AN R,YANG Y,YANG F,et al.Use prompt to differentiatetext generated by ChatGPT and humans [J].Machine Learning with Applications,2023,14:100497.
[74]RAY P P.ChatGPT:A comprehensive review on background,applications,key challenges,bias,ethics,limitations and future scope [J].Internet of Things and Cyber-Physical Systems,2023,3:121-154.
[75]YUAN A,COENEN A,REIF E,et al.Wordcraft:story writing with large language models [C]//Proceedings of the 27th International Conference on Intelligent User Interfaces(IUI ’22).New York,NY,USA:ACM,2022:841-852.
[76]WANG H,DOU Y,CHEN C,et al.Attacking fake news detectors via manipulating news social engagement[C]//Proceedings of the ACM Web Conference.ACM,2023:3978-3986.
[77]FARQUHAR S,KOSSEN J,KUHN L,et al.Detecting hallucinations in large language models using semantic entropy [J].Nature,2024,630(8017):625-630.
[78]LI T,WANG Z,LIU W,et al.Revisiting Jailbreaking for Large Language Models:A Representation Engineering Perspective[C]//Proceedings of the 31st International Conference on Computational Linguistics(COLING 2025).ACL,2025:3158-3178.
[1] YIN Shi, SHI Zhenyang, WU Menglin, CAI Jinyan, YU De. Deep Learning-based Kidney Segmentation in Ultrasound Imaging:Current Trends and Challenges [J]. Computer Science, 2025, 52(9): 16-24.
[2] ZENG Lili, XIA Jianan, LI Shaowen, JING Maike, ZHAO Huihui, ZHOU Xuezhong. M2T-Net:Cross-task Transfer Learning Tongue Diagnosis Method Based on Multi-source Data [J]. Computer Science, 2025, 52(9): 47-53.
[3] LI Yaru, WANG Qianqian, CHE Chao, ZHU Deheng. Graph-based Compound-Protein Interaction Prediction with Drug Substructures and Protein 3D Information [J]. Computer Science, 2025, 52(9): 71-79.
[4] LUO Chi, LU Lingyun, LIU Fei. Partial Differential Equation Solving Method Based on Locally Enhanced Fourier NeuralOperators [J]. Computer Science, 2025, 52(9): 144-151.
[5] LIU Leyuan, CHEN Gege, WU Wei, WANG Yong, ZHOU Fan. Survey of Data Classification and Grading Studies [J]. Computer Science, 2025, 52(9): 195-211.
[6] LIU Wei, XU Yong, FANG Juan, LI Cheng, ZHU Yujun, FANG Qun, HE Xin. Multimodal Air-writing Gesture Recognition Based on Radar-Vision Fusion [J]. Computer Science, 2025, 52(9): 259-268.
[7] LIU Zhengyu, ZHANG Fan, QI Xiaofeng, GAO Yanzhao, SONG Yijing, FAN Wang. Review of Research on Deep Learning Compiler [J]. Computer Science, 2025, 52(8): 29-44.
[8] TANG Boyuan, LI Qi. Review on Application of Spatial-Temporal Graph Neural Network in PM2.5 ConcentrationForecasting [J]. Computer Science, 2025, 52(8): 71-85.
[9] ZHENG Cheng, YANG Nan. Aspect-based Sentiment Analysis Based on Syntax,Semantics and Affective Knowledge [J]. Computer Science, 2025, 52(7): 218-225.
[10] HE Jing, CHEN Yiran. Study on Efficiency of Large Model in Recognizing Rumors from Different Sources [J]. Computer Science, 2025, 52(6A): 240700131-5.
[11] ZHOU Lei, SHI Huaifeng, YANG Kai, WANG Rui, LIU Chaofan. Intelligent Prediction of Network Traffic Based on Large Language Model [J]. Computer Science, 2025, 52(6A): 241100058-7.
[12] GUAN Xin, YANG Xueyong, YANG Xiaolin, MENG Xiangfu. Tumor Mutation Prediction Model of Lung Adenocarcinoma Based on Pathological [J]. Computer Science, 2025, 52(6A): 240700010-8.
[13] TAN Jiahui, WEN Chenyan, HUANG Wei, HU Kai. CT Image Segmentation of Intracranial Hemorrhage Based on ESC-TransUNet Network [J]. Computer Science, 2025, 52(6A): 240700030-9.
[14] RAN Qin, RUAN Xiaoli, XU Jing, LI Shaobo, HU Bingqi. Function Prediction of Therapeutic Peptides with Multi-coded Neural Networks Based on Projected Gradient Descent [J]. Computer Science, 2025, 52(6A): 240800024-6.
[15] FAN Xing, ZHOU Xiaohang, ZHANG Ning. Review on Methods and Applications of Short Text Similarity Measurement in Social Media Platforms [J]. Computer Science, 2025, 52(6A): 240400206-8.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!