计算机科学 ›› 2026, Vol. 53 ›› Issue (6A): 251200031-16.doi: 10.11896/jsjkx.251200031

• 人工智能 • 上一篇    下一篇

基于多维语义对比学习的生成式AI信息茧房量化诊断模型

李晓, 孙欣宇   

  1. 中国政法大学法治信息管理学院 北京 102249
  • 出版日期:2026-06-16 发布日期:2026-06-12
  • 通讯作者: 李晓(lixiao@cupl.edu.cn)
  • 基金资助:
    国家重点研发计划(2022YFC3303000, 2022YFC3303001);教育部产学合作协同育人项目(241100007150419);中国政法大学青年教师学术创新研究团队项目(25CSTD01)

Quantitative Diagnostic Model for Generative AI Information Cocoons Based on MultidimensionalSemantic Contrastive Learning

LI Xiao, SUN Xinyu   

  1. College of Law and Information Management,China University of Political Science and Law,Beijing 102249,China
  • Published:2026-06-16 Online:2026-06-12
  • About author:LI Xiao,born in 1986,Ph.D,associate professor.His main research interests include legal AI and big data in criminal psychology.
  • Supported by:
    National Key R&D Program of China(2022YFC3303000,2022YFC3303001),University-Industry Cooperation and Collaborative Education Program of the Ministry of Education of China(241100007150419) and Young Scholars Academic Innovation Research Team Program at China University of Political Science and Law(25CSTD01).

摘要: 生成式人工智能(Generative AI)在与用户交互过程中,因其“单向顺从”特性,易引发话题窄化、观点同质等新型信息茧房风险,对个体认知安全构成威胁。现有研究多集中于理论分析,缺乏对动态对话流进行细粒度、可解释量化诊断的有效工具。为此,提出一种理论驱动的生成式信息茧房多维量化诊断模型(Generative AI Information Cocoon Multidimensional Verification Probe,GCI-MVP)。该模型首先通过自监督对比学习获取高质量的对话语义表示;进而设计了一种多分支神经诊断架构,将信息茧房理论核心机制编码为可学习的神经计算单元,分别从话题多样性、语义单一性和认知框架重复性3个维度构建了话题茧房指数(TCI)、语义单一性指数(SUI)和认知框架重复指数(FRI) 3个可解释指标;最后通过理论驱动的线性耦合层合成统一的GCI-MVP综合风险指数。在WildChat真实对话数据集上的实验表明,GCI-MVP模型能有效诊断不同等级的信息茧房风险,整体分类准确率达到85.4%,宏平均F1分数为0.825,显著优于LDA主题多样性、词汇多样性及基于BERT的基线模型。Bootstrap检验与McNemar检验共同确认该优势具有统计显著性(p<0.001)。消融实验验证了各维度指标的必要性,典型案例分析进一步揭示了模型指标与“认知选择偏向”“机器认知共振”等理论机制的高度对应关系。跨模型泛化测试表明,模型在GLM-4、文心一言4.0、BLOOMZ-7B上无需微调即可稳定诊断(宏平均F1=0.803),具备良好的通用性。本研究为生成式AI的认知安全风险提供了可计算、可解释的诊断工具,对构建安全可信的人机对话系统具有重要的理论价值与应用前景。

关键词: 生成式人工智能, 信息茧房, 认知安全, AI对齐, 对话风险, 可解释评估

Abstract: This paper proposes GCI-MVP,a theory-driven multidimensional diagnostic model that quantifies information cocoon risks in Generative AI dialogues.Unlike traditional recommender systems,Generative AI exhibits “unidirectional compliance”.This tendency risks constructing closed cognitive spaces through human-AI co-construction-manifested as topic narrowing,opi-nion homogenization,and cognitive frame repetition.Existing studies remain largely theoretical and lack fine-grained,interpretable diagnostic tools for dynamic conversational flows.GCI-MVP addresses this gap through three synergistic innovations.Firstly,it establishes a theory-computable-explainable triadic paradigm.This paradigm encodes three core information cocoon mechanisms—cognitive selection bias,machine cognitive resonance,and cognitive frame repetition—into learnable neural computation units:to-pic prototypes,semantic anchors,and frame probes.Secondly,it synthesizes three interpretable metrics—topic cocoon index(TCI),semantic uniformity index(SUI),and frame repetition index(FRI)-via a multi-branch diagnostic architecture.Thirdly,it enables end-to-end risk assessment through a theory-driven linear fusion layer.Experiments on real-world Chinese dialogues(WildChat) demonstrate that GCI-MVP effectively diagnoses information cocoon risks at different levels,achieving 85.4% accuracy and a macro F1-score of 0.825 in three-level risk classification.It significantly outperforms LDA-based topic diversity,lexical diversity,and fine-tuned BERT baselines.Bootstrap tests and McNemar's test jointly confirm the statistical significance of this advantage(p<0.001).Systematic ablation studies validate the necessity of each diagnostic dimension,and typical case analyses further reveal strong alignment between the proposed metrics and theoretical mechanisms such as “cognitive selection bias” and “machine cognitive resonance.” Cross-model generalization tests on GLM-4,ERNIE 4.0,and BLOOMZ-7B demonstrate that the model achieves stable diagnosis without fine-tuning(macro F1=0.803),exhibiting strong generalizability.GCI-MVP provides a computable,interpretable,and auditable tool for assessing cognitive safety risks in generative AI,offering important theoretical value and application prospects for building secure and trustworthy human-AI dialogue systems.

Key words: Generative AI, Information cocoons, Cognitive safety, AI alignment, Conversational risk, Interpretable evaluation

中图分类号: 

  • TP389.1
[1] HUANG L H.The Formation and Response to “Information Cocoons” in Generative Artificial Intelligence [J].Library and Information Service,2025,69(X):87-91.
[2] CAO D Y.“Reflexive Information Cocoons”:The Construction Mechanism and Transcendence of Generative Artificial Intelligence [J].Exploration and Free Views,2025,1(2):153-166.
[3] HAN Q M,WANG H Y,XU J D.The Impact of User Information Exchange on Information Narrowing in SocialMedia:A Case Study of Sina Weibo [J].Information Science,2016,34(12):97-101..
[4] GUO S L,ZHANG X N,SU X N.Causes and Empirical Research on the Information Cocoons in the Application of Generative Artificial Intelligence by Researchers [J].Information Stu-dies:Theory & Application,2025,48(2):45-55.
[5] WANG Y X,ZHANG W,LIU C,et al.Aligning Large Lan-guage Models with Human Cognitive Diversity:A Framework for Measuring and Mitigating Intellectual Homogenization [C]//Advances in Neural Information Processing Systems 37(NeurIPS 2024).Vancouver:Curran Associates,Inc.,2024:11245-11267.
[6] CHEN K,RODRIGUEZ M,THOMPSON B,et al.Quantifying and Mitigating Intellectual Echo Chambers in LLM-Driven Conversations [C]//Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics(ACL 2024).Bangkok:Association for Computational Linguistics,2024:3892-3910.
[7] GUO S L,ZHANG X,WANG Y.Quantifying Information Diversity in Social Media Using Dynamic Topic Models:An LDA-based Approach and Its Limitations [J].Journal of the Association for Information Science and Technology,2022,73(5):678-692.
[8] SEARCENT P,TAGC C.Social media and the future of open debate:a user-oriented approach to Facebook's filter bubble conundrum [J].Discourse,Context and Media,2019,27(3):41-48.
[9] KITCHENS B,JOHNSON S L,GRAY P H.Understandingecho chambers and filter bubbles:the impact of social media on diversification and partisan shifts in news consumption [J].MIS Quarterly,2020,44(4):1619-1649.
[10] BEAM M A,KOSICKI G M.Personalized news portals:filtering systems and increased news exposure [J].Journalism & Mass Communication Quarterly,2014,91(1):59-77.
[11] DUAN Y,YUAN Y Z,ZHANG H.An Empirical Study on the Information Cocoons of Network Users and Their Formation Mechanism in the Big Data Environment [J].Journal of Intelligence,2020,39(11):158-164.
[12] CHEN Q,WANG Y W.Cocoon Effect and News Consumption Behavior Pattern:A Case Study of User Comment Data from Tencent News Client [J].Social Sciences,2019(11):73-87.
[13] ZHANG M,LI Y,WANG X Y,et al.A Quantitative Diagnostic Framework for Information Cocoons in Recommender Systems:From Static Metrics to Dynamic Processes [J].IEEE Transactions on Knowledge and Data Engineering,2024,36(8):3789-3805.
[14] WANG H,LIU Y,SUN J.Diagnostic Model of Information Cocoons in Generative AI Environments Based on Multi-Dimensional Semantic Evolution Trajectories [J].Journal of the China Society for Scientific and Technical Information,2025,44(2):156-170.
[15] LI W,CHEN Y,ZHAO Q.Measuring the Echo Chamber Effect in Conversational AI:A Multi-Dimensional Approach [J].ACM Transactions on Information Systems,2024,42(3):1-28.
[16] WU J,WANG X,FENG F,et al.Self-supervised graph learning for recommendation [C]//Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval.New York:ACM,2021:726-735.
[17] GIORGI J,NITSKI O,WANG B,et al.DeCLUTR:Deep contrastive learning for unsupervised textual representations [C]//Proceedings of the 58th Annual Meeting of the Association for Computa-tional Linguistics.Online:Association for Computational Linguistics,2020:879-895.
[18] CARLSSON F,GYLLENSTEN A C,GOGOULOU E,et al.Semantic re-tuning with contrastive tension [C]//International Conference on Learning Representations(ICLR 2021).2021.
[19] LIN Z,LIU B,MADOTTO A,et al.Zero-shot dialogue state tracking via cross-task transfer [C]//Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing(EMNLP 2021).Association for Computational Linguistics,2021:7890-7900.
[20] CHEN T,KORNBUTH S,NOROUZI M,et al.A simple framework for contrastive learning of visual representations [C]//Proceedings of the 37th International Conference on Machine Learning(ICML 2020).2020.
[21] ZHANG L,HE Z,MAO T T.The Double-Edged Sword Effect of Generative Artificial Intelligence Information Acquisition on Information Cocoons [J/OL].https://link.cnki.net/urlid/11.1448.G3.20251010.1650.008.
[22] RISKO E F,GILBERT S J.Cognitive offloading [J].Trends in Cognitive Sciences,2016,20(9):676-688.
[23] SUNSTEIN C R.Infotopia:How Many Minds Produce Know-ledge [M].Beijing:Law Press,2008.
[24] TAO H,HE Y.Quantifying Topic Persistence in Conversational AI:A Benchmark and Evaluation Framework [J].ACM Tran-sactions on Interactive Intelligent Systems,2023,13(3):1-24.
[25] LAPATA M.Probabilistic text structuring:Experiments withsentence ordering [C]//Proceedings of the 41st Annual Mee-ting of the Association for Computational Linguistics.Sapporo:Association for Computational Linguistics,2003:545-552.
[26] XU X,DONG J Y.A Study on the Emotional Bias of Users' “Information Cocoons” in Social Network Content Production [J].Global Media Journal,2022,9(4):78-99.
[27] SCHEGLOFF E A.Sequence organization in interaction:a primer in conversation analysis [M].Cambridge:Cambridge University Press,2007.
[28] DEMBERG V,KELLER F.A computational model of the information density-syntax interface [C]//Proceedings of the 30th Annual Conference of the Cognitive Science Society.Austin:Cognitive Science Society,2008:1440-1445.
[29] JOLLIFFE I T,CADIMA J.Principal component analysis:a review and recent developments [J].Philosophical Transactions of the Royal Society A:Mathematical,Physical and Engineering Sciences,2016,374(2065):20150202.
[30] LIKERT R.A technique for the measurement of attitudes [J].Archives of Psychology,1932,22(140):1-55.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!