计算机科学 ›› 2026, Vol. 53 ›› Issue (6A): 251200031-16.doi: 10.11896/jsjkx.251200031
李晓, 孙欣宇
LI Xiao, SUN Xinyu
摘要: 生成式人工智能(Generative AI)在与用户交互过程中,因其“单向顺从”特性,易引发话题窄化、观点同质等新型信息茧房风险,对个体认知安全构成威胁。现有研究多集中于理论分析,缺乏对动态对话流进行细粒度、可解释量化诊断的有效工具。为此,提出一种理论驱动的生成式信息茧房多维量化诊断模型(Generative AI Information Cocoon Multidimensional Verification Probe,GCI-MVP)。该模型首先通过自监督对比学习获取高质量的对话语义表示;进而设计了一种多分支神经诊断架构,将信息茧房理论核心机制编码为可学习的神经计算单元,分别从话题多样性、语义单一性和认知框架重复性3个维度构建了话题茧房指数(TCI)、语义单一性指数(SUI)和认知框架重复指数(FRI) 3个可解释指标;最后通过理论驱动的线性耦合层合成统一的GCI-MVP综合风险指数。在WildChat真实对话数据集上的实验表明,GCI-MVP模型能有效诊断不同等级的信息茧房风险,整体分类准确率达到85.4%,宏平均F1分数为0.825,显著优于LDA主题多样性、词汇多样性及基于BERT的基线模型。Bootstrap检验与McNemar检验共同确认该优势具有统计显著性(p<0.001)。消融实验验证了各维度指标的必要性,典型案例分析进一步揭示了模型指标与“认知选择偏向”“机器认知共振”等理论机制的高度对应关系。跨模型泛化测试表明,模型在GLM-4、文心一言4.0、BLOOMZ-7B上无需微调即可稳定诊断(宏平均F1=0.803),具备良好的通用性。本研究为生成式AI的认知安全风险提供了可计算、可解释的诊断工具,对构建安全可信的人机对话系统具有重要的理论价值与应用前景。
中图分类号:
| [1] HUANG L H.The Formation and Response to “Information Cocoons” in Generative Artificial Intelligence [J].Library and Information Service,2025,69(X):87-91. [2] CAO D Y.“Reflexive Information Cocoons”:The Construction Mechanism and Transcendence of Generative Artificial Intelligence [J].Exploration and Free Views,2025,1(2):153-166. [3] HAN Q M,WANG H Y,XU J D.The Impact of User Information Exchange on Information Narrowing in SocialMedia:A Case Study of Sina Weibo [J].Information Science,2016,34(12):97-101.. [4] GUO S L,ZHANG X N,SU X N.Causes and Empirical Research on the Information Cocoons in the Application of Generative Artificial Intelligence by Researchers [J].Information Stu-dies:Theory & Application,2025,48(2):45-55. [5] WANG Y X,ZHANG W,LIU C,et al.Aligning Large Lan-guage Models with Human Cognitive Diversity:A Framework for Measuring and Mitigating Intellectual Homogenization [C]//Advances in Neural Information Processing Systems 37(NeurIPS 2024).Vancouver:Curran Associates,Inc.,2024:11245-11267. [6] CHEN K,RODRIGUEZ M,THOMPSON B,et al.Quantifying and Mitigating Intellectual Echo Chambers in LLM-Driven Conversations [C]//Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics(ACL 2024).Bangkok:Association for Computational Linguistics,2024:3892-3910. [7] GUO S L,ZHANG X,WANG Y.Quantifying Information Diversity in Social Media Using Dynamic Topic Models:An LDA-based Approach and Its Limitations [J].Journal of the Association for Information Science and Technology,2022,73(5):678-692. [8] SEARCENT P,TAGC C.Social media and the future of open debate:a user-oriented approach to Facebook's filter bubble conundrum [J].Discourse,Context and Media,2019,27(3):41-48. [9] KITCHENS B,JOHNSON S L,GRAY P H.Understandingecho chambers and filter bubbles:the impact of social media on diversification and partisan shifts in news consumption [J].MIS Quarterly,2020,44(4):1619-1649. [10] BEAM M A,KOSICKI G M.Personalized news portals:filtering systems and increased news exposure [J].Journalism & Mass Communication Quarterly,2014,91(1):59-77. [11] DUAN Y,YUAN Y Z,ZHANG H.An Empirical Study on the Information Cocoons of Network Users and Their Formation Mechanism in the Big Data Environment [J].Journal of Intelligence,2020,39(11):158-164. [12] CHEN Q,WANG Y W.Cocoon Effect and News Consumption Behavior Pattern:A Case Study of User Comment Data from Tencent News Client [J].Social Sciences,2019(11):73-87. [13] ZHANG M,LI Y,WANG X Y,et al.A Quantitative Diagnostic Framework for Information Cocoons in Recommender Systems:From Static Metrics to Dynamic Processes [J].IEEE Transactions on Knowledge and Data Engineering,2024,36(8):3789-3805. [14] WANG H,LIU Y,SUN J.Diagnostic Model of Information Cocoons in Generative AI Environments Based on Multi-Dimensional Semantic Evolution Trajectories [J].Journal of the China Society for Scientific and Technical Information,2025,44(2):156-170. [15] LI W,CHEN Y,ZHAO Q.Measuring the Echo Chamber Effect in Conversational AI:A Multi-Dimensional Approach [J].ACM Transactions on Information Systems,2024,42(3):1-28. [16] WU J,WANG X,FENG F,et al.Self-supervised graph learning for recommendation [C]//Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval.New York:ACM,2021:726-735. [17] GIORGI J,NITSKI O,WANG B,et al.DeCLUTR:Deep contrastive learning for unsupervised textual representations [C]//Proceedings of the 58th Annual Meeting of the Association for Computa-tional Linguistics.Online:Association for Computational Linguistics,2020:879-895. [18] CARLSSON F,GYLLENSTEN A C,GOGOULOU E,et al.Semantic re-tuning with contrastive tension [C]//International Conference on Learning Representations(ICLR 2021).2021. [19] LIN Z,LIU B,MADOTTO A,et al.Zero-shot dialogue state tracking via cross-task transfer [C]//Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing(EMNLP 2021).Association for Computational Linguistics,2021:7890-7900. [20] CHEN T,KORNBUTH S,NOROUZI M,et al.A simple framework for contrastive learning of visual representations [C]//Proceedings of the 37th International Conference on Machine Learning(ICML 2020).2020. [21] ZHANG L,HE Z,MAO T T.The Double-Edged Sword Effect of Generative Artificial Intelligence Information Acquisition on Information Cocoons [J/OL].https://link.cnki.net/urlid/11.1448.G3.20251010.1650.008. [22] RISKO E F,GILBERT S J.Cognitive offloading [J].Trends in Cognitive Sciences,2016,20(9):676-688. [23] SUNSTEIN C R.Infotopia:How Many Minds Produce Know-ledge [M].Beijing:Law Press,2008. [24] TAO H,HE Y.Quantifying Topic Persistence in Conversational AI:A Benchmark and Evaluation Framework [J].ACM Tran-sactions on Interactive Intelligent Systems,2023,13(3):1-24. [25] LAPATA M.Probabilistic text structuring:Experiments withsentence ordering [C]//Proceedings of the 41st Annual Mee-ting of the Association for Computational Linguistics.Sapporo:Association for Computational Linguistics,2003:545-552. [26] XU X,DONG J Y.A Study on the Emotional Bias of Users' “Information Cocoons” in Social Network Content Production [J].Global Media Journal,2022,9(4):78-99. [27] SCHEGLOFF E A.Sequence organization in interaction:a primer in conversation analysis [M].Cambridge:Cambridge University Press,2007. [28] DEMBERG V,KELLER F.A computational model of the information density-syntax interface [C]//Proceedings of the 30th Annual Conference of the Cognitive Science Society.Austin:Cognitive Science Society,2008:1440-1445. [29] JOLLIFFE I T,CADIMA J.Principal component analysis:a review and recent developments [J].Philosophical Transactions of the Royal Society A:Mathematical,Physical and Engineering Sciences,2016,374(2065):20150202. [30] LIKERT R.A technique for the measurement of attitudes [J].Archives of Psychology,1932,22(140):1-55. |
|
||