计算机科学 ›› 2026, Vol. 53 ›› Issue (6A): 250600055-5.doi: 10.11896/jsjkx.250600055
杨华, 王宝会
YANG Hua, WANG Baohui
摘要: 提出一种融合知识图谱嵌入与大模型的事实预测算法,旨在应对招投标领域中三元组真实性判断的挑战。针对传统事实预测算法泛化能力不足以及单一大模型在处理结构化知识时存在的局限性,采用TransR模型对招投标文件中抽取的实体和关系进行低维嵌入表示,同时利用Qwen2.5-1.5B大模型,通过LoRa微调提取文本语义特征,并在特征级融合模块中实现两种信息的深度整合。在真实招投标数据集上进行的实验显示,所提方法在事实预测任务中的精确率为86.4%,召回率为93.2%,F1值为89.7%,相较于传统知识图谱嵌入算法F1值提升了14个百分点,相较于仅微调大模型的方法F1值提升了11.3个百分点。
中图分类号:
| [1] LIU H Y,QU X L,SHEN Y K,et al.Research on Reasoning of Traditional Chinese Medicine Knowledge Graph [J/OL].[2025-04-02] .http://kns.cnki.net/kcms/detail/11.5699.R.20250307.2243.009.html. [2] WANG S B.Research on the Evolution of Knowledge GraphsBased on Multimodal Large Models [J].China High-Tech,2025(2):25-27. [3] SHEN M L,SHI Z C,GAO Y B,et al.Fact Verification Based on Collaborative Reasoning of Graph Embedding and Semantic Fusion [J/OL].[2025-04-02] .http://kns.cnki.net/kcms/detail/51.1307.TP.20240630.2146.002.html. [4] ZHANG L.Current Situation,Problems and Suggestions ofStandardized Bidding for Engineering Construction Projects [J].Popular Standardization,2025(6):100-102. [5] WANG L,ZHAO W,WEI Z,et al.SimKGC:Simple Contrastive Knowledge Graph Completion with Pre-trained Language Mo-dels[C]//Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics.Association for Computational Linguistics,2022:1-12. [6] JIANG P,AGARWAL S,JIN B,et al.Text-Augmented OpenKnowledge Graph Completion via Pre-Trained Language Models[C]//Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing(EMNLP).Association for Computational Linguistics,2023:1-12. [7] WANG H,ZHAO S,QIANG Z,et al.Knowledge-tuning Large Language Models with Structured Medical Knowledge Bases for Reliable Response Generation in Chinese[J].arXiv:2309.04175,2023. [8] LV X,LIN Y,CAO Y,et al.Do Pre-trained Models BenefitKnowledge Graph Completion? A Reliable Evaluation and a Reasonable Approach[C]//Findings of the Association for Computational Linguistics(ACL 2022).IEEE Computer Society,2022:3570-3581. [9] LI C K,XIE M Y,LÜ Q,et al.A Method for Extracting IFC-BIM Semantic Information Based on the TransE Model[J].Journal of Geo-Information Science,2025,27(6):1263-1274. [10] DU X J,TAO Y Z,LI G L.Research on the development ofTrans series knowledge representation methods[J].Computer and Digital Engineering,2023,51(11):2515-2517. [11] SUN Z,DENG Z,NIE J,et al.RotatE:Knowledge Graph Embedding by Relational Rotation in Complex Space[J].arXiv:1902.10197,2019. [12] TROUILLON T,WELBL J,RIEDEL S,et al.Complex Embeddings for Simple Link Prediction[J].arXiv:1606.06357,2016. [13] YAO L,PENG J Z,MAO C S,et al.Exploring Large Language Models for Knowledge Graph Completion[J].arXiv:2308.13916,2023. [14] XU D,ZHANG Z,LIN Z,et al.Multi-perspective Improvement of Knowledge Graph Completion with Large Language Models[C]//Proceedings of the 2024 Joint International Conference on Computational Linguistics,Language Resources and Evaluation(LREC-COLING 2024).Torino,Italia:ELRA and ICCL,2024:11956-11968. [15] ZHANG Y,CHEN Z,GUO L B,et al.Making Large Language Models Perform Better in Knowledge Graph Completion[C]//Findings of the Association for Computational Linguistics:ACL 2024.IEEE Computer Society,2024:1-12. [16] SUN C,WANG H R,JING B X,et al.A Knowledge Reasoning Method Based on Hierarchical Reinforcement Learning [J].Application Research of Computers,2024,41(3):805-810. [17] LIU C C,SANG L,LI W,et al.A Method for Completing Multivariate Relationship Knowledge Graphs Driven by Large Language Models [J].Computer Science,2025,52(1):94-101. [18] LI J W,DENG Y D,CHEN B.Automatic Construction of Domain UML Models Based on Fine-tuned Qwen2[J].Computer Science,2025,52(S1):31-34. |
|
||