计算机科学 ›› 2026, Vol. 53 ›› Issue (6A): 250600055-5.doi: 10.11896/jsjkx.250600055

• 人工智能 • 上一篇    下一篇

融合知识图谱嵌入与大模型的事实预测研究

杨华, 王宝会   

  1. 北京航空航天大学软件学院 北京 100191
  • 出版日期:2026-06-16 发布日期:2026-06-12
  • 通讯作者: 王宝会(wangbh@buaa.edu.cn)
  • 作者简介:(987754124@qq.com)

Research on Fact Prediction by Integrating Knowledge Graph Embeddings and Large Models

YANG Hua, WANG Baohui   

  1. School of Software,Beihang University,Beijing 100191,China
  • Published:2026-06-16 Online:2026-06-12
  • About author:YANG Hua,born in 1997,postgraduate.Her main research interests include na-tural language processing and deep learning.
    WANG Baohui,born in 1973,professor,master's supervisor.His main research interests include software architecture,big data,artificial intelligence,etc.

摘要: 提出一种融合知识图谱嵌入与大模型的事实预测算法,旨在应对招投标领域中三元组真实性判断的挑战。针对传统事实预测算法泛化能力不足以及单一大模型在处理结构化知识时存在的局限性,采用TransR模型对招投标文件中抽取的实体和关系进行低维嵌入表示,同时利用Qwen2.5-1.5B大模型,通过LoRa微调提取文本语义特征,并在特征级融合模块中实现两种信息的深度整合。在真实招投标数据集上进行的实验显示,所提方法在事实预测任务中的精确率为86.4%,召回率为93.2%,F1值为89.7%,相较于传统知识图谱嵌入算法F1值提升了14个百分点,相较于仅微调大模型的方法F1值提升了11.3个百分点。

关键词: 知识图谱, 事实预测, TransR, LoRa微调, 特征级融合

Abstract: This paper proposes a fact prediction algorithm that integrates knowledge graph embedding with a large language mo-del,aiming to address the challenges of judging the authenticity of triples in the field of bidding.In view of the insufficient generalization ability of traditional fact prediction algorithms and the limitations of a single large language model in handling structured knowledge,this paper employs the TransR model to perform low-dimensional embedding representation of the entities and relationships extracted from bidding documents.At the same time,the Qwen 2.5-1.5 B large language model is utilized to extract text semantic features through LoRa fine-tuning,and a deep integration of the two types of information is achieved in the feature-level fusion module.The experiments are conducted on a real bidding dataset.The experimental results show that theproposed method achieves a precision of 86.4%,a recall rate of 93.2%,and an F1 score of 89.7% in the fact prediction task.Compared with traditional knowledge graph embedding algorithms,the F1 score is improved by 14 percentage points,and compared with the method of only fine-tuning the large language model,the F1 score is increased by 11.3 percentage points.

Key words: Knowled gegraph, Fact prediction, TransR, LoRa fine-tuning, Feature-level fusion

中图分类号: 

  • TP301
[1] LIU H Y,QU X L,SHEN Y K,et al.Research on Reasoning of Traditional Chinese Medicine Knowledge Graph [J/OL].[2025-04-02] .http://kns.cnki.net/kcms/detail/11.5699.R.20250307.2243.009.html.
[2] WANG S B.Research on the Evolution of Knowledge GraphsBased on Multimodal Large Models [J].China High-Tech,2025(2):25-27.
[3] SHEN M L,SHI Z C,GAO Y B,et al.Fact Verification Based on Collaborative Reasoning of Graph Embedding and Semantic Fusion [J/OL].[2025-04-02] .http://kns.cnki.net/kcms/detail/51.1307.TP.20240630.2146.002.html.
[4] ZHANG L.Current Situation,Problems and Suggestions ofStandardized Bidding for Engineering Construction Projects [J].Popular Standardization,2025(6):100-102.
[5] WANG L,ZHAO W,WEI Z,et al.SimKGC:Simple Contrastive Knowledge Graph Completion with Pre-trained Language Mo-dels[C]//Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics.Association for Computational Linguistics,2022:1-12.
[6] JIANG P,AGARWAL S,JIN B,et al.Text-Augmented OpenKnowledge Graph Completion via Pre-Trained Language Models[C]//Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing(EMNLP).Association for Computational Linguistics,2023:1-12.
[7] WANG H,ZHAO S,QIANG Z,et al.Knowledge-tuning Large Language Models with Structured Medical Knowledge Bases for Reliable Response Generation in Chinese[J].arXiv:2309.04175,2023.
[8] LV X,LIN Y,CAO Y,et al.Do Pre-trained Models BenefitKnowledge Graph Completion? A Reliable Evaluation and a Reasonable Approach[C]//Findings of the Association for Computational Linguistics(ACL 2022).IEEE Computer Society,2022:3570-3581.
[9] LI C K,XIE M Y,LÜ Q,et al.A Method for Extracting IFC-BIM Semantic Information Based on the TransE Model[J].Journal of Geo-Information Science,2025,27(6):1263-1274.
[10] DU X J,TAO Y Z,LI G L.Research on the development ofTrans series knowledge representation methods[J].Computer and Digital Engineering,2023,51(11):2515-2517.
[11] SUN Z,DENG Z,NIE J,et al.RotatE:Knowledge Graph Embedding by Relational Rotation in Complex Space[J].arXiv:1902.10197,2019.
[12] TROUILLON T,WELBL J,RIEDEL S,et al.Complex Embeddings for Simple Link Prediction[J].arXiv:1606.06357,2016.
[13] YAO L,PENG J Z,MAO C S,et al.Exploring Large Language Models for Knowledge Graph Completion[J].arXiv:2308.13916,2023.
[14] XU D,ZHANG Z,LIN Z,et al.Multi-perspective Improvement of Knowledge Graph Completion with Large Language Models[C]//Proceedings of the 2024 Joint International Conference on Computational Linguistics,Language Resources and Evaluation(LREC-COLING 2024).Torino,Italia:ELRA and ICCL,2024:11956-11968.
[15] ZHANG Y,CHEN Z,GUO L B,et al.Making Large Language Models Perform Better in Knowledge Graph Completion[C]//Findings of the Association for Computational Linguistics:ACL 2024.IEEE Computer Society,2024:1-12.
[16] SUN C,WANG H R,JING B X,et al.A Knowledge Reasoning Method Based on Hierarchical Reinforcement Learning [J].Application Research of Computers,2024,41(3):805-810.
[17] LIU C C,SANG L,LI W,et al.A Method for Completing Multivariate Relationship Knowledge Graphs Driven by Large Language Models [J].Computer Science,2025,52(1):94-101.
[18] LI J W,DENG Y D,CHEN B.Automatic Construction of Domain UML Models Based on Fine-tuned Qwen2[J].Computer Science,2025,52(S1):31-34.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!