Computer Science ›› 2026, Vol. 53 ›› Issue (6A): 250600055-5.doi: 10.11896/jsjkx.250600055

• Artificial Intelligence • Previous Articles     Next Articles

Research on Fact Prediction by Integrating Knowledge Graph Embeddings and Large Models

YANG Hua, WANG Baohui   

  1. School of Software,Beihang University,Beijing 100191,China
  • Online:2026-06-16 Published:2026-06-12
  • About author:YANG Hua,born in 1997,postgraduate.Her main research interests include na-tural language processing and deep learning.
    WANG Baohui,born in 1973,professor,master's supervisor.His main research interests include software architecture,big data,artificial intelligence,etc.

Abstract: This paper proposes a fact prediction algorithm that integrates knowledge graph embedding with a large language mo-del,aiming to address the challenges of judging the authenticity of triples in the field of bidding.In view of the insufficient generalization ability of traditional fact prediction algorithms and the limitations of a single large language model in handling structured knowledge,this paper employs the TransR model to perform low-dimensional embedding representation of the entities and relationships extracted from bidding documents.At the same time,the Qwen 2.5-1.5 B large language model is utilized to extract text semantic features through LoRa fine-tuning,and a deep integration of the two types of information is achieved in the feature-level fusion module.The experiments are conducted on a real bidding dataset.The experimental results show that theproposed method achieves a precision of 86.4%,a recall rate of 93.2%,and an F1 score of 89.7% in the fact prediction task.Compared with traditional knowledge graph embedding algorithms,the F1 score is improved by 14 percentage points,and compared with the method of only fine-tuning the large language model,the F1 score is increased by 11.3 percentage points.

Key words: Knowled gegraph, Fact prediction, TransR, LoRa fine-tuning, Feature-level fusion

CLC Number: 

  • TP301
[1] LIU H Y,QU X L,SHEN Y K,et al.Research on Reasoning of Traditional Chinese Medicine Knowledge Graph [J/OL].[2025-04-02] .http://kns.cnki.net/kcms/detail/11.5699.R.20250307.2243.009.html.
[2] WANG S B.Research on the Evolution of Knowledge GraphsBased on Multimodal Large Models [J].China High-Tech,2025(2):25-27.
[3] SHEN M L,SHI Z C,GAO Y B,et al.Fact Verification Based on Collaborative Reasoning of Graph Embedding and Semantic Fusion [J/OL].[2025-04-02] .http://kns.cnki.net/kcms/detail/51.1307.TP.20240630.2146.002.html.
[4] ZHANG L.Current Situation,Problems and Suggestions ofStandardized Bidding for Engineering Construction Projects [J].Popular Standardization,2025(6):100-102.
[5] WANG L,ZHAO W,WEI Z,et al.SimKGC:Simple Contrastive Knowledge Graph Completion with Pre-trained Language Mo-dels[C]//Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics.Association for Computational Linguistics,2022:1-12.
[6] JIANG P,AGARWAL S,JIN B,et al.Text-Augmented OpenKnowledge Graph Completion via Pre-Trained Language Models[C]//Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing(EMNLP).Association for Computational Linguistics,2023:1-12.
[7] WANG H,ZHAO S,QIANG Z,et al.Knowledge-tuning Large Language Models with Structured Medical Knowledge Bases for Reliable Response Generation in Chinese[J].arXiv:2309.04175,2023.
[8] LV X,LIN Y,CAO Y,et al.Do Pre-trained Models BenefitKnowledge Graph Completion? A Reliable Evaluation and a Reasonable Approach[C]//Findings of the Association for Computational Linguistics(ACL 2022).IEEE Computer Society,2022:3570-3581.
[9] LI C K,XIE M Y,LÜ Q,et al.A Method for Extracting IFC-BIM Semantic Information Based on the TransE Model[J].Journal of Geo-Information Science,2025,27(6):1263-1274.
[10] DU X J,TAO Y Z,LI G L.Research on the development ofTrans series knowledge representation methods[J].Computer and Digital Engineering,2023,51(11):2515-2517.
[11] SUN Z,DENG Z,NIE J,et al.RotatE:Knowledge Graph Embedding by Relational Rotation in Complex Space[J].arXiv:1902.10197,2019.
[12] TROUILLON T,WELBL J,RIEDEL S,et al.Complex Embeddings for Simple Link Prediction[J].arXiv:1606.06357,2016.
[13] YAO L,PENG J Z,MAO C S,et al.Exploring Large Language Models for Knowledge Graph Completion[J].arXiv:2308.13916,2023.
[14] XU D,ZHANG Z,LIN Z,et al.Multi-perspective Improvement of Knowledge Graph Completion with Large Language Models[C]//Proceedings of the 2024 Joint International Conference on Computational Linguistics,Language Resources and Evaluation(LREC-COLING 2024).Torino,Italia:ELRA and ICCL,2024:11956-11968.
[15] ZHANG Y,CHEN Z,GUO L B,et al.Making Large Language Models Perform Better in Knowledge Graph Completion[C]//Findings of the Association for Computational Linguistics:ACL 2024.IEEE Computer Society,2024:1-12.
[16] SUN C,WANG H R,JING B X,et al.A Knowledge Reasoning Method Based on Hierarchical Reinforcement Learning [J].Application Research of Computers,2024,41(3):805-810.
[17] LIU C C,SANG L,LI W,et al.A Method for Completing Multivariate Relationship Knowledge Graphs Driven by Large Language Models [J].Computer Science,2025,52(1):94-101.
[18] LI J W,DENG Y D,CHEN B.Automatic Construction of Domain UML Models Based on Fine-tuned Qwen2[J].Computer Science,2025,52(S1):31-34.
[1] YANG Yahui, WANG Yong. Sparse Graph Generation Method for the Traveling Salesman Problem Based on Frequency Graphs [J]. Computer Science, 2026, 53(6A): 250300087-7.
[2] WANG Dezhi, CHENG Kun. Collaborative Scheduling Strategies for Superconducting Quantum Processors and Heterogeneous Computing Systems [J]. Computer Science, 2026, 53(6A): 250600165-5.
[3] LYU Qingguo, HE Chenglong, HU Hanqing, ZHANG Wei, DAI Xiangguang, ZHANG Keke, GUAN Mingyu. Variance-reduced Distributed Stochastic Compositional Optimization Algorithm over Directed Networks [J]. Computer Science, 2026, 53(6A): 250700050-10.
[4] FU Shiqi, ZHU Jinxia, XU Qichen, DU Zeyu. Dynamic Sparsity and Heterogeneous Knowledge Distillation for Top-k Recommendation [J]. Computer Science, 2026, 53(6A): 250700121-9.
[5] JIN Kehan, JIA Riheng. Research on Cooperative Trajectory Optimization of Multi-truck-UAV System Based on UAV Exchange [J]. Computer Science, 2026, 53(6A): 250900105-9.
[6] SUN Xiaoxue, JIA Haipeng, ZHANG Yunquan, YU Yue, QIN Pinle. GPU-based Implementation and Optimization of Banded Matrix LU Factorization [J]. Computer Science, 2026, 53(6): 117-127.
[7] WANG Pan, WANG Ji, ZHONG Zhengyi, BAO Weidong, ZHANG Yaohong. Lightweight Federated Continual Learning Method Based on Double Anti-forgetting Mechanism [J]. Computer Science, 2026, 53(4): 424-434.
[8] YANG Changhao, QIN Jin, WANG Hao. Large-scale Multi-objective Evolutionary Algorithm Based on Objective Similarity and Dual-EndVariable Guided Search [J]. Computer Science, 2026, 53(3): 351-365.
[9] YAO Jia, LI Dongdong, WANG Zhe. Multi-task Speech Emotion Recognition Incorporating Gender Information [J]. Computer Science, 2026, 53(1): 180-186.
[10] FAN Jiabin, WANG Baohui, CHEN Jixuan. Method for Symbol Detection in Substation Layout Diagrams Based on Text-Image MultimodalFusion [J]. Computer Science, 2026, 53(1): 206-215.
[11] XIE Wenlin, DU Ming, ZHOU Junfeng. PIEnum:Efficient Algorithm of Path Enumeration on Large Uncertain Graphs [J]. Computer Science, 2025, 52(12): 115-124.
[12] WANG Xianglong, WANG Yisong, XIE Zhongtao. Complexities of Logic Programs with Convex Aggregates [J]. Computer Science, 2025, 52(12): 209-214.
[13] WANG Xinwei, FENG Feng. Multi-strategy Improved Electric Eel Foraging Optimization Algorithm [J]. Computer Science, 2025, 52(11): 245-254.
[14] YANG Hua, WANG Baohui. Bidding Document Named Entity Recognition Algorithm Based on Multi-head Attention Mechanism and Dictionary Feature Fusion [J]. Computer Science, 2025, 52(11A): 241000154-6.
[15] LI Pengyan, WANG Baohui. Knowledge Graph Completion Model Based on Multi-semantic Extraction [J]. Computer Science, 2025, 52(11A): 241200012-7.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!