Computer Science ›› 2026, Vol. 53 ›› Issue (3): 331-340.doi: 10.11896/jsjkx.250200101

• Artificial Intelligence • Previous Articles     Next Articles

Embedding Model of Knowledge Graph via Jointly Modeling Ontology and Instances

QIN Jing, LI Guanfeng, CHEN Yuyin, XIAO Yuhang   

  1. School of Information Engineering, Ningxia University, Yinchuan 750021, China
    Ningxia Key Laboratory of Artificial Intelligence and Information Security for Channeling Computing Resources from the East to the West, Yinchuan 750021, China
  • Received:2025-02-25 Revised:2025-04-28 Published:2026-03-12
  • About author:QIN Jing,born in 2000,postgraduate,is a member of CCF(No.Y8902G).Her main research interest is knowledge graph embedding and reasoning.
    LI Guanfeng,born in 1979,Ph.D,associate professor,is a member of CCF(No.A0519M).His mian research interests include knowledge engineering and intelligent computing.
  • Supported by:
    Full-time Introduction of High-level Talent Research Start-up Project Foundation of Ningxia(2023BSB03066),Natural Science Foundation of Ningxia Province(2024AAC03098),National Natural Science Foundation of China (62066038) and 2025 Graduate Innovation Project of Ningxia University(CXXM2025-038).

Abstract: Knowledge graph embedding provides a more powerful knowledge representation input to machine learning models by projecting entities and relationships into a continuous low-dimensional vector space,thereby supporting more knowledge graph application scenarios.In recent years,researchers have tried to use the potential semantic information between ontology and instance in knowledge graph to enhance the embedding of knowledge graph.However,they fail to effectively integrate the hierarchical structure of concepts and the specific information of instances,and ignore the transitivity between isA relationships,resulting in limited performance and generalization ability of the models when dealing with long-tail entities in the knowledge graph.In order to solve the above shortcomings,this paper proposes a knowledge graph embedding model(Representation Learning of Knowledge Graph via Jointly Modeling Ontology and Instances,JMOI),which integrates ontology and instance.By introducing self-attention mechanism,this model captures the complex semantic relationship between concepts and instances,and adds a learnable parameter to adjust the neighborhood range of concept embedding,so as to distinguish the hierarchical information of diffe-rent concepts.The transitivity of isA relationship is modeled.Experimental results on the YAGO26K-906 and DB111K-174 datasets show that JMOI achieves the best performance in most cases compared with the prior art,with a maximum improvement of 6.5% in the link prediction Hits@1 and 6.9% in the Recall in triple classification compared with the suboptimal model.

Key words: Knowledge graph, Knowledge graph embedding, Concepts and instances, Link prediction, Triple classification

CLC Number: 

  • TP391.1
[1]LIANG K,MENG L,LIU M,et al.A survey of knowledgegraph reasoning on graph types:static,dynamic,and multi-modal[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2024(12):46.
[2]ZHENG Z,XU Y,LIU Y,et al.Distantly supervised relation extraction based on residual attention and self learning[J].Neural Processing Letters,2024,56(3):1-16.
[3]TIAN L,ZHOU X,WU Y,et al.Knowledge graph and know-ledge reasoning:A systematic review[J].Journal of Electronic Science and Technology,2022,20(2):159-186.
[4]WANG D,ZHOU S,HUANG J,et al.Triple alignment-en-hanced complex question answering over knowledge bases[J].Neurocomputing,2024,588:127709.
[5]LI Y,ZHU C.TransE-MTP:A new representation learningmethod for knowledge graph embedding with multi-translation principles andtransE[J].Electronics,2024,13(16):3171.
[6]ZHANG Z,GUAN Z,ZHANG F,et al.Weighted knowledgegraph embedding[C]//SIGIR’23:Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval.New York:ACM,2023:867-877.
[7]WANG S,FU K,SUN X,et al.Representation learning ofknowledge graphs with the interaction between entity types and relations[J].Neurocomputing,2022,508:305-314.
[8]WANG P,ZHOU J.JECI++:A modified joint knowledge graph embedding model for concepts and instances[J].Big Data Research,2020,24,100160.
[9]LYU L,HOU L,LIU Z.Differentiating concepts and instances for knowledge graph embedding[J].arXiv:1811.04588,2018.
[10]HAO J,CHEN M,YU W,et al.Universal representation lear-ning of knowledge bases by jointly embedding instances and ontological concepts[C]//KDD:ACM SIGKDD International Conference on Knowledge Discovery & Data Mining.New York:ACM,2019:1709-1719.
[11]BAI Y,WANG W,SUN Y.Dual-Geometric space embeddingmodel for two-view knowledge graphs[C]//KDD ’22:Procee-dings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining.New York:ACM,2022:5033-5041.
[12]ZHANG P,CHEN D,FANG Y,et al.CIST:Differentiating concepts and instances based on spatial transformation for know-ledge graph embedding[J].Mathematics,2022,10:1-18.
[13]HUANG Z,SUN Y,WANG W,et al.Concept2Box:joint geometric embeddings for learning two-view knowledge graphs[C]//ACL-Findings:Annual Meeting of the Association for Computational Linguistics.Association for Computational Linguistics,2023:10105-10118.
[14]LI Z,LIU X,WANG X,et al.TransO:a knowledge-driven representation learning method with ontology information constraints[J].World Wide Web,2023,26(1):297-319.
[15]WANG K,QI G,WU T,et al.Embedding ontologies via incorporating extensional and intensional knowledge[J].Data Intelligence,2024,6(2):175-190.
[16]MILLER G.WordNet:A lexical database for english[J].Communications of the ACM,1995,38:39-41.
[17]BORDES A,USUNIER N,GARCIA-DURAN A.et al.Translating embeddings for modeling multi-relational data[C]//NIPS:26th International Conference on Neural Information Processing Systems.Lake Tahoe,Nevada:MIT Press,2013:2787-2795.
[18]YANG B,YIH W,HE X,et al.Embedding entities and relations for learning and inference in knowledge bases[C]//ICLR:3rd International Conference on Learning Representations.San Diego,CA:Computational and Biological Learning Society,2015.
[19]NICKEL M,ROSASCO L,POGGIO T A.Holographic embeddings of knowledge graphs[J].arXiv:1510.04935,2015.
[20]WANG Z,ZHANG J,FENG J,et al.Knowledge graph embedding by translating on hyperplanes[C]//AAAI:Twenty-Eighth AAAI Conference on Artificial Intelligence.AAAI,2014:1112-1119.
[21]LIN Y,LIU Z,SUN M,et al.Learning entity and relation embeddings for knowledge graph completion[C]//AAAI:Twenty-Ninth AAAI Conference on Artificial Intelligence.AAAI,2015:2181-2187.
[22]JI G,HE S,XU L,et al.Knowledge graph embedding via dynamic mapping matrix[C]//ACL-IJCNLP:53rd Annual Mee-ting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing.Association for Computational Linguistics,2015:687-696.
[23]CHEN X J,XIANG Y.STransH:A revised translation-based model for knowledge representation[J].Computer Science,2019,46(9):184-189.
[24]BIN C,QIN S,RAO G,et al.Multiview translation learning for knowledge graph embedding[J].Scientific Programming,2020,2020:1-9.
[25]NICKEL M,TRESP V,KRIEGEL H P,et al.A three-way mo-del for collective learning on multi-relational data[C]//ICML:International Conference on Machine Learning.Bellevue,WA:ICML,2011:3104482-3104584.
[26]LIU Y,YAO Q,LI Y.Generalizing tensor decomposition for n-ary relational knowledge bases[C]//WWW:The Web Confe-rence.ACM,2020:1104-1114.
[27]DI S,YAO Q,CHEN L.Searching to sparsify tensor decomposition for nary relational data[C]//WWW:The Web Conference.ACM,2021:4043-4054.
[28]DETTMERS T,MINERVINI P,STENETORP P,et al.Convolutional 2d knowledge graph embeddings[C]//AAAI:Thirtieth AAAI Conferenceon Artificial Intelligence.AAAI,2018.
[29]NGUYEN D,NGUYEN T,NGUYEN D,et al.A Novel embedding model for knowledge base completion based on convolutional neural network[C]//NAACL-HLT:2018 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.Association for Computational Linguistics,2018:327-333.
[30]GUO L,SUN Z,HU W.Learning to exploit long-term relational dependencies in knowledge graphs[J].arXiv:1905.04914,2019.
[31]ZHANG X,ZHANG C,GUO J,et al.Graph attention network with dynamic representation of relations for knowledge graph completion[J].Expert Systems With Applications,2023,219:119616.
[32]XU H,BAO J,LIU W.Double-Branch multi-attention based graphneural network for knowledge graph completion[C]//ACL:61st Annual Meeting of the Association for Computatio-nal Linguistics.Association for Computational Linguistics,2023:15257-15271.
[33]LI X,TIAN Y,JI S.Semantic-and relation-based graph neural network for knowledge graph completion[J].Applied Intelligence,2024,54(8):6085-6107.
[34]WANG Z,LI J.Text-Enhanced representation learning forknowledge graph[C]//IJCAI:Twenty-Fifth International Joint Conference on Artificial Intelligence.New York:IJCAI,2016:1293-1299.
[35]GUAN N,SONG D,LIAO L.Knowledge graph embedding with concepts[J].Knowledge-Based Systems,2019,164:38-44.
[36]ZHANG J D,LI J.Knowledge graph embedding combining with hierarchical type information[J].Journal of Software,2022,33,3331-3346.
[1] DU Jiantong, GUAN Zeli, XUE Zhe. Multi-task Learning-based Ophthalmic Video Feature Fusion and Multi-dimensional Profiling [J]. Computer Science, 2026, 53(3): 383-391.
[2] CUI Mengtian, HE Liwen, XIE Qi, WANG Fang. Group Semantic-driven Hypergraph Network for Disinformation Detection with Fusion PropagationStructure [J]. Computer Science, 2026, 53(3): 88-96.
[3] ZHANG Jing, PAN Jinghao, JIANG Wenchao. Background Structure-aware Few-shot Knowledge Graph Completion [J]. Computer Science, 2026, 53(2): 331-341.
[4] XI Penghui, WU Xiazhen, JIANG Wencong, FANG Liangda, HE Chaobo, GUAN Quanlong. Review of Personalized Educational Resource Recommendations [J]. Computer Science, 2026, 53(2): 1-15.
[5] CHEN Yuyin, LI Guanfeng, QIN Jing, XIAO Yuhang. Survey on Complex Logical Query Methods in Knowledge Graphs [J]. Computer Science, 2026, 53(2): 273-288.
[6] CHEN Zhuangzhuang, DENG Yichen, YU Dunhui, XIAO Kui. Cross-language Knowledge Graph Entity Alignment Based on Meta-learning [J]. Computer Science, 2026, 53(1): 271-277.
[7] CAI Qihang, XU Bin, DONG Xiaodi. Knowledge Graph Completion Model Using Semantically Enhanced Prompts and Structural Information [J]. Computer Science, 2025, 52(9): 282-293.
[8] WANG Dongsheng. Multi-defendant Legal Judgment Prediction with Multi-turn LLM and Criminal Knowledge Graph [J]. Computer Science, 2025, 52(8): 308-316.
[9] HONG Xinran, MA Jun, WANG Jing, ZHANG Chuang, YU Jie, LI Xiaoling, ZHANG Xueyan, YANG Yajing. Survey on Research of Compatibility Issues in Operating System for Software Ecology Evolution [J]. Computer Science, 2025, 52(7): 1-12.
[10] LUO Xuyang, TAN Zhiyi. Knowledge-aware Graph Refinement Network for Recommendation [J]. Computer Science, 2025, 52(7): 103-109.
[11] LI Pengyan, WANG Baohui, YE Zihao. Study on Improvements of RippleNet Model Based on Representation Enhancement [J]. Computer Science, 2025, 52(6A): 240800142-9.
[12] SHI Enyi, CHANG Shuyu, CHEN Kejia, ZHANG Yang, HUANG Haiping. BiGCN-TL:Bipartite Graph Convolutional Neural Network Transformer Localization Model for Software Bug Partial Localization Scenarios [J]. Computer Science, 2025, 52(6A): 250200086-11.
[13] ZHENG Xinxin, CHEN Fan, SUN Baodan, GONG Jianguang, JIANG Junhui. Question Answering System for Soybean Planting Management Based on Knowledge Graph [J]. Computer Science, 2025, 52(6A): 240500025-8.
[14] HU Xin, DUAN Jiangli, HUANG Denan. Concept Cognition for Knowledge Graphs by Mining Double Granularity Concept Characteristics [J]. Computer Science, 2025, 52(6A): 240800047-6.
[15] GUO Xuan, HOU Jinlin, WANG Wenjun, JIAO Pengfei. Dynamic Link Prediction Method for Adaptively Modeling Network Dynamics [J]. Computer Science, 2025, 52(6): 118-128.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!