计算机科学 ›› 2021, Vol. 48 ›› Issue (5): 225-231.doi: 10.11896/jsjkx.200300093

• 人工智能 • 上一篇    下一篇

四元数关系旋转的知识图谱补全模型

陈恒1,2, 王维美1, 李冠宇1, 史一民1   

  1. 1 大连海事大学信息科学技术学院 辽宁 大连116026
    2 大连外国语大学语言智能研究中心 辽宁 大连 116044
  • 收稿日期:2020-03-16 修回日期:2020-07-08 出版日期:2021-05-15 发布日期:2021-05-09
  • 通讯作者: 李冠宇(rabitlee@163.com)
  • 基金资助:
    国家自然科学基金项目(61976032,61806038,61602076,61702072);辽宁省高等学校基本科研项目(2017JYT09);大连外国语大学科研创新团队(2016CXTD06)

Knowledge Graph Completion Model Using Quaternion as Relational Rotation

CHEN Heng1,2, WANG Wei-mei1, LI Guan-yu1, SHI Yi-ming1   

  1. 1 Faculty of Information Science & Technology,Dalian Maritime University,Dalian,Liaoning 116026,China
    2 Research Center for Language Intelligence,Dalian University of Foreign Languages,Dalian,Liaoning 116044,China
  • Received:2020-03-16 Revised:2020-07-08 Online:2021-05-15 Published:2021-05-09
  • About author:CHEN Heng,born in 1982,Ph.D,asso-ciate professor.His main research in-terests include intelligent information processing and so on.(chenheng@dlufl.edu.cn)
    LI Guan-yu,born in 1963,Ph.D,professor.His main research interests include intelligent information processing and so on.
  • Supported by:
    National Natural Science Foundation of China(61976032,61806038,61602076,61702072),Basic Scientific Research Projects of Liaoning University(2017JYT09) and Research and Innovation Team of Dalian University of Foreign Languages(2016CXTD06).

摘要: 知识图谱是真实世界三元组的结构化表示,通常三元组被表示成头实体、关系、尾实体的形式。针对知识图谱中广泛存在的数据稀疏问题,提出了一种将四元数作为关系旋转的知识图谱补全方法。文中使用极具表现力的超复数表示对实体和关系进行建模,以进行链接预测。这种超复数嵌入用于表示实体,关系则被建模为四元数空间中的旋转。具体来说,将每个关系定义为超复数空间中头实体到尾实体的旋转,用于推理和建模各种关系模式,包括对称/反对称、反转和组合。在公开的数据集WN18RR和FB15K-237上进行相关的链接预测实验,实验结果表明,在WN18RR数据集中,其平均倒数排名(Mean Reciprocal Rank,MRR)比RotatE的提高了4.6%,其Hit@10比RotatE的提高了1.7%;在FB15K-237数据集中,其平均倒数排名比RotatE的提高了5.6%,其Hit@3比RotatE的提高了1.4%。该实验证明,使用四元数作为关系旋转的知识图谱补全方法可以有效提高三元组预测精度。

关键词: 超复数表示, 链接预测, 四元数, 知识图谱, 知识图谱补全

Abstract: Knowledge graph is a structured representation of real-world triples.Typically,triples are represented in the form of head entity,relationship entity and tail entity.Aiming at the data sparse problem widely existing in knowledge graph,this paper proposes a knowledge graph completion method using quaternions as relational rotation.In this paper,we model entities and relations in the expressive hyper-complex representations for link prediction.This hyper-complex embedding is used to represent entities,and relations are modelled as rotations in quaternion space.Specifically,we define each relation as a rotation from the head entity to the tail entity in the hyper-complex space,which could be used to infer and model diverse relation patterns,including symmetry/anti-symmetry,reversal and combination.In the experiment,the public datasets WN18RR and FB15K-237 are used for the related link prediction experiment.Experimental results show that on the WN18RR dataset,its mean reciprocal rank (MRR) is 4.6% higher than RotatE,and its Hit@10 is 1.7% higher than RotatE.On the FB15K-237 dataset,its MRR is 5.6% higher than RotatE,its Hit@3 is 1.4% higher than RotatE.Experiments show that the knowledge graph completion method using quaternions as relational rotation can effectively improve the prediction accuracy of triples.

Key words: Hyper-complex representation, Knowledge graph, Knowledge graph completion, Link prediction, Quaternion

中图分类号: 

  • TP181
[1]SUCHANEK F M,KASNECI G,WEIKUM G.Yago:a core of semantic knowledge[C]//Proceedings of the 16th International Conference on World Wide Web.2007:697-706.
[2]BOLLACKER K,EVANS C,PARITOSH P,et al.Freebase:acollaboratively created graph database for structuring human knowledge[C]//Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data.2008:1247-1250.
[3]LEHMANN J,ISELE R,JAKOB M,et al.DBpedia-a large-scale,multilingual knowledge base extracted from Wikipedia[J].Semantic Web,2015,6(2):167-195.
[4]ZHANG F,YUAN N J,LIAN D,et al.Collaborative knowledge base embedding for recommender systems[C]//Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.2016:353-362.
[5]HAO Y,ZHANG Y,LIU K,et al.An end-to-end model forquestion answering over knowledge base with cross-attention combining global knowledge[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1:Long Papers).2017:221-231.
[6]XIONG C,POWER R,CALLAN J.Explicit semantic rankingfor academic search via knowledge graph embedding[C]//Proceedings of the 26th International Conference on World Wide Web.2017:1271-1279.
[7]YANG B,MITCHELL T.Leveraging knowledge bases in lstms for improving machine reading[J].arXiv:1902.09091,2019.
[8]WANG W M,SHI Y M,LI G Y.Improved capsule networkknowledge graph completion method[J/OL].Computer Engineering:1-7.[2020-03-13].https://doi.org/10.19678/j.issn.1000-3428.0055 390.
[9]LI Z X,REN S Y,WANG H M,et al.Knowledge inference method based on unstructured text enhanced association rules[J].Computer Science,2019,46(11):209-215.
[10]SOCHER R,CHEN D,MANNING C D,et al.Reasoning with neural tensor networks for knowledge base completion[C]//Advances in Neural Information Processing Systems.2013:926-934.
[11]WEST R,GABRILOVICH E,MURPHYK,et al.Knowledgebase completion via search-based question answering[C]//Proceedings of the 23rd International Conference on World Wide Web.ACM,2014:515-526.
[12]BORDES A,USUNIER N,GARCIA-DURAN A,et al.Translating embeddings for modeling multi-relational data[C]//Processings of the NIPS.Cambridge,MA:MIT Press,2013:2787-2795.
[13]WANG Z,ZHANG J,FENG J,et al.Knowledge graph embedding by translating on hyperplanes[C]//Processings of the AAAI.Menlo Park,CA:AAAI,2014:1112-1119.
[14]LIN Y,LIU Z,SUN M,et al.Learning entity and relation embeddings for knowledge graph completion[C]//Processings of the AAAI.Menlo Park,CA:AAAI,2014:2181-2187.
[15]WANG Q,MAO Z,WANG B,et al.Knowledge graph embedding:A survey of approaches and applications[J].IEEE Transactions on Knowledge and Data Engineering,2017,29(12):2724-2743.
[16]SUN Z,DENG Z H,NIE J Y,et al.Rotate:Knowledge graph embedding by relational rotation in complex space[J].arXiv:1902.10197,2019.
[17]BORDES A,WESTON J,COLLOBERT R,et al.Learningstructured embeddings of knowledge bases[C]//National Conference on Artificial Intelligence.2011:301-306.
[18]MBORDES A,GLOROT X,WESTON J,et al.A semanticmatching energy function for learning with multi-relational data[J].Neural Information Processing Systems,2014,94(2):233-259.
[19]MIKOLOV T,SUTSKEVER I,CHEN K,et al.Distributed representations of words and phrases and their compositionality[C]//Advances in Neural Information Processing Systems.2013:3111-3119.
[20]JI G,HE S,XU L,et al.Knowledge graph embedding via dynamic mapping matrix[C]//Processings of the ACL.Stroudsburg,PA:ACL,2015:687-696.
[21]YANG B,YIH W,HE X,et al.Embedding entities and rela-tions for learning and inference in knowledge bases[J].arXiv:1412.6575,2014.
[22]TROUILLON T,WELBL J,RIEDEL S,et al.Complex embeddings for simple link prediction[C]//International Conference on Machine Learning.2016:2071-2080.
[23]ZHANG S,TAY Y,YAO L,et al.Quaternion knowledge graph embeddings[C]//Advances in Neural Information Processing Systems.2019:2735-2745.
[24]LIN H L,WANG Y Z,JIAY T,et al.Overview of knowledge fusion methods for network big data [J].Journal of Computer,2017,40(1):1-27.
[25]GUAN S P,JIN X L,JIA Y T,et al.Research progress ofknowledge reasoning for knowledge graph [J].Journal of Software,2018,29(10):2966-2994.
[26]TOUTANOVA K,CHEN D.Observed Versus Latent Features for Knowledge Base and Text Inference[C]//Proceedings of the 3rd Workshop on Continuous Vector Space Models and their Compositionality.2015:57-66.
[27]DETTMERS T,MINERVINI P,STENETORP P,et al.Convolutional 2D knowledge graph embeddings[C]//Processings of the AAAI.2018:1811-1818.
[28]KINGMA D P,BA J.Adam:A method for stochastic optimization[J].arXiv:1412.6980,2014.
[29]NICKEL M,ROSASCO L,POGGIO T A.Holographic embeddings of knowledge graphs[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2016:1955-1961.
[30]KADLEC R,BAJGAR O,KLEINDIENST J.Knowledge base completion:Baselines strike back[J].arXiv:1705.10744,2017.
[31]NGUYEN D Q,NGUYEN T D,NGUYEN D Q,et al.A novel embedding model for knowledge base completion based on convolutional neural network[J].arXiv:1712.02121,2017.
[1] 宋杰, 梁美玉, 薛哲, 杜军平, 寇菲菲.
基于无监督集群级的科技论文异质图节点表示学习方法
Scientific Paper Heterogeneous Graph Node Representation Learning Method Based onUnsupervised Clustering Level
计算机科学, 2022, 49(9): 64-69. https://doi.org/10.11896/jsjkx.220500196
[2] 黄丽, 朱焱, 李春平.
基于异构网络表征学习的作者学术行为预测
Author’s Academic Behavior Prediction Based on Heterogeneous Network Representation Learning
计算机科学, 2022, 49(9): 76-82. https://doi.org/10.11896/jsjkx.210900078
[3] 徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺.
时序知识图谱表示学习
Temporal Knowledge Graph Representation Learning
计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[4] 饶志双, 贾真, 张凡, 李天瑞.
基于Key-Value关联记忆网络的知识图谱问答方法
Key-Value Relational Memory Networks for Question Answering over Knowledge Graph
计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[5] 吴子仪, 李邵梅, 姜梦函, 张建朋.
基于自注意力模型的本体对齐方法
Ontology Alignment Method Based on Self-attention
计算机科学, 2022, 49(9): 215-220. https://doi.org/10.11896/jsjkx.210700190
[6] 孔世明, 冯永, 张嘉云.
融合知识图谱的多层次传承影响力计算与泛化研究
Multi-level Inheritance Influence Calculation and Generalization Based on Knowledge Graph
计算机科学, 2022, 49(9): 221-227. https://doi.org/10.11896/jsjkx.210700144
[7] 秦琪琦, 张月琴, 王润泽, 张泽华.
基于知识图谱的层次粒化推荐方法
Hierarchical Granulation Recommendation Method Based on Knowledge Graph
计算机科学, 2022, 49(8): 64-69. https://doi.org/10.11896/jsjkx.210600111
[8] 王杰, 李晓楠, 李冠宇.
基于自适应注意力机制的知识图谱补全算法
Adaptive Attention-based Knowledge Graph Completion
计算机科学, 2022, 49(7): 204-211. https://doi.org/10.11896/jsjkx.210400129
[9] 马瑞新, 李泽阳, 陈志奎, 赵亮.
知识图谱推理研究综述
Review of Reasoning on Knowledge Graph
计算机科学, 2022, 49(6A): 74-85. https://doi.org/10.11896/jsjkx.210100122
[10] 邓凯, 杨频, 李益洲, 杨星, 曾凡瑞, 张振毓.
一种可快速迁移的领域知识图谱构建方法
Fast and Transmissible Domain Knowledge Graph Construction Method
计算机科学, 2022, 49(6A): 100-108. https://doi.org/10.11896/jsjkx.210900018
[11] 杜晓明, 袁清波, 杨帆, 姚奕, 蒋祥.
军事指控保障领域命名实体识别语料库的构建
Construction of Named Entity Recognition Corpus in Field of Military Command and Control Support
计算机科学, 2022, 49(6A): 133-139. https://doi.org/10.11896/jsjkx.210400132
[12] 熊中敏, 舒贵文, 郭怀宇.
融合用户偏好的图神经网络推荐模型
Graph Neural Network Recommendation Model Integrating User Preferences
计算机科学, 2022, 49(6): 165-171. https://doi.org/10.11896/jsjkx.210400276
[13] 钟将, 尹红, 张剑.
基于学术知识图谱的辅助创新技术研究
Academic Knowledge Graph-based Research for Auxiliary Innovation Technology
计算机科学, 2022, 49(5): 194-199. https://doi.org/10.11896/jsjkx.210400195
[14] 朱敏, 梁朝晖, 姚林, 王翔坤, 曹梦琦.
学术引用信息可视化方法综述
Survey of Visualization Methods on Academic Citation Information
计算机科学, 2022, 49(4): 88-99. https://doi.org/10.11896/jsjkx.210300219
[15] 梁静茹, 鄂海红, 宋美娜.
基于属性图模型的领域知识图谱构建方法
Method of Domain Knowledge Graph Construction Based on Property Graph Model
计算机科学, 2022, 49(2): 174-181. https://doi.org/10.11896/jsjkx.210500076
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!