Computer Science ›› 2020, Vol. 47 ›› Issue (4): 189-193.doi: 10.11896/jsjkx.190300024

• Artificial Intelligence • Previous Articles     Next Articles

Knowledge Graph Representation Based on Improved Vector Projection Distance

LI Xin-chao, LI Pei-feng, ZHU Qiao-ming   

  1. School of Computer Science and Technology,Soochow University,Suzhou,Jiangsu 215006,ChinaProvincial Key Laboratory for Computer Information Processing Technology,Suzhou,Jiangsu 215006,China
  • Received:2019-03-08 Online:2020-04-15 Published:2020-04-15
  • Contact: LI Pei-feng,born in 1971,Ph.D,professor,Ph.D supervisor,is a member of China Computer Federation.His main research interests include natural language processing and machine learning.
  • About author:LI Xin-chao,born in 1995,postgradua-te.His main research interests include natural language processing and representation learning.
  • Supported by:
    This work was supported by the National Natural Science Foundation of China(61836007,61772354,61773276).

Abstract: Representation learning is of great value in knowledge graph reasoning,which realizes the computability of knowledge by embedding entities and relationships into a low-dimensional space.The representation learning model based on vector projection distance has better ability of knowledge representation on complex relationships.However,the model is easily susceptible to irrelevant information,especially when dealing with one-to-one relationships,and it still has space to improve performance in representing one-to-many,many-to-one and many-to-many relationships.In this paper,we proposed an improved representation learning model SProjE,which introduces an adaptive metric method to reduce the weight of noise information and optimizes the loss function to improve the loss weight of complex relation triples.The proposed model is suitable for large scale knowledge graph representation learning.At last,the experimental results on the WN18 and FB15k data sets show that SProjE achieves significant and consistent improvements compared with the existing models and methods.

Key words: Adaptive metric, Entity link prediction, Knowledge graph, Representation learning

CLC Number: 

  • TP391.1
[1]BORDES A,WESTON J,USUNIER N.Open Question Answering with Weakly Supervised EmbeddingModels[J/OL].
[2014-04-16].https://arxiv.org/pdf/1404.4326.pdf.
[2]ZHENG Z,SI X,LI F,et al.Entity Disambiguation with Freebase[C]//2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.IEEE Computer Society,2012.
[3]DAIBER J,JAKOB M.Improving efficiency and accuracy inmultilingual entity extraction[C]//Proceedings of the 9th International Conference on Semantic Systems.ACM,2013:121-124.
[4]BERANT J,CHOU A,FROSTIG R,et al.Semantic parsing on freebase from question-answer pairs[C]//Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing.2013:1533-1544.
[5]WANG Q.Knowledge graph embedding:A survey of approaches and applications [J].IEEE Transactions on Knowledge and Data Engineering,2017,29(12):2724-2743.
[6]SHI B,WENINGER T.ProjE:Embedding Projection forKnowledge Graph Completion[C]// Proc of AAAI 2017.San Francisco:AAAI,2017:1236-1242.
[7]MIKOLOV T,SUTSKEVER I,CHEN,et al.Distributed representations of words and phrases and their compositionality[C]//Proc of NIPS 2013.Cambridge,MA:MIT Press,2013:3111-3119.
[8]BORDES A,USUNIER N,GARCIA-DURAN A,et al.Translating embeddings for modeling multi-relational data[C]//Proc of NIPS 2013.Cambridge,MA:MIT Press,2013:2787-2795.
[9]WANG Z,ZHANG J,FENG J,et al.Knowledge graph embedding by translating on hyperplanes[C]//Proc of AAAI 2014.Menlo Park,CA:AAAI,2014:1112-1119.
[10]LIN Y K,LIU Z Y,SUN M S,et al.LearingEntity and Relation Embeddings for Knowledge Graph Completion[C]//Proc of AAAI 2015.Menlo Park,CA:AAAI,2015:2181-2187.
[11]JI G,HE S,XU L,et al.Knowledge Graph Embedding viaDynamic Mapping Matrix[C]//Proc of ACL 2015.Beijing,China:ACL,2015:687-696.
[12]JI G,LIU K,HE S,et al.Knowledge Graph Completion withAdaptive Sparse Transfer Matrix[C]// Thirtieth Aaai Confe-rence on Artificial Intelligence.AAAI Press,2016.
[13]FAN M,QIANG Z,CHANG E,et al.Transition-based knowledge graph embedding with relational mapping properties[C]//Proc. of PACLIC.2014.
[14]XIAO H,HUANG M L,HAO Y,et al.TransA:An adaptiveapproach for knowledge graph embedding [J/OL].[2015-09-28].https://arxiv.org/pdf/1509.05490.pdf.
[15]NICKEL M,TRESP V,KRIEGEL H P.A Three-Way Modelfor Collective Learning on Multi-Relational Data[C]//Proc of ICML 2011.New York,USA:ACM,2011:809-816.
[16]BORDES A,GLOROT X,WESTON J,et al.A semantic matching energy function for learning with multi-relational data[J].Machine Learning,2014,94(2):233-259.
[17]SOCHER R,CHEN D,MANNING C D,et al.Reasoning with neural tensor networks for knowledge base completion[C]//Proc of NIPS 2013.Cambridge,MA:MIT Press,2013:926-934.
[18]BOLLACKER K,EVANS C,PARITOSH P,et al.Freebase:acollaboratively created graph database for structuring human knowledge[C]// Sigmod Conference.2008.
[19]KINGMA D,BA J.Adam:A method for stochastic optimization [J/OL].[2017-01-30].https://arxiv.org/pdf/1412.6980.pdf.
[20]BORDES A,WESTON J,COLLOBERT R,et al.Learningstructured embeddings of knowledge bases[C]//Proc. of AAAI 2011.Menlo Park,CA:AAAI,2011:301-306.
[1] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[2] WU Zi-yi, LI Shao-mei, JIANG Meng-han, ZHANG Jian-peng. Ontology Alignment Method Based on Self-attention [J]. Computer Science, 2022, 49(9): 215-220.
[3] KONG Shi-ming, FENG Yong, ZHANG Jia-yun. Multi-level Inheritance Influence Calculation and Generalization Based on Knowledge Graph [J]. Computer Science, 2022, 49(9): 221-227.
[4] SONG Jie, LIANG Mei-yu, XUE Zhe, DU Jun-ping, KOU Fei-fei. Scientific Paper Heterogeneous Graph Node Representation Learning Method Based onUnsupervised Clustering Level [J]. Computer Science, 2022, 49(9): 64-69.
[5] HUANG Li, ZHU Yan, LI Chun-ping. Author’s Academic Behavior Prediction Based on Heterogeneous Network Representation Learning [J]. Computer Science, 2022, 49(9): 76-82.
[6] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[7] LI Zong-min, ZHANG Yu-peng, LIU Yu-jie, LI Hua. Deformable Graph Convolutional Networks Based Point Cloud Representation Learning [J]. Computer Science, 2022, 49(8): 273-278.
[8] QIN Qi-qi, ZHANG Yue-qin, WANG Run-ze, ZHANG Ze-hua. Hierarchical Granulation Recommendation Method Based on Knowledge Graph [J]. Computer Science, 2022, 49(8): 64-69.
[9] WANG Jie, LI Xiao-nan, LI Guan-yu. Adaptive Attention-based Knowledge Graph Completion [J]. Computer Science, 2022, 49(7): 204-211.
[10] MA Rui-xin, LI Ze-yang, CHEN Zhi-kui, ZHAO Liang. Review of Reasoning on Knowledge Graph [J]. Computer Science, 2022, 49(6A): 74-85.
[11] DENG Kai, YANG Pin, LI Yi-zhou, YANG Xing, ZENG Fan-rui, ZHANG Zhen-yu. Fast and Transmissible Domain Knowledge Graph Construction Method [J]. Computer Science, 2022, 49(6A): 100-108.
[12] DU Xiao-ming, YUAN Qing-bo, YANG Fan, YAO Yi, JIANG Xiang. Construction of Named Entity Recognition Corpus in Field of Military Command and Control Support [J]. Computer Science, 2022, 49(6A): 133-139.
[13] HUANG Pu, DU Xu-ran, SHEN Yang-yang, YANG Zhang-jing. Face Recognition Based on Locality Regularized Double Linear Reconstruction Representation [J]. Computer Science, 2022, 49(6A): 407-411.
[14] XIONG Zhong-min, SHU Gui-wen, GUO Huai-yu. Graph Neural Network Recommendation Model Integrating User Preferences [J]. Computer Science, 2022, 49(6): 165-171.
[15] ZHONG Jiang, YIN Hong, ZHANG Jian. Academic Knowledge Graph-based Research for Auxiliary Innovation Technology [J]. Computer Science, 2022, 49(5): 194-199.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!