Computer Science ›› 2019, Vol. 46 ›› Issue (9): 184-189.doi: 10.11896/j.issn.1002-137X.2019.09.026

• Artificial Intelligence • Previous Articles     Next Articles

STransH:A Revised Translation-based Model for Knowledge Representation

CHEN Xiao-jun, XIANG Yang   

  1. (College of Electronic and Information Engineering,Tongji University,Shanghai 201804,China)
  • Received:2018-08-13 Online:2019-09-15 Published:2019-09-02

Abstract: Recently,representation learning technology represented by deep learning has attracted many attentions in natural language processing,computer vision and speech recognition.Representation learning aims to project the interested objects into a low-dimensional,dense and real-valued semantic space.To this end,a number of models and methods were proposed for knowledge embedding.Among them,TransE is a classic translation-based method with low model complexity,high computational efficiency and favorable knowledge representation ability.However,it has limitations in dealing with complex relations including reflexive,one-to-many,many-to-one and many-to-many relations.In light of this,this paper proposed a revised translation-based method for knowledge graph representation,namely STransH.In this method,firstly,entity and relation embeddings are built in separate entity space and relation space,and then the non-linear operation of single-layer network layer is adopted to enhance the semantic connection between entity and relation.Inspired by TransH,this paper introduced the relation-oriented hyperspace model,thus projecting head and tail entities to the hyperspace of a given relation for distinction.Besides,it also proposed a simple trick to improve the quality of negative triplets.At last,it conducted extensive experiments on link prediction and triplet classification on benchmark datasets like WordNet and Freebase.Experimental results show that STransH performs significant improvements over TransE and TransH compared with TransE and TransH,and its Hits@10 and triplet classification accuracy are increased by nearly 10% respectively.

Key words: Knowledge graph, Link prediction, Representation learning, Triplet classification

CLC Number: 

  • TP391
[1]MILLER G.Wordnet-a Lexical Database for English [J].Communications of the Acm,1995,38(11):39-41.
[2]BOLLACKER K,EVANS C,PARITOSH P,et al.Freebase:a collaboratively created graph database for structuring human knowledge[C]//Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data.New York:ACM,2008:1247-1250.
[3]BENGIO Y,COURVILLE A,VINCENT P.Representationlearning:a review and new perspectives [J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2013,35(8):1798-1828.
[4]MIKOLOV T,SUTSKEVER I,CHEN K,et al.DistributedRepresentations of Words and Phrases and their Compositionality [J].Advances in Neural Information Processing Systems,2013,26:3111-3119.
[5]BORDES A,WESTON J,COLLOBERT R,et al.LearningStructured Embeddings of Knowledge Bases[C]//Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence.Palo Alto:AAAI Press,2011:301-306.
[6]SOCHER R,CHEN D,MANNING C D,et al.Reasoning with neural tensor networks for knowledge base completion[C]//Neural Information Processing Systems 2013.Lake Tahoe:NIPS,2013:926-934.
[7]BORDES A,GLOROT X,WESTON J,et al.A semantic matching energy function for learning with multi-relational data [J].Machine Learning,2014,94(2):233-259.
[8]BORDES A,USUNIER N,GARCIA-DURAN A,et al.Translating Embeddings for Modeling Multi-relational Data[C]//Proceedings of Neural Information Processing Systems 2013.Massachusetts:MIT Press,2013:2787-2795.
[9]NGUYEN D Q,SIRTS K,QU L,et al.STransE:a novel embedding model of entities and relationships in knowledge bases[C]//Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics.San Diego:ACL,2016:460-466.
[10]WANG Z,ZHAN J,FENG J,et al.Knowledge graph embedding by translating on hyperplanes[C]//Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence.Palo Alto:AAAI Press,2014:1112-1119.
[11]JIANG T W,QIN B,LIU T.Open Domain Knowledge Reaso-ning for Chinese Based on Representation Learning[J].Journal of Chinese Information Processing,2018,32(2):34-41.(in Chinese)姜天文,秦兵,刘挺.基于表示学习的开放域中文知识推理 [J].中文信息学报,2018,32(2):34-41.
[12]LIN Y,LIU Z,ZHU X,et al.Learning entity and relation embeddings for knowledge graph completion[C]//Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence.Palo Alto:AAAI Press,2015:2181-2187.
[13]LIN Y,LIU Z,LUAN H,et al.Modeling Relation Paths forRepresentation Learning of Knowledge Bases[C]//Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing.Lisbon:ACL,2015:705-714.
[14]XIAO H,HUANG M,HAO Y,et al.TransA:An adaptive approach for knowledge graph embedding [J].arXiv:1509.05490,2015.
[15]JI G,HE S,XU L,et al.Knowledge graph embedding via dynamic mapping matrix[C]//Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing.Beijing:ACL,2015:687-696.
[16]JENATTON R,ROUXN L,BORDES A,et al.A latent factor model for highly multi-relational data[C]//Proceedings of Neural Information Processing Systems 2012.Massachusetts:MIT Press,2012:3167-3175.
[17]NICKEL M,TRESP V,KRIEGELH P.A Three-Way Model for Collective Learning on Multi-Relational Data[C]//Proceedings of the 28th International Conference on Machine Learning.New York:ACM,2011:809-816.
[18]AN B,HAN X P,SUN L,et al.Triple Classification Based on Synthesized Features for Knowledge Based[J].Journal of Chinese Information Processing,2016,30(6):84-89.(in Chinese)安波,韩先培,孙乐,等.基于分布式表示和多特征融合的知识库三元组分类 [J].中文信息学报,2016,30(6):84-89.
[1] SONG Jie, LIANG Mei-yu, XUE Zhe, DU Jun-ping, KOU Fei-fei. Scientific Paper Heterogeneous Graph Node Representation Learning Method Based onUnsupervised Clustering Level [J]. Computer Science, 2022, 49(9): 64-69.
[2] HUANG Li, ZHU Yan, LI Chun-ping. Author’s Academic Behavior Prediction Based on Heterogeneous Network Representation Learning [J]. Computer Science, 2022, 49(9): 76-82.
[3] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[4] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[5] WU Zi-yi, LI Shao-mei, JIANG Meng-han, ZHANG Jian-peng. Ontology Alignment Method Based on Self-attention [J]. Computer Science, 2022, 49(9): 215-220.
[6] KONG Shi-ming, FENG Yong, ZHANG Jia-yun. Multi-level Inheritance Influence Calculation and Generalization Based on Knowledge Graph [J]. Computer Science, 2022, 49(9): 221-227.
[7] LI Zong-min, ZHANG Yu-peng, LIU Yu-jie, LI Hua. Deformable Graph Convolutional Networks Based Point Cloud Representation Learning [J]. Computer Science, 2022, 49(8): 273-278.
[8] QIN Qi-qi, ZHANG Yue-qin, WANG Run-ze, ZHANG Ze-hua. Hierarchical Granulation Recommendation Method Based on Knowledge Graph [J]. Computer Science, 2022, 49(8): 64-69.
[9] WANG Jie, LI Xiao-nan, LI Guan-yu. Adaptive Attention-based Knowledge Graph Completion [J]. Computer Science, 2022, 49(7): 204-211.
[10] HUANG Pu, DU Xu-ran, SHEN Yang-yang, YANG Zhang-jing. Face Recognition Based on Locality Regularized Double Linear Reconstruction Representation [J]. Computer Science, 2022, 49(6A): 407-411.
[11] MA Rui-xin, LI Ze-yang, CHEN Zhi-kui, ZHAO Liang. Review of Reasoning on Knowledge Graph [J]. Computer Science, 2022, 49(6A): 74-85.
[12] DENG Kai, YANG Pin, LI Yi-zhou, YANG Xing, ZENG Fan-rui, ZHANG Zhen-yu. Fast and Transmissible Domain Knowledge Graph Construction Method [J]. Computer Science, 2022, 49(6A): 100-108.
[13] DU Xiao-ming, YUAN Qing-bo, YANG Fan, YAO Yi, JIANG Xiang. Construction of Named Entity Recognition Corpus in Field of Military Command and Control Support [J]. Computer Science, 2022, 49(6A): 133-139.
[14] XIONG Zhong-min, SHU Gui-wen, GUO Huai-yu. Graph Neural Network Recommendation Model Integrating User Preferences [J]. Computer Science, 2022, 49(6): 165-171.
[15] ZHONG Jiang, YIN Hong, ZHANG Jian. Academic Knowledge Graph-based Research for Auxiliary Innovation Technology [J]. Computer Science, 2022, 49(5): 194-199.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!