Computer Science ›› 2019, Vol. 46 ›› Issue (9): 184-189.doi: 10.11896/j.issn.1002-137X.2019.09.026

• Artificial Intelligence • Previous Articles     Next Articles

STransH:A Revised Translation-based Model for Knowledge Representation

CHEN Xiao-jun, XIANG Yang   

  1. (College of Electronic and Information Engineering,Tongji University,Shanghai 201804,China)
  • Received:2018-08-13 Online:2019-09-15 Published:2019-09-02

Abstract: Recently,representation learning technology represented by deep learning has attracted many attentions in natural language processing,computer vision and speech recognition.Representation learning aims to project the interested objects into a low-dimensional,dense and real-valued semantic space.To this end,a number of models and methods were proposed for knowledge embedding.Among them,TransE is a classic translation-based method with low model complexity,high computational efficiency and favorable knowledge representation ability.However,it has limitations in dealing with complex relations including reflexive,one-to-many,many-to-one and many-to-many relations.In light of this,this paper proposed a revised translation-based method for knowledge graph representation,namely STransH.In this method,firstly,entity and relation embeddings are built in separate entity space and relation space,and then the non-linear operation of single-layer network layer is adopted to enhance the semantic connection between entity and relation.Inspired by TransH,this paper introduced the relation-oriented hyperspace model,thus projecting head and tail entities to the hyperspace of a given relation for distinction.Besides,it also proposed a simple trick to improve the quality of negative triplets.At last,it conducted extensive experiments on link prediction and triplet classification on benchmark datasets like WordNet and Freebase.Experimental results show that STransH performs significant improvements over TransE and TransH compared with TransE and TransH,and its Hits@10 and triplet classification accuracy are increased by nearly 10% respectively.

Key words: Knowledge graph, Representation learning, Link prediction, Triplet classification

CLC Number: 

  • TP391
[1]MILLER G.Wordnet-a Lexical Database for English [J].Communications of the Acm,1995,38(11):39-41.
[2]BOLLACKER K,EVANS C,PARITOSH P,et al.Freebase:a collaboratively created graph database for structuring human knowledge[C]//Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data.New York:ACM,2008:1247-1250.
[3]BENGIO Y,COURVILLE A,VINCENT P.Representationlearning:a review and new perspectives [J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2013,35(8):1798-1828.
[4]MIKOLOV T,SUTSKEVER I,CHEN K,et al.DistributedRepresentations of Words and Phrases and their Compositionality [J].Advances in Neural Information Processing Systems,2013,26:3111-3119.
[5]BORDES A,WESTON J,COLLOBERT R,et al.LearningStructured Embeddings of Knowledge Bases[C]//Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence.Palo Alto:AAAI Press,2011:301-306.
[6]SOCHER R,CHEN D,MANNING C D,et al.Reasoning with neural tensor networks for knowledge base completion[C]//Neural Information Processing Systems 2013.Lake Tahoe:NIPS,2013:926-934.
[7]BORDES A,GLOROT X,WESTON J,et al.A semantic matching energy function for learning with multi-relational data [J].Machine Learning,2014,94(2):233-259.
[8]BORDES A,USUNIER N,GARCIA-DURAN A,et al.Translating Embeddings for Modeling Multi-relational Data[C]//Proceedings of Neural Information Processing Systems 2013.Massachusetts:MIT Press,2013:2787-2795.
[9]NGUYEN D Q,SIRTS K,QU L,et al.STransE:a novel embedding model of entities and relationships in knowledge bases[C]//Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics.San Diego:ACL,2016:460-466.
[10]WANG Z,ZHAN J,FENG J,et al.Knowledge graph embedding by translating on hyperplanes[C]//Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence.Palo Alto:AAAI Press,2014:1112-1119.
[11]JIANG T W,QIN B,LIU T.Open Domain Knowledge Reaso-ning for Chinese Based on Representation Learning[J].Journal of Chinese Information Processing,2018,32(2):34-41.(in Chinese)姜天文,秦兵,刘挺.基于表示学习的开放域中文知识推理 [J].中文信息学报,2018,32(2):34-41.
[12]LIN Y,LIU Z,ZHU X,et al.Learning entity and relation embeddings for knowledge graph completion[C]//Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence.Palo Alto:AAAI Press,2015:2181-2187.
[13]LIN Y,LIU Z,LUAN H,et al.Modeling Relation Paths forRepresentation Learning of Knowledge Bases[C]//Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing.Lisbon:ACL,2015:705-714.
[14]XIAO H,HUANG M,HAO Y,et al.TransA:An adaptive approach for knowledge graph embedding [J].arXiv:1509.05490,2015.
[15]JI G,HE S,XU L,et al.Knowledge graph embedding via dynamic mapping matrix[C]//Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing.Beijing:ACL,2015:687-696.
[16]JENATTON R,ROUXN L,BORDES A,et al.A latent factor model for highly multi-relational data[C]//Proceedings of Neural Information Processing Systems 2012.Massachusetts:MIT Press,2012:3167-3175.
[17]NICKEL M,TRESP V,KRIEGELH P.A Three-Way Model for Collective Learning on Multi-Relational Data[C]//Proceedings of the 28th International Conference on Machine Learning.New York:ACM,2011:809-816.
[18]AN B,HAN X P,SUN L,et al.Triple Classification Based on Synthesized Features for Knowledge Based[J].Journal of Chinese Information Processing,2016,30(6):84-89.(in Chinese)安波,韩先培,孙乐,等.基于分布式表示和多特征融合的知识库三元组分类 [J].中文信息学报,2016,30(6):84-89.
[1] DING Yu, WEI Hao, PAN Zhi-song, LIU Xin. Survey of Network Representation Learning [J]. Computer Science, 2020, 47(9): 52-59.
[2] WANG Hui, LE Zi-chun, GONG Xuan, WU Yu-kun, ZUO Hao. Review of Link Prediction Methods Based on Feature Classification [J]. Computer Science, 2020, 47(8): 302-312.
[3] JIANG Zong-li, LI Miao-miao, ZHANG Jin-li. Graph Convolution of Fusion Meta-path Based Heterogeneous Network Representation Learning [J]. Computer Science, 2020, 47(7): 231-235.
[4] HUANG Yi, SHEN Guo-wei, ZHAO Wen-bo, GUO Chun. Network Representation Learning Algorithm Based on Vulnerability Threat Schema [J]. Computer Science, 2020, 47(7): 292-298.
[5] BAI Xue, Nurbol and WANG Ya-dong. Map Analysis for Research Status and Development Trend on Network Security Situational Awareness [J]. Computer Science, 2020, 47(6A): 340-343.
[6] ZHANG Zhi-yang, ZHANG Feng-li, CHEN Xue-qin, WANG Rui-jin. Information Cascade Prediction Model Based on Hierarchical Attention [J]. Computer Science, 2020, 47(6): 201-209.
[7] FU Kun, QIU Qian, ZHAO Xiao-meng, GAO Jin-hui. Event Detection Method Based on Node Evolution Staged Optimization [J]. Computer Science, 2020, 47(5): 96-102.
[8] YUAN Rong, SONG Yu-rong, MENG Fan-rong. Link Prediction Method Based on Weighted Network Topology Weight [J]. Computer Science, 2020, 47(5): 265-270.
[9] LI Xin-chao, LI Pei-feng, ZHU Qiao-ming. Knowledge Graph Representation Based on Improved Vector Projection Distance [J]. Computer Science, 2020, 47(4): 189-193.
[10] MA Yang, CHENG Guang-quan, LIANG Xing-xing, LI Yan, YANG Yu-ling, LIU Zhong. Improved SDNE in Weighted Directed Network [J]. Computer Science, 2020, 47(4): 233-237.
[11] JIAN Song-lei, LU Kai. Survey on Representation Learning of Complex Heterogeneous Data [J]. Computer Science, 2020, 47(2): 1-9.
[12] LIU Miao-miao,HU Qing-cui,GUO Jing-feng,CHEN Jing. Survey of Link Prediction Algorithms in Signed Networks [J]. Computer Science, 2020, 47(2): 21-30.
[13] ZHANG Hu, ZHOU Jing-jing, GAO Hai-hui, WANG Xin. Network Representation Learning Method on Fusing Node Structure and Content [J]. Computer Science, 2020, 47(12): 119-124.
[14] XIANG Ying, FENG Jun, XIA Pei-pei, LU Jia-min. Extraction of Water Conservancy Spatial Relationship Words Based on Bootstrapping [J]. Computer Science, 2020, 47(12): 131-138.
[15] WANG Hui, LE Zi-chun, GONG Xuan, ZUO Hao, WU Yu-kun. TNTlink Prediction Model Based on Feature Learning [J]. Computer Science, 2020, 47(12): 245-251.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] LEI Li-hui and WANG Jing. Parallelization of LTL Model Checking Based on Possibility Measure[J]. Computer Science, 2018, 45(4): 71 -75 .
[2] SUN Qi, JIN Yan, HE Kun and XU Ling-xuan. Hybrid Evolutionary Algorithm for Solving Mixed Capacitated General Routing Problem[J]. Computer Science, 2018, 45(4): 76 -82 .
[3] ZHANG Jia-nan and XIAO Ming-yu. Approximation Algorithm for Weighted Mixed Domination Problem[J]. Computer Science, 2018, 45(4): 83 -88 .
[4] WU Jian-hui, HUANG Zhong-xiang, LI Wu, WU Jian-hui, PENG Xin and ZHANG Sheng. Robustness Optimization of Sequence Decision in Urban Road Construction[J]. Computer Science, 2018, 45(4): 89 -93 .
[5] SHI Wen-jun, WU Ji-gang and LUO Yu-chun. Fast and Efficient Scheduling Algorithms for Mobile Cloud Offloading[J]. Computer Science, 2018, 45(4): 94 -99 .
[6] ZHOU Yan-ping and YE Qiao-lin. L1-norm Distance Based Least Squares Twin Support Vector Machine[J]. Computer Science, 2018, 45(4): 100 -105 .
[7] LIU Bo-yi, TANG Xiang-yan and CHENG Jie-ren. Recognition Method for Corn Borer Based on Templates Matching in Muliple Growth Periods[J]. Computer Science, 2018, 45(4): 106 -111 .
[8] GENG Hai-jun, SHI Xin-gang, WANG Zhi-liang, YIN Xia and YIN Shao-ping. Energy-efficient Intra-domain Routing Algorithm Based on Directed Acyclic Graph[J]. Computer Science, 2018, 45(4): 112 -116 .
[9] CUI Qiong, LI Jian-hua, WANG Hong and NAN Ming-li. Resilience Analysis Model of Networked Command Information System Based on Node Repairability[J]. Computer Science, 2018, 45(4): 117 -121 .
[10] WANG Zhen-chao, HOU Huan-huan and LIAN Rui. Path Optimization Scheme for Restraining Degree of Disorder in CMT[J]. Computer Science, 2018, 45(4): 122 -125 .