Computer Science ›› 2024, Vol. 51 ›› Issue (3): 235-243.doi: 10.11896/jsjkx.221200097

• Artificial Intelligence • Previous Articles     Next Articles

TMGAT:Graph Attention Network with Type Matching Constraint

SUN Shounan, WANG Jingbin, WU Renfei, YOU Changkai, KE Xifan, HUANG Hao   

  1. College of Computer and Data Science,Fuzhou University,Fuzhou 350108,China
  • Received:2022-12-14 Revised:2023-04-13 Online:2024-03-15 Published:2024-03-13
  • About author:SUN Shounan,born in 1998,postgra-duate.His main research interests include knowledge graph,relation rea-soning and knowledge representation.WANG Jingbin,born in 1973,master,professor,is a member of CCF(No.25996M).Her main research interests include knowledge graph,relation reasoning,distributed data management and knowledge repesentation.
  • Supported by:
    National Natural Science Foundation of China(61672159) and Natural Science Foundation of Fujian Province,China(2021J01619).

Abstract: The graph structure has recently been employed to solve the KGC problem of knowledge graph completion.The graph neural network(GNNs) constantly updates the representation of the central entity by aggregating the entity's local neighborhood information,whereas the graph attention network(GATs) focuses on aggregating the neighbors to obtain a more accurate representation of the central entity by using the attention mechanism.Although these models performed well in KGC,they all neglect the central entity's type information and only use neighborhood information to calculate attention,resulting in inaccurately mea-sured attention.This paper proposes a type-matching constrained graph attention network(TMGAT) to address these issues.The entity type-relation level of attention is derived by calculating the attention of the central entity type to each neighborhood relationship,and the type matching degree between the central entity and each neighborhood connection is further determined.The entity-relation level attention is then determined by combining the type matching degree through the neighborhood relation and the corresponding neighbor entity,and the final attention of the neighborhood node to the central entity is obtained.The type matching degree is utilized to constrain the traditional attention mechanism,increase attention mechanism accuracy,obtain more accurate central entity embedding,and subsequently improve knowledge graph completion accuracy.The proposed TMGAT is the first model of knowledge graph completion task combined with explicit type in GATs up to this point.To validate the TMGAT model's performance,two existing data sets are processed so that each entity in the data set has several types.Finally,experiment demonstrates TMGAT's high competitiveness in knowledge completion tasks and the effect of the number of types on the model's performance analyzed.

Key words: Knowledge graph, Knowledge graph completion, Graph structure, Graph attention mechanism, Type infomation

CLC Number: 

  • TP391
[1]BOLLACKER K,EVANS C,PARITOSH P,et al.Freebase:a collaboratively created graph database for structuring human knowledge[C]//Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data.2008:1247-1250.
[2]MILLER G A.WordNet:a lexical database for English[J].Communications of the ACM,1995,38(11):39-41.
[3]SUCHANEK F M,KASNECI G,WEIKUM G.Yago:a core of semantic knowledge[C]//Proceedings of the 16th International Conference on World Wide Web.2007:697-706.
[4]AUER S,BIZER C,KOBILAROV G,et al.Dbpedia:A nucleus for a web of open data[M]//The Semantic Web.Berlin,Heidelberg:Springer,2007:722-735.
[5]BORDES A,CHOPRA S,WESTON J.Question answering with subgraph embeddings[J].arXiv:1406.3676,2014.
[6]ZHANG F,YUAN N J,LIAN D,et al.Collaborative knowledge base embedding for recommender systems[C]//Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.2016:353-362.
[7]SCHLICHTKRULL M,KIPF T N,BLOEM P,et al.Modeling relational data with graph convolutional networks[C]//Euro-pean Semantic Web Conference.Cham:Springer,2018:593-607.
[8]XIE R,LIU Z,SUN M.Representation Learning of Knowledge Graphs with Hierarchical Types[C]//IJCAI.2016:2965-2971.
[9]MA S,DING J,JIA W,et al.Transt:Type-based multiple embedding representations for knowledge graph completion[C]//Joint European Conference on Machine Learning and Knowledge Discovery in Databases.Cham:Springer,2017:717-733.
[10]HAO J,CHEN M,YU W,et al.Universal representation lear-ning of knowledge bases by jointly embedding instances and ontological concepts[C]//Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mi-ning.2019:1709-1719.
[11]JAIN P,KUMAR P,CHAKRABARTI S.Type-sensitive know-ledge base inference without explicit typesupervision[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics(Volume 2:Short Papers).2018:75-80.
[12]NIU G,LI B,ZHANG Y,et al.AutoETER:Automated entitytype representation for knowledge graph embedding[J].arXiv:2009.12030,2020.
[13]DETTMERS T,MINERVINI P,STENETORP P,et al.Convolutional 2d knowledge graph embeddings[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2018.
[14]BORDES A,USUNIER N,GARCIA-DURAN A,et al.Translating embeddings for modeling multi-relational data[J].Advances in Neural Information Processing Systems,2013,26(2):2787-2795.
[15]WANG Z,ZHANG J,FENG J,et al.Knowledge graph embedding by translating on hyperplanes[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2014.
[16]SUN Z,DENG Z H,NIE J Y,et al.Rotate:Knowledge graph embedding by relational rotation in complex space[J].arXiv:1902.10197,2019.
[17]NICKEL M,TRESP V,KRIEGEL H P.A three-way model for collective learning on multi-relational data[C]//ICML.2011.
[18]YANG B,YIH W,HE X,et al.Embedding entities and relations for learning and inferencein knowledge bases[J].arXiv:1412.6575,2014.
[19]TROUILLON T,WELBL J,RIEDEL S,et al.Complex embeddings for simple link prediction[C]//International Conference on Machine Learning.PMLR,2016:2071-2080.
[20]SHANG C,TANG Y,HUANG J,et al.End-to-end structure-aware convolutional networks for knowledge base completion[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2019:3060-3067.
[21]VASHISHTH S,SANYAL S,NITIN V,et al.Composition-based multi-relational graphconvolutional networks[J].arXiv:1911.03082,2019.
[22]NATHANI D,CHAUHAN J,SHARMA C,et al.Learning attention-based embeddings for relation prediction in knowledge graphs[J].arXiv:1906.01195,2019.
[23]ZHAO X,JIA Y,LI A,et al.Target relational attention-oriented knowledge graph reasoning[J].Neurocomputing,2021,461:577-586.
[24]LI R,CAO Y,ZHU Q,et al.How does knowledge graphembed-ding extrapolate to unseen data:a semantic evidence view[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2022:5781-5791.
[25]SUN Z,VASHISHTH S,SANYAL S,et al.A re-evaluation of knowledge graph completion methods[J].arXiv:1911.03903,2019.
[26]VASHISHTH S,SANYAL S,NITIN V,et al.Interacte:Improving convolution-based knowledge graph embeddings by increa-sing feature interactions[C]//Proceedings of the AAAI Confe-rence on Artificial Intelligence.2020:3009-3016.
[1] ZHANG Liying, SUN Haihang, SUN Yufa , SHI Bingbo. Review of Node Classification Methods Based on Graph Convolutional Neural Networks [J]. Computer Science, 2024, 51(4): 95-105.
[2] ZHOU Honglin, SONG Huazhu, ZHANG Juan. Knowledge Graph Embedding Model with Entity Description on Cement Manufacturing Domain [J]. Computer Science, 2024, 51(3): 251-256.
[3] ZOU Chunling, ZHU Zhengzhou. Fusion Model of Housekeeping Service Course Recommendation Based on Knowledge Graph [J]. Computer Science, 2024, 51(2): 47-54.
[4] XU Tianyue, LIU Xianhui, ZHAO Weidong. Knowledge Graph and User Interest Based Recommendation Algorithm [J]. Computer Science, 2024, 51(2): 55-62.
[5] HU Binhao, ZHANG Jianpeng, CHEN Hongchang. Knowledge Graph Completion Algorithm Based on Generative Adversarial Network and Positiveand Unlabeled Learning [J]. Computer Science, 2024, 51(1): 310-315.
[6] JIN Yu, CHEN Hongmei, LUO Chuan. Interest Capturing Recommendation Based on Knowledge Graph [J]. Computer Science, 2024, 51(1): 133-142.
[7] WANG Jing, ZHANG Miao, LIU Yang, LI Haoling, LI Haotian, WANG Bailing, WEI Yuliang. Study on Dual-security Knowledge Graph for Process Industrial Control [J]. Computer Science, 2023, 50(9): 68-74.
[8] ZHAI Lizhi, LI Ruixiang, YANG Jiabei, RAO Yuan, ZHANG Qitan, ZHOU Yun. Overview About Composite Semantic-based Event Graph Construction [J]. Computer Science, 2023, 50(9): 242-259.
[9] TANG Shaosai, SHEN Derong, KOU Yue, NIE Tiezheng. Link Prediction Model on Temporal Knowledge Graph Based on Bidirectionally Aggregating Neighborhoods and Global Aware [J]. Computer Science, 2023, 50(8): 177-183.
[10] MAO Huihui, ZHAO Xiaole, DU Shengdong, TENG Fei, LI Tianrui. Short-term Subway Passenger Flow Forecasting Based on Graphical Embedding of Temporal Knowledge [J]. Computer Science, 2023, 50(7): 213-220.
[11] GAO Xiang, TANG Jiqiang, ZHU Junwu, LIANG Mingxuan, LI Yang. Study on Named Entity Recognition Method Based on Knowledge Graph Enhancement [J]. Computer Science, 2023, 50(6A): 220700153-6.
[12] LIANG Mingxuan, WANG Shi, ZHU Junwu, LI Yang, GAO Xiang, JIAO Zhixiang. Survey of Knowledge-enhanced Natural Language Generation Research [J]. Computer Science, 2023, 50(6A): 220200120-8.
[13] ZHANG Yaqing, SHAN Zhongyuan, ZHAO Junfeng, WANG Yasha. Intelligent Mapping Recommendation-based Knowledge Graph Instance Construction and Evolution Method [J]. Computer Science, 2023, 50(6): 142-150.
[14] DONG Jiaxiang, ZHAI Jiyu, MA Xin, SHEN Leixian, ZHANG Li. Mechanical Equipment Fault Diagnosis Driven by Knowledge [J]. Computer Science, 2023, 50(5): 82-92.
[15] SHAO Yunfei, SONG You, WANG Baohui. Study on Degree of Node Based Personalized Propagation of Neural Predictions forSocial Networks [J]. Computer Science, 2023, 50(4): 16-21.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!