Computer Science ›› 2023, Vol. 50 ›› Issue (8): 177-183.doi: 10.11896/jsjkx.220900061

• Artificial Intelligence • Previous Articles     Next Articles

Link Prediction Model on Temporal Knowledge Graph Based on Bidirectionally Aggregating Neighborhoods and Global Aware

TANG Shaosai, SHEN Derong, KOU Yue, NIE Tiezheng   

  1. School of Computer Science and Engineering,Northeastern University,Shenyang 110167,China
  • Received:2022-09-07 Revised:2022-12-26 Online:2023-08-15 Published:2023-08-02
  • About author:TANG Shaosai,born in 1998,postgra-duate.His main research interest is link prediction on temporal knowledge graph.
    SHEN Derong,born in 1964,Ph.D,professor,Ph.D supervisor,is a member of China Computer Federation.Her main research interests include distributed database and web data management.
  • Supported by:
    National Natural Science Foundation of China(62172082,62072084,62072086) and Fundamental Research Funds for the Central Universities(N2116008).

Abstract: Temporal knowledge graphs(TKG) have great potential of application in many fields,such as recommender systems,search engine and natural language processing,but the incompleteness of TKG limites its application,so it is important to study link prediction model on TKG.Most existing methods focus on TKG completion and can't predict future facts.This paper proposes a link prediction model on TKG,which is based on bidirectionally aggregating neighborhoods and global aware.On the one hand,the proposed model independently aggregates entity's recently active and positive behavior and models their temporal evolution by recurrent neural network (RNN).On the other hand,it captures the chronic behavior patterns of entities by global aware module.Experimental results on four benchmark datasets show that our proposed method can improve the performance of forecasting future facts.

Key words: Temporal knowledge graph, Link prediction, Recurrent neural network

CLC Number: 

  • TP391
[1]LIU Z,XIONG C,SUN M,et al.Entity-duet neural ranking:Understanding the role of knowledge graph semantics in neural information retrieval[J].arXiv:1805.07591,2018.
[2]KOREN Y,BELL R,VOLINSKY C.Matrix factorization techniques for recommender systems[J].Computer,2009,42(8):30-37.
[3]CHEN J C,CHEN J S,YU Z.Incorporating structured com-monsense knowledge in story completion[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2019,:6244-6251.
[4]WANG M,WANG H F,LI B H,et al.Survey of Key Technolo-gies of New Generation Knowledge Graph[J/OL].Journal of Computer Research and Development:1-18.[2022-05-21].http://kns.cnki.net/kcms/detail/11.1777.TP20220301.1217.002.html.
[5]PARK N,LIU F,MEHTA P,et al.EvoKG:Jointly ModelingEvent Time and Network Structure for Reasoning over Temporal Knowledge Graphs[C]//Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining.2022:794-803.
[6]ZHU C,CHEN M,FAN C,et al.Learning from history:Mode-ling temporal knowledge graphs with sequential copy-generation networks[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2021:6244-6251.
[7]LEBLAY J,CHEKOL M W.Deriving validity time in know-ledge graph[C]//Companion Proceedings of the Web Conference 2018.ACM,2018:1771-1776.
[8]DASGUPTA S S,RAY S N,TALUKDAR P.Hyte:Hyper-plane-based temporally aware knowledge graph embedding[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing.2018:2001-2011.
[9]JIN W,QU M,JIN X,et al.Recurrent event network:Autoregressive structure inference over temporal knowledge graphs[C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing.2020:6669-6683.
[10]SCHLICHTKRULL M,KIPF T N,BLOEM P,et al.Modeling relational data with graph convolutional networks[C]//Euro-pean Semantic Web Conference.2018:593-607.
[11]GUAN S P,JIN X L,JIA Y T,et al.Knowledge reasoning over knowledge graph:A survey[J].Journal of Software,2018,29(10):2966-2994.
[12]YANG D W,ZHOU G,LU J C,et al.Review of knowledgegraph completion based on knowledge representation learning[J].Journal of Information Engineering University,2021,22(5):558-565.
[13]BORDES A,USUNIER N,GARCIA-DURAN A,et al.Translating embeddings for modeling multi-relational data[C]//Neural Information Processing Systems(NIPS).New York:Curran Associates,2013:2787-2795.
[14]WANG Z,ZHANG J,FENG J,et al.Knowledge graph embedding by translating on hyperplanes[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2014:1112-1119.
[15]LIN Y,LIU Z,SUN M,et al.Learning entity and relation embeddings for knowledge graph completion[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2015:21881-2187.
[16]YANG B,YIH W,HE X,et al.Embedding Entities and Relations for Learning and Inference in Knowledge Bases[C]//International Conference on Learning Representations.2015:202-206.
[17]TROUILLON T,WELBL J,RIEDEL S,et al.Complex Embeddings for Simple Link Prediction[C]//Proceedings of the 33nd International Conference on Machine Learning.2016:2071-2080.
[18]SOCHER R,CHEN D,MANNING C D,et al.Reasoning with neural tensor networks for knowledge base completion[C]//27th Annual Conference on Neural Information Processing Systems 2013.2013:926-934.
[19]DONG X,GABRILOVICH E,HEITZ G,et al.Knowledgevault:a web-scale approach to probabilistic knowledge fusion[C]//The 20th ACM SIGKDD International Conference on knowledge Discovery and Data Miming.2014:601-610.
[20]GOEL R,KAZEMI S M,BRUBAKER M,et al.Diachronic Embedding for Temporal Knowledge Graph Completion[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2020:3988-3995.
[21]GARCÍA-DURÁN A,DUMANČIĆ S,NIEPERT M.Learning sequence encoders for temporal knowledge graph completion[J].arXiv:1809.03202,2018.
[22]TRIVEDI R,FARAJTABAR M,WANG Y,et al.Know-Evolve:Deep Reasoning in Temporal Knowledge Graphs[C]//Proceedings of the 33nd International Conference on Machine Learning.2017:3462-3471.
[23]PAREJA A,DOMENICONI G,CHEN J,et al.EvolveGCN:Evolving graph convolutional networks for dynamic graphs[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2020,34(4):5363-5370.
[24]DING Z,HAN Z,MA Y,et al.Learning neural ordinary equations for forecasting future links on temporal knowledge graphs[C]//Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing.2021:8352-8364.
[25]HAN Z,CHEN P,MA Y,et al.Explainable subgraph reasoningfor forecasting on temporal knowledge graphs[C]//Interna-tional Conference on Learning Representations.2021.
[1] JIANG Linpu, CHEN Kejia. Self-supervised Dynamic Graph Representation Learning Approach Based on Contrastive Prediction [J]. Computer Science, 2023, 50(7): 207-212.
[2] MAO Huihui, ZHAO Xiaole, DU Shengdong, TENG Fei, LI Tianrui. Short-term Subway Passenger Flow Forecasting Based on Graphical Embedding of Temporal Knowledge [J]. Computer Science, 2023, 50(7): 213-220.
[3] LI Shujing, HUANG Zengfeng. Mixed-curve for Link Completion of Multi-relational Heterogeneous Knowledge Graphs [J]. Computer Science, 2023, 50(4): 172-180.
[4] WANG Jingbin, LAI Xiaolian, LIN Xinyu, YANG Xinyi. Context-aware Temporal Knowledge Graph Completion Based on Relation Constraints [J]. Computer Science, 2023, 50(3): 23-33.
[5] HU Zhongyuan, XUE Yu, ZHA Jiajie. Survey on Evolutionary Recurrent Neural Networks [J]. Computer Science, 2023, 50(3): 254-265.
[6] SONG Jie, LIANG Mei-yu, XUE Zhe, DU Jun-ping, KOU Fei-fei. Scientific Paper Heterogeneous Graph Node Representation Learning Method Based onUnsupervised Clustering Level [J]. Computer Science, 2022, 49(9): 64-69.
[7] HUANG Li, ZHU Yan, LI Chun-ping. Author’s Academic Behavior Prediction Based on Heterogeneous Network Representation Learning [J]. Computer Science, 2022, 49(9): 76-82.
[8] PENG Shuang, WU Jiang-jiang, CHEN Hao, DU Chun, LI Jun. Satellite Onboard Observation Task Planning Based on Attention Neural Network [J]. Computer Science, 2022, 49(7): 242-247.
[9] YU Xin, LIN Zhi-liang. Novel Neural Network for Dealing with a Kind of Non-smooth Pseudoconvex Optimization Problems [J]. Computer Science, 2022, 49(5): 227-234.
[10] LI Yong, WU Jing-peng, ZHANG Zhong-ying, ZHANG Qiang. Link Prediction for Node Featureless Networks Based on Faster Attention Mechanism [J]. Computer Science, 2022, 49(4): 43-48.
[11] AN Xin, DAI Zi-biao, LI Yang, SUN Xiao, REN Fu-ji. End-to-End Speech Synthesis Based on BERT [J]. Computer Science, 2022, 49(4): 221-226.
[12] SHI Yu-tao, SUN Xiao. Conversational Comprehension Model for Question Generation [J]. Computer Science, 2022, 49(3): 232-238.
[13] LI Hao, CAO Shu-yu, CHEN Ya-qing, ZHANG Min. User Trajectory Identification Model via Attention Mechanism [J]. Computer Science, 2022, 49(3): 308-312.
[14] ZHAO Xue-lei, JI Xin-sheng, LIU Shu-xin, LI Ying-le, LI Hai-tao. Link Prediction Method for Directed Networks Based on Path Connection Strength [J]. Computer Science, 2022, 49(2): 216-222.
[15] WANG Jia-chang, ZHENG Dai-wei, TANG Lei, ZHENG Dan-chen, LIU Meng-juan. Empirical Research on Remaining Useful Life Prediction Based on Machine Learning [J]. Computer Science, 2022, 49(11A): 211100285-9.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!