Computer Science ›› 2023, Vol. 50 ›› Issue (11): 201-209.doi: 10.11896/jsjkx.221100217

• Artificial Intelligence • Previous Articles     Next Articles

QubitE:Qubit Embedding for Knowledge Graph Completion

LIN Xueyuan, E Haihong , SONG Wenyu, LUO Haoran, SONG Meina   

  1. School of Computer Science,Beijing University of Posts and Telecommunications,Beijing 100876,China
  • Received:2022-11-25 Revised:2023-02-09 Online:2023-11-15 Published:2023-11-06
  • About author:LIN Xueyuan,born in 1998,postgra-duate.His main research interests include deep learning,knowledge graph,natural language processing,big data and artificial intelligence.E Haihong,born in 1982,Ph.D,asso-ciate professor,is a member of China Computer Federation.Her main research interests include deep learning,knowledge graph,natural language processing,big data and artificial intelligence.
  • Supported by:
    National Natural Science Foundation of China(62176026,61902034)and Natural Science Foundation of Beijing,China(M22009).

Abstract: The knowledge graph completion task completes the knowledge graph by predicting missing facts in the knowledge graph.The quantum-based knowledge graph embedding(KGE) model uses variational quantum circuits to score triples by mea-suring the probability distribution of qubit states,and triples with high scores are the missing facts.But the current quantum-based KGE either loses the quantum advantage in the optimization process and the matrix unitary property is destroyed,or requires a large number of parameters for storing quantum states,resulting in overfitting and low performance.Furthermore,these methods ignore the theoretical analysis that is essential for understanding model performance.In order to solve the performance problem and bridge the theoretical gap,we propose QubitE:entities are embedded as qubits(unit complex vectors),relations are embedded as quantum gates(unit unitary matrices),the scoring process is complex matrix multiplication,and kernel methods are used for optimization.The parameterization method of the model can maintain the quantum advantage in optimization,the space-time complexity is linear,and it can even further realize semantic-based quantum logic calculation.In addition,the model can be proved to be fully expressive,relational schema reasoning ability and inclusiveness,etc.theoretically,which is helpful to understand the model performance.Experiments show that QubitE can achieve results comparable to state-of-the-art classical models on some benchmark knowledge graphs.

Key words: Knowledge graph, Knowledge graph completion, Knowledge graph embedding, Representation learning, Qubit

CLC Number: 

  • TP391
[1]MA Y P,TRESP V,ZHAO L M,et al.Variational QuantumCircuit Model for Knowledge Graph Embedding[J].Advanced Quantum Technologies,2019,2(7/8):1-13.
[2]BORDES A,USUNIER N,GARCIA-DURAN A et al.Translating Embeddings for Modeling Multi-Relational Data [C]//NIPS.2013.
[3]LIN Y K,LIU Z Y,SUN M S,et al.Learning Entity and Relation Embeddings for Knowledge Graph Completion[C]//AAAI.2015.
[4]SUN Z Q,DENG Z H,NIE J Y,et al.RotatE:Knowledge Graph Embedding by Relational Rotation in Complex Space [C]//International Conference on Learning Representations.2019.
[5]ZHANG S,TAY Y,YAO L N,et al.Quaternion KnowledgeGraph Embeddings [J].arXiv:1904.10281,2019.
[6]NAYYERI M,VAHDATI S, AYKUL C,et al.5* Knowledge Graph Embeddings with Projective Transformations [J].arXiv:2006.04986,2020.
[7]IVANA B,ALLEN C,TIMOTHY M.Multi-Relational Poincaré Graph Embeddings[C]//Advances in Neural Information Processing Systems 32:Annual Conference on Neural Information Processing Systems 2019.Vancouver,BC,Canada:NeurIPS 2019,2019:4465-4475.
[8]INES C,WOLF A,DA-CHENG JUAN D C,et al.Low-Dimensional Hyperbolic Knowledge Graph Embeddings [C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.online:ACL 2020,2020:6901-6914.
[9]YANG B S,YIH W T,HE X D,et al.Embedding Entities and Relations for Learning and Inference in Knowledge Bases [C]//3rd International Conference on Learning Representations,ICLR 2015.San Diego:Conference Track Proceedings,2015.
[10]THÉO T,WELBL J,RIEDEL S,et al.Complex Embeddings for Simple Link Prediction [C]//Proceedings of the 33nd International Conference on Machine Learning,ICML 2016.New York:JMLR.org,2016:2071-2080.
[11]KAZEMI S M, POOLE D.SimplE Embedding for Link Predic-tion in Knowledge Graphs[C]//Advances in Neural Information Processing Systems 31:Annual Conference on Neural Information Processing Systems 2018.Canada:NeurIPS 2018,2018:4289-4300.
[12]IVANA B,CARL ALLEN C,TIMOTHY M.HypernetworkKnowledge Graph Embeddings [C]//Artificial Neural Networks and Machine Learning--ICANN 2019--28th International Conference on Artificial Neural Networks.Germany:Springer,2019:553-565.
[13]IVANA B,CARL ALLEN C,TIMOTHY M.TuckER:Tensor Factorization for Knowledge Graph Completion [C]//Procee-dings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing.Hong Kong:EMNLP-IJCNLP,2019:5184-5193.
[14]SETH L,SCHULD M,IJAZ A,et al.Quantum Embeddings for Machine Learning[J].arXiv:2001.03622,2020.
[15]GLOROT X,BENGIO Y.Understanding the Difficulty of Trai-ning Deep Feedforward Neural Networks [C]//Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics.JMLR Workshop,2010:249-256.
[16]WANG Y J,GEMULLA R,LI H.On Multi-Relational LinkPrediction with Bilinear Models [C]//AAAI.2018.
[17]BOLLACKER K D,EVANS C,PARITOSH P,et al.Freebase:A Collaboratively Created Graph Database for Structuring Human Knowledge [C]//Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data.New York:SIGMOD 2008:1247-1250.
[18]TOUTANOVA K,CHEN D Q.Observed Versus Latent Features for Knowledge Base and Text Inference[C]//The 3rd Workshop on Continuous Vector Space Models and their Compositionality.2015.
[19]MILLER G A.WordNet:A Lexical Database for English [J].Communications of the ACM,1992,38(1):39-41.
[20]DETTMERS T,MINERVINI P,STENETORP P,et al.Convolutional 2d Knowledge Graph Embeddings [C]//Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence,(AAAI-18),the 30th Innovative Applications of Artificial Intelligence(IAAI-18),and the 8th AAAI Symposium on Educa-tional Advances in Artificial Intelligence(EAAI-18).New Or-leans,Louisiana,USA,AAAI Press,2018:1811-1818.
[21]ADAM P,GROSS S,CHINTALA S,et al.Automatic Differentiation in PyTorch [C]//NIPS.2017.
[1] WANG Jing, ZHANG Miao, LIU Yang, LI Haoling, LI Haotian, WANG Bailing, WEI Yuliang. Study on Dual-security Knowledge Graph for Process Industrial Control [J]. Computer Science, 2023, 50(9): 68-74.
[2] ZHAI Lizhi, LI Ruixiang, YANG Jiabei, RAO Yuan, ZHANG Qitan, ZHOU Yun. Overview About Composite Semantic-based Event Graph Construction [J]. Computer Science, 2023, 50(9): 242-259.
[3] XIAO Guiyang, WANG Lisong , JIANG Guohua. Multimodal Knowledge Graph Embedding with Text-Image Enhancement [J]. Computer Science, 2023, 50(8): 163-169.
[4] TANG Shaosai, SHEN Derong, KOU Yue, NIE Tiezheng. Link Prediction Model on Temporal Knowledge Graph Based on Bidirectionally Aggregating Neighborhoods and Global Aware [J]. Computer Science, 2023, 50(8): 177-183.
[5] JIANG Linpu, CHEN Kejia. Self-supervised Dynamic Graph Representation Learning Approach Based on Contrastive Prediction [J]. Computer Science, 2023, 50(7): 207-212.
[6] MAO Huihui, ZHAO Xiaole, DU Shengdong, TENG Fei, LI Tianrui. Short-term Subway Passenger Flow Forecasting Based on Graphical Embedding of Temporal Knowledge [J]. Computer Science, 2023, 50(7): 213-220.
[7] GAO Xiang, TANG Jiqiang, ZHU Junwu, LIANG Mingxuan, LI Yang. Study on Named Entity Recognition Method Based on Knowledge Graph Enhancement [J]. Computer Science, 2023, 50(6A): 220700153-6.
[8] LIANG Mingxuan, WANG Shi, ZHU Junwu, LI Yang, GAO Xiang, JIAO Zhixiang. Survey of Knowledge-enhanced Natural Language Generation Research [J]. Computer Science, 2023, 50(6A): 220200120-8.
[9] ZHANG Yaqing, SHAN Zhongyuan, ZHAO Junfeng, WANG Yasha. Intelligent Mapping Recommendation-based Knowledge Graph Instance Construction and Evolution Method [J]. Computer Science, 2023, 50(6): 142-150.
[10] DONG Jiaxiang, ZHAI Jiyu, MA Xin, SHEN Leixian, ZHANG Li. Mechanical Equipment Fault Diagnosis Driven by Knowledge [J]. Computer Science, 2023, 50(5): 82-92.
[11] WANG Huiyan, YU Minghe, YU Ge. Deep Learning-based Heterogeneous Information Network Representation:A Survey [J]. Computer Science, 2023, 50(5): 103-114.
[12] ZHANG Xue, ZHAO Hui. Sentiment Analysis Based on Multi-event Semantic Enhancement [J]. Computer Science, 2023, 50(5): 238-247.
[13] SHEN Qiuhui, ZHANG Hongjun, XU Youwei, WANG Hang, CHENG Kai. Comprehensive Survey of Loss Functions in Knowledge Graph Embedding Models [J]. Computer Science, 2023, 50(4): 149-158.
[14] LI Shujing, HUANG Zengfeng. Mixed-curve for Link Completion of Multi-relational Heterogeneous Knowledge Graphs [J]. Computer Science, 2023, 50(4): 172-180.
[15] MA Tinghuai, SUN Shengjie, RONG Huan, QIAN Minfeng. Knowledge Graph-to-Text Model Based on Dynamic Memory and Two-layer Reconstruction Reinforcement [J]. Computer Science, 2023, 50(3): 12-22.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!