Computer Science ›› 2024, Vol. 51 ›› Issue (11): 239-247.doi: 10.11896/jsjkx.231000015

• Artificial Intelligence • Previous Articles     Next Articles

KBQA Algorithm Introducing Core Entity Attention Evaluation

ZHAO Weidong, JIN Yanfeng, ZHANG Rui, LIN Yanzheng   

  1. School of Software,Fudan University,Shanghai 200433,China
    Shanghai Key Laboratory of Data Science,Fudan University,Shanghai 200433,China
  • Received:2023-10-07 Revised:2024-04-04 Online:2024-11-15 Published:2024-11-06
  • About author:ZHAO Weidong,born in 1971,Ph.D,associate professor.His main research interests include machine learning,deep learning and recommender systems.
  • Supported by:
    National Natural Science Foundation of China(71971066).

Abstract: There are numerous knowledge base question answering(KBQA) researches on complex semantics and complex syntax,but most of them are based on the premise that the subject entity of the question has been obtained,and insufficient attention has been paid to the multi-intentions and multi-entities in the question,and the identification of the core entity in the interrogative sentence is the key to natural language understanding.To address this problem,a KBQA model introducing core entity attention is proposed.Based on the attention mechanism and attention enhancement techniques,the proposed model assesses the importance of the recognized entity mention,obtains the entity mention attention,removes the potential interfering items,captures the core entity of the user’s question,so as to solve the semantic understanding problem of multi-entity and multi-intention interrogative sentences.Evaluated results are introduced into the subsequent Q&A reasoning as importance weights.Finally,comparative experiments are conducted with KVMem,GraftNet,PullNet and other models in English MetaQA dataset,multi-entity question MetaQA dataset,and multi-entity question HotpotQA dataset.For multi-entity question,the proposed model achieves better experimental results on Hits@n,accuracy,recall and other evaluation indexes.

Key words: Knowledge graph question answering, Intention recognition, Entity attention, Multi-entity, Multi-intention

CLC Number: 

  • TP391
[1] WANG Y,CHEN Q,HE C,et al.Knowledge base question answering system based on knowledge graph representation lear-ning[C]//Proceedings of the 2020 the 4th International Confe-rence on Innovation in Artificial Intelligence.2020:170-179.
[2] TROUILLON T,WELBL J,RIEDEL S,et al.Complex embeddings for simple link prediction[C]//International Conference on Machine Learning.PMLR,2016:2071-2080.
[3] AGHAEI S,RAAD E,FENSEL A.Question answering overknowledge graphs:A case study in tourism[J].IEEE Access,2022,10:69788-69801.
[4] HU S,ZOU L,YU J X,et al.Answering natural language questions by subgraph matching over knowledge graphs[J].IEEE Transactions on Knowledge and Data Engineering,2017,30(5):824-837.
[5] SUN Y,ZHANG L,CHENG G,et al.SPARQA:skeleton-based semantic parsing for complex questions over knowledge bases[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2020:8952-8959.
[6] ZHU S,CHENG X,SU S.Knowledge-based question answering by tree-to-sequence learning[J].Neurocomputing,2020,372:64-72.
[7] MAHESHWARI G,TRIVEDI P,LUKOVNIKOV D,et al.Learning to rank query graphs for complex question answering over knowledge graphs[C]//The Semantic Web-ISWC 2019:18th International Semantic Web Conference,Auckland,New Zealand,October 26-30,2019,Proceedings,Part I 18.Springer International Publishing,2019:487-504.
[8] REDDY S,LAPATA M,STEEDMAN M.Large-scale semantic parsing without question-answer pairs[J].Transactions of the Association for Computational Linguistics,2014,2:377-392.
[9] BAST H,HAUSSMANN E.More accurate question answering on freebase[C]//Proceedings of the 24th ACM International on Conference on Information and Knowledge Management.2015:1431-1440.
[10] YIH S W,CHANG M W,HE X,et al.Semantic parsing viastaged query graph generation:Question answering with know-ledge base[C]//Proceedings of the Joint Conference of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP.2015:1321-1331.
[11] ZHENG W,YU J X,ZOU L,et al.Question answering over knowledgegraphs:question understanding via template decomposition[J].Proceedings of the VLDB Endowment,2018,11(11):1373-1386.
[12] BHUTANI N,ZHENG X,JAGADISH H V.Learning to answer complex questions over knowledge bases with query composition[C]//Proceedings of the 28th ACM International Conference on Information and Knowledge Management.2019:739-748.
[13] CHEN Z Y,CHANG C H,CHEN Y P,et al.UHop:An unrestricted-hop relation extraction framework for knowledge-based question answering[J].arXiv:1904.01246,2019.
[14] LAN Y,WANG S,JIANG J.Multi-hop knowledge base question answering with an iterative sequence matching model[C]//2019 IEEE International Conference on Data Mining(ICDM).IEEE,2019:359-368.
[15] SUN H,BEDRAX-WEISS T,COHEN W W.Pullnet:Open domain question answering with iterative retrieval on knowledge bases and text[J].arXiv:1904.09537,2019.
[16] XIONG W,YU M,CHANG S,et al.Improving question an-swering over incomplete kbs with knowledge-aware reader[J].arXiv:1905.07098,2019.
[17] HAN J,CHENG B,WANG X.Open domain question answering based on text enhanced knowledge graph with hyperedge infusion[C]//Findings of the Association for Computational Linguistics:EMNLP 2020.2020:1475-1481.
[18] SAXENA A,TRIPATHI A,TALUKDAR P.Improving multi-hop question answering over knowledge graphs using knowledge base embeddings[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.2020:4498-4507.
[19] HE G,LAN Y,JIANG J,et al.Improving multi-hop knowledgebase question answering by learning intermediate supervision signals[C]//Proceedings of the 14th ACM International Confe-rence on Web Search and Data Mining.2021:553-561.
[20] ZHOU M,HUANG M,ZHU X.An interpretable reasoning network for multi-relation question answering[C]//Proceedings of the 27th International Conference on Computational Linguistics.2018:2010-2022.
[21] XU K,LAI Y,FENG Y,et al.Enhancing key-value memoryneural networks for knowledge based question answering[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies,Volume 1.2019:2937-2947.
[22] RAY P P.ChatGPT:A comprehensive review on background,applications,key challenges,bias,ethics,limitations and future scope[J].Internet of Things and Cyber-Physical Systems,2023,3(4):121-154.
[23] ZHAO C Y,ZHU G B,WANG J Q.The Inspiration Brought by ChatGPT to LLM and the New Development Ideas of Multi-modal Large Model[J].Data Analysis and Knowledge Discovery,2023,7(3):26-35.
[24] LEE J,YOON W,KIM S,et al.BioBERT:a pre-trained biome-dical language representation model for biomedical text mining[J].Bioinformatics,2020,36(4):1234-1240.
[25] ZHANG W,GU X,TANG L,et al.Application of machinelearning,deep learning and optimization algorithms in geoengineering and geoscience:Comprehensive review and future challenge[J].Gondwana Research,2022,109:1-17.
[26] LAN Y,HE G,JIANG J,et al.Complex knowledge base question answering:a survey[J].IEEE Transactions on Knowledge and Data Engineering,2022,14(8):1-20.
[1] ZHANG Haoyan, DUAN Liguo, WANG Qinchen, GAO Hao. Long Text Multi-entity Sentiment Analysis Based on Multi-task Joint Training [J]. Computer Science, 2024, 51(6): 309-316.
[2] WANG Kai, LI Zhou-jun, SHENG Wen-bo, CHEN Shu-wei, WANG Ming-xuan, LIU Jian-qing, LAN Hai-bo, ZHANG Rui. Multi-turn Dialogue Technology and Its Application in Power Grid Data Query [J]. Computer Science, 2022, 49(10): 265-271.
[3] PENG Wu,YAO Shu-ping. Study on Intrusion Intention Recognition Based on the Probabilistic Inference [J]. Computer Science, 2010, 37(1): 79-82.
[4] ZENG Peng ,WU Ling-Da ,CHEN Wen-Wei (School of Information System ~ Management, National University of Defense Technology, Changsha 410073). [J]. Computer Science, 2007, 34(7): 181-183.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!