Computer Science ›› 2019, Vol. 46 ›› Issue (10): 215-221.doi: 10.11896/jsjkx.190400071

• Artificial Intelligence • Previous Articles     Next Articles

Multi-view Attentional Approach to Single-fact Knowledge-based Question Answering

LUO Da, SU Jin-dian, LI Peng-fei   

  1. (School of Computer Science and Engineering,South China University of Technology,Guangzhou 511400,China)
  • Received:2019-04-11 Revised:2019-06-28 Online:2019-10-15 Published:2019-10-21

Abstract: Knowledge base question answering (KB-QA) has received extensive attention in recent years,and becomes an important natural language processing task.In the knowledge base question answering task,simple question refers to the question that can be answered by a single-fact of the knowledge base.For this task,the existing approaches mainly map the question and the KB fact into a common vector space and calculate their similarity to get the answer.But this approach would lose part of the semantic interaction information of the original words.To solve this problem,a multi-view attention-based relation detection approach was proposed,which aims to model the correlation between the question and the KB relation from multiple perspectives,and preserves more original interaction information so as to improve the accuracy of the approach.In addition,in order to alleviate the impacts of noisy data and improve the accuracy of entity recognition,this paper also encoded the question by combining the dynamic word vectors based on the language model and the part-of-speech feature of the word during the process of entity linking.Finally,experiments conducted on the SimpleQuestions dataset based on FB2M and FB5M achieve the accuracy results of 78.9% and 78.3%,respectively,which illustrative the effectiveness of the proposed approach for reflecting the semantic correlation between the question and the KB relation,and reflect the improvements of the accuracy for single-fact KBQA.

Key words: Attention mechanism, Deep learning, Knowledge base, Natural language processing, Question answering

CLC Number: 

  • TP183
[1]SUCHANEK F M,KASNECI G,WEIKUM G.Yago:a core of semantic knowledge[C]//Proceedings of the 16th international conference on World Wide Web.New York,NY:ACM,2007:697-706.
[2]BOLLACKER K,EVANS C,PARITOSH P,et al.Freebase:a collaboratively created graph database for structuring human knowledge[C]//Proceedings of the 2008 ACM SIGMOD international conference on Management of data.New York,NY:ACM,2008:1247-1250.
[3]LEHMANN J,ISELE R,JAKOB M,et al.DBpedia-a large-scale,multilingual knowledge base extracted from Wikipedia[J].Semantic Web,2015,6(2):167-195.
[4]BERANT J,LIANG P.Semantic parsing via paraphrasing[C]//Proceedings of the 52nd Annual Meeting of ACL (Volume 1:Long Papers).Stroudsburg,PA:ACL,2014:1415-1425.
[5]REDDY S,LAPATA M,STEEDMAN M.Large-scale semantic parsing without question-answer pairs[J].Transactions of the Association of Computational Linguistics,2014,2(1):377-392.
[6]BERANT J,CHOU A,FROSTIG R,et al.Semantic parsing on freebase from question-answer pairs[C]//Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing.2013:1533-1544.
[7]BORDES A,CHOPRA S,WESTON J.Question Answering with Subgraph Embeddings[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing,A meeting of SIGDAT,a Special Interest Group of the ACL.Doha,Qatar,View at Publisher View at Google Scholar,2014:615-620.
[8]BORDES A,USUNIER N,CHOPRA S,et al.Large-scale simple question answering with memory networks[J].arXiv:1506.02075,2015.
[9]HE X,GOLUB D.Character-Level Question Answering with Attention[C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing.Stroudsburg,PA:ALL,2016:1598-1607.
[10]HAKIMOV S,JEBBARA S,CIMIANO P.Evaluating Architectural Choices for Deep Learning Approaches for Question Answering Over Knowledge Bases[C]//ICSC.IEEE,2019:110-113.
[11]DAI Z,LI L,XU W.CFO:Conditional Focused Neural Question Answering with Large-scale Knowledge Bases[C]//Procee-dings of the 54th Annual Meeting of the Association for Computational Linguistics.Stroudsburg,PA:ACL,2016:800-810.
[12]YIN W,YU M,XIANG B,et al.Simple Question Answering by Attentive Convolutional Neural Network[C]//COLING 2016.New York:ACM,2016:1746-1756.
[13]YIH W T,CHANG M W,HE X,et al.Semantic Parsing via Staged Query Graph Generation:Question Answering with Knowledge Base[C]//Meeting of the Association for Computational Linguistics & the International Joint Conference on Natural Language Processing.Stroudsburg,PA:ALL,2015:1321-1331.
[14]YANG Y,CHANG M W.S-MART:Novel Tree-based Struc-tured Learning Algorithms Applied to Tweet Entity Linking[C]//ACL 2015.Stroudsburg,PA:ACL,2015:504-513.
[15]QU Y,LIU J,KANG L,et al.Question Answering over Freebase via Attentive RNN with Similarity Matrix based CNN[J].arXiv:1804.03317,2018.
[16]YU Y,HASAN K S,YU M,et al.Knowledge Base Relation Detection via Multi-View Matching[C]//ADBIS (Short Papers and Workshops).Berlin:Springer,2018:286-294.
[17]WANG Z,HAMZA W,FLORIAN R.Bilateral Multi-Perspective Matching for Natural Language Sentences[C]//IJCAI 2017.Cambridge,MA:MIT,2017:4144-4150.
[18]ZHANG H,XU G,LIANG X,et al.An Attention-Based Word-Level Interaction Model:Relation Detection for Knowledge Base Question Answering[J].IEEE Access,2018:1-1.
[19]BERANT J,CHOU A,FROSTIG R,et al.Semantic parsing on freebase from question-answer pairs[C]//Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing.Stroudsburg,PA:ALL,2013:1533-1544.
[20]HAO Y,LIU H,HE S,et al.Pattern-revising Enhanced Simple Question Answering over Knowledge Bases[C]//Proceedings of the 27th International Conference on Computational Linguistics.New York:ACM,2018:3272-3282.
[21]YU M,YIN W,HASAN K S,et al.Improved neural relation detection for knowledge base question answering[C]//Proceedings of the 55th Annual Meeting of the Association for ComputationalLinguistics.Stroudsburg,PA:ACL,2017:571-581.
[1] ZHOU Fang-quan, CHENG Wei-qing. Sequence Recommendation Based on Global Enhanced Graph Neural Network [J]. Computer Science, 2022, 49(9): 55-63.
[2] LYU Xiao-feng, ZHAO Shu-liang, GAO Heng-da, WU Yong-liang, ZHANG Bao-qi. Short Texts Feautre Enrichment Method Based on Heterogeneous Information Network [J]. Computer Science, 2022, 49(9): 92-100.
[3] DAI Yu, XU Lin-feng. Cross-image Text Reading Method Based on Text Line Matching [J]. Computer Science, 2022, 49(9): 139-145.
[4] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[5] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[6] XIONG Li-qin, CAO Lei, LAI Jun, CHEN Xi-liang. Overview of Multi-agent Deep Reinforcement Learning Based on Value Factorization [J]. Computer Science, 2022, 49(9): 172-182.
[7] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[8] TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[9] WANG Ming, PENG Jian, HUANG Fei-hu. Multi-time Scale Spatial-Temporal Graph Neural Network for Traffic Flow Prediction [J]. Computer Science, 2022, 49(8): 40-48.
[10] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[11] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[12] YAN Jia-dan, JIA Cai-yan. Text Classification Method Based on Information Fusion of Dual-graph Neural Network [J]. Computer Science, 2022, 49(8): 230-236.
[13] WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[14] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[15] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!