Computer Science ›› 2019, Vol. 46 ›› Issue (10): 215-221.doi: 10.11896/jsjkx.190400071

• Artificial Intelligence • Previous Articles     Next Articles

Multi-view Attentional Approach to Single-fact Knowledge-based Question Answering

LUO Da, SU Jin-dian, LI Peng-fei   

  1. (School of Computer Science and Engineering,South China University of Technology,Guangzhou 511400,China)
  • Received:2019-04-11 Revised:2019-06-28 Online:2019-10-15 Published:2019-10-21

Abstract: Knowledge base question answering (KB-QA) has received extensive attention in recent years,and becomes an important natural language processing task.In the knowledge base question answering task,simple question refers to the question that can be answered by a single-fact of the knowledge base.For this task,the existing approaches mainly map the question and the KB fact into a common vector space and calculate their similarity to get the answer.But this approach would lose part of the semantic interaction information of the original words.To solve this problem,a multi-view attention-based relation detection approach was proposed,which aims to model the correlation between the question and the KB relation from multiple perspectives,and preserves more original interaction information so as to improve the accuracy of the approach.In addition,in order to alleviate the impacts of noisy data and improve the accuracy of entity recognition,this paper also encoded the question by combining the dynamic word vectors based on the language model and the part-of-speech feature of the word during the process of entity linking.Finally,experiments conducted on the SimpleQuestions dataset based on FB2M and FB5M achieve the accuracy results of 78.9% and 78.3%,respectively,which illustrative the effectiveness of the proposed approach for reflecting the semantic correlation between the question and the KB relation,and reflect the improvements of the accuracy for single-fact KBQA.

Key words: Question answering, Knowledge base, Deep learning, Attention mechanism, Natural language processing

CLC Number: 

  • TP183
[1]SUCHANEK F M,KASNECI G,WEIKUM G.Yago:a core of semantic knowledge[C]//Proceedings of the 16th international conference on World Wide Web.New York,NY:ACM,2007:697-706.
[2]BOLLACKER K,EVANS C,PARITOSH P,et al.Freebase:a collaboratively created graph database for structuring human knowledge[C]//Proceedings of the 2008 ACM SIGMOD international conference on Management of data.New York,NY:ACM,2008:1247-1250.
[3]LEHMANN J,ISELE R,JAKOB M,et al.DBpedia-a large-scale,multilingual knowledge base extracted from Wikipedia[J].Semantic Web,2015,6(2):167-195.
[4]BERANT J,LIANG P.Semantic parsing via paraphrasing[C]//Proceedings of the 52nd Annual Meeting of ACL (Volume 1:Long Papers).Stroudsburg,PA:ACL,2014:1415-1425.
[5]REDDY S,LAPATA M,STEEDMAN M.Large-scale semantic parsing without question-answer pairs[J].Transactions of the Association of Computational Linguistics,2014,2(1):377-392.
[6]BERANT J,CHOU A,FROSTIG R,et al.Semantic parsing on freebase from question-answer pairs[C]//Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing.2013:1533-1544.
[7]BORDES A,CHOPRA S,WESTON J.Question Answering with Subgraph Embeddings[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing,A meeting of SIGDAT,a Special Interest Group of the ACL.Doha,Qatar,View at Publisher View at Google Scholar,2014:615-620.
[8]BORDES A,USUNIER N,CHOPRA S,et al.Large-scale simple question answering with memory networks[J].arXiv:1506.02075,2015.
[9]HE X,GOLUB D.Character-Level Question Answering with Attention[C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing.Stroudsburg,PA:ALL,2016:1598-1607.
[10]HAKIMOV S,JEBBARA S,CIMIANO P.Evaluating Architectural Choices for Deep Learning Approaches for Question Answering Over Knowledge Bases[C]//ICSC.IEEE,2019:110-113.
[11]DAI Z,LI L,XU W.CFO:Conditional Focused Neural Question Answering with Large-scale Knowledge Bases[C]//Procee-dings of the 54th Annual Meeting of the Association for Computational Linguistics.Stroudsburg,PA:ACL,2016:800-810.
[12]YIN W,YU M,XIANG B,et al.Simple Question Answering by Attentive Convolutional Neural Network[C]//COLING 2016.New York:ACM,2016:1746-1756.
[13]YIH W T,CHANG M W,HE X,et al.Semantic Parsing via Staged Query Graph Generation:Question Answering with Knowledge Base[C]//Meeting of the Association for Computational Linguistics & the International Joint Conference on Natural Language Processing.Stroudsburg,PA:ALL,2015:1321-1331.
[14]YANG Y,CHANG M W.S-MART:Novel Tree-based Struc-tured Learning Algorithms Applied to Tweet Entity Linking[C]//ACL 2015.Stroudsburg,PA:ACL,2015:504-513.
[15]QU Y,LIU J,KANG L,et al.Question Answering over Freebase via Attentive RNN with Similarity Matrix based CNN[J].arXiv:1804.03317,2018.
[16]YU Y,HASAN K S,YU M,et al.Knowledge Base Relation Detection via Multi-View Matching[C]//ADBIS (Short Papers and Workshops).Berlin:Springer,2018:286-294.
[17]WANG Z,HAMZA W,FLORIAN R.Bilateral Multi-Perspective Matching for Natural Language Sentences[C]//IJCAI 2017.Cambridge,MA:MIT,2017:4144-4150.
[18]ZHANG H,XU G,LIANG X,et al.An Attention-Based Word-Level Interaction Model:Relation Detection for Knowledge Base Question Answering[J].IEEE Access,2018:1-1.
[19]BERANT J,CHOU A,FROSTIG R,et al.Semantic parsing on freebase from question-answer pairs[C]//Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing.Stroudsburg,PA:ALL,2013:1533-1544.
[20]HAO Y,LIU H,HE S,et al.Pattern-revising Enhanced Simple Question Answering over Knowledge Bases[C]//Proceedings of the 27th International Conference on Computational Linguistics.New York:ACM,2018:3272-3282.
[21]YU M,YIN W,HASAN K S,et al.Improved neural relation detection for knowledge base question answering[C]//Proceedings of the 55th Annual Meeting of the Association for ComputationalLinguistics.Stroudsburg,PA:ACL,2017:571-581.
[1] ZHAO Jia-qi, WANG Han-zheng, ZHOU Yong, ZHANG Di, ZHOU Zi-yuan. Remote Sensing Image Description Generation Method Based on Attention and Multi-scale Feature Enhancement [J]. Computer Science, 2021, 48(1): 190-196.
[2] LIU Yang, JIN Zhong. Fine-grained Image Recognition Method Combining with Non-local and Multi-region Attention Mechanism [J]. Computer Science, 2021, 48(1): 197-203.
[3] WANG Rui-ping, JIA Zhen, LIU Chang, CHEN Ze-wei, LI Tian-rui. Deep Interest Factorization Machine Network Based on DeepFM [J]. Computer Science, 2021, 48(1): 226-232.
[4] YU Wen-jia, DING Shi-fei. Conditional Generative Adversarial Network Based on Self-attention Mechanism [J]. Computer Science, 2021, 48(1): 241-246.
[5] TONG Xin, WANG Bin-jun, WANG Run-zheng, PAN Xiao-qin. Survey on Adversarial Sample of Deep Learning Towards Natural Language Processing [J]. Computer Science, 2021, 48(1): 258-267.
[6] WANG Run-zheng, GAO Jian, HUANG Shu-hua, TONG Xin. Malicious Code Family Detection Method Based on Knowledge Distillation [J]. Computer Science, 2021, 48(1): 280-286.
[7] LU Long-long, CHEN Tong, PAN Min-xue, ZHANG Tian. CodeSearcher:Code Query Using Functional Descriptions in Natural Languages [J]. Computer Science, 2020, 47(9): 1-9.
[8] DING Yu, WEI Hao, PAN Zhi-song, LIU Xin. Survey of Network Representation Learning [J]. Computer Science, 2020, 47(9): 52-59.
[9] TIAN Ye, SHOU Li-dan, CHEN Ke, LUO Xin-yuan, CHEN Gang. Natural Language Interface for Databases with Content-based Table Column Embeddings [J]. Computer Science, 2020, 47(9): 60-66.
[10] HE Xin, XU Juan, JIN Ying-ying. Action-related Network:Towards Modeling Complete Changeable Action [J]. Computer Science, 2020, 47(9): 123-128.
[11] YE Ya-nan, CHI Jing, YU Zhi-ping, ZHAN Yu-liand ZHANG Cai-ming. Expression Animation Synthesis Based on Improved CycleGan Model and Region Segmentation [J]. Computer Science, 2020, 47(9): 142-149.
[12] DENG Liang, XU Geng-lin, LI Meng-jie, CHEN Zhang-jin. Fast Face Recognition Based on Deep Learning and Multiple Hash Similarity Weighting [J]. Computer Science, 2020, 47(9): 163-168.
[13] PAN Zu-jiang, LIU Ning, ZHANG Wei, WANG Jian-yong. MTHAM:Multitask Disease Progression Modeling Based on Hierarchical Attention Mechanism [J]. Computer Science, 2020, 47(9): 185-189.
[14] BAO Yu-xuan, LU Tian-liang, DU Yan-hui. Overview of Deepfake Video Detection Technology [J]. Computer Science, 2020, 47(9): 283-292.
[15] ZHAO Wei, LIN Yu-ming, WANG Chao-qiang, CAI Guo-yong. Opinion Word-pairs Collaborative Extraction Based on Dependency Relation Analysis [J]. Computer Science, 2020, 47(8): 164-170.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] LEI Li-hui and WANG Jing. Parallelization of LTL Model Checking Based on Possibility Measure[J]. Computer Science, 2018, 45(4): 71 -75 .
[2] SUN Qi, JIN Yan, HE Kun and XU Ling-xuan. Hybrid Evolutionary Algorithm for Solving Mixed Capacitated General Routing Problem[J]. Computer Science, 2018, 45(4): 76 -82 .
[3] ZHANG Jia-nan and XIAO Ming-yu. Approximation Algorithm for Weighted Mixed Domination Problem[J]. Computer Science, 2018, 45(4): 83 -88 .
[4] WU Jian-hui, HUANG Zhong-xiang, LI Wu, WU Jian-hui, PENG Xin and ZHANG Sheng. Robustness Optimization of Sequence Decision in Urban Road Construction[J]. Computer Science, 2018, 45(4): 89 -93 .
[5] SHI Wen-jun, WU Ji-gang and LUO Yu-chun. Fast and Efficient Scheduling Algorithms for Mobile Cloud Offloading[J]. Computer Science, 2018, 45(4): 94 -99 .
[6] ZHOU Yan-ping and YE Qiao-lin. L1-norm Distance Based Least Squares Twin Support Vector Machine[J]. Computer Science, 2018, 45(4): 100 -105 .
[7] LIU Bo-yi, TANG Xiang-yan and CHENG Jie-ren. Recognition Method for Corn Borer Based on Templates Matching in Muliple Growth Periods[J]. Computer Science, 2018, 45(4): 106 -111 .
[8] GENG Hai-jun, SHI Xin-gang, WANG Zhi-liang, YIN Xia and YIN Shao-ping. Energy-efficient Intra-domain Routing Algorithm Based on Directed Acyclic Graph[J]. Computer Science, 2018, 45(4): 112 -116 .
[9] CUI Qiong, LI Jian-hua, WANG Hong and NAN Ming-li. Resilience Analysis Model of Networked Command Information System Based on Node Repairability[J]. Computer Science, 2018, 45(4): 117 -121 .
[10] WANG Zhen-chao, HOU Huan-huan and LIAN Rui. Path Optimization Scheme for Restraining Degree of Disorder in CMT[J]. Computer Science, 2018, 45(4): 122 -125 .