Computer Science

Computer Science ›› 2023, Vol. 50 ›› Issue (3): 266-275.doi: 10.11896/jsjkx.220300022

• Artificial Intelligence • Previous Articles     Next Articles

Document-enhanced Question Answering over Knowledge-Bases

FENG Chengcheng1, LIU Pai2, JIANG Linying1, MEI Xiaohan3, GUO Guibing1   

  1. 1 School of Software,Northeastern University,Shenyang 110000,China
    2 School of Engineering,Westlake University,Hangzhou 310000,China
    3 School of Software,University of Maryland,Maryland MD20740,USA
  • Received:2022-03-02 Revised:2022-08-28 Online:2023-03-15 Published:2023-03-15
  • About author:FENG Chengcheng,born in 1996,postgraduate.Her main research interest is natural language processing.
    JIANG Linying,born in 1972,master,professor.Her main research interests include data analysis,natural language processing,embedded system,and information system engineering.
  • Supported by:
    National Natural Science Foundation of China(61972078) and Technology Foundation of Shenyang,China(21-108-9-19).

PDF (PC)

289

Abstract: Recently,knowledge base(KB) has been widely adopted to the task of question answering(QA) to provide a proper answer for a given question,known as the KBQA problem.However,knowledge base itself may be incomplete(e.g.KB does not contain the answer to the question,or some of the entities and relationships in the question),limiting the overall performance of existing KBQA models.To resolve this issue,this paper proposes a new model to leverage textual documents for KBQA task by providing additional answers to enhance knowledge base coverage and background information to enhance the representation of questions.Specifically,the proposed model consists of three modules,namely entity and question representation module,document and enhanced-question representation module and answer prediction module.The first module aims to learn the representations of entities from the retrieved subgraph of knowledge base.Then,the question representation can be updated with the fusion of seed entities.The second module attempts to learn a proper representation of the document that is relevant to the given question.Then,the question representation can be further improved by fusing the document information.Finally,the last module makes an answer prediction based on the information of knowledge base,updated question and documents.Extensive experiments are conducted on the WebQuestionsSP dataset,and the results show that better accuracy can be obtained in comparison with other counterparts.

Key words: KB-QA, Co-attention, End-to-end, Neural network, Fusion gate function

CLC Number: 

  • TP391
[1]ZETTLEMOYER L S,COLLINS M.Learning context-depen-dent mappings from sentences to logical form[C]//Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP.2009.
[2]KWIATKOWSKI T,CHOI E,ARTZI Y,et al.Scaling semantic parsers with on-the-fly ontology matching[C]//Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing.2013:1545-1556.
[3]YIH S W,CHANG M W,HE X,et al.Semantic parsing viastaged query graph generation:Question answering with know-ledge base[C]//Proceedings of the Joint Conference of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP.2015.
[4]YAO X,VAN DURME B.Information extraction over struc-tured data:Question answering with freebase[C]//Proceedings of the 52nd Annual Meeting of the Association for Computa-tional Linguistics(Volume 1:Long Papers).2014:956-966
[5]XU K,REDDY S,FENG Y,et al.Question answering on freebase via relation extraction and textual evidence[C]// Procee-dings of the 54th Annual Meeting of the Association for Computational Linguistics.2016:2326-2336.
[6]SUN H,DHINGRA B,ZAHEER M,et al.Open domain question answering using early fusion of knowledge bases and text[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing.Brussels,Belgium,2018:4231-4242.
[7]XIONG W,YU M,CHANG S,et al.Improving question answering over incomplete kbs with knowledge-aware reader[C]//Annual Meeting of the Association for Computational Linguistics.2019.
[8]OUYANG D T,XIAO J,YE Y X.Distant supervision for relation extraction with weakconstraints of entity pairs[J].Journal of Jilin University(Engineering and Technology Edition),2019,49(3):912-919.
[9]YIH W,HE X,MEEK C.Semantic parsing for single-relation question answering[C]//Proceedings of the 52nd Annual Mee-ting of the Association for Computational Linguistics(Volume 2:Short Papers).2014:643-648.
[10]GOLUB D,HE X.Character-level question answering with attention[C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing.2016:1598-1607.
[11]YIN W,YU M,XIANG B,et al.Simple question answering byattentive convolutional neural network[J].arXiv:1606.03391,2016.
[12]DAI Z,LI L,XU W.Cfo:Conditional focused neural question answering with large-scale knowledge bases[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics.2016.
[13]WANG G X,HE S Z,LI K,et al.Knowledge Base Question Answering Method Incorporating Fact Text[J].Pattern Recognition and Artificial Intelligence,2021,3(3):267-274.
[14]WU T B,LIU L P,LUO X D,et al.Knowledge Base Question Answering Method Based on Weak Dependency Information[J].Computer Engineering,2021,47(6):76-82.
[15]DONG L,WEI F,ZHOU M,et al.Question answering overfreebase with multi-column convolutional neural networks[C]//Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing(Volume 1:Long Papers).2015:260-269.
[16]HAO Y,ZHANG Y,LIU K,et al.An end-to-end model forquestion answering over knowledge base with cross-attention combining global knowledge[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics(Volume 1:Long Papers).2017:221-231.
[17]CHEN Y,WU L,ZAKI M J.Bidirectional attentive memorynetworks for question answering over knowledge bases[C]//Proceedings of the 2018 Conference on the North American Chapter of the Association for Computational Linguistics.2019.
[18]CHENG Z,ZHOU X,HE X H,et al.Multi-angle AttentionQuestion Answering Model Fused with Position Embedding[J].Innovation of Science and Technolog,2022,26(9):85-88.
[19]DAS R,ZAHEER M,REDDY S,et al.Question answering on knowledge bases and text using universal schema and memory networks[C]//Proceedings of the Annual Meeting of the Association for Computational Linguistics.2017.
[20]LI Z P.Research on Question Answering over Knowledge Bases with External Texts based on Graph Attention Network[D].Guangzhou:South China University of Technology,2020.
[21]HAN J,CHENG B,WANG X.Open domain question answering based on text enhanced knowledge graph with hyperedge infusion[C]//Findings of the Association for Computational Linguistics:EMNLP 2020.2020:1475-1481.
[22]HAVELIWALA T H.Topic-sensitive pagerank:A context-sensitive ranking algorithm for web search[J].IEEE Transactions on Knowledge and Data Engineering,2003,15(4):784-796.
[23]CHEN D,FISCH A,WESTON J,et al.Reading wikipedia to answer open-domain questions[C]//Proceedings of the Association for Computational Linguistics(ACL).2017.
[24]SONG L,ZHANG Y,WANG Z,et al.A graph-to-sequencemodel for AMR-to-text generation[C]//Proceedings of the Association for Computational Linguistics(ACL).2018.
[25]XU K,WU L,WANG Z,et al.Graph2seq:Graph to sequence learning with attention-based neural networks[J].arXiv:1804.00823,2018.
[26]LU J,YANG J,BATRA D,et al.Hierarchical Question-Image Co-Attention for Visual Question Answering [C]//Proceedings of the 30th Conference on Neural Information Processing Systems(NIPS).2016.
[27]YIH W,RICHARDSON M,MEEK C,et al.The value of se-mantic parse labeling for knowledge base question answering[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics(Volume 2:Short Papers).2016:201-206.
[28]MILLER A,FISCH A,DODGE J,et al.Key-value memory networks for directly reading documents[C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing(EMNLP 2016).Austin,Texas,USA,2016:1400-1409.
[29]LIANG C,BERANT J,LE Q,et al.Neural Symbolic Machines:Learning Semantic Parsers on Freebase with Weak Supervision[C]// Proceedings of the 55th Annual Meeting of Association for Computational Linguistics(ACL’17).2017.
[30]SUN H,BEDRAX-WEISS T,COHEN W W.Pullnet:Open domain question answering with iterative retrieval on knowledge bases and text[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing.2019.
[31]SAXENA A,TRIPATHI A,TALUKDAR P.Improving multi-hop question answering over knowledge graphs using knowledge base embeddings[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.2020:4498-4507.
[1] CHEN Fuqiang, KOU Jiamin, SU Limin, LI Ke. Multi-information Optimized Entity Alignment Model Based on Graph Neural Network [J]. Computer Science, 2023, 50(3): 34-41.
[2] YU Jian, ZHAO Mankun, GAO Jie, WANG Congyuan, LI Yarong, ZHANG Wenbin. Study on Graph Neural Networks Social Recommendation Based on High-order and Temporal Features [J]. Computer Science, 2023, 50(3): 49-64.
[3] LI Zhifei, ZHAO Yue, ZHANG Yan. Survey of Knowledge Graph Reasoning Based on Representation Learning [J]. Computer Science, 2023, 50(3): 94-113.
[4] RAO Dan, SHI Hongwei. Study on Air Traffic Flow Recognition and Anomaly Detection Based on Deep Clustering [J]. Computer Science, 2023, 50(3): 121-128.
[5] WANG Xiaofei, FAN Xueqiang, LI Zhangwei. Improving RNA Base Interactions Prediction Based on Transfer Learning and Multi-view Feature Fusion [J]. Computer Science, 2023, 50(3): 164-172.
[6] MEI Pengcheng, YANG Jibin, ZHANG Qiang, HUANG Xiang. Sound Event Joint Estimation Method Based on Three-dimension Convolution [J]. Computer Science, 2023, 50(3): 191-198.
[7] HU Zhongyuan, XUE Yu, ZHA Jiajie. Survey on Evolutionary Recurrent Neural Networks [J]. Computer Science, 2023, 50(3): 254-265.
[8] HUAN Zhigang, JIANG Guoquan, ZHANG Yujian, LIU Liu, LIU Shanshan. Employing Gated Mechanism to Incorporate Multi-features into Chinese Event Coreference Resolution [J]. Computer Science, 2023, 50(3): 291-297.
[9] LI Haitao, WANG Ruimin, DONG Weiyu, JIANG Liehui. Semi-supervised Network Traffic Anomaly Detection Method Based on GRU [J]. Computer Science, 2023, 50(3): 380-390.
[10] ZHANG Qi, YU Shuangyuan, YIN Hongfeng, XU Baomin. Neural Collaborative Filtering for Social Recommendation Algorithm Based on Graph Attention [J]. Computer Science, 2023, 50(2): 115-122.
[11] WEI Qi, ZHAO Juan. Research Progress of Infrared and Visible Image Fusion Algorithms [J]. Computer Science, 2023, 50(2): 190-200.
[12] CAO Jinjuan, QIAN Zhong, LI Peifeng. End-to-End Event Factuality Identification with Joint Model [J]. Computer Science, 2023, 50(2): 292-299.
[13] WANG Xiangwei, HAN Rui, Chi Harold LIU. Hierarchical Memory Pool Based Edge Semi-supervised Continual Learning Method [J]. Computer Science, 2023, 50(2): 23-31.
[14] PU Jinyao, BU Lingmei, LU Yongmei, YE Ziming, CHEN Li, YU Zhonghua. Utilizing Heterogeneous Graph Neural Network to Extract Emotion-Cause Pairs Effectively [J]. Computer Science, 2023, 50(1): 205-212.
[15] ZHANG Rujia, DAI Lu, GUO Peng, WANG Bang. Chinese Nested Named Entity Recognition Algorithm Based on Segmentation Attention andBoundary-aware [J]. Computer Science, 2023, 50(1): 213-220.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.