Computer Science ›› 2021, Vol. 48 ›› Issue (6): 196-201.doi: 10.11896/jsjkx.200700100

• Artificial Intelligence • Previous Articles     Next Articles

Text Matching Fusion Model Combining Multi-granularity Information

LYU Le-bin, LIU Qun, PENG Lu, DENG Wei-bin , WANG Chong-yu   

  1. Chongqing Key Laboratory of Computational Intelligence,Chongqing University of Posts and Telecommunications,Chongqing 400065,China
  • Received:2020-07-15 Revised:2020-08-20 Online:2021-06-15 Published:2021-06-03
  • About author:LYU Le-bin,born in 1994,master.His main research interests include natural language processing and so on.(lebinlv@foxmail.com)
    LIU Qun,born in 1969,Ph.D,profes-sor,is a member of China Computer Federation.Her main research interests include data mining,complex network and so on.
  • Supported by:
    National Key Research and Development Program of China(2018YFC0832100, 2018YFC0832102) and Key Program of National Natural Science Foundation of China(61936001).

Abstract: Conventional text matching methods are basically divided into representational text matching models and interaction-based text matching models.Since the representation-based text matching model is easy to lose semantic focus and the interaction-based text matching model ignores global information,a text matching fusion model combining multi-granularity information is proposed in this paper.This model fuses two text matching models through interactive attention and expressing attention,and then uses convolutional neural networks to extract multiple different levels of granularity information presented in the text.Then the local important information and global semantic information can be captured.The experimental results on three different text matching tasks show that the proposed model outperform other optimal models by 5.3%,0.4%,1.5% on the NDCG@5 evaluation index respectively.By extracting multiple granularity information of the text and combining interactive attention and expressed attention,the proposed model can effectively pay attention to the text information of different levels,and solve the problem of losing semantics and ignoring global information during the text matching process in the traditional models.

Key words: Expressive attention, Granular network, Interactive attention, Multi-granularity information, Text matching

CLC Number: 

  • TP391
[1]HUANG P S,HE X,GAO J,et al.Learning deep structured semantic models for web search using click through data[C]//Proceedings of the 22nd ACM international conference on Conference on in-formation & knowledge management.California:ACM Press,2013:2333-2338.
[2]PANG L,LAN Y,GUO J,et al.Text matching as image recognition[C]//Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence.Arizona:AAAI Press,2016:2793-2799.
[3]JÄRVELIN K,KEKÄLÄINEN J.Cumulated gain-based evaluation of IR techniques[J].ACM Transactions on Information Systems (TOIS),2002,20(4),422-446.
[4] SHEN Y,HE X,GAO J,et al.Learning semantic representations using convolutional neural networks for web search[C]//International Conference on World Wide Web.Seoul:ACM Press,2014:373-374.
[5]WAN S,LAN Y,GUO J,et al.A deep architecture for semantic matching with multiple positional sentence representations[C]//Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence.Arizona:AAAI Press,2016:2835-2841.
[6]GONG Y,LUO H,ZHANG J.Natural Language Inference over Interaction Space.International Conference on Learning Representations [EB/OL].[2020-7-11].https://arxiv.org/pdf/1709.04348.pdf.
[7] HU B,LU Z,LI H,et al.Convolutional Neural Network Architectures for Matching Natural Language Sentences[C]//Advances in Neural Information Processing Systems.Montreal:MIT Press,2015:2042-2050.
[8]XIONG C,DAI Z,CALLAN J,et al.End-to-End Neural Ad-hoc Ranking with Kernel Pooling[J].In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval.Tokyo:ACM Press,2017,51(cd):55-64.
[9]DAI Z,XIONG C,CALLAN J,et al.Convolutional Neural Networks for Soft-Matching N-Grams in Ad-hoc Search[C]//Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining.California:ACM Press,2018:126-134.
[10]PENNINGTON J,SOCHER R,MANNING C.Glove:GlobalVectors for Word Representation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Proces-sing.Doha,Qatar:ACL Press,2014:1532-1543.
[11]SEO M,KEMBHAVI A,FARHADI A,et al.Bidirectional Attention Flow for Machine Comprehension.arXiv:Computation and Language [EB/OL].[2020-7-11].https://arxiv.org/pdf/1611.01603.pdf.
[12]XIE S,GIRSHICK R,DOLLAR P,et al.Aggregated ResidualTransformations for Deep Neural Networks[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Hawaii:IEEE Press,2017:5987-5995.
[13]YANG Y,YIH W,MEEK C.WikiQA:A Challenge Dataset for Open-Domain Question Answering[C]//In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing.Lisbon,Portugal:ACL Press,2015:2013-2018.
[14]BOWMAN S,ANGELI G,POTTS C,et al.A large annotated corpus for learning natural language inference[C]//Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing.Lisbon,Portugal:ACL Press,2015:632-642.
[15]NAKOV P,MÁRQUEZ L,MOSCHITTI A,et al.SemEval-2016 Task 3:Community Question Answering.ArXiv:Information Retrieval[EB/OL].[2020-07-11].http://arxiv.org/abs/1912.00730.pdf.
[16]FAN Y,PANG L,HOU J,et al.MatchZoo:A Toolkit for Deep Text Matching.ArXiv:Information Retrieval[EB/OL].[2020-07-11].https://arxiv.org/pdf/1707.07270v1.pdf.
[17]MITRA B,DIAZ F,CRASWELL N.Learning to match using local and distributed representations of text for web search[C]//Proceedings of the 26th International Conference on World Wide Web.Australia:ACM Press,2017:1291-1299.
[18]GUO J,FAN Y,AI Q,et al.A Deep Relevance Matching Mo-del for Ad-hoc Retrieval[C]//Conference on Information and Knowledge Management.Indianapolis:ACM Press,2016:55-64.
[19]YANG Z, LAN Q, GUO J,et al.A deeptop-k relevance ma-tching model for ad-hoc retrieval[C]//China Conference on Information Retrieval.Guilin:Springer Press,2018:16-27.
[1] LYU Xiao-feng, ZHAO Shu-liang, GAO Heng-da, WU Yong-liang, ZHANG Bao-qi. Short Texts Feautre Enrichment Method Based on Heterogeneous Information Network [J]. Computer Science, 2022, 49(9): 92-100.
[2] PAN Zhi-hao, ZENG Bi, LIAO Wen-xiong, WEI Peng-fei, WEN Song. Interactive Attention Graph Convolutional Networks for Aspect-based Sentiment Classification [J]. Computer Science, 2022, 49(3): 294-300.
[3] CHEN Zhuo, WANG Guo-yin, LIU Qun. Natural Scene Text Detection Algorithm Combining Multi-granularity Feature Fusion [J]. Computer Science, 2021, 48(12): 243-248.
[4] WU Yu, LI Zhou-jun. Survey on Retrieval-based Chatbots [J]. Computer Science, 2021, 48(12): 278-285.
[5] XU Fang, DENG Min, XIONG Zeng-gang, YE Cong-huan, XU Ning. Data Forwarding Algorithm Based on Multidimensional Context Matching in Mobile Social Networks [J]. Computer Science, 2019, 46(2): 81-87.
[6] . [J]. Computer Science, 2008, 35(12): 167-170.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!