Computer Science ›› 2026, Vol. 53 ›› Issue (3): 341-350.doi: 10.11896/jsjkx.250300039

• Artificial Intelligence • Previous Articles     Next Articles

Enhanced Multi-turn Machine Reading Comprehension for Aspect Sentiment Triplet Extraction

HAO Yuanbin1, DUAN Liguo1,2, LI Aiping1, CHEN Jiahao1, CUI Juanjuan1, CHANG Xuanwei1   

  1. 1 Department of Computer Science and Technology, Taiyuan University of Technology, Taiyuan 030024, China
    2 Shanxi Electronic Science and Technology Institute, Linfen, Shanxi 041000, China
  • Received:2025-03-10 Revised:2025-05-26 Online:2026-03-15 Published:2026-03-12
  • About author:HAO Yuanbin,born in 1999,postgra-duate,is a member of CCF(No.Z0508G).His main research interest is sentiment analysis.
    DUAN Liguo,born in 1970,professor,is a member of CCF(No.15823S).His main research interest is natural language processing.
  • Supported by:
    Natural Science Foundation of Shanxi Province,China(202203021221234,202303021211052,202303021222248).

Abstract: ASTE aims to simultaneously extract aspects,their corresponding opinions,and sentiment polarities from text.It is an emerging and challenging task in aspect-level sentiment analysis.Among existing methods,those based on multi-turn machine reading comprehension have effectively achieved sentiment triplet extraction,but they still exhibit certain limitations.Firstly,the single text feature in multi-turn reading comprehension struggles to adapt to specific subtasks.Secondly,the global self-attention mechanism lacks focus on syntactically more important words and assigns higher attention weights to less significant words.To address these issues,this paper proposes an enhanced multi-turn machine reading comprehension(EMT-MRC) method,which designs a bidirectional attention flow in each turn of reading comprehension to construct the interaction between text and questions,thereby obtaining task-specific text representations.Additionally,dependency syntactic relations are integrated into the Transformer encoder,which constrains the model’s attention distribution through dependency distances,thereby enhancing the model’sfocus on the grammatical aspects of sentences.Experiments on two groups of datasets demonstrate the effectiveness of the proposed method.

Key words: Aspect-level sentiment, Triplet extraction, Machine reading comprehension, Dependency syntax, Bidirectional attention flow

CLC Number: 

  • TP391
[1]ZHANG W,LI X,DENG Y,et al.A survey on aspect-basedsentiment analysis:Tasks,methods,and challenges[J].IEEE Transactions on Knowledge and Data Engineering,2022,35(11):11019-11038.
[2]CHEN S,WANG Y,LIU J,et al.Bidirectional machine reading comprehension for aspect sentiment triplet extraction[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2021:12666-12674.
[3]VASWANI A,SHAZEER N,PARMAR N,et al.Attention is all you need[C]//Proceedings of the 31st International Confe-rence on Neural Information Processing Systems.2017:6000-6010.
[4]CHEN Z,QIAN T.Enhancing aspect term extraction with soft prototypes[C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing(EMNLP).2020:2107-2117.
[5]WU Z,ZHAO F,DAI X Y,et al.Latent opinions transfer network for target-oriented opinion words extraction[C]//Procee-dings of the AAAI Conference on Artificial Intelligence.2020:9298-9305.
[6]XUE W,LI T.Aspect Based Sentiment Analysis with GatedConvolutional Networks[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics.2018:2514-2523.
[7]HOU X,FU L,MENG C,et al.Train Once for All:A Transitional Approach for Efficient Aspect Sentiment Triplet Extraction[J].arXiv:2412.00208,2024.
[8]BIE Y,YANG Y.A multitask multiview neural network forend-to-end aspect-based sentiment analysis[J].Big Data Mining and Analytics,2021,4(3):195-207.
[9]ZHANG H Y,DUAN L G,WANG Q C,et al.Multi-entity sentiment analysis of long text based on multi-task joint training[J].Computer Science,2024,51(6):309-316.
[10]PENG H,XU L,BING L,et al.Knowing what,how and why:A near complete solution for aspect-based sentiment analysis[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2020:8600-8607.
[11]LI X,BING L,ZHANG W,et al.Exploiting BERT for End-to-End Aspect-based Sentiment Analysis[C]//Proceedings of the 5th Workshop on Noisy User-generated Text(W-NUT 2019).2019:34-41.
[12]KENTON J D M W C,TOUTANOVA L K.BERT:Pre-training of deep bidirectional transformers for language understanding[C]//Proceedings of NAACL-HLT.2019.
[13]WU Z,YING C,ZHAO F,et al.Grid Tagging Scheme for Aspect-oriented Fine-grained Opinion Extraction[C]//Findings of the Association for Computational Linguistics:EMNLP 2020.2020:2576-2585.
[14]XU L,LI H,LU W,et al.Position-Aware Tagging for Aspect Sentiment Triplet Extraction[C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing(EMNLP).2020:2339-2349.
[15]XU L,CHIA Y K,BING L.Learning Span-Level Interactions for Aspect Sentiment Triplet Extraction[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing.2021:4755-4766.
[16]LI Y,LIN Y,LIN Y,et al.A span-sharing joint extractionframework for harvesting aspect sentiment triplets[J].Know-ledge-Based Systems,2022,242:108366.
[17]LIU Y,ZHOU Y,LI Z,et al.HIM:An end-to-end hierarchical interaction model for aspect sentiment triplet extraction[J].IEEE/ACM Transactions on Audio,Speech,and Language Processing,2023,31:2272-2285.
[18]WANG Y,CHEN Z,CHEN S.ES-ASTE:enhanced span-level framework for aspect sentiment triplet extraction[J].Journal of Intelligent Information Systems,2023,60(3):593-612.
[19]YANG X,PENG T,BI H,et al.Span-level bidirectional retention scheme for aspect sentiment triplet extraction[J].Information Processing & Management,2024,61(5):103823.
[20]PENG K,JIANG L,PENG H,et al.Prompt based tri-channel graph convolution neural network for aspect sentiment triplet extraction[C]//Proceedings of the 2024 SIAM International Conference on Data Mining(SDM).Society for Industrial and Applied Mathematics,2024:145-153.
[21]MAO Y,SHEN Y,YU C,et al.A joint training dual-mrc framework for aspect based sentiment analysis[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2021:13543-13551.
[22]ZHAI Z,CHEN H,FENG F,et al.COM-MRC:A COntext-masked machine reading comprehension framework for aspect sentiment triplet extraction[C]//Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing.2022:3230-3241.
[23]WANG K,LIU Y,ZHANG K,et al.QoMRC:Query-oriented Machine Reading Comprehension Framework for Aspect Sentiment Triplet Extraction[C]//International Conference on Database Systems for Advanced Applications.Singapore:Springer,2024:173-189.
[24]ZOU W,ZHANG W,WU W,et al.A multi-task shared cascade learning for aspect sentiment triplet extraction using BERT-MRC[J].Cognitive Computation,2024,16(4):1554-1571.
[25]ZHANG Z,WU Y,ZHOU J,et al.SG-Net:Syntax guided transformer for language representation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,44(6):3285-3299.
[26]KINGMA D P,BA J.Adam:A method for stochastic optimization[J].arXiv:1412.6980,2014.
[27]LI Y,HE Q,ZHANG D.Dual graph convolutional networks integrating affective knowledge and position information for aspect sentiment triplet extraction[J].Frontiers in Neurorobotics,2023,17:1193011.
[28]HOU S,KAI J,XUE H,et al.Syntax-guided Localized Self-at-tention by Constituency Syntactic Distance[C]//Findings of the Association for Computational Linguistics:EMNLP 2022.2022:2334-2341.
[29]GAO L,WANG Y,LIU T,et al.Question-driven span labeling model for aspect-opinion pair extraction[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2021:12875-12883.
[1] CHANG Xuanwei, DUAN Liguo, CHEN Jiahao, CUI Juanjuan, LI Aiping. Method for Span-level Sentiment Triplet Extraction by Deeply Integrating Syntactic and Semantic
Features
[J]. Computer Science, 2026, 53(2): 322-330.
[2] ZHANG Zebao, YU Hannan, WANG Yong, PAN Haiwei. Combining Syntactic Enhancement with Graph Attention Networks for Aspect-based Sentiment Classification [J]. Computer Science, 2024, 51(5): 200-207.
[3] GU Wenxia, ZAOKERE Kadeer, YANG Qian, AISHAN Wumaier. Multilingual Opinion Factor Extraction Fusing Aspect Semantics and Grid Tagging [J]. Computer Science, 2024, 51(4): 324-333.
[4] LUO Yuanyuan, YANG Chunming, LI Bo, ZHANG Hui, ZHAO Xujian. Chinese Medical Named Entity Recognition Method Incorporating Machine ReadingComprehension [J]. Computer Science, 2023, 50(9): 287-294.
[5] YANG Zhizhuo, XU Lingling, Zhang Hu, LI Ru. Answer Extraction Method for Reading Comprehension Based on Frame Semantics and GraphStructure [J]. Computer Science, 2023, 50(8): 170-176.
[6] WANG Yali, ZHANG Fan, YU Zeng, LI Tianrui. Aspect-level Sentiment Classification Based on Interactive Attention and Graph Convolutional Network [J]. Computer Science, 2023, 50(4): 196-203.
[7] LI Shuai, XU Bin, HAN Yike, LIAO Tongxin. SS-GCN:Aspect-based Sentiment Analysis Model with Affective Enhancement and Syntactic Enhancement [J]. Computer Science, 2023, 50(3): 3-11.
[8] LIU Luping, ZHOU Xin, CHEN Junjun, He Xiaohai, QING Linbo, WANG Meiling. Event Extraction Method Based on Conversational Machine Reading Comprehension Model [J]. Computer Science, 2023, 50(2): 275-284.
[9] ZHANG Longji, ZHAO Hui. Aspect-level Sentiment Analysis Integrating Syntactic Distance and Aspect-attention [J]. Computer Science, 2023, 50(12): 262-269.
[10] KANG Shuming, ZHU Yan. Text Stance Detection Based on Topic Attention and Syntactic Information [J]. Computer Science, 2023, 50(11A): 230200068-5.
[11] QIU Jia-zuo, XIONG De-yi. Frontiers in Neural Question Generation:A Literature Review [J]. Computer Science, 2021, 48(6): 159-167.
[12] YIN Jiu, CHI Kai-kai, HUAN Ruo-hong. Aspect-level Sentiment Analysis of Text Based on ATT-DGRU [J]. Computer Science, 2021, 48(5): 217-224.
[13] LI Zhou-jun,WANG Chang-bao. Survey on Deep-learning-based Machine Reading Comprehension [J]. Computer Science, 2019, 46(7): 7-12.
[14] LIU Fei-long, HAO Wen-ning, CHEN Gang, JIN Da-wei and SONG Jia-xing. Attention of Bilinear Function Based Bi-LSTM Model for Machine Reading Comprehension [J]. Computer Science, 2017, 44(Z6): 92-96.
[15] DONG Ren-song,WANG Hua,ZHANG Xiao-zhong,YU Zheng-tao and ZHANG Tao. Effects of Statistical Machine Translation with Language Model of Dependency Syntax Relationship [J]. Computer Science, 2014, 41(2): 99-101.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!