计算机科学 ›› 2026, Vol. 53 ›› Issue (3): 341-350.doi: 10.11896/jsjkx.250300039

• 人工智能 • 上一篇    下一篇

基于特征增强式多轮机器阅读理解的方面情感三元组抽取

郝渊斌1, 段利国1,2, 李爱萍1, 陈嘉昊1, 崔娟娟1, 常轩伟1   

  1. 1 太原理工大学计算机科学与技术学院 太原 030024
    2 山西电子科技学院 山西 临汾 041000
  • 收稿日期:2025-03-10 修回日期:2025-05-26 出版日期:2026-03-15 发布日期:2026-03-12
  • 通讯作者: 段利国(463035793@qq.com)
  • 作者简介:(781900914@qq.com)
  • 基金资助:
    山西省自然科学基金(202203021221234,202303021211052,202303021222248)

Enhanced Multi-turn Machine Reading Comprehension for Aspect Sentiment Triplet Extraction

HAO Yuanbin1, DUAN Liguo1,2, LI Aiping1, CHEN Jiahao1, CUI Juanjuan1, CHANG Xuanwei1   

  1. 1 Department of Computer Science and Technology, Taiyuan University of Technology, Taiyuan 030024, China
    2 Shanxi Electronic Science and Technology Institute, Linfen, Shanxi 041000, China
  • Received:2025-03-10 Revised:2025-05-26 Published:2026-03-15 Online:2026-03-12
  • About author:HAO Yuanbin,born in 1999,postgra-duate,is a member of CCF(No.Z0508G).His main research interest is sentiment analysis.
    DUAN Liguo,born in 1970,professor,is a member of CCF(No.15823S).His main research interest is natural language processing.
  • Supported by:
    Natural Science Foundation of Shanxi Province,China(202203021221234,202303021211052,202303021222248).

摘要: 方面情感三元组抽取(ASTE)旨在同时提取出文本中的方面及其对应的观点和情感极性,是一项新兴且具有挑战性的方面级情感分析任务。现有方法中,基于多轮机器阅读理解的方法有效实现了情感三元组抽取,但仍存在一定的局限性:其一,多轮阅读理解中单一的文本特征难以适应特定子任务;其二,全局自注意力机制缺乏对语法层面更重要单词的关注,且其对不重要单词赋予更高的注意力权重。针对这些问题,提出一种特征增强式多轮机器阅读理解方法(EMT-MRC),在每轮机器阅读理解中设计双向注意力流构建文本与问题的交互关系,从而获得特定任务感知的文本表示。同时,将依存句法关系整合到Transformer编码器,通过依存距离约束模型注意力分布,加强模型对句子语法层面的关注。通过在两组基准数据集上的实验,证明了提出方法的有效性。

关键词: 方面级情感, 三元组抽取, 机器阅读理解, 依存句法, 双向注意力流

Abstract: ASTE aims to simultaneously extract aspects,their corresponding opinions,and sentiment polarities from text.It is an emerging and challenging task in aspect-level sentiment analysis.Among existing methods,those based on multi-turn machine reading comprehension have effectively achieved sentiment triplet extraction,but they still exhibit certain limitations.Firstly,the single text feature in multi-turn reading comprehension struggles to adapt to specific subtasks.Secondly,the global self-attention mechanism lacks focus on syntactically more important words and assigns higher attention weights to less significant words.To address these issues,this paper proposes an enhanced multi-turn machine reading comprehension(EMT-MRC) method,which designs a bidirectional attention flow in each turn of reading comprehension to construct the interaction between text and questions,thereby obtaining task-specific text representations.Additionally,dependency syntactic relations are integrated into the Transformer encoder,which constrains the model’s attention distribution through dependency distances,thereby enhancing the model’sfocus on the grammatical aspects of sentences.Experiments on two groups of datasets demonstrate the effectiveness of the proposed method.

Key words: Aspect-level sentiment, Triplet extraction, Machine reading comprehension, Dependency syntax, Bidirectional attention flow

中图分类号: 

  • TP391
[1]ZHANG W,LI X,DENG Y,et al.A survey on aspect-basedsentiment analysis:Tasks,methods,and challenges[J].IEEE Transactions on Knowledge and Data Engineering,2022,35(11):11019-11038.
[2]CHEN S,WANG Y,LIU J,et al.Bidirectional machine reading comprehension for aspect sentiment triplet extraction[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2021:12666-12674.
[3]VASWANI A,SHAZEER N,PARMAR N,et al.Attention is all you need[C]//Proceedings of the 31st International Confe-rence on Neural Information Processing Systems.2017:6000-6010.
[4]CHEN Z,QIAN T.Enhancing aspect term extraction with soft prototypes[C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing(EMNLP).2020:2107-2117.
[5]WU Z,ZHAO F,DAI X Y,et al.Latent opinions transfer network for target-oriented opinion words extraction[C]//Procee-dings of the AAAI Conference on Artificial Intelligence.2020:9298-9305.
[6]XUE W,LI T.Aspect Based Sentiment Analysis with GatedConvolutional Networks[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics.2018:2514-2523.
[7]HOU X,FU L,MENG C,et al.Train Once for All:A Transitional Approach for Efficient Aspect Sentiment Triplet Extraction[J].arXiv:2412.00208,2024.
[8]BIE Y,YANG Y.A multitask multiview neural network forend-to-end aspect-based sentiment analysis[J].Big Data Mining and Analytics,2021,4(3):195-207.
[9]ZHANG H Y,DUAN L G,WANG Q C,et al.Multi-entity sentiment analysis of long text based on multi-task joint training[J].Computer Science,2024,51(6):309-316.
[10]PENG H,XU L,BING L,et al.Knowing what,how and why:A near complete solution for aspect-based sentiment analysis[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2020:8600-8607.
[11]LI X,BING L,ZHANG W,et al.Exploiting BERT for End-to-End Aspect-based Sentiment Analysis[C]//Proceedings of the 5th Workshop on Noisy User-generated Text(W-NUT 2019).2019:34-41.
[12]KENTON J D M W C,TOUTANOVA L K.BERT:Pre-training of deep bidirectional transformers for language understanding[C]//Proceedings of NAACL-HLT.2019.
[13]WU Z,YING C,ZHAO F,et al.Grid Tagging Scheme for Aspect-oriented Fine-grained Opinion Extraction[C]//Findings of the Association for Computational Linguistics:EMNLP 2020.2020:2576-2585.
[14]XU L,LI H,LU W,et al.Position-Aware Tagging for Aspect Sentiment Triplet Extraction[C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing(EMNLP).2020:2339-2349.
[15]XU L,CHIA Y K,BING L.Learning Span-Level Interactions for Aspect Sentiment Triplet Extraction[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing.2021:4755-4766.
[16]LI Y,LIN Y,LIN Y,et al.A span-sharing joint extractionframework for harvesting aspect sentiment triplets[J].Know-ledge-Based Systems,2022,242:108366.
[17]LIU Y,ZHOU Y,LI Z,et al.HIM:An end-to-end hierarchical interaction model for aspect sentiment triplet extraction[J].IEEE/ACM Transactions on Audio,Speech,and Language Processing,2023,31:2272-2285.
[18]WANG Y,CHEN Z,CHEN S.ES-ASTE:enhanced span-level framework for aspect sentiment triplet extraction[J].Journal of Intelligent Information Systems,2023,60(3):593-612.
[19]YANG X,PENG T,BI H,et al.Span-level bidirectional retention scheme for aspect sentiment triplet extraction[J].Information Processing & Management,2024,61(5):103823.
[20]PENG K,JIANG L,PENG H,et al.Prompt based tri-channel graph convolution neural network for aspect sentiment triplet extraction[C]//Proceedings of the 2024 SIAM International Conference on Data Mining(SDM).Society for Industrial and Applied Mathematics,2024:145-153.
[21]MAO Y,SHEN Y,YU C,et al.A joint training dual-mrc framework for aspect based sentiment analysis[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2021:13543-13551.
[22]ZHAI Z,CHEN H,FENG F,et al.COM-MRC:A COntext-masked machine reading comprehension framework for aspect sentiment triplet extraction[C]//Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing.2022:3230-3241.
[23]WANG K,LIU Y,ZHANG K,et al.QoMRC:Query-oriented Machine Reading Comprehension Framework for Aspect Sentiment Triplet Extraction[C]//International Conference on Database Systems for Advanced Applications.Singapore:Springer,2024:173-189.
[24]ZOU W,ZHANG W,WU W,et al.A multi-task shared cascade learning for aspect sentiment triplet extraction using BERT-MRC[J].Cognitive Computation,2024,16(4):1554-1571.
[25]ZHANG Z,WU Y,ZHOU J,et al.SG-Net:Syntax guided transformer for language representation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,44(6):3285-3299.
[26]KINGMA D P,BA J.Adam:A method for stochastic optimization[J].arXiv:1412.6980,2014.
[27]LI Y,HE Q,ZHANG D.Dual graph convolutional networks integrating affective knowledge and position information for aspect sentiment triplet extraction[J].Frontiers in Neurorobotics,2023,17:1193011.
[28]HOU S,KAI J,XUE H,et al.Syntax-guided Localized Self-at-tention by Constituency Syntactic Distance[C]//Findings of the Association for Computational Linguistics:EMNLP 2022.2022:2334-2341.
[29]GAO L,WANG Y,LIU T,et al.Question-driven span labeling model for aspect-opinion pair extraction[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2021:12875-12883.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!