计算机科学 ›› 2024, Vol. 51 ›› Issue (5): 200-207.doi: 10.11896/jsjkx.230200189

• 人工智能 • 上一篇    下一篇

结合句法增强与图注意力网络的方面级情感分类

张泽宝, 余翰男, 王勇, 潘海为   

  1. 哈尔滨工程大学计算机科学与技术学院 哈尔滨 150000
    哈尔滨工程大学电子政务建模仿真国家工程实验室 哈尔滨 150000
  • 收稿日期:2023-02-24 修回日期:2023-06-27 出版日期:2024-05-15 发布日期:2024-05-08
  • 通讯作者: 王勇(wangyongcs@hrbeu.edu.cn)
  • 作者简介:(zhangzebao@hrbeu.edu.cn)
  • 基金资助:
    国家自然科学基金(62072135);教育部人文社科研究项目(20YJCZH172);国家重点研发计划(2022YFC3301800)

Combining Syntactic Enhancement with Graph Attention Networks for Aspect-based Sentiment Classification

ZHANG Zebao, YU Hannan, WANG Yong, PAN Haiwei   

  1. School of Computer Science and Technology,Harbin Engineering University,Harbin 150000,ChinaModeling and Emulation in E-Government National Engineering Laboratory,Harbin Engineering University,Harbin 150000,China
  • Received:2023-02-24 Revised:2023-06-27 Online:2024-05-15 Published:2024-05-08
  • About author:ZHANG Zebao,born in 1978,Ph.D,lecturer.His main research interests include natural language processing,data management and data mining.
    WANG Yong,born in 1983,Ph.D,lecturer.His main research interests include social computing,big data analysis and information security.
  • Supported by:
    National Natural Science Foundation of China(62072135),Humanities and Social Sciences Research Project of the Ministry of Education(20YJCZH172) and National Key Research and Development Program of China(2022YFC3301800).

摘要: 方面级情感分类旨在识别给定特定方面文本的情感极性,在本领域中,将图神经网络与句法依赖解析相结合是当下热门的研究方向之一,此类方法通过句法解析捕捉句子中词与词之间的关系,依此构建图结构,输入图神经网络中得到情感极性。若句法解析器出现解析错误,将会对以图为基础的图神经网络模型产生巨大影响。为了增强解析器生成的句法依赖树的解析结果,文中提出了一种句法增强图注意力网络,该网络通过融合多个解析器的解析结果,提高句法依赖解析精度,得到更精准的依赖关系句法图;在图注意力网络中使用密集连接机制捕获更丰富的特征,更适配于增强后的句法图,同时引入方面注意力机制捕获方面语义特征。实验结果验证了句法增强方法的有效性,在3个基准数据集上的分类准确度都有所提高,在方面级情感分析领域具有较好的表现。

关键词: 方面级情感分析, 依赖解析, 句法增强, 图注意力网络, 密集连接

Abstract: Aspect-level sentiment classification aims to identify the emotional polarity of a given aspect text.In this field,the combination of graph neural network and syntactic dependency parsing is one of the current hot research directions.Based on the relationship between them,the graph structure is constructed and input into the graph neural network to obtain the emotional polarity.If the syntax parser makes a parsing error,the impact on the graph-based graph neural network model will be huge.In order to enhance the parsing results of the syntactic dependency tree generated by the parser,a syntactically enhanced graph attention network is proposed.By fusing the parsing results of multiple parsers,the parsing accuracy of syntactic dependencies is improved,and a more accurate dependency syntactic graph is obtained.A densely connected mechanism is used in graph attention networks to capture richer features,which are more suitable for enhanced syntactic graphs,and the aspect attention mechanism is introduced to capture aspect semantic features.Experimental results verify the effectiveness of the syntactic enhancement method.The classification accuracy on the three benchmark datasets has been improved,and it has a better performance in the field of aspect-level sentiment analysis.

Key words: Aspect-level sentiment analysis, Dependency parsing, Syntax enhancement, Graph attention network, Dense connection

中图分类号: 

  • TP391
[1]MA J,CAI X,WEI D,et al.Aspect-Based Attention LSTM for Aspect-Level Sentiment Analysis[C]//2021 3rd World Symposium on Artificial Intelligence(WSAI).2021.
[2]JIA Y,WANG Y,ZAN H,et al.Syntactic Information and Multiple Semantic Segments for Aspect-Based Sentiment Classification[J].International Journal of Asian Language Processing,2021,31:2250006.
[3]SUN K,ZHANG R,MENSAH S,et al.Aspect-Level Sentiment Analysis Via Convolution over Dependency Tree[C]//Procee-dings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing(EMNLP-IJCNLP).2019.
[4]JORDAN M I.Serial order:A parallel distributed processing approach[J].ICS-Report 8604 Institute for Cognitive Science University of California,1986,121:64.
[5]TANG D,QIN B,FENG X,et al.Effective LSTMs for Target-Dependent Sentiment Classification[C]//Proceedings of COLING 2016,the 26th International Conference on Computational Linguistics:Technical Papers.2016:3298-3307.
[6]CHEN P C,SUN Z,BING L,et al.Recurrent Attention Network on Memory for Aspect Sentiment Analysis[C]//Procee-dings of the 2017 Conference on Empirical Methods in Natural Language Processing.2017.
[7]KIM Y.Convolutional Neural Networks for Sentence Classification[J].arXiv:1408.5882,2014.
[8]HUANG B,CARLEY K M.Parameterized Convolutional Neu-ral Networks for Aspect Level Sentiment Classification[C]//Empirical Methods in Natural Language Processing.Association for Computational Linguistics,2019.
[9]WANG X,LI F,ZHANG Z,et al.A Unified Position-awareConvolutional Neural Network for Aspect Based Sentiment Analysis[J].Neurocomputing,2021,450(12):91-103.
[10]WANG Y,HUANG M,ZHU X,et al.Attention-based LSTM for Aspect-level Sentiment Classification[C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing.2016.
[11]LIU J,YUE Z.Attention Modeling for Targeted Sentiment[C]//Conference of the European Chapter of the Association for Computational Linguistics.2017.
[12]MA D,LI S,ZHANG X,et al.Interactive Attention Networks for Aspect-Level Sentiment Classification[C]//Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence(IJCAI).2017:4068-4074.
[13]FAN C,GAO Q,DU J,et al.Convolution-based Memory Network for Aspect-based Sentiment Analysis[C]//The 41st International ACM SIGIR Conference.ACM,2018.
[14]LI X,BING L,LAM W,et al.Transformation Networks for Target-Oriented Sentiment Classification[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics(ACL).2018:946-956.
[15]KIPF T N,WELLING M.Semi-Supervised Classification withGraph Convolutional Networks[C]//Proceedings of the International Conference on Learning Representations(ICLR).2017.
[16]XIAO L,HU X,CHEN Y,et al.Targeted Sentiment Classification Based on Attentional Encoding and Graph Convolutional Networks[J].Applied Sciences,2020,10(3):957.
[17]XIAO Y,ZHOU G.Syntactic Edge-Enhanced Graph Convolu-tional Networks for Aspect-Level Sentiment Classification With Interactive Attention[J].IEEE Access,2020,8:157068-157080.
[18]TIAN Y,CHEN G,SONG Y.Aspect-based Sentiment Analysis with Type-aware Graph Convolutional Networks and Layer Ensemble[C]//Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.2021.
[19]VELIKOVI P,CUCURULL G,CASANOVA A,et al.GraphAttention Networks[C]//Proceedings of the International Conference on Learning Representations(ICLR).2018.
[20]BAI X,LIU P,ZHANG Y.Exploiting Typed Syntactic Depen-dencies for Targeted Sentiment Classification Using Graph Attention Neural Network[J].IEEE/ACM Transactionson Audio,Speech,and Language Processing,2021,29:503-514.
[21]YUAN L,WANG J,YU L C,et al.Graph attention network with memory fusion for aspect-level sentiment analysis[C]//Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing.2020:27-36.
[22]XU G T,LIU P Y,ZHU Z F,et al.Attention-Enhanced Graph Convolutional Networks for Aspect-Based Sentiment Classification with Multi-Head Attention[J].Applied Sciences,2021,11(8):3640.
[23]HOU X,HUANG J,WANG G,et al.Selective Attention Based Graph Convolutional Networks for Aspect-Level Sentiment Classification[C]//Proceedings of the Fifteenth Workshop on Graph-Based Methods for Natural Language Processing(TextGraphs-15).2021.
[24]BAHDANAU D,CHO K,BENGIO Y.Neural Machine Translation by Jointly Learning to Align and Translate[C]//Procee-dings of the International Conference on Learning Representations(ICLR).2015.
[25]DEVLIN J,CHANG M W,LEE K,et al.BERT:Pre-training of Deep Bidirectional Transformers for Language Understanding[C]//NAACL-HLT.2019:4171-4186.
[26]DOZAT T,MANNING C D.Deep Biaffine Attention for Neural Dependency Parsing[C]//Proceedings of the International Conference on Learning Representations(ICLR).2017.
[27]MANNING C D,SURDEANU M,BAUER J,et al.The Stanford CoreNLP natural language processing toolkit[C]//Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics:System Demonstrations.2014:55-60.
[28]HUANG G,LIU Z,LAURENS V,et al.Densely ConnectedConvolutional Networks[C]//IEEE Computer Society.IEEE Computer Society,2016.
[29]HERCIG T,T BRYCHCÍN,SVOBODA L,et al.UWB at Se-mEval-2016 Task 5:Aspect Based Sentiment Analysis[C]//Proceedings of the 10th International Workshop on Semantic Evaluation.2016.
[30]LI D,WEI F,TAN C,et al.Adaptive Recursive Neural Network for Target-dependent Twitter Sentiment Classification[C]//Meeting of the Association for Computational Linguistics.2014.
[31]JIANG Q,CHENL,XU R,et al.A Challenge Dataset and Effective Models for Aspect-Based Sentiment Analysis[C]//Procee-dings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing(EMNLP-IJCNLP).2019.
[32]KINGMA D,BA J.Adam:A Method for Stochastic Optimization[C]//Conference on Neural Information Processing Systems(NIPS).2014.
[33]FAN F,FENG Y,ZHAO D.Multi-grained Attention Network for Aspect-Level Sentiment Classification[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing.2018.
[34]SONG Y,WANG J,TAO J,et al.Attentional Encoder Network for Targeted Sentiment Classification[J].arXiv:1902.09314,2019.
[35]LI X,LU R,LIU P,et al.Graph convolutional networks withhierarchical multi-head attention for aspect-level sentiment classification[J].The Journal of Supercomputing,2022,78(13):14846-14865.
[36]HUANG B,CARLEY K M.Syntax-Aware Aspect Level Sentiment Classification with Graph Attention Networks[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Confe-rence on Natural Language Processing(EMNLP-IJCNLP).2019:5469-5477.
[37]ZENG J,LIU T,JIA W,et al.Relation construction for aspect-level sentiment classification[J].Information Sciences,2022,586:209-223.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!