Computer Science ›› 2023, Vol. 50 ›› Issue (12): 262-269.doi: 10.11896/jsjkx.221000090

• Artificial Intelligence • Previous Articles     Next Articles

Aspect-level Sentiment Analysis Integrating Syntactic Distance and Aspect-attention

ZHANG Longji1, ZHAO Hui2   

  1. 1 College of Software,Xinjiang University,Urumqi 830000,China
    2 School of Information Science and Engineering,Xinjiang University,Urumqi 830000,China
  • Received:2022-10-12 Revised:2023-03-15 Online:2023-12-15 Published:2023-12-07
  • About author:ZHANG Longji,born in 1996,postgra-duate.His main research interests include natural language processing,aspect based sentiment analysis,etc.
    ZHAO Hui,born in 1972,Ph.D,professor,Ph.D supervisor,is a member of China Computer Federation.Her main research interests include artificial intelligence,affective computing,speech and digital image processing.
  • Supported by:
    National Natural Science Foundation of China(62166041).

Abstract: Currently,the over-smoothing problem arises from deep convolution in syntactic dependency tree-based graph convolutional networks.This problem prevents the convolutional graph network from extracting the global node information of the syntactic dependency tree.Although the sequential model can extract information about the context of the sentence,the timing-dependent nature of the sequential model leads to the inability of the graph convolutional network to effectively distinguish the contribution of context features to aspect terms.This paper proposes a novel graph convolutional network model based on syntactic distance and aspect focus attention mechanisms to address the above problems.First,the model learns the contextual information of sentences and aspect terms separately using a bidirectional long short-term memory network and uses a convolutional graph network to learn the syntactic dependency information of sentences.Secondly,this model calculates the syntactic dependency distance among all nodes based on the syntactic dependency tree,sets a threshold to weaken the weight share of long-distance features,and improves the ability of the graph convolution model to distinguish context features.Finally,this paper also designs attention mechanisms with residual connectivity to automatically guide the aspect terms to focus on the critical information in the sentence.Experimental results demonstrate that the model exhibits better analytical performance on several publicly available datasets compared to the baseline approach,with sentiment classification accuracy as high as 75.94% and 78.59% on the Twitter and Laptop datasets,demonstrating the effectiveness of the proposed approach.

Key words: Graph convolutional networks, Syntactic dependency tree, Syntactic dependency distances, Attention mechanisms, Aspect-level sentiment analysis

CLC Number: 

  • TP391
[1]DONTHU N,KUMAR S,PANDEY N,et al.Mapping the electronic word-of-mouth(eWOM) research:A systematic review and bibliometric analysis[J].Journal of Business Research,2021,135:758-773.
[2]DANDREA E,DUCANGE P,BECHINI A,et al.Monitoringthe public opinion about the vaccination topic from tweets ana-lysis[J].Expert Systems with Applications,2019,116:209-226.
[3]KULKARNI K,KALRO A D,SHARMA D,et al.A typology of viral ad sharers using sentiment analysis[J].Journal of Retailing and Consumer Services,2020,53:101739.
[4]MEDSKER L R,JAIN L C.Recurrent neural networks[J].Design and Applications,2001,5:64-67.
[5]GRAVES A,MOHAMED A,HINTON G.Speech recognitionwith deep recurrent neural networks[C]//2013 IEEE International Conference on Acoustics,Speech and Signal Processing.IEEE,2013:6645-6649.
[6]DEY R,SALEM F M.Gate-variants of gated recurrent unit(GRU) neural networks[C]//2017 IEEE 60th International Midwest Symposium on Circuits and Systems(MWSCAS).IEEE,2017:1597-1600.
[7]HE R D,LEE W S,NG H T,et al.Effective Attention Modeling for Aspect-Level Sentiment Classification[C]//International Conference on Computational Linguistics.Association for Computational Linguistics,2018:1121-1131.
[8]KIPF T N,WELLING M.Semi-supervised classification withgraph convolutional networks[J].arXiv:1609.02907,2016.
[9]ZHANG Y H,QI P,MANNING C D.Graph convolution overpruned dependency trees improves relation extraction[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing.2018:2205-2215.
[10]VELIČKOVIĆ P,CUCURULL G,CASANOVA A,et al.Graph attention networks[J].arXiv:1710.10903,2017.
[11]HAN H,WU Y H,QIN X Y.An interaction graph attentionnetworks model for aspect-level sentiment analysis[J].Journal of Electronics and Information,2021,43(11):3282-3290.
[12]WU H S,MIAO Y Q,ZHANG W Z,et al.Aspect level sentiment analysis based on distance and graph convolution network[J].Journal of Application Research of Computers,2021,38(11):3274-3278.
[13]TANG D Y,QIN B,FENG X,et al.Effective LSTMs for target-dependent sentiment classification[J].arXiv:1512.01100,2015.
[14]WANG Y Q,HUANG M L,ZHU X Y,et al.Attention-based LSTM for aspect-level sentiment classification[C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing.2016:606-615.
[15]MA D H,LI S J,ZHANG X D,et al.Interactive attention networks for aspect-level sentiment classification[J].arXiv:1709.00893,2017.
[16]CHEN P,SUN Z Q,BING L D,et al.Recurrent attention network on memory for aspect sentiment analysis[C]//Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing.2017:452-461.
[17]FAN F,FENG Y S,ZHAO D Y.Multi-grained attention net-work for aspect-level sentiment classification[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing.2018:3433-3442.
[18]XING B W,LIAO L J,SONG D,et al.Earlier attention? aspect-aware LSTM for aspect-based sentiment analysis[J].arXiv:1905.07719,2019.
[19]GU S Q,ZHANG L P,HOU Y X,et al.A position-aware bidirectional attention network for aspect-level sentiment analysis[C]//Proceedings of the 27th International Conference on Computational Linguistics.2018:774-784.
[20]GILMER J,SCHOENHOLZ S,RILEY P F,et al.Message pas-sing neural networks[M]//Machine Learning Meets Quantum Physics.Cham:Springer,2020:199-214.
[21]SUN K,ZHANG R C,MENSAH S,et al.Aspect-level sentiment analysis via convolution over dependency tree[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Confe-rence on Natural Language Processing(EMNLP-IJCNLP).2019:5679-5688.
[22]ZHANG C,LI Q C,SONG D W.Aspect-based sentiment classification with aspect-specific graph convolutional networks[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing(EMNLP-IJCNLP).2019:4568-4578.
[23]LU Q,ZHU Z F,ZHANG G Y,et al.Aspect-gated graph convolutional networks for aspect-based sentimentanalysis[J].Applied Intelligence,2021,51(7):4408-4419.
[24]CHEN J P,HUANG Z H,XUE Y.Bilateral-brain-like Semantic and Syntactic Cognitive Network for Aspect-level Sentiment Analysis[C]//2021 International Joint Conference on Neural Networks(IJCNN).IEEE,2021:1-8.
[25]CHEN C H,TENG Z Y,ZHANG Y.Inducing target-specific latent structures for aspect sentiment classification[C]//Procee-dings of the 2020 Conference on Empirical Methods in Natural Language Processing(EMNLP).2020:5596-5607.
[26]ZHANG M,QIAN T Y.Convolution over hierarchical syntactic and lexical graphs for aspect level sentiment analysis[C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing(EMNLP).2020:3540-3549.
[27]PANG S G,XUE Y,YAN Z H,et al.Dynamic and multi-channel graph convolutional networks for aspect-based sentiment analysis[C]//Findings of the Association for Computational Linguistics:ACL-IJCNLP 2021.2021:2627-2636.
[28]LI R F,CHEN H,FENG F X,et al.Dual graph convolutional networks for aspect-based sentiment analysis[C]//Proceedings of the 59th Annual Meeting of the Association for Computa-tional Linguistics and the 11th International Joint Conference on Natural Language Processing(Volume 1:Long Papers).2021:6319-6329.
[29]LI D,WEI F R,TAN C Q,et al.Adaptive recursive neural net-work for target-dependent twitter sentiment classification[C]//Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics(volume 2:Short papers).2014:49-54.
[30]PONTIKI M,GALANIS D,PAPAGEORGIOU H,et al.Semeval-2016 task 5:Aspect based sentiment analysis[C]//International Workshop on Semantic Evaluation.2016:19-30.
[1] LUO Huilan, LONG Jun, LIANG Miaomiao. Attentional Feature Fusion Approach for Siamese Network Based Object Tracking [J]. Computer Science, 2023, 50(6A): 220300237-9.
[2] YANG Ying, ZHANG Fan, LI Tianrui. Aspect-based Sentiment Analysis Based on Dual-channel Graph Convolutional Network with Sentiment Knowledge [J]. Computer Science, 2023, 50(5): 230-237.
[3] WANG Yali, ZHANG Fan, YU Zeng, LI Tianrui. Aspect-level Sentiment Classification Based on Interactive Attention and Graph Convolutional Network [J]. Computer Science, 2023, 50(4): 196-203.
[4] LI Shuai, XU Bin, HAN Yike, LIAO Tongxin. SS-GCN:Aspect-based Sentiment Analysis Model with Affective Enhancement and Syntactic Enhancement [J]. Computer Science, 2023, 50(3): 3-11.
[5] WANG Zhendong, DONG Kaikun, HUANG Junheng, WANG Bailing. SemFA:Extreme Multi-label Text Classification Model Based on Semantic Features and Association Attention [J]. Computer Science, 2023, 50(12): 270-278.
[6] DENG Ruhan, ZHANG Qinghua, HUANG Shuaishuai, GAO Man. Novel Graph Convolutional Network Based on Multi-granularity Feature Fusion for Aspect-basedSentiment Analysis [J]. Computer Science, 2023, 50(10): 80-87.
[7] WANG Lin, LIU Zhe, SHI Dianxi, ZHOU Chenlei, YANG Shaowu, ZHANG Yongjun. Fusion Tracker:Single-object Tracking Framework Fusing Image Features and Event Features [J]. Computer Science, 2023, 50(10): 96-103.
[8] ZHENG Cheng, MEI Liang, ZHAO Yiyan, ZHANG Suhang. Text Classification Method Based on Bidirectional Attention and Gated Graph Convolutional Networks [J]. Computer Science, 2023, 50(1): 221-228.
[9] SUN Jie-qi, LI Ya-feng, ZHANG Wen-bo, LIU Peng-hui. Dual-field Feature Fusion Deep Convolutional Neural Network Based on Discrete Wavelet Transformation [J]. Computer Science, 2022, 49(6A): 434-440.
[10] ZHOU Hai-yu, ZHANG Dao-qiang. Multi-site Hyper-graph Convolutional Neural Networks and Application [J]. Computer Science, 2022, 49(3): 129-133.
[11] PAN Zhi-hao, ZENG Bi, LIAO Wen-xiong, WEI Peng-fei, WEN Song. Interactive Attention Graph Convolutional Networks for Aspect-based Sentiment Classification [J]. Computer Science, 2022, 49(3): 294-300.
[12] ZHANG Bin, LIU Chang-hong, ZENG Sheng, JIE An-quan. Speech-driven Personal Style Gesture Generation Method Based on Spatio-Temporal GraphConvolutional Networks [J]. Computer Science, 2022, 49(11A): 210900094-5.
[13] JIANG Zong-li, LI Miao-miao, ZHANG Jin-li. Graph Convolution of Fusion Meta-path Based Heterogeneous Network Representation Learning [J]. Computer Science, 2020, 47(7): 231-235.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!