Computer Science ›› 2023, Vol. 50 ›› Issue (3): 3-11.doi: 10.11896/jsjkx.220700238

• Special Issue of Knowledge Engineering Enabled By Knowledge Graph: Theory, Technology and System • Previous Articles     Next Articles

SS-GCN:Aspect-based Sentiment Analysis Model with Affective Enhancement and Syntactic Enhancement

LI Shuai, XU Bin, HAN Yike, LIAO Tongxin   

  1. School of Computer Science and Engineering,Northeastern University,Shenyang 110819,China
  • Received:2022-07-24 Revised:2022-12-06 Online:2023-03-15 Published:2023-03-15
  • About author:LI Shuai,born in 1998,postgraduate.His main research interests include affective computing and aspect-level sentiment analysis.
    XU Bin,born in 1980,Ph.D,associate professor,is a member of China Computer Federation.His main research interests include artificial intelligence and smart education.
  • Supported by:
    Fundamental Research Funds for the Central Universities(N2116019),Liaoning Natural Science Foundation(2022-MS-119) and Teaching Research Project of Computer Basic Education of AFCEC(2022-AFCEC-237).

Abstract: Aspect-based sentiment analysis(ABSA),as a downstream application of knowledge graph,belongs to the fine-grained sentiment analysis task,which aims to understand the sentiment polarity of people on the evaluation target at the aspect level.Relevant research in recent years has made significant progress,but existing methods focus on exploiting sequentiality or syntactic dependency constraints within sentences,and do not fully exploit the type of dependencies between context words and aspect words.In addition,the existing graph-based convolutional neural network models have insufficient ability to retain node features.In response to this problem,firstly,based on the syntactic dependency tree,this paper fully excavates the dependency types between context words and aspect words,and integrates them into the construction of the dependency graph.Second,we define a “sensitive relation set”,which is used to construct auxiliary sentences to enhance the correlation between specific context words and aspect words,and at the same time,combined with the sentiment knowledge network SenticNet to enhance the sentence dependency graph,and then improve the construction of the graph neural network.Finally,a context retention mechanism is introduced to reduce the information loss of node features in the multilayer graph convolution neural network.The proposed SS-GCN model fuses the syntactic and contextual representations learned in parallel to accomplish sentiment enhancement and syntactic enhancement,and extensive experiments on three public datasets demonstrate the effectiveness of SS-GCN.

Key words: Aspect-level sentiment analysis, Graph convolutional networks, SenticNet, Attention mechanism, Bi-LSTM

CLC Number: 

  • TP391
[1]ZHANG C,LI Q,SONG D.Aspect-based sentiment classification with aspect-specific graph convolutional networks[J].ar-Xiv:1909.03477,2019.
[2]ZHOU J,HUANG J X,HU Q V,et al.SK-GCN:Modeling Syntax and Knowledge via Graph Convolutional Network for aspect-level sentiment classification[J].Knowledge-Based Systems,2020(205):106292.
[3]LIANG B,SU H,GUI L,et al.Aspect-based sentiment analysis via affective knowledge enhanced graph convolutional networks[J].Knowledge-Based Systems,2021,235:107643.
[4]CAMBRIA E,SPEER R,HAVASI C,et al.SenticNet:A publicly available semantic resource for opinion mining[C]//AAAI CSK.Arlington,2010:14-18.
[5]CAMBRIA E,HAVASI C,HUSSAIN A.Senticnet 2:A semantic and affective resource for opinion mining and sentiment ana-lysis[C]//Twenty-Fifth International FLAIRS Conference.2012:202-207.
[6]CAMBRIA E,OLSHER D,RAJAGOPAL D.SenticNet 3:acommon and common-sense knowledge base for cognition-driven sentiment analysis[C]//Twenty-eighth AAAI Conference on Artificial Intelligence.2014:1515-1521.
[7]CAMBRIAE,PORIA S,BAJPAI R,et al.SenticNet 4:A semantic resource for sentiment analysis based on conceptual primitives[C]//Proceedings of COLING 2016,the 26th International Conference on Computational Linguistics:Technical papers.2016:2666-2677.
[8]CAMBRIA E,PORIA S,HAZARIKA D,et al.SenticNet 5:Discovering conceptual primitives for sentiment analysis by means of context embeddings[C]//Proceedings of the AAAI Confe-rence on Artificial Intelligence.2018:1795-1802.
[9]CAMBRIA E,LI Y,XING F Z,et al.SenticNet 6:Ensemble application of symbolic and subsymbolic AI for sentiment analysis[C]//Proceedings of the 29th ACM International Conference on Information & Knowledge Management.2020:105-114.
[10]QI P,ZHANG Y,ZHANG Y,et al.Stanza:A Python natural languageprocessing toolkit for many human languages[J].ar-Xiv:2003.07082,2020.
[11]TANG D,QIN B,FENG X,et al.Effective LSTMs for target-dependent sentiment classification[J].arXiv:1512.01100,2015.
[12]WANG Y,HUANG M,ZHU X,et al.Attention-based LSTM for aspect-level sentiment classification[C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing.2016:606-615.
[13]MA D,LI S,ZHANG X,et al.Interactive attention networks for aspect-level sentiment classification[J].arXiv:1709.00893,2017.
[14]CHEN P,SUN Z,BING L,et al.Recurrent attention network on memory for aspect sentiment analysis[C]//Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing.2017:452-461.
[15]LI C B,ZHAO L,LI X G,et al.Text Sentiment Classification Model Based on TF-IDF Weighted Convolutional Neural Network[J].Journal of Chongqing University of Technology(Natural Science),2021,35(11):109-115.
[16]XUE W,LI T.Aspect Based Sentiment Analysis with GatedConvolutional Networks[J/OL].https://arxiv.org/abs/1805.07043.
[17]LI X,BING L,LAM W,et al.Transformation networks for target-oriented sentiment classification[J].arXiv:1805.01086,2018.
[18]HOU X,QI P,WANG G,et al.Graph ensemble learning overmultiple dependency trees for aspect-level sentiment classification[J].arXiv:2103.11794,2021.
[19]WANG K,SHEN W,YANG Y,et al.Relational graph attention network for aspect-based sentiment analysis[J].arXiv:2004.12362,2020.
[20]LI R,CHEN H,FENG F,et al.Dual Graph Convolutional Networks for Aspect-based Sentiment Analysis[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing.2021.
[21]ZHOU J,HUANG J X,HU Q V,et al.SK-GCN:Modeling Syntax and Knowledge via Graph Convolutional Network for aspect-level sentiment classification[J].Knowledge-Based Systems,2020,205(3):106292.
[22]XING F Z,PALLUCCHINI F,CAMBRIA E.Cognitive-inspired domain adaptation of sentiment lexicons[J].Information Processing & Management,2019,56(3):554-564.
[23]ZHONG Q,DING L,LIU J,et al.Knowledge Graph Augmented Network Towards Multiview Representation Learning forAspect-based Sentiment Analysis[J].arXiv:2201.04831,2022.
[24]LI M,LU Q,LONG Y,et al.Inferring affective meanings of words from word embedding[J].IEEE Transactions on Affective Computing,2017,8(4):443-456.
[25]PENNINGTON J,SOCHER R,MANNING C D.Glove:Global vectors for word representation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Proces-sing(EMNLP).2014:1532-1543.
[26]SUN K,ZHANG R,MENSAH S,et al.Aspect-level sentiment analysis via convolution over dependency tree[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing(EMNLP-IJCNLP).2019:5679-5688.
[27]CHEN Y.Convolutional neural network forsentence classifica-tion[D].Waterloo:University of Waterloo,2015.
[28]MARIA P,DIMITRIS G,JOHNP,et al.SemEval-2014 Task 4:Aspect Based Sentiment Analysis[C]//Proceedings of the 8th International Workshop on Semantic Evaluation(SemEval 2014).2014:27-35.
[29]DONG L,WEI F,TAN C,et al.Adaptive recursive neural network for target-dependent twitter sentiment classification[C]//Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics.2014:49-54.
[30]TANG J,LU Z,SU J,et al.Progressive self-supervised attention learning for aspect-level sentiment analysis[J].arXiv:1906.01213,2019.
[31]FAN F,FENG Y,ZHAO D.Multi-grained attention network for aspect-level sentiment classification[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing.2018:3433-3442.
[32]TANG H,JI D,LI C,et al.Dependency graph enhanced dual-transformer structure for aspect-based sentiment classification[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.2020:6578-6588.
[33]ZHU X,ZHU L,GUO J,et al.GL-GCN:Global and local dependency guided graph convolutional networks for aspect-based sentiment classification[J].Expert Systems with Applications,2021,186:115712.
[34]MA Y,PENG H,KHAN T,et al.Sentic LSTM:a hybrid network for targeted aspect-based sentiment analysis[J].Cognitive Computation,2018,10(4):639-650.
[35]WU S,XU Y,WU F,et al.Aspect-based sentiment analysis via fusing multiple sources of textual knowledge[J].Knowledge-Based Systems,2019,183:104868.
[36]LAI S,XU L,LIU K,et al.Recurrent convolutional neural networks for text classification[C]//Twenty-ninth AAAI Confe-rence on Artificial Intelligence.2015:2267-2273.
[1] CHEN Fuqiang, KOU Jiamin, SU Limin, LI Ke. Multi-information Optimized Entity Alignment Model Based on Graph Neural Network [J]. Computer Science, 2023, 50(3): 34-41.
[2] ZHOU Mingqiang, DAI Kailang, WU Quanwang, ZHU Qingsheng. Attention-aware Multi-channel Graph Convolutional Rating Prediction Model for Heterogeneous Information Networks [J]. Computer Science, 2023, 50(3): 129-138.
[3] ZOU Yunzhu, DU Shengdong, TENG Fei, LI Tianrui. Visual Question Answering Model Based on Multi-modal Deep Feature Fusion [J]. Computer Science, 2023, 50(2): 123-129.
[4] QU Zhong, WANG Caiyun. Crack Detection of Concrete Pavement Based on Attention Mechanism and Lightweight DilatedConvolution [J]. Computer Science, 2023, 50(2): 231-236.
[5] LIU Luping, ZHOU Xin, CHEN Junjun, He Xiaohai, QING Linbo, WANG Meiling. Event Extraction Method Based on Conversational Machine Reading Comprehension Model [J]. Computer Science, 2023, 50(2): 275-284.
[6] CAI Xiao, CEHN Zhihua, SHENG Bin. SPT:Swin Pyramid Transformer for Object Detection of Remote Sensing [J]. Computer Science, 2023, 50(1): 105-113.
[7] ZHANG Jingyuan, WANG Hongxia, HE Peisong. Multitask Transformer-based Network for Image Splicing Manipulation Detection [J]. Computer Science, 2023, 50(1): 114-122.
[8] LI Xuehui, ZHANG Yongjun, SHI Dianxi, XU Huachi, SHI Yanyan. AFTM:Anchor-free Object Tracking Method with Attention Features [J]. Computer Science, 2023, 50(1): 138-146.
[9] ZHAO Qian, ZHOU Dongming, YANG Hao, WANG Changchen. Image Deblurring Based on Residual Attention and Multi-feature Fusion [J]. Computer Science, 2023, 50(1): 147-155.
[10] ZHENG Cheng, MEI Liang, ZHAO Yiyan, ZHANG Suhang. Text Classification Method Based on Bidirectional Attention and Gated Graph Convolutional Networks [J]. Computer Science, 2023, 50(1): 221-228.
[11] ZHOU Fang-quan, CHENG Wei-qing. Sequence Recommendation Based on Global Enhanced Graph Neural Network [J]. Computer Science, 2022, 49(9): 55-63.
[12] DAI Yu, XU Lin-feng. Cross-image Text Reading Method Based on Text Line Matching [J]. Computer Science, 2022, 49(9): 139-145.
[13] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[14] XIONG Li-qin, CAO Lei, LAI Jun, CHEN Xi-liang. Overview of Multi-agent Deep Reinforcement Learning Based on Value Factorization [J]. Computer Science, 2022, 49(9): 172-182.
[15] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!