Computer Science

Computer Science ›› 2022, Vol. 49 ›› Issue (3): 294-300.doi: 10.11896/jsjkx.210100180

• Artificial Intelligence • Previous Articles     Next Articles

Interactive Attention Graph Convolutional Networks for Aspect-based Sentiment Classification

PAN Zhi-hao, ZENG Bi, LIAO Wen-xiong, WEI Peng-fei, WEN Song   

  1. School of Computer,Guangdong University of Technology,Guangzhou,Guangdong 510006,China
  • Received:2021-01-23 Revised:2021-06-08 Online:2022-03-15 Published:2022-03-15
  • About author:PAN Zhi-hao,born in 1997,postgra-duate.His main research interests include natural language processing and emotion analysis.
    ZENG Bi,born in 1963,professor,is a senior member of China Computer Federation.Her main research interests include machine learning and big data applications.
  • Supported by:
    National Natural Science Foundation of China(61876043), Natural Science Foundation of Guangdong Province(2018A030313868) and Key Technology Projects in High-Tech Industrial Field of Qingyuan(2020KJJH039).

PDF (PC)

724

Abstract: Aspect-based sentiment classification aims at identifying the sentiment polarity of the given aspect in a sentence.Most of the previous methods are based on long short-term memory network(LSTM)and attention mechanisms,which largely rely on the semantic correlation between aspects and contextual words in the modeled sentence,but ignore the syntactic information in the sentence.To tackle this problem,an interactive attention graph convolutional network(IAGCN) is proposed to model the semantic correlation and syntactic correlation of words in a sentence.Firstly,IAGCN starts with a bi-directional long short-term memory network(BiLSTM) to capture contextual semantic information regarding word orders.Then,the position information is introduced and put it into the graph convolutional network to learn the syntactic information.After that,aspect representation is obtained through mask mechanism.Finally,the interactive attention mechanism is used to interactively calculate and generate the aspect-specific contextual representation as the final classification feature.Through this complementary design,the model can obtain a good contextual representation that aggregates the aspect target information,and is helpful for sentiment classification.Experimental results show that the model achieve a good performance on multiple datasets.Compared with the Bi-IAN model without considering the syntax information,our model are superior to Bi-IAN model on all datasets,especially on the REST14,REST15 and REST16 datasets in the restaurant domain.Our model improves by 4.17%,7.98% and 8.03% on F1 scores respectively compare with the Bi-IAN model.Compared with the ASGCN model,which also takes semantic information and syntax information into account,the F1 scores of our model is better than that of the ASGCN model in all datasets except LAP14 dataset,especially on the REST14,REST15 and REST16 datasets in the restaurant domain.Compared with the ASGCN model,the F1 scores of our model is increased by 2.05%,1.66% and 2.77% respectively.

Key words: Aspect-based sentiment classification, Bi-directional long short-term memory network, Graph convolutional networks, Interactive attention mechanism, Semantic information, Syntactical information

CLC Number: 

  • TP391
[1]KIRITCHENKO S,ZHU X,CHERRY C,et al.NRC-Canada-2014:Detecting aspects and sentiment in customer reviews[C]//Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014).2014:437-442.
[2]HUANG B,OU Y,CARLEY K M.Aspect level sentiment classification with attention-over-attention neural networks[C]//International Conference on Social Computing,Behavioral-Cultural Modeling and Prediction and Behavior Representation in Modeling and Simulation.2018:197-206.
[3]TANG D,QIN B,FENG X,et al.Effective LSTMs for target-dependent sentiment classification[J].arXiv:1512.01100,2015.
[4]TANG D,QIN B,LIU T.Aspect level sentiment classification with deep memory network[J].arXiv:1605.08900,2016.
[5]WANG Y,HUANG M,ZHU X,et al.Attention-based LSTM for aspect-level sentiment classification[C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing.2016:606-615.
[6]LECUN Y,BOTTOU L,BENGIO Y,et al.Gradient-based learning applied to document recognition[J].Proceedings of the IEEE,1998,86(11):2278-2324.
[7]HOCHREITER S,SCHMIDHUBER J.Long short-term memory[J].Neural Computation,1997,9(8):1735-1780.
[8]MNIH V,HEESS N,GRAVES A.Recurrent models of visual attention[J].Advances in Neural Information Processing Systems,2014,27:2204-2212.
[9]KIPF T N,WELLING M.Semi-supervised classification withgraph convolutional networks[J].arXiv:1609.02907,2016.
[10]HUANG B,CARLEY K M.Syntax-aware aspect level sentiment classification with graph attention networks[J].arXiv:1909.02606,2019.
[11]ZHANG C,LI Q,SONG D.Aspect-based sentiment classification with aspect-specific graph convolutional networks[J].ar-Xiv:1909.03477,2019.
[12]MA D,LI S,ZHANG X,et al.Interactive attention networks for aspect-level sentiment classification[J].arXiv:1709.00893,2017.
[13]JIANG L,YU M,ZHOU M,et al.Target-dependent twittersentiment classification[C]//Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics:Human Language Technologies.2011:151-160.
[14]LI C B,DUAN Q J,JI C H,et al,Method of Short Text Classification Based on CHI and TF-IWF Feature Selection[J].Journal of Chongqing University of Technology (Natural Science),2021,35(5):135-140,222.
[15]LI X,BING L,LAM W,et al.Transformation networks for target-oriented sentiment classification[J].arXiv:1805.01086,2018.
[16]HUANG B,CARLEY K M.Parameterized convolutional neural networks for aspect level sentiment classification[J].arXiv:1909.06276,2019.
[17]XU Z D,CHEN B Y,WANG X,et al.Research on capsule network-based for aspect-level sentiment classification[J].Chinese Journal of Intelligent Science and Technology,2020,2(3):284-292.
[18]SUN Z F,WANG J.RCNN-BGRU-HN Network Model for Aspect-based Sentiment Analysis[J].Journal of Computer Science,2019,46(9):223-228.
[19]YIN J,CHI K K,HUAN R H.Aspect-level Sentiment Analysis of Text Based on ATT-DGRU[J].Computer Science,2021,48(5):217-224.
[20]PENNINGTON J,SOCHER R,MANNING C D.Glove:Global vectors for word representation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Proces-sing (EMNLP).2014:1532-1543.
[21]ZHANG C,LI Q,SONG D.Syntax-aware aspect-level sentiment classification with proximity-weighted convolution network[C]//Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval.2019:1145-1148.
[22]ZHAO P,HOU L,WU O.Modeling sentiment dependencieswith graph convolutional networks for aspect-level sentiment classification[J].Knowledge-Based Systems,2020,193:105443.
[23]DONG L,WEI F,TAN C,et al.Adaptive recursive neural network for target-dependent twitter sentiment classification[C]//Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (volume 2:Short Papers).2014:49-54.
[24]PONTIKI M,GALANIS D,PAVLOPOULOS J,et al.SemEval-2014 Task 4:Aspect Based Sentiment Analysis[C]//Procee-dings of the 8th International Workshop on Semantic Evaluation (SemEval 2014).2014:27-35.
[25]PONTIKI M,GALANIS D,PAPAGEORGIOU H,et al.Semeval-2015 task 12:Aspect based sentiment analysis[C]//Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015).2015:486-495.
[26]PONTIKI M,GALANIS D,PAPAGEORGIOU H,et al.Semeval-2016 task 5:Aspect based sentiment analysis[C]//International Workshop on Semantic Evaluation.2016:19-30.
[27]CHEN H,YANG Y,DU S D.Research on Aspect-Level Sentiment Analysis of User Reviews[J].Journal of Frontiers of Computer Science and Technology,2021,15(3):478-485.
[1] YAN Jia-dan, JIA Cai-yan. Text Classification Method Based on Information Fusion of Dual-graph Neural Network [J]. Computer Science, 2022, 49(8): 230-236.
[2] GUO Liang, YANG Xing-yao, YU Jiong, HAN Chen, HUANG Zhong-hao. Hybrid Recommender System Based on Attention Mechanisms and Gating Network [J]. Computer Science, 2022, 49(6): 158-164.
[3] ZHOU Hai-yu, ZHANG Dao-qiang. Multi-site Hyper-graph Convolutional Neural Networks and Application [J]. Computer Science, 2022, 49(3): 129-133.
[4] SHAO Hai-lin, JI Yi, LIU Chun-ping, XU Yun-long. Scene Text Detection Algorithm Based on Enhanced Feature Pyramid Network [J]. Computer Science, 2022, 49(2): 248-255.
[5] WU Lan, WANG Han, LI Bin-quan. Unsupervised Domain Adaptive Method Based on Optimal Selection of Self-supervised Tasks [J]. Computer Science, 2021, 48(6A): 357-363.
[6] JIANG Zong-li, LI Miao-miao, ZHANG Jin-li. Graph Convolution of Fusion Meta-path Based Heterogeneous Network Representation Learning [J]. Computer Science, 2020, 47(7): 231-235.
[7] HUO Dan, ZHANG Sheng-jie, WAN Lu-jun. Context-based Emotional Word Vector Hybrid Model [J]. Computer Science, 2020, 47(11A): 28-34.
[8] WANG Qi-fa, WANG Zhong-qing, LI Shou-shan, ZHOU Guo-dong. Comment Sentiment Classification Using Cross-attention Mechanism and News Content [J]. Computer Science, 2020, 47(10): 222-227.
[9] LU Hai-chuan, FU Hai-dong, LIU Yu. Geo-semantic Data Storage and Retrieval Mechanism Based on CAN [J]. Computer Science, 2019, 46(2): 171-177.
[10] ZHANG Qun, WANG Hong-jun and WANG Lun-wen. Short Text Clustering Algorithm Combined with Context Semantic Information [J]. Computer Science, 2016, 43(Z11): 443-446.
[11] WU Zhi-peng HUANG Zhi-qiu WANG Shan-shan CAO De-jian. Research on Framework of Safety Verification Based on Fault-extended SysML Activity Diagram [J]. Computer Science, 2015, 42(7): 222-228.
[12] YOU Hong-tao,ZHANG Yan-yuan,LIN Yi and LIU Sheng. Based on the Semantic Information of the Stored Energy Efficiency Research [J]. Computer Science, 2013, 40(Z6): 112-114.
[13] . Semantic-based Chinese Web Page Retrieval [J]. Computer Science, 2012, 39(8): 79-87.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.