Computer Science ›› 2021, Vol. 48 ›› Issue (5): 217-224.doi: 10.11896/jsjkx.200500076

• Artificial Intelligence • Previous Articles     Next Articles

Aspect-level Sentiment Analysis of Text Based on ATT-DGRU

YIN Jiu, CHI Kai-kai, HUAN Ruo-hong   

  1. School of Computer Science and Technology,Zhejiang University of Technology,Hangzhou 310023,China
  • Received:2020-05-18 Revised:2020-07-30 Online:2021-05-15 Published:2021-05-09
  • About author:YIN Jiu,born in 1996,postgraduate.Her main research interest include machine learning and so on.
    CHI Kai-kai,born in 1980,Ph.D,professor,Ph.D supervisor,is a member of China Computer Federation.His main research interests include wireless networks and machine learning.
  • Supported by:
    National Natural Science Foundation of China(61872322).

Abstract: Aspect-level sentiment classification is to analyze the sentiment polarity in a given aspect for a given text.In the exis-ting mainstream solutions,the attention mechanism-based cyclic neural network model ignores the importance of keyword pro-ximity context information,and the CNN multilayer model is not good at capturing sentence-level long-distance dependency information.This paper proposes an aspect-level emotion classification network model based on disconnected gated recurrent units(DGRU) and attention mechanism,which is abbreviated as ATT-DGRU.The DGRU network used in this model integrates the advantages of circular neural network and CNN.It can not only capture the long-distance dependent semantic information of text,but also extract the semantic information of key phrases.Attention mechanism is used to capture the importance of each word to a specific aspect when deducing the sentiment polarity of a specific aspect,meanwhile generates an emotional weight vector,which can be visualized.Accuracies of two-class and three-class of ATT-DGRU model constructed in this paper can reach 91.11% and 87.76% respectively in ACSA task on Chinese hotel review datasets.Accuracies of two-class and three class of ATT-DGRU model can reach 77.21% and 90.06% respectively in ATSA task on SemEval2014-Restaurant dataset.

Key words: Aspect-level sentiment classification, Deep learning, Disconnected gated recurrent unit

CLC Number: 

  • TP391
[1]PANG B,LEE L,VAITHYANATHAN S,et al.Thumbs up? Sentiment Classification using Machine Learning Techniques[C]//The ACL-02 Conference on Empirical Methods in Natural Language Processing.2002:79-86.
[2]ZHANG L,LIU B.Sentiment Analysis and Opinion Mining[M].Morgan:Claypool Publishers,2017:1-50.
[3]PANG B,LEE L.Opinion Mining and Sentiment Analysis[J].Foundations and Trends in Information Retrieval,2008,2(1):1-135.
[4]PONTIKI M,GALANIS D,PAVLOPOULOS J,et al.SemEval-2014 Task 4:Aspect Based Sentiment Analysis[C]//International Conference on Computational Linguistics.2014:27-35.
[5]GOODFELLOW I,BENGIO Y,COURVILLE A.Deep Learning[M].Massachusetts:The MIT Press,2016:24-31.
[6]WANG B.Disconnected Recurrent Neural Networks for TextCategorization[C]//the 56th Annual Meeting of the Association for Computational Linguistics.2018:2311-2320.
[7]CHO K,VAN MERRIENBOER B,GULCEHRE C,et al.Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation[J].arXiv:1406.1078,2014.
[8]GERS F A,SCHMIDHUBER J,CUMMINS F.Learning to Forget:Continual Prediction with LSTM[J].Neural Computation,2000,12(10):2451-2471.
[9]ZHANG Z,ZOU Y,GAN C.Textual sentiment analysis viathree different attention convolutional neural networks and cross-modality consistent regression[J].Neurocomputing,2018,275:1407-1415.
[10]AKHTAR M S,GUPTA D,EKBAL A,et al.Feature selection and ensemble construction:A two-step method for aspect based sentiment analysis[J].Knowledge Based Systems,2017,125(1):116-135.
[11]HAN H,ZHANG J,YANG J,et al.Generate domain-specificsentiment lexicon for review sentiment analysis[J].Multimedia Tools & Applications,2018,77(16):21265-21280.
[12]COLLOBERT R,WESTON J,BOTTOU L,et al.Natural Language Processing(Almost) from Scratch[J].Journal of Machine Learning Research,2011,12(1):2493-2537.
[13]KALCHBRENNER N,GREFENSTETTE E,BLUNSOM P,et al.A Convolutional Neural Network for Modelling Sentences[C]//Meeting of the Association for Computational Linguistics.2014:655-665.
[14]WANG L,CAO Z,DE MELO G,et al.Relation Classification via Multi-Level Attention CNNs[C]//the 54th Annual Meeting of the Association for Computational Linguistics,2016:1298-1307.
[15]TANG D,QIN B,LIU T,et al.Document Modeling with Gated Recurrent Neural Network for Sentiment Classification[C]//The 2015 Conference on Empirical Methods in Natural Language Processing.2015:1422-1432.
[16]TANG D,QIN B,FENG X,et al.Effective LSTMs for Target-Dependent Sentiment Classification[J].arXiv:1512.01100v2,2016.
[17]ZHANG M,ZHANG Y,VO D T,et al.Gated neural networks for targeted sentiment analysis[C]//Thirtieth AAAI Confe-rence on Artificial Intelligence,2016:3087-3093.
[18]SHUANG K,REN X,YANG Q,et al.AELA-DLSTMs:Attention-enabled and location-aware double LSTMs for aspect-level sentiment classification[J].Neurocomputing,2019,334:25-34.
[19]MA D,LI S,ZHANG X,et al.Interactive attention networks for aspect-level sentiment classification[J].arXiv:1709.00893,2017.
[20]XUE W,LI T.Aspect based sentiment analysis with gated convo-lutional networks[J].arXiv:1805.07043,2018.
[21]SHI Y,YAO K,TIAN L,et al.Deep LSTM based Feature Mapping for Query Classification[C]//The 2016 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.2016:1501-1511.
[22]YANG M,TU W,WANG J,et al.Attention Based LSTM for Target Dependent Sentiment Classification[C]//Thirty-First AAAI Conference on Artificial Intelligence.2017:5013-5014.
[23]CHEN P,SUN Z,BING L,et al.Recurrent attention network on memory for aspect sentiment analysis[C]//Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing.2017:452-461.
[1] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[2] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[3] TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[4] WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[5] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[6] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[7] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[8] HOU Yu-tao, ABULIZI Abudukelimu, ABUDUKELIMU Halidanmu. Advances in Chinese Pre-training Models [J]. Computer Science, 2022, 49(7): 148-163.
[9] ZHOU Hui, SHI Hao-chen, TU Yao-feng, HUANG Sheng-jun. Robust Deep Neural Network Learning Based on Active Sampling [J]. Computer Science, 2022, 49(7): 164-169.
[10] SU Dan-ning, CAO Gui-tao, WANG Yan-nan, WANG Hong, REN He. Survey of Deep Learning for Radar Emitter Identification Based on Small Sample [J]. Computer Science, 2022, 49(7): 226-235.
[11] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[12] CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126.
[13] LIU Wei-ye, LU Hui-min, LI Yu-peng, MA Ning. Survey on Finger Vein Recognition Research [J]. Computer Science, 2022, 49(6A): 1-11.
[14] SUN Fu-quan, CUI Zhi-qing, ZOU Peng, ZHANG Kun. Brain Tumor Segmentation Algorithm Based on Multi-scale Features [J]. Computer Science, 2022, 49(6A): 12-16.
[15] KANG Yan, XU Yu-long, KOU Yong-qi, XIE Si-yu, YANG Xue-kun, LI Hao. Drug-Drug Interaction Prediction Based on Transformer and LSTM [J]. Computer Science, 2022, 49(6A): 17-21.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!