Computer Science ›› 2019, Vol. 46 ›› Issue (9): 223-228.doi: 10.11896/j.issn.1002-137X.2019.09.033

• Artificial Intelligence • Previous Articles     Next Articles

RCNN-BGRU-HN Network Model for Aspect-based Sentiment Analysis

SUN Zhong-feng, WANG Jing   

  1. (School of Computer Science and Technology,Nanjing Tech University,Nanjing 211816,China)
  • Received:2018-07-18 Online:2019-09-15 Published:2019-09-02

Abstract: The general neural network model has less inter-connectivity between sentences and cannot capture much more semantic information between words in the task of aspect-based sentiment analysis.To adress these problems,this paper proposed a deep learning network model with novel structure.The model can preserve the sequential relationship of sentences in the comment text through the regional convolutional neural network(RCNN).At the same time,the time cost of model training can be greatly reduced by combining bi-directional gated recurrent unit (BGRU).In addition,the introduction of highway network (HN) could enable the proposed model to capture much more semantic information between words.The attention mechanism is additionally utilized in an effort to assign weights of the concerned aspect in the network structure,which is able to effectively obtain the long-distance dependency of the concerned aspect in the whole review.The model can give end-to-end training and experiment on different datasets,achieving better performance than the existing network model.

Key words: Deep learning, Aspect-based sentiment analysis, Convolutional neural network, Bi-directional gated recurrent unit, Highway network, Attention mechanism

CLC Number: 

  • TP183
[1]CAMBRIA E,DAS D,BANDYOPADHYAY S,et al.A Practical Guide to Sentiment Analysis[M].Berlin:Springer International Publishing,2017.
[2]DAS S R,CHEN M Y.Yahoo! For Amazon:Sentiment Extraction from Small Talk on the Web[J].Management Science,2007,53(9):1375-1388.
[3]PANG B,LEE L,VAITHYANATHAN S.Thumbs up?:sentiment classification using machine learning techniques[EB/OL].http://www.doc88.com/p-1416919772501.html.
[4]MNIHV,HEESS N,GRAVES A.Recurrent models of visualattention[C]//Proceedings of Advances in Neural Information Processing Systems 27(NIPS 2014).Cambridge,MA:MIT Press,2014:2204-2212.
[5]BAHDANAU D,CHO K,BENGIO Y.Neural machine translation by jointly learning to align and translate[J].arXiv:1409.0473,2014.
[6]YIN W,SCHüTZE H,XIANG B,et al.Abcnn:Attention-based convolutional neural network for modeling sentence pairs[J].Transactions of the Association for Computational Linguistics,2016,4(11):259-272.
[7]WANG Y,HUANG M,ZHAO L,et al.Attention-based LSTM for aspect-level sentiment classification[C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing.Austin,USA,2016:606-615.
[8]KIRITCHENKO S,ZHU X,CHERRY C,et al.NRC-Canada-2014:Detecting Aspects and Sentiment in Customer Reviews[C]//International Workshop on Semantic Evaluation.Dublin:Ireland:Association for Computational Linguistics,2014:437-442.
[9]HU M,LIU B.Mining and summarizing customer reviews[C]//Proceedings of the Tenth ACM SIGKDD International Confe-rence on Knowledge Discovery and Data Mining.New York:ACM,2004:168-177.
[10]PORIA S,CAMBRIA E,GELBUKH A.Aspect extraction for opinion mining with a deep convolutional neural network[M].Amsterdam:Elsevier Science Publishers B.V.,2016:42-49.
[11]TANG D,QIN B,LIU T.Aspect Level Sentiment Classification with Deep Memory Network[J/OL].https://arxiv.org/abs/1605.08900.
[12]LECUN Y,BOTTOU L,BENGIO Y,et al.Gradient-basedlearning applied to document recognition[J].Proceedings of the IEEE,1998,86(11):2278-2324.
[13]HOCHREITER S,SCHMIDHUBER J.Long short-term memory[J].Neural Computation,1997,9(8):1735-1780.
[14]CHUNG J,GULCEHRE C,CHO K H,et al.Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling[J].arXiv:1412.3555,2014.
[15]WANG J,YU L C,LAI K R,et al.Dimensional sentiment ana-lysis using a regional cnn-lstm model[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics.Berlin,Germany,2016:225-230.
[16]KIM Y,JERNITE Y,SONTAG D,et al.Character-Aware Neural Language Models[J/OL].https://arxiv.org/abs/1508.06615.
[1] ZHOU Yan, ZENG Fan-zhi, WU Chen, LUO Yue, LIU Zi-qin. 3D Shape Feature Extraction Method Based on Deep Learning [J]. Computer Science, 2019, 46(9): 47-58.
[2] MA Lu, PEI Wei, ZHU Yong-ying, WANG Chun-li, WANG Peng-qian. Fall Action Recognition Based on Deep Learning [J]. Computer Science, 2019, 46(9): 106-112.
[3] LI Qing-hua, LI Cui-ping, ZHANG Jing, CHEN Hong, WANG Shao-qing. Survey of Compressed Deep Neural Network [J]. Computer Science, 2019, 46(9): 1-14.
[4] WANG Yan-ran, CHEN Qing-liang, WU Jun-jun. Research on Image Semantic Segmentation for Complex Environments [J]. Computer Science, 2019, 46(9): 36-46.
[5] SHI Chun-dan, QIN Lin. Chinese Named Entity Recognition Method Based on BGRU-CRF [J]. Computer Science, 2019, 46(9): 237-242.
[6] MIAO Yong-wei, LI Gao-yi, BAO Chen, ZHANG Xu-dong, PENG Si-long. Image Localized Style Transfer Based on Convolutional Neural Network [J]. Computer Science, 2019, 46(9): 259-264.
[7] SHI Xiao-hong, HUANG Qin-kai, MIAO Jia-xin, SU Zhuo. Edge-preserving Filtering Method Based on Convolutional Neural Networks [J]. Computer Science, 2019, 46(9): 277-283.
[8] DENG Cun-bin, YU Hui-qun, FAN Gui-sheng. Integrating Dynamic Collaborative Filtering and Deep Learning for Recommendation [J]. Computer Science, 2019, 46(8): 28-34.
[9] DU Wei, DING Shi-fei. Overview on Multi-agent Reinforcement Learning [J]. Computer Science, 2019, 46(8): 1-8.
[10] GUO Xu, ZHU Jing-hua. Deep Neural Network Recommendation Model Based on User Vectorization Representation and Attention Mechanism [J]. Computer Science, 2019, 46(8): 111-115.
[11] ZHANG Yi-jie, LI Pei-feng, ZHU Qiao-ming. Event Temporal Relation Classification Method Based on Self-attention Mechanism [J]. Computer Science, 2019, 46(8): 244-248.
[12] FANG Jie, LI Pei-feng, ZHU Qiao-ming. Employing Multi-attention Mechanism to Resolve Event Coreference [J]. Computer Science, 2019, 46(8): 277-281.
[13] YU Yang, LI Shi-jie, CHEN Liang, LIU Yun-ting. Ship Target Detection Based on Improved YOLO v2 [J]. Computer Science, 2019, 46(8): 332-336.
[14] LI Zhou-jun,WANG Chang-bao. Survey on Deep-learning-based Machine Reading Comprehension [J]. Computer Science, 2019, 46(7): 7-12.
[15] SHEN Chen-lin, ZHANG Lu, WU Liang-qing, LI Shou-shan. Sentiment Classification Towards Question-Answering Based on Bidirectional Attention Mechanism [J]. Computer Science, 2019, 46(7): 151-156.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] SUN Qi, JIN Yan, HE Kun and XU Ling-xuan. Hybrid Evolutionary Algorithm for Solving Mixed Capacitated General Routing Problem[J]. Computer Science, 2018, 45(4): 76 -82 .
[2] LI Bai-shen, LI Ling-zhi, SUN Yong and ZHU Yan-qin. Intranet Defense Algorithm Based on Pseudo Boosting Decision Tree[J]. Computer Science, 2018, 45(4): 157 -162 .
[3] WANG Zheng-li, XIE Tian, HE Kun and JIN Yan. 0-1 Knapsack Variant with Time Scheduling[J]. Computer Science, 2018, 45(4): 53 -59 .
[4] YANG Pei-an, WU Yang, SU Li-ya, LIU Bao-xu. Overview of Threat Intelligence Sharing Technologies in Cyberspace[J]. Computer Science, 2018, 45(6): 9 -18,26 .
[5] LAI Wen-xing, DENG Zhong-min. Improved NSGA2 Algorithm Based on Dominant Strength[J]. Computer Science, 2018, 45(6): 187 -192 .
[6] HUANG Yi-long, LI Pei-feng, ZHU Qiao-ming. Joint Model of Events’ Causal and Temporal Relations Identification[J]. Computer Science, 2018, 45(6): 204 -207,234 .
[7] SHEN Xia-jiong, ZHANG Jun-tao, HAN Dao-jun. Short-term Traffic Flow Prediction Model Based on Gradient Boosting Regression Tree[J]. Computer Science, 2018, 45(6): 222 -227,264 .
[8] ZHOU Feng, LI Rong-yu. Convolutional Neural Network Model for Text Classification Based on BGRU Pooling[J]. Computer Science, 2018, 45(6): 235 -240 .
[9] YAO Han-bing, XING Na-na, ZHOU Jun-wei and LI Yong-hua. Study on Secure Retrieval Scheme over Encrypted Data Supporting Result Ranking[J]. Computer Science, 2018, 45(5): 123 -130 .
[10] WU Zhong-zhong, LV Xin and LI Xin. Query Probability Based Dummy Location Selection Algorithm[J]. Computer Science, 2018, 45(5): 143 -146, 162 .