Computer Science

Computer Science ›› 2022, Vol. 49 ›› Issue (3): 246-254.doi: 10.11896/jsjkx.201200073

• Artificial Intelligence • Previous Articles     Next Articles

Fine-grained Sentiment Classification of Chinese Microblogs Combining Dual Weight Mechanismand Graph Convolutional Neural Network

LI Hao, ZHANG Lan, YANG Bing, YANG Hai-xiao, KOU Yong-qi, WANG Fei, KANG Yan   

  1. School of Software,Yunnan University,Kunming 650504,China
  • Received:2020-12-07 Revised:2021-06-08 Online:2022-03-15 Published:2022-03-15
  • About author:LI Hao,born in 1970,professor,Ph.D,His main research interests include distributed computing,grid and cloud computing research.
    KANG Yan,born in 1972,Ph.D,asso-ciate professor.Her main research inte-rests include software engineering,system optimization,big data processing and mining.
  • Supported by:
    National Natural Science Foundation of China(61762092),Open Fund Project of Key Laboratory of Software Engineering in Yunnan Province(2020SE303),Major Science and Technology Projects in Yunnan Province(202002AB080001),Material Genetic Engineering-Calculation Software Development of Integrated Calculation Function Module Based on Metcloud(2019CLJY06) and Gene Enginee-ring of Rare and Precious Metal Materialsin Yunnan Province-R & D and Demonstration Application of High-throughput Integrated Computing and Data Analysis Technology for Rare and Precious Metal Materials(2019ZE001-1,202002AB080001).

PDF (PC)

507

Abstract: Using deep learning models and attention mechanisms to classify fine-grained emotions of Chinese microblogs has become a research hotspot.However,the existing attention mechanisms consider the impact of words on words,and lack effective integration of the various dimensional characteristics of the words themselves (such as word meaning,part of speech,semantics and other characteristic information).In order to solve this problem,the paper proposes a dual weight mechanism WDWM (word and dimension weight mechanism),and combines it with the GCN model based on the analytical dependency tree,so that it can not only select the words that contain key information in each microblog,but also extract the important dimensional characteristics of the word and effectively integrate multiple dimensional characteristics of words,so as to capture more rich feature information.The F measure of fine-grained sentiment classification of Chinese microblogs combining dual weight mechanism and graph convolutional neural network(WDWM-GCN) reaches 84.02%,which is 1.7% higher than the latest algorithm proposed by WWW in 2020,which further proves that WDWM-GCN can effectively integrate the multi-dimensional characteristics of words and capture rich feature information.In the experiment on the classification of Sogou news data set,after the BERT model is addedto the WDWM mechanism,the classification effect is further improved,which fully provs that the WDWM has a significant improvement on the text classification model.

Key words: Attention mechanism, Dual weight mechanism, Fine-grained emotion classification, Graph convolutional neural network

CLC Number: 

  • TP391
[1]HU M,LIU B.Mining and Summarizing Customer Reviews[C]//Tenth Acm Sigkdd International Conference on Know-ledge Discovery & Data Mining ACM.2004:168-177.
[2]LI R,LIN Z,LIN H L,et al.A Review of Text Sentiment Ana-lysis[J].Journal of Computer Research and Development,2018,55(1):30-52.
[3]ZHAO J Q,GUI X L,ZHANG X J.Deep Convolution Neural Networks for Twitter Sentiment Analysis[J].IEEE Access,2018,6(1):23253-23260.
[4]WEI X,TAO L.Aspect Based Sentiment Analysis with Gated Convolutional Networks[J].arXiv:1805.07043,2018.
[5]ALIAKSEI S,MOSCHITTI A.Twitter Sentiment Analysiswith Deep Convolutional Neural Networks[C]//International ACM Sigir Conference.ACM,2015:959-962.
[6]PWINT OO S H,THEERAMUNKONG T,HUNG N D.Sentence Sentiment Classification Using Convolutional Neural Network in Myanmar Texts[C]//2020 2nd International Confe-rence on Image,Video and Signal Processing(IVSP ’20).2020.
[7]SOCHER R,PERELYGIN A,WU Y J,et al.Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank[C]//Conference on Empirical Methods in Natural Language Processing(EMNLP 2013).2013.
[8]ABDUL-MAGEED M,UNGAR L.Emonet:Fine-grained Emo-tion Detection with Gated Recurrent Neural Networks[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistic (ACL’17).2017:718-728.
[9]SACHIN S,TRIPATHI A,MAHAJAN N,et al.SentimentAnalysis Using Gated Recurrent Neural Networks[J].SN Computer Science,2020,1(2):1-13.
[10]BAZIOTIS C,PELEKIS N,DOULKERIDIS C.Datastories atsemeval-2017 Task 4:Deep LSTM with Attention for Message-level and Topic-based Sentiment Analysis [C]//Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017).2017.
[11]LU Y,ZHOU J,DAI H N,et al.Sentiment Analysis of Chinese Microblog Based on Stacked Bidirectional LSTM[C]//2018 15th International Symposium on Pervasive Systems,Algorithms and Networks (I-SPAN).2018.
[12]QIAN Q,HUANG M,LEI J,et al.Linguistically RegularizedLSTM for Sentiment Classification[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics.2017.
[13]BAHDANAU D,CHO K,BENGIO Y.Neural Machine Translation by Jointly Learning to Align and Translate[J].arXiv:1409.0473,2014.
[14]TRAN N K,NIEDEREÉE C.Multihop Attention Networks for Question Answer Matching[C]//The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval (SIGIR’18).2018:325-334.
[15]LIU P,LIU T W,SHI J,et al.Aspect level sentiment classification with unbiased attention and target enhanced representations[C]//Proceedings of the 35th Annual ACM Symposium on Applied Computing (SAC ’20).2020:843-850.
[16]LEI Z,YANG Y,YANG M,et al.A Multi-sentiment-resource Enhanced Attention Network for Sentiment Classification[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Short Papers).2018.
[17]SHAO X L.Fine-Grained Sentiment Analysis Based on Hierarchical Attention Networks[J].Computer Ence and Application,2019,9(11):2143-2153.
[18]WANG Y,HUANG M,ZHU X,et al.Attention-based LSTM for Aspect-level Sentiment Classification[C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing.2016.
[19]WU X H,CHEN L,WEI T T,et al.Sentiment analysis of Chinese short text based on Self-Attention and Bi-LSTM[J].Journal of Chinese Information Processing,2019,33(6):100-107.
[20]WANG Z T,YU Z W,GUO B,et al.Sentiment analysis of Chinese microblog based on lexicon and rule set[J].Computer Engineering & Applications,2015,51(8):218-225.
[21]VILARES D,ALONSO M A,GÓMEZ-RODRÍGUEZ C.Supervised Sentiment Analysis in Multilingual Environments[J].Information Processing & Management,2017,53(3):595-607.
[22]GAMON M.Sentiment classification on customer feedback data[C]//Proceedings of the 20th International Conference on Computational Linguistics.2004:841-847.
[23]LIU P F,MENG H L.Conditional random fields labeling andmaximum entropy classification for aspect based sentiment ana-lysis[C]//International Workshop on Semantic Evaluation.2014.
[24]BO P,LILLIAN L,SHIVAKUMAR V.Thumbs up? Sentiment Classification using Machine Learning Techniques[C]//EMNLP.2002:79-86.
[25]CHEN K,LIANG B,KE W D,et al.Sentiment Analysis of Chinese Weibo Based on Multi-channel Convolutional Neural Network[J].Computer Research and Development,2018,55(5):945-957.
[26]ZHENG S M,YANG M.A New Method of Improving BERT for Text Classification [C]//International Conference on Intelligent Science and Big Data Engineering.2019:442-452.
[27]ZHENG Z,LI L,JING C.Deeply Hierarchical Bi-directionalLSTM for Sentiment Classification[J].Computer Science,2018,45(8):213-217.
[28]WANG J L,YANG Y X,WANG X M.ResLCNN model for short text classification[J].Journal of Software,2017,28(s2):61-69.
[29]YANG Z C,YANG D Y,DYER C,et al.Hierarchical attention networks for document classification[C]//ACL.2016:1480-1489.
[30]LUONG M,PHAM H,MANNING C.Effective approaches to attention-based neural machine translation[C]//EMNLP.2015.
[31]VASWANI A,SHAZEER N,PARMAR N,et al.Attention isall you need[C]//Proceedings of the 31st International Confe-rence on Neural Information Processing Systems.2017:6000-6010.
[32]DU C,HUANG L.Text Classification Research with Attention-based Recurrent Neural Networks[J].International Journal of Computers,Communications & Control (IJCCC),2018,13(1):50.
[33]ZHANG J,DUAN L G,LI A P,et al.Fine-grained SentimentAnalysis Based on Combination of Attention and Gated Mechanism[J].Computer Science,2021,48(8):226-233.
[34]KIP F T,WELLING M.Semi-supervised classification withgraph convolutional networks[C]//ICLR.2016.
[35]LAI Y,ZHANG L,HAN D,et al.Fine-Grained Emotion Classification of Chinese Microblogs Based on Graph Convolution Networks[J].World Wide Web,2020,23(4):1-17.
[36]WEN S,WAN X.Emotion Classification in Microblog TextsUsing Class Sequential Rules[C]//AAAI.2014:187-193.
[37]JIANG F,LIU Y,LUAN H,et al.Microblog Sentiment Analysis with Emoticon Space Model[C]//Chinese National Confe-rence on Social Media Processing.Berlin:Springer,2014.
[38]YE P,KUMAR J,KANG L,et al.Unsupervised feature lear-ning framework for no-reference image quality assessment[C]//2012 IEEE Conference on Computer Vision and Pattern Recognition.2012:1098-1105.
[39]YOON K.Convolutional Neural Networks for Sentence Classification[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing.2014.
[40]LIU P F,QIU X P,HUANG X J,et al.Recurrent Neural Network for Text Classification with Multi-Task Learning[C]//Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence.2016:2873-2879.
[41]JOULIN A,GRAVE E,BOJANOWSKI P,et al.Bag of Tricks for Efficient Text Classification[J].arXiv:1607.01759,2016.
[42]JOHNSON R,ZHANG T.Deep Pyramid Convolutional Neural Networks for Text Categorization[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics(Long Papers).2017.
[43]DEVLIN J,CHANG M W,LEE K,et al.Pre-training of Deep Bidirectional Transformers for Language Understanding[J].arXiv:1810.04805,2018.
[1] ZHOU Fang-quan, CHENG Wei-qing. Sequence Recommendation Based on Global Enhanced Graph Neural Network [J]. Computer Science, 2022, 49(9): 55-63.
[2] DAI Yu, XU Lin-feng. Cross-image Text Reading Method Based on Text Line Matching [J]. Computer Science, 2022, 49(9): 139-145.
[3] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[4] XIONG Li-qin, CAO Lei, LAI Jun, CHEN Xi-liang. Overview of Multi-agent Deep Reinforcement Learning Based on Value Factorization [J]. Computer Science, 2022, 49(9): 172-182.
[5] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[6] WANG Ming, PENG Jian, HUANG Fei-hu. Multi-time Scale Spatial-Temporal Graph Neural Network for Traffic Flow Prediction [J]. Computer Science, 2022, 49(8): 40-48.
[7] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[8] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[9] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[10] YAN Jia-dan, JIA Cai-yan. Text Classification Method Based on Information Fusion of Dual-graph Neural Network [J]. Computer Science, 2022, 49(8): 230-236.
[11] JIN Fang-yan, WANG Xiu-li. Implicit Causality Extraction of Financial Events Integrating RACNN and BiLSTM [J]. Computer Science, 2022, 49(7): 179-186.
[12] XIONG Luo-geng, ZHENG Shang, ZOU Hai-tao, YU Hua-long, GAO Shang. Software Self-admitted Technical Debt Identification with Bidirectional Gate Recurrent Unit and Attention Mechanism [J]. Computer Science, 2022, 49(7): 212-219.
[13] PENG Shuang, WU Jiang-jiang, CHEN Hao, DU Chun, LI Jun. Satellite Onboard Observation Task Planning Based on Attention Neural Network [J]. Computer Science, 2022, 49(7): 242-247.
[14] ZHANG Ying-tao, ZHANG Jie, ZHANG Rui, ZHANG Wen-qiang. Photorealistic Style Transfer Guided by Global Information [J]. Computer Science, 2022, 49(7): 100-105.
[15] ZENG Zhi-xian, CAO Jian-jun, WENG Nian-feng, JIANG Guo-quan, XU Bin. Fine-grained Semantic Association Video-Text Cross-modal Entity Resolution Based on Attention Mechanism [J]. Computer Science, 2022, 49(7): 106-112.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.