Computer Science ›› 2019, Vol. 46 ›› Issue (7): 151-156.doi: 10.11896/j.issn.1002-137X.2019.07.024

• Artificial Intelligence • Previous Articles     Next Articles

Sentiment Classification Towards Question-Answering Based on Bidirectional Attention Mechanism

SHEN Chen-lin,ZHANG Lu,WU Liang-qing,LI Shou-shan   

  1. (School of Computer Science & Technology,Soochow University,Suzhou,Jiangsu 215006,China)
  • Received:2018-06-12 Online:2019-07-15 Published:2019-07-15

Abstract: Sentiment classification is a fundamental task in natural language processing,which aims at inferring the sentiment polarity of a given text.Previous studies for sentiment classification,mainly focus on sentence,document and tweet text styles.Different from these researches,this paper focused on a novel text style,i.e.,question-answering (QA) review,for sentiment classification.Firstly,a large-scale and high-quality QA review corpus was collected and built.Then,a bidirectional attention neural network for QA sentiment classification was proposed.Specifically,the question and answer text with Bi-LSTM were encoded respectively.After that,sentiment weights in question and answer text were calculated synchronously by employing bidirectional attention mechanism.Finally,the sentiment matching representation for each QA review with sentiment weights can be obtained.Empirical studies show that the proposed approach achieves a great result (75.5% in Accuracy and 61.4% in Macro F1),and has remarkable improvement compared with other baselines.

Key words: Attention mechanism, Question-Answering, Sentiment classification

CLC Number: 

  • TP391
[1]ZHAO Y Y,QIN B,LIU T.Sentiment Analysis [J].Journal of Software,2010,21(8):1834-1848.(in Chinese)
赵妍妍,秦兵,刘挺.文本情感分析 [J].软件学报,2010,21(8):1834-1848.
[2]ZHANG Y F,LAI G K,ZHANG M,et al.Explicit Factor Mo- dels for Explainable Recommendation Based on phrase-level Sentiment Analysis[C]∥Proceedings of the 37th International ACM SIGIR Conference on Research & Development in Information Retrieval.2014:83-92.
[3]CHAMBERS N,BOWEN V,GENCO E,et al.Identifying Politi- cal Sentiment between Nation States with Social Media[C]∥Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing.2015:65-75.
[4]WANG R H,CUI X M,ZHOU W,et al.Research of Text Sen- timent Classification Based on Improved Semantic Comprehension [J].Computer Science,2017,44(S2):92-97.(in Chinese)
王日宏,崔兴梅,周炜,等.改进的基于语义理解的文本情感分类方法研究 [J].计算机科学,2017,44(S2):92-97.
[5]XU J C,CHEN D L,QIU X P,et al.Cached Long Short-Term Memory Neural Networks for Document-level Sentiment Classification[C]∥Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing.2016:1660-1669.
[6]TURKEY P D.Thumbs up or Thumbs down?:Semantic Orientation Applied to Unsupervised Classification of Reviews[C]∥Proceedings of the 40th Annual Meeting on Association for Computational Linguistics.2002:417-424.
[7]TANG D Y,WEI F R,YANG N,et al.Learning Sentiment Specific Word Embedding for Twitter Sentiment Classification[C]∥Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics.2014:1555-1565.
[8]MATSUMOTO S,TAKAMURA H,OKUMURA M.Senti- ment Classification Using Word Sub-sequence and Dependency Sub-trees[C]∥Proceedings of Pacific-Asia Conference on Knowledge Discovery and Data Mining.2005:301-311.
[9]ZHOU X J,WAN X J,XIAO J G.Cross-lingual Sentiment Classification with Bilingual Document Representation Learning[C]∥Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics.2016:1403-1412.
[10]LI S S,HUANG C R,ZHOU G D,et al.Employing Personal/Impersonal Views in Supervised and Semi-supervised Sentiment Classification[C]∥Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics.2010:414-423.
[11]XIA R,WANG C,DAI X Y,et al.Co-training for Semi-supervised Sentiment Classification Based on Dual-view Bags-of-words Representation[C]∥Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing.2015:1054-1063.
[12]PONTIKI M,GALANIS D,PAVLOPOULOS J,et al.SemEval-2014 Task 4:Aspect Based Sentiment Analysis[C]∥Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016).2016:19-30.
[13]WANG Y Q,HUANG M L,ZHAO L,et al.Attention-based LSTM for Aspect-level Sentiment Classification[C]∥Procee-dings of the 2016 Conference on Empirical Methods in Natural Language Processing.2016:606-615.
[14]TANG D Y,QIN B,LIU T.Aspect Level Sentiment Classification with Deep Memory Network[C]∥Proceedings of the 2016 Conference on Empirical Methods in Natural Language Proces-sing.2016:214-224.
[15]HOCHREITER S,SCHMIDHUBER J.Long Short-term Me- mory [J].Neural Computation,1997,9(8):1735-1780.
[16]LUONG T,PHAM H,MANNINGC D.Effective Approaches to Attention-based Neural Machine Translation[C]∥Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing.2015:1412-1421.
[17]PENG Y,HE X,ZHAO J.Object-part Attention Model for Fine-grained Image Classification [J].IEEE Transactions on Image Processing,2018,27(3):1487-1500.
[18]YANG Z C,YANG D Y,DYER C,et al.Hierarchical Attention Networks for Document Classification[C]∥Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.2016:1480-1489.
[19]CUI Y M,CHEN Z P,WEI S,et al.Attention-over-attention Neural Networks for Reading Comprehension[C]∥Proceedings of the 55th Annual Meeting of the Association for Computatio-nal Linguistics.2017:593-602.
[20]KINGMA D,BA J.Adam:A Method for Stochastic Optimization [C]∥Proceedings of the 3rd International Conference on Learning Representations.2015:1-15.
[21]LEI T,BARZILAY R,JAAKKOLA T.Molding CNNs for Text:Non-linear,Non-consecutive Convolutions[C]∥Procee-dings of the 2015 Conference on Empirical Methods in Natural Language Processing.2015:1565-1575.
[22]WANG Z G,HAMZA W,FLORIAN R.Bilateral Multi-perspec- tive Matching for Natural Language Sentences[C]∥Proceedings of the 2017 International Joint Conferences on Artificial Intelligence.2017:4144-4150.
[1] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[2] ZHOU Fang-quan, CHENG Wei-qing. Sequence Recommendation Based on Global Enhanced Graph Neural Network [J]. Computer Science, 2022, 49(9): 55-63.
[3] DAI Yu, XU Lin-feng. Cross-image Text Reading Method Based on Text Line Matching [J]. Computer Science, 2022, 49(9): 139-145.
[4] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[5] XIONG Li-qin, CAO Lei, LAI Jun, CHEN Xi-liang. Overview of Multi-agent Deep Reinforcement Learning Based on Value Factorization [J]. Computer Science, 2022, 49(9): 172-182.
[6] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[7] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[8] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[9] YAN Jia-dan, JIA Cai-yan. Text Classification Method Based on Information Fusion of Dual-graph Neural Network [J]. Computer Science, 2022, 49(8): 230-236.
[10] WANG Ming, PENG Jian, HUANG Fei-hu. Multi-time Scale Spatial-Temporal Graph Neural Network for Traffic Flow Prediction [J]. Computer Science, 2022, 49(8): 40-48.
[11] JIN Fang-yan, WANG Xiu-li. Implicit Causality Extraction of Financial Events Integrating RACNN and BiLSTM [J]. Computer Science, 2022, 49(7): 179-186.
[12] XIONG Luo-geng, ZHENG Shang, ZOU Hai-tao, YU Hua-long, GAO Shang. Software Self-admitted Technical Debt Identification with Bidirectional Gate Recurrent Unit and Attention Mechanism [J]. Computer Science, 2022, 49(7): 212-219.
[13] PENG Shuang, WU Jiang-jiang, CHEN Hao, DU Chun, LI Jun. Satellite Onboard Observation Task Planning Based on Attention Neural Network [J]. Computer Science, 2022, 49(7): 242-247.
[14] ZHANG Ying-tao, ZHANG Jie, ZHANG Rui, ZHANG Wen-qiang. Photorealistic Style Transfer Guided by Global Information [J]. Computer Science, 2022, 49(7): 100-105.
[15] ZENG Zhi-xian, CAO Jian-jun, WENG Nian-feng, JIANG Guo-quan, XU Bin. Fine-grained Semantic Association Video-Text Cross-modal Entity Resolution Based on Attention Mechanism [J]. Computer Science, 2022, 49(7): 106-112.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!