Computer Science ›› 2023, Vol. 50 ›› Issue (5): 238-247.doi: 10.11896/jsjkx.220400256

• Artificial Intelligence • Previous Articles     Next Articles

Sentiment Analysis Based on Multi-event Semantic Enhancement

ZHANG Xue, ZHAO Hui   

  1. College of Information Science and Engineering,XinjiangUniversity,Urumqi 830046,China
    Key Laboratory of Signal Detection and Processing,Xinjiang Uygur Autonomous Region,Urumqi 830046,China
    Key Laboratory of Multilingual Information Technology, Xinjiang Uygur Autonomous Region,Urumqi 830046,China
  • Received:2022-04-26 Revised:2022-09-05 Online:2023-05-15 Published:2023-05-06
  • About author:ZHANG Xue,born in 1995,postgra-duate.Her main research interests include natural language processing and implicit sentiment analysis.
    ZHAO Hui,born in 1972 Ph.D,professor,Ph.D supervisor,is a member of China Computer Federation.Her main research interests include artificial intelligence,affective computing,speech and digital image processing.
  • Supported by:
    National Natural Science Foundation of China(62166041).

Abstract: Implicit sentiment analysis is to detect the sentiment of sentences that do not contain obvious sentiment words.This paper focuses on event-centric sentiment analysis,which is to infer sentiment polarity from the events described in the sentence.In event-centric sentiment analysis,existing methods either treat noun phrases in the text as events,or adopt complex models to model events,fail to model event information sufficiently,and fail to consider events that contain multiple events.In order to solve the above problems,it is proposed to represent events in the form of event triples〈subject,predicate,object〉.Based on this event representation,an event-enhanced semantic-based sentiment analysis model(MEA) is further proposed to detect the sentiment of texts.In this paper,syntactic information is used to capture the relationship of event triples,and attention mechanism is used to model the relationship between events according to the contribution of each event to the sentence.At the same time,a bidirec-tional long-short-term memory network(Bi-LSTM) is used to model the contextual information of sentences,and a multi-level orthogonal attention mechanism is used to capture the difference of attention weights under different polarities,which can be used as a significant discriminative feature.Finally,according to the importance of event features and sentence features,they are assigned different weight ratios,and they are fused to obtain the final sentence representation.Furthermore,this paper proposes a dataset for event-enhanced sentiment analysis(MEDS),where each sentence is labeled with event triplet representations and sentiment polarity labels.Research shows that the proposed model outperforms existing baseline models in self-built datasets.

Key words: Event-based sentiment analysis, Representation learning, Sentiment analysis, Graph convolutional neural network, Attention mechanism

CLC Number: 

  • TP391
[1]LIU B.Sentiment analysis:Mining opinions,sentiments,andemotions[M].Cambridgeshire:Cambridge University Press,2020.
[2]CAMBRIA E,PORIA S,GELBUKH A,et al.Sentiment analysis is a big suitcase[J].Intelligent Systems,2018,32(6):74-80.
[3]LIAO J,WANG S,LI D.Identification of fact-implied implicitsentiment based on multi-level semantic fused representation[J].Knowledge-Based Systems,2019,165:197-207.
[4]GREENE S,RESNIK P.More than words:Syntactic packaging and implicit sentiment[C]//Proceedings of Human Language Technologies:The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics.2009:503-511.
[5]ZHOU D,WANG J,ZHANG L,et al.Implicit Sentiment Ana-lysis with Event-centered Text Representation[C]//Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing.2021:6884-6893.
[6]WEBER N,BALASUBRAMANIAN N,CHAMBERS N.Event representations with tensor-based compositions[C]//Procee-dings of the I Conference on Artificial Intelligence.2018.
[7]ZHANG C,LI Q,SONG D.Aspect-based sentiment classification with aspect-specific graph convolutional networks[J].ar-Xiv:1909.03477,2019.
[8]SUN K,ZHANG R,MENSAH S,et al.Aspect-level sentiment analysis via convolution over dependency tree[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing(EMNLP-IJCNLP).2019:5679-5688.
[9]SHUTOVA E,TEUFEL S,KORHONEN A.Statistical metaphor processing[J].Computational Linguistics,2013,39(2):301-353.
[10]ZHANG L,LIU B.Identifying noun product features that imply opinions[C]//Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics:Human Language Technologies.2011:575-580.
[11]BALAHUR A,HERMIDA J M,MONTOYO A.Detecting implicit expressions of sentiment in text based on commonsense knowledge[C]//Proceedings of the 2nd Workshop on Computational Approaches to Subjectivity and Sentiment Analysis(WASSA 2.011).2011:53-60.
[12]DENG L J,WIEBE J.Joint prediction for entity/event-level sentiment analysis using probabilistic soft logic models[C]//Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing.2015:179-189.
[13]HOFMANN J,TROIANO E,SASSENBERG K,et al.Appraisal theories for emotion classification in text[J].arXiv:2003.14155,2020.
[14]GAONKAR R S.Modeling label semantics for predicting emotional reactions[D].Stony Brook:State University of New York at Stony Brook,2019.
[15]DING H,RILOFF E.Acquiring knowledge of affective events from blogs using label propagation[C]//Thirtieth I Conference on Artificial Intelligence.2016:2935-2942.
[16]DING H,RILOFF E.Weakly supervised induction of affectiveevents by optimizing semantic consistency[C]//Proceedings of the I Conference on Artificial Intelligence.2018.
[17]DING H,RILOFF E.Human needs categorization of affectiveevents using labeled and unlabeled data[C]//Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies,Volume 1(Long Papers).2018:1919-1929.
[18]YANG Y,ZHOU D,HE Y,et al.Interpretable relevant emotion ranking with event-driven attention[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing(EMNLP-IJCNLP).2019:177-187.
[19]ZHUANG Y,JIANG T,RILOFF E.Affective event classification with discourse-enhanced self-training[C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing(EMNLP).2020:5608-5617.
[20]ROSENTHAL S,FARRA N,NAKOV P.SemEval-2017 task 4:Sentiment analysis in Twitter[C]//Proceedings of the 11th international workshop on semantic evaluation(SemEval-2017).2017:502-518.
[21]GRISHMAN R,WESTBROOK D,MEYERS A.Nyu's English ace 2005 system description[C]//ACE 2005 Evaluation Workshop.2005.
[22]HE L,LEE K,LEWIS M,et al.Deep semantic role labeling:What works and what's next[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics(Volume 1:Long Papers).2017:473-483.
[23]PENNINGTON J,SOCHER R,MANNING C D.GloVe:Global vectors for word representation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Proces-sing(EMNLP).Doha,2014:1532-1543.
[24]WEI J,LIAO J,YANG Z,et al.Bi-LSTM with multi-polarityorthogonal attention for implicit sentiment analysis[J].Neurocomputing,2020,383:165-173.
[25]SARA R,PRESLAV N,SVETLANA K,et al.SemEval-2015 Task 10:Sentiment Analysis in Twitter[C]//Proceedings of the 9th International Workshop on Semantic Evaluation(SemEval 2015).2015:451-463.
[26]CHEN D,MANNING C.A fast and accurate dependency parser using neural networks[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing(EMNLP).2014:740-750.
[27]KIM Y.Convolutional Neural Networks for Sentence Classification[J].arXiv:1408.5882,2014.
[28]LIU P F,QIU X P,HUANG X J.Recurrent Neural Network for Text Classification with Multi-Task Learning[C]//Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence.New York,USA:I Press,2014.2873-2879.
[29]ZHOU P,SHI W,TIAN J,et al.Attention-based bidirectional long short-term memory networks for relation classification[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics(volume 2:Short papers).2016:207-212.
[30]CHUNG J,GULCEHRE C,CHO K,et al.Empirical evaluation of gated recurrent neural networks on sequence modeling[J].arXiv:1412.3555,2014.
[31]GAO G,CHOI E,CHOI Y,et al.Neural metaphor detection in context[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing.2018.
[32]LIN Y,LI J P,XU K,et al.Sentiment Analysis with Multi-Head Attention-Based Bi-LSTM Model[J].Journal of Shanxi University,2020,43(1):1-7.
[1] ZHANG Shunyao, LI Huawang, ZHANG Yonghe, WANG Xinyu, DING Guopeng. Image Retrieval Based on Independent Attention Mechanism [J]. Computer Science, 2023, 50(6A): 220300092-6.
[2] LIU Haowei, YAO Jingchi, LIU Bo, BI Xiuli, XIAO Bin. Two-stage Method for Restoration of Heritage Images Based on Muti-scale Attention Mechanism [J]. Computer Science, 2023, 50(6A): 220600129-8.
[3] LI Fan, JIA Dongli, YAO Yumin, TU Jun. Graph Neural Network Few Shot Image Classification Network Based on Residual and Self-attention Mechanism [J]. Computer Science, 2023, 50(6A): 220500104-5.
[4] SUN Kaiwei, WANG Zhihao, LIU Hu, RAN Xue. Maximum Overlap Single Target Tracking Algorithm Based on Attention Mechanism [J]. Computer Science, 2023, 50(6A): 220400023-5.
[5] WU Liuchen, ZHANG Hui, LIU Jiaxuan, ZHAO Chenyang. Defect Detection of Transmission Line Bolt Based on Region Attention Mechanism andMulti-scale Feature Fusion [J]. Computer Science, 2023, 50(6A): 220200096-7.
[6] ZHANG Shuaiyu, PENG Li, DAI Feifei. Person Re-identification Method Based on Progressive Attention Pyramid [J]. Computer Science, 2023, 50(6A): 220200084-8.
[7] LUO Huilan, LONG Jun, LIANG Miaomiao. Attentional Feature Fusion Approach for Siamese Network Based Object Tracking [J]. Computer Science, 2023, 50(6A): 220300237-9.
[8] DOU Zhi, HU Chenguang, LIANG Jingyi, ZHENG Liming, LIU Guoqi. Lightweight Target Detection Algorithm Based on Improved Yolov4-tiny [J]. Computer Science, 2023, 50(6A): 220700006-7.
[9] ZENG Zehua, LUO Huilan. Cross-dataset Learning Combining Multi-object Tracking and Human Pose Estimation [J]. Computer Science, 2023, 50(6A): 220400199-7.
[10] DAI Tianhong, SONG Jieqi. Multimodal MRI Brain Tumor Segmentation Based on Multi-encoder Architecture [J]. Computer Science, 2023, 50(6A): 220200108-6.
[11] HUANG Yujiao, CHEN Mingkai, ZHENG Yuan, FAN Xinggang, XIAO Jie, LONG Haixia. Text Classification Based on Weakened Graph Convolutional Networks [J]. Computer Science, 2023, 50(6A): 220700039-5.
[12] GAO Xiang, TANG Jiqiang, ZHU Junwu, LIANG Mingxuan, LI Yang. Study on Named Entity Recognition Method Based on Knowledge Graph Enhancement [J]. Computer Science, 2023, 50(6A): 220700153-6.
[13] FU Yue, SHI We. Study on Satire Detection Based on Sentiment-Topic-Satire Hybrid Model [J]. Computer Science, 2023, 50(6A): 220300018-6.
[14] ZHANG Tao, CHENG Yifei, SUN Xinxu. Graph Attention Networks Based on Causal Inference [J]. Computer Science, 2023, 50(6A): 220600230-9.
[15] CUI Lin, CUI Chenlu, LIU Zhengwei, XUE Kai. Speech Emotion Recognition Based on Improved MFCC and Parallel Hybrid Model [J]. Computer Science, 2023, 50(6A): 220800211-7.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!