Computer Science ›› 2023, Vol. 50 ›› Issue (1): 205-212.doi: 10.11896/jsjkx.211100265

• Artificial Intelligence • Previous Articles     Next Articles

Utilizing Heterogeneous Graph Neural Network to Extract Emotion-Cause Pairs Effectively

PU Jinyao, BU Lingmei, LU Yongmei, YE Ziming, CHEN Li, YU Zhonghua   

  1. School of Computer Science,Sichuan University,Chengdu 610045,China
  • Received:2021-11-26 Revised:2022-06-27 Online:2023-01-15 Published:2023-01-09
  • About author:PU Jinyao,born in 1997,postgraduate.His main research interests include na-tural language processing and deep learning.
    YU Zhonghua,born in 1967,Ph.D,associate professor.His main research intere-sts include computational linguistics and natural language processing.
  • Supported by:
    National Key Research and Development Program of China(2020YFB0704502).

Abstract: As an emerging task in text sentiment analysis,the automatic extraction of emotion-cause pairs aims to identify emotion expression from the raw texts without any annotation in the unit of clauses,and identify the causes for the corresponding emotions to form emotion-cause pairs.The crucial point of this task is focused on how to effectively capture the relationship between emotions and causes and among different emotion-cause pairs.To overcome the shortcomings of existing researches in capturing these associations,such as too coarse granularity and unable to effectively distinguish the mutual influence of causal relations between different pairs,this paper proposes an emotion-cause pair extraction method based on a heterogeneous graph neural network.Initially,we construct a heterogeneous graph with clauses and clause pairs as vertices,in which there are different types of edges between clauses and clause pairs and between different clause pairs to capture various fine-grained associations.Then using the heterogeneous graph neural network algorithm with attention mechanism to iteratively update the vertex embeddings of clauses and clause pairs.Finally,the updated embeddings is input to the binary classifier,and the classifier judges whether the corresponding pair has an emotion-cause relationship.To evaluate the effectiveness of the proposed model,we conduct a series of experiments on a benchmark dataset of the emotion-cause pair extraction task.The results demonstrate that the method based on the heterogeneous graph neural network proposed in this paper has a stable effect improvement,and the F1 value is 0.85% higher than the state-of-art baselines.When the bottom encoder(for obtaining the initial embeddings of clauses and clause pairs) is replaced by BERT,the F1 value can reach 73.12%,and our model also outperforms the state-of-art algorithm.

Key words: Sentiment analysis, Emotion-Cause pair extraction, Heterogeneous graph neural network, Graph neural network

CLC Number: 

  • TP391
[1]GUI L,WU D,XU R,et al.Event-driven emotion cause extraction with corpus construction[C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Proces-sing.Texas:ACL,2016:1639-1649.
[2]XIA R,DING Z.Emotion-Cause Pair Extraction:A new task to emotion analysis in texts[C]//Proceedings of the 57th Confe-rence of the Association for Computational Linguistics.Flo-rence:ACL,2019:1003-1012.
[3]CHEN Y,HOU W,CHENG X,et al.Joint learning for emotion classification and emotion cause detection[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing.Brussels:ACL,2018:646-651.
[4]WEI P,ZHAO J,MAO W.Effective inter-clause modeling forEnd-to-End Emotion-Cause Pair Extraction[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.Online:ACL,2020:3171-3181.
[5]SONG H,ZHANG C,LI Q,et al.End-to-end emotion-cause pair extraction via learning to link[J].arXiv:2002.10710,2020.
[6]DING Z,XIA R,YU J.End-to-End Emotion-Cause Pair Extraction based on sliding window Multi-Label Learning[C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing(EMNLP).ACL,2020:3574-3583.
[7]WU S,CHEN F,WU F,et al.A Multi-Task Learning Neural Network for Emotion-Cause Pair Extraction[J/OL].ECAI.2020:2212-2219.https://ebooks.iospress.nl/doi/10.3233/FAIA200347.
[8]CHENG Z,JIANG Z,YIN Y,et al.A symmetric local searchnetwork for Emotion-Cause Pair Extraction[C]//Proceedings of the 28th International Conference on Computational Linguistics.Barcelona:ACL,2020:139-149.
[9]CHEN X,LI Q,WANG J.A Unified Sequence Labeling Model for Emotion Cause Pair Extraction[C]//Proceedings of the 28th International Conference on Computational Linguistics.Barcelona:ACL,2020:208-218.
[10]YUAN C,FAN C,BAO J,et al.Emotion-Cause Pair Extraction as sequence labeling based on a novel tagging scheme[C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing(EMNLP).ACL,2020:3568-3573.
[11]FAN C,YUAN C,DU J,et al.Transition-based directed graph construction for emotion-cause pair extraction[C]//Proceedings of the 58th Annual Meeting of the Association for Computa-tional Linguistics.ACL,2020:3707-3717.
[12]DING Z,XIA R,YU J.ECPE-2D:Emotion-Cause Pair Extraction based on Joint Two-Dimensional Representation,Interaction and Prediction[C]//Proceedings of the 58th Annual Mee-ting of the Association for Computational Linguistics.ACL,2020:3161-3170.
[13]CHEN Y,HOU W,LI S,et al.End-to-End Emotion-Cause Pair Extraction with graph convolutional network[C]//Proceedings of the 28th International Conference on Computational Linguistics.Barcelona:ACL,2020:198-207.
[14]LEE S,CHEN Y,HUANG C.A text-driven rule-based system for emotion cause detection[C]//The NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Ge-neration of Emotion in Text.California:ACL,2010:45-53.
[15]LI W,XU H.Text-based emotion classification using emotion cause extraction[J].Expert Systems with Applications,2014,41(4):1742-1749.
[16]GAO K,XU H,WANG J.A rule-based approach to emotion cause detection for Chinese micro-blogs[J].Expert Systems with Applications,2015,42(9):4517-4528.
[17]YADA S,IKEDA K,HOASHI K,et al.A bootstrap method for automatic rule acquisition on emotion cause extraction[C]//IEEE International Conference on Data Mining Workshops.New Orleans:IEEE,2017:414-421.
[18]GHAZI D,INKPEN D,SZPAKOWICZ S.Detecting emotionstimuli inemotion-bearing sentences[C]//Computational Linguistics and Intelligent Text Processing.Cairo:Spring,2015:152-165.
[19]SONG S,YAO M.Detecting concept-level emotion cause in microblogging[C]//Proceedings of the 24th International Confe-rence on World Wide Web Companion.New York:ACM,2015:119-120.
[20]CHEN Y,LEE S,LI S,et al.Emotion cause detection with linguistic constructions[C]//23rd International Conference on Computational Linguistics.Beijing:COLING,2010:179-187.
[21]GUI L,HU J,HE Y,et al.A question answering approach foremotion cause extraction[C]//Proceedings of the 2017 Confe-rence on Empirical Methods in Natural Language Processing.Copenhagen:ACL,2017:1593-1602.
[22]LI X,SONG K,FENG S,et al.A co-attention neural network model for emotion cause analysis with emotional context awareness[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing.Brussels:ACL,2018:4752-4757.
[23]XIA R,ZHANG M,DING Z.RTHN:A RNN-TransformerHierarchical Network for emotion cause extraction[C]//Procee-dings of the Twenty-Eighth International Joint Conference on Artificial Intelligence.Macao:IJCAI,2019:5285-5291.
[24]FAN C,YAN H,DU J,et al.A knowledge regularized hierarchical approach for emotion cause analysis[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing.Hong Kong:ACL,2019:5618-5628.
[25]DING Z,HE H,ZHANG M,et al.From independent prediction to re-ordered prediction:integrating relative position and global label information to emotion cause identification[C]//Procee-dings of the AAAI Conference on Artificial Intelligence.Ha-waii:AAAI,2019:6343-6350.
[26]CHEN Y,HOU W,CHENG X,et al.Joint learning for emotion classification and emotion cause detection[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing.Brussels:ACL,2018:646-651.
[27]QIU J,TANG J,MA H,et al.Deepinf:social influence prediction with deep learning[C]//Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining.New York:ACM,2018:2110-2119.
[28]SRIVASTAVA R K,GREFF K,SCHMIDHUBER J.Training very deepnetworks[J].arXiv:1507.06228,2015.
[29]TANG H,JI D,ZHOU Q.Joint multi-level attentional model for emotion detection and emotion-cause pairextraction[J].Neurocomputing,2020,409:329-340.
[30]DEVLIN J,CHANG M W,LEE K,et al.Bert:Pre-training of deep bidirectional transformers for language understanding[J].arXiv:1810.04805,2018.
[1] HAO Jingyu, WEN Jingxuan, LIU Huafeng, JING Liping, YU Jian. Deep Disentangled Collaborative Filtering with Graph Global Information [J]. Computer Science, 2023, 50(1): 41-51.
[2] GU Xizhi, SHAO Yingxia. Fast Computation Graph Simplification via Influence-based Pruning for Graph Neural Network [J]. Computer Science, 2023, 50(1): 52-58.
[3] SUN Kaili, LUO Xudong , Michael Y.LUO. Survey of Applications of Pretrained Language Models [J]. Computer Science, 2023, 50(1): 176-184.
[4] ZHOU Fang-quan, CHENG Wei-qing. Sequence Recommendation Based on Global Enhanced Graph Neural Network [J]. Computer Science, 2022, 49(9): 55-63.
[5] YAN Jia-dan, JIA Cai-yan. Text Classification Method Based on Information Fusion of Dual-graph Neural Network [J]. Computer Science, 2022, 49(8): 230-236.
[6] QI Xiu-xiu, WANG Jia-hao, LI Wen-xiong, ZHOU Fan. Fusion Algorithm for Matrix Completion Prediction Based on Probabilistic Meta-learning [J]. Computer Science, 2022, 49(7): 18-24.
[7] YANG Bing-xin, GUO Yan-rong, HAO Shi-jie, Hong Ri-chang. Application of Graph Neural Network Based on Data Augmentation and Model Ensemble in Depression Recognition [J]. Computer Science, 2022, 49(7): 57-63.
[8] XIONG Zhong-min, SHU Gui-wen, GUO Huai-yu. Graph Neural Network Recommendation Model Integrating User Preferences [J]. Computer Science, 2022, 49(6): 165-171.
[9] DENG Zhao-yang, ZHONG Guo-qiang, WANG Dong. Text Classification Based on Attention Gated Graph Neural Network [J]. Computer Science, 2022, 49(6): 326-334.
[10] YU Ai-xin, FENG Xiu-fang, SUN Jing-yu. Social Trust Recommendation Algorithm Combining Item Similarity [J]. Computer Science, 2022, 49(5): 144-151.
[11] LI Yong, WU Jing-peng, ZHANG Zhong-ying, ZHANG Qiang. Link Prediction for Node Featureless Networks Based on Faster Attention Mechanism [J]. Computer Science, 2022, 49(4): 43-48.
[12] CAO He-xin, ZHAO Liang, LI Xue-feng. Technical Research of Graph Neural Network for Text-to-SQL Parsing [J]. Computer Science, 2022, 49(4): 110-115.
[13] MIAO Xu-peng, ZHOU Yue, SHAO Ying-xia, CUI Bin. GSO:A GNN-based Deep Learning Computation Graph Substitutions Optimization Framework [J]. Computer Science, 2022, 49(3): 86-91.
[14] DING Feng, SUN Xiao. Negative-emotion Opinion Target Extraction Based on Attention and BiLSTM-CRF [J]. Computer Science, 2022, 49(2): 223-230.
[15] YANG Xu-hua, JIN Xin, TAO Jin, MAO Jian-fei. Text Classification Based on Graph Neural Networks and Dependency Parsing [J]. Computer Science, 2022, 49(12): 293-300.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!