Computer Science ›› 2025, Vol. 52 ›› Issue (1): 307-314.doi: 10.11896/jsjkx.231100130

• Artificial Intelligence • Previous Articles     Next Articles

Dialogue Generation Model Integrating Emotional and Commonsense Knowledge

CHENG Jinfeng, JIANG Zongli   

  1. Faculty of Information Technology,Beijing University of Technology,Beijing 100124,China
  • Received:2023-11-20 Revised:2024-05-23 Online:2025-01-15 Published:2025-01-09
  • About author:CHENG Jinfeng,born in 1990,postgraduate.Her main research interests include natural language processing and so on.
    JIANG Zongli,born in 1956,professor,Ph.D,Ph.D supervisor.His main research interests include network information processing and so on.

Abstract: With the development of deep learning technology,as an important branch of human-machine dialogue system,open domain dialogue system has also developed rapidly.However,there are still problems such as poor empathy and low diversity in response sentences generated by existing dialogue models in open domains.To address these problems,a dialogue generation model integrating emotional and commonsense knowledge is proposed in this paper.Commonsense knowledge vector corresponding to each word is firstly obtained based on the emotion dictionary and commonsense knowledge graph,and the vector is input into the encoder for encoding along with the word embedding vector of the word itself.Then a two-stage decodingprocess is used to ge-nerate response sentence:the first decoding stage is to predict the emotional intensity of the word to be generated and obtain the corresponding emotional vector for that word based on it,the second decoding stage combines the encoding result of the first stage with the word embedding vector of the generated word and its corresponding common sense knowledge vector as input to predict the word to be generated.Experimental results show that the response sentences generated by the proposed model are more empathetic and diverse,and it has a certain improvement in PPL,BLEU,ACC and DISTINCT evaluation compared with the baseline models.

Key words: Dialogue model, Emotional dictionary, Commonsense knowledge graph, Two-stage decoding, Emotional intensity

CLC Number: 

  • TP391
[1]CHEN X,ZHOU Q.A survey of research onopen domain dialogue systems[J].Journal of Chinese Information Processing,2021,35(11):1-12.
[2]VINYALS O,LE Q.A neural conversational model[J].arXiv:1506.05869,2015.
[3]SHAO L,GOUWS S,BRITZ D,et al.Generating high-quality and informative conversation responses with sequence-to-sequence models[C]//Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing.2017:2210-2219.
[4]VASWANI A,SHAZEER N,PARMAR N,et al.Attention isall you need[C]//Advances in Neural Information Processing Systems.2017:5998-6008.
[5]ZHANG S X,LI J,ZHU G L,et al.Dialogue generation model based on improved encoder-decoder and emotion dictionary[J].Computer Engineering and Design,2023,44(2):570-575.
[6]KESKIN C S.From what isn’t Empathy to Empathic Learning Process[J].Procedia-Social and Behavioral Sciences,2014,116:4932-4938.
[7]SPEER R,CHIN J,HAVASI C.ConceptNet 5.5:An open multi-lingual graph of general knowledge[J].arXiv:1612.03975,2017.
[8]MOHAMMAD S.Obtaining reliable human ratings of valence,arousal,and dominance for 20000 English words[C]//Procee-dings of the 56th Annual Meeting of the Association for Computational Linguistics(volume 1:Long papers).2018:174-184.
[9]RASHKIN H,SMITH E M,LI M,et al.Towards empatheticopen-domain conversation models:A new benchmark and dataset[J].arXiv.1811.00207,2018.
[10]SERBAN I V,SORDONI A,BENGIO Y,et al.Building end-to-end dialogue systems using generative hierarchical neural network models[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2016.
[11]SERBAN I V,KLINGER T,TESAURO G.Multiresolution recurrent neural networks:An application to dialogue response generation[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2017.
[12]LI J,MONROE W,RITTER A,et al.Deep reinforcement lear-ning for dialogue generation[J].arXiv:1606.01541,2016.
[13]LIU L M,CHEN Y Z,ZHEN J T.Multi-turn Dialogue Model for Domain Data Augmentation and Multi-granularity Semantic Understanding[J].Journal of Chinese Computer Systems.2024,45(7):1585-1591.
[14]CHENG T T,YAO C L,YU X Q,et al.Empathetic DialogueGeneration by Incorporating Commonsense Knowledge Based on Multi-Head Attention Mechanism[J].Computer Engineering,2024,50(6):94-101.
[15]ZHOU H,HUANG M,ZHANG T,et al.Emotional chattingmachine:Emotional conversation generation with internal and external memory[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2018.
[16]LIN Z,MADOTTO A,SHINI J,et al.MoEL:Mixture of empathetic listeners[C]//Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing.2019:121-132.
[17]MAJUMDER N,HONG P,PENG S,et al.MIME:MIMickingemotions for empathetic response generation[C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing.2020:8968-8979.
[18]LI Q,LI P,REN Z,et al.Knowledge bridging for empathetic dia-logue generation[C]//Proceedings of the AAAI Conference on Artificial Intelligence.British Columbia,Canada,2022:10993-11001.
[19]SABOUR S,ZHENG C,HUANG M.Cem:Commonsense-aware empathetic response generation[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2022:11229-11237.
[20]WANG L,LI J,LIN Z,et al.Empathetic dialogue generation via sensitive emotion recognition and sensible knowledge selection.[C]//Findings of the Association for Computational Linguistics.2022:4634-4645.
[21]LIU Q,CHEN Y,CHEN B,et al.You impress me:Dialoguegeneration via mutual persona perception[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.2020:1417-1427.
[22]CHE M Y,LI S,YANG Y.EmpHi:Generating empathetic responses with human-like intents[C]//Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.2022:1063-1074.
[1] LIN Haonan, TAN Hongye, FENG Huimin. Clinical Findings Recognition and Yin & Yang Status Inference Based on Doctor-Patient Dialogue [J]. Computer Science, 2024, 51(11A): 231000084-7.
[2] WANG Yu, REN Fu-ji and QUAN Chang-qin. Review of Dialogue Management Methods in Spoken Dialogue System [J]. Computer Science, 2015, 42(6): 1-7.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!