计算机科学 ›› 2026, Vol. 53 ›› Issue (5): 22-29.doi: 10.11896/jsjkx.250600163

• 智能教育技术 • 上一篇    下一篇

教师教学情感智能分析技术研究综述

刘一璞1, 马苗1,2, 胡曦明1   

  1. 1 陕西师范大学人工智能与计算机学院 西安 710119
    2 现代教学技术教育部重点实验室 西安 710062
  • 收稿日期:2025-06-24 修回日期:2025-09-21 发布日期:2026-05-08
  • 通讯作者: 马苗(mmthp@snnu.edu.cn)
  • 作者简介:(lyp2023@snnu.edu.cn)
  • 基金资助:
    国家自然科学基金(62377031);陕西省重点研发计划项目(2024GX-YBXM-086);陕西师范大学人工智能赋能本科教育教学专题研究与实践项目(24ZYTS11)

Intelligent Analysis Technology on Teachers’ Teaching Emotions

LIU Yipu1, MA Miao1,2, HU Ximing1   

  1. 1 School of Artificial Intelligence and Computer Science, Shaanxi Normal University, Xi’an 710119, China
    2 Key Laboratory of Modern Teaching Technology, Ministry of Education, Xi’an 710062, China
  • Received:2025-06-24 Revised:2025-09-21 Online:2026-05-08
  • About author:LIU Yipu,born in 2000,postgraduate.His main research interests include intelligent educational technology and so on.
    MA Miao,born in 1977,Ph.D,professor,Ph.D supervisor.Her main research interests include image processing,videoanalysis and smart education.
  • Supported by:
    National Natural Science Foundation of China(62377031),Key Research and Development Program of Shaanxi Province(2024GX-YBXM-086) and Shaanxi Normal University Artificial Intelligence Empowerment Undergraduate Education Teaching Special Topic Research and Practice Project(24ZYTS11).

摘要: 教师积极的教学情感能够显著提升教学效果,激发学生学习兴趣和参与度,营造良好的课堂氛围,促进学生对知识的理解和掌握;反之,不当的教学情感会影响学生的学习热情,降低教学效率,甚至导致学生厌学。在我国教育数字化转型背景下,利用海量的文本、语音、视频等课堂教学数据进行教师教学情感的智能检测与分析,对于提高教学质量、提升教师教学反思效果、完善教师数字画像具有重要的现实意义和实用价值。在传统情感分析的基础上,综述基于人工智能的教师教学情感智能分析技术,包括梳理国内外教师情感研究方法,从文本、语音、视觉及多模态等角度分析智能情感分析技术的研究现状,归纳总结多模态智能情感分析技术的关键技术,最后剖析教师教学情感智能分析技术面临的机遇、挑战及发展趋势。

关键词: 课堂教学, 教学情感, 智能分析

Abstract: Teachers’ positive teaching emotions can significantly improve teaching effectiveness,stimulate students’ interest and participation in learning,create a good classroom atmosphere,and promote students’ understanding and mastery of knowledge.On the contrary,inappropriate teaching emotions will affect students’ enthusiasm for learning,reduce teaching efficiency,and even lead to students’ anorexia.Under the background of the digital transformation of education in China,how to use the massive text,voice,video and other classroom teaching data for the intelligent detection and analysis of teachers’ teaching emotions is of great practical significance and value for improving the quality of teaching,enhancing the effects of teachers’ teaching reflections,and perfecting the teachers’ digital images.On the basis of traditional emotion analysis,this paper reviews the intelligent analysis technology of teachers’ teaching emotions based on artificial intelligence,including combing the research methods of teachers’ emo ions at home and abroad,analyzing the current research status of intelligent emotion analysis technology from the perspectives of text,speech,vision and multimodal,focusing on summarizing the key technologies of multimodal intelligent emotion ana-lysis technology,and finally focusing on analyzing the opportunities,challenges and development trends of the intelligent analysis technology of teachers’ teaching emotions.Finally,it focuses on analyzing the opportunities,challenges and development trends of the intelligent analysis technology for teachers’ teaching.

Key words: Classroom teaching, Teaching emotions, Intelligent analysis

中图分类号: 

  • TP391
[1]FRENZEL A C,DANIELS L,BURIĆ I.Teacher emotions in the classroom and their implications for students[J].Educational Psychologist,2021,56(4):250-264.
[2]SUTTON R E,WHEATLEY K F.Teachers’ emotions andteaching:A review of the literature and directions for future research[J].Educational Psychology Review,2003,15(4):327-358.
[3]CHEN J.Understanding teacher emotions:The development of a teacher emotion inventory[J].Teaching and Teacher Education,2016,55(4):68-77.
[4]BURIĆ I,SLIŠKOVIĆ A,MACUKA I.A mixed-method ap-proach to the assessment of teachers’ emotions:development and validation of theteacher emotion questionnaire[J].Educational Psychology,2018,38(3):325-349.
[5]STARKEY-PERRET R,DELEDALLE A,JEOFFRION C,et al.Measuring the impact of teaching approaches on achievement-related emotions:The use of theachievement emotions questionnaire[J].British Journal of Educational Psychology,2018,88(3):446-464.
[6]MA P,YU J,QIAO Y,et al.Developing and validating a scale to measure teachers’ emotional labor strategy in classrooms[J].Social Psychology of Education,2023,26(3):557-577.
[7]LI Q,ZHENG X.Review andprospect of teacher emotion research methods[J].Foreign Language Journal,2021,8(4):80-87.
[8]MA N,ZHANG Y L,DU L,et al.Research on theemotion-cognition automatic analysis model for online asynchronous interaction text-Taking large-scale teacher online training as an example[J].Modern Educational Technology,2022,32(5):83-92.
[9]YU X H,ZHAN X Y.How much do we know about teachercomments?-Exploring emotional value behind the text[J].e-Education Research,2022,43(7):97-105.
[10]LIANG J,ZHANG X Y,ZHANG Z H.Speech emotion recognition of teachers in classroom teaching[C]//Chinese Control and Decision Conference.2020:5045-5050.
[11]OU Z G,LIU Y P,LI R L,et al.Research on teacher speechemotion recognition in international Chinese language classrooms[J].Modern Educational Technology,2023,33(8):87-95.
[12]ZHOU J X,LIU J S,GAN J H,et al.Classroom speech emotion recognition method based on multi-scale temporal-aware network[J].Computer Applications,2024,44(5):1636-1643.
[13]LIU T,WANG M,YANG B,et al.ESERNet:Learning spectrogram structure relationship for effective speech emotion recognition with swin transformer in classroom discourse analysis[J].Neurocomputing,2025,612(1):128711.
[14]YANG J M,PI Z L,ZHANG Y,et al.The role of teachers’ eye gaze in instructional videos:An eye-tracking study[J].China Educational Technology,2020,404(9):22-29.
[15]ZHAO J,LI J,JIA J.A study on posture-based teacher-student behavioral engagement pattern[J].Sustainable Cities and Society,2021,67(4):102749.
[16]YU Z,JIN Z,XUE Q,et al.Comprehensiveteacher teaching posture evaluation model:Based on OpenPose posture recognition in the context of digitalization and intelligence integration[C]//International Conference on Machine Learning and Computer Application.2023:479-483.
[17]CHEN Z Z,WANG Z,ZHENG Q Y.Teacher attention recognition algorithm based on full-range head pose estimation[J].Computer Engineering,2024,50(7):96-103.
[18]PENG H C,WEI F,YAN H B.Multimodal-data enabling tea-cher’s profile:from stick figure to holographic portrait[J].Open Education Research,2021,27(2):80-89.
[19]LU Y Y,CHEN Z Z,CHEN R,et al.Research on the application framework of intelligent technologies to promote teachers’ classroom teaching behaviors evaluation[J].Modern Educational Technology,2022,32(12):76-84.
[20]ZHAO G,ZHANG Y,CHU J.A multimodal teacher speechemotion recognition method in the smart classroom[J].Internet of Things,2024,25(4):101069.
[21]YU S,ANDROSOV A,YAN H.Exploring the prospects ofmultimodal large language models forautomated emotion recognition in education:Insights from Gemini[J].Computers & Edu-cation,2025,232(7):105307.
[22]PAN J,FANG W,ZHANG Z,et al.Multimodal emotion recognition based on facial expressions,speech,and EEG[J].IEEE Open Journal of Engineering in Medicine and Biology,2024,5(1):396-403.
[23]GONG X,CHEN C L P,ZHANG T.Cross-cultural emotion re-cognition with EEG and eye movement signals based on multiple stacked broad learning system[J].IEEE Transactions on Computational Social Systems,2024,11(2):2014-2025.
[24]MAAS A L,DALY R E,PHAM P T,et al.Learning word vectors for sentiment analysis[C]//Annual Meeting of the Association for Computational Linguistics.2011:142-150.
[25]SOCHER R,PERELYGIN A,WU J,et al.Recursive deep mo-dels for semantic compositionality over a sentiment treebank[C]//Empirical Methods in Natural Language Processing.2013:1631-1642.
[26]BLITZER J,DREDZE M,PEREIRA F.Biographies,bollywood,boom-boxes and blenders:Domain adaptation for sentiment classification[C]//Annual Meeting of the Association of Computational Linguistics.2007:440-447.
[27]BURKHARDT F,PAESCHKE A,ROLFES M,et al.A data-base of German emotional speech[C]//Interspeech.2005:1517-1520.
[28]BUSSO C,BULUT M,LEE C C,et al.IEMOCAP:Interactiveemotional dyadic motion capture database[J].Language Resources and Evaluation,2008,42(4):335-359.
[29]LIVINGSTONE S R,RUSSO F A.TheRyerson audio-visual database of emotional speech and song(RAVDESS):A dynamic,multimodal set of facial and vocal expressions in north American English[J].PLoS One,2018,13(5):e0196391.
[30]CAO H,COOPER D G,KEUTMANN M K,et al.CREMA-D:Crowd-sourced emotional multimodal actors dataset[J].IEEE Transactions on Affective Computing,2014,5(4):377-390.
[31]LUCEY P,COHN J F,KANADE T,et al.The extended cohn-kanade dataset(CK+):A complete dataset for action unit and emotion-specified expression[C]//IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops.2010:94-101.
[32]ZHANG Z,GIRARD J M,WU Y,et al.Multimodal spontaneous emotion corpus for human behavior analysis[C]//IEEE Confe-rence on Computer Vision and Pattern Recognition.2016:3438-3446.
[33]GOODFELLOW I J,ERHAN D,CARRIER P L,et al.Challenges in representation learning:A report on three machine lear-ning contests[C]//Neural Information Processing.2013:117-124.
[34]MOLLAHOSSEINI A,HASANI B,MAHOOR M H.Affec-tnet:A database for facial expression,valence,andarousal computing in the wild[J].IEEE Transactions on Affective Computing,2017,10(1):18-31.
[35]LI S,DENG W,DU J P.Reliable crowdsourcing and deep locality-preserving learning for expression recognition in the wild[C]//IEEE Conference on Computer Vision and Pattern Recognition.2017:2852-2861.
[36]PORIA S,HAZARIKA D,MAJUMDER N,et al.MELD:Amultimodal multi-party dataset for emotion recognition in conversations[C]//Annual Meeting of the Association for Computational Linguistics.2019:527-536.
[37]KOELSTRA S,MUHL C,SOLEYMANI M,et al.DEAP:A database for emotion analysis;using physiological signals[J].IEEE Transactions on Affective Computing,2011,3(1):18-31.
[38]ZADEH A A B,LIANG P P,PORIA S,et al.Multimodal language analysis in the wild:CMU-MOSEI dataset and interpretable dynamic fusion graph[C]//Annual Meeting of the Association for Computational Linguistics.2018:2236-2246.
[39]HUANG M,XIE H,RAO Y,et al.Lexicon-based sentimentconvolutional neural networks for online review analysis[J].IEEE Transactions on Affective Computing,2020,13(3):1337-1348.
[40]DING F,KANG X,NAKAGAWA S,et al.Neuro or symbolic? Fine-tuned transformer with unsupervised LDA topic clustering for text sentiment analysis[J].IEEE Transactions on Affective Computing,2024,15(2):493-507.
[41]ZHANG Z L,FEI Q J,CHEN Y Y,et al.Research on emotion recognition of multi category text based on BERT model and dynamic integrated selection[J].China Management Science,2024,32(6):140-150.
[42]WAN B,WU P,YEO C K,et al.Emotion-cognitive reasoning integrated BERT for sentiment analysis of online public opinions on emergencies[J].Information Processing & Management,2024,61(2):103609.
[43]ULGEN I R,DU Z,BUSSO C,et al.Revealing emotional clusters in speaker embeddings:A contrastive learning strategy for speech emotion recognition[C]//IEEE International Conference on Acoustics,Speech and Signal Processing.2024:12081-12085.
[44]SHEN S,GAO Y,LIU F,et al.Emotion neural transducer for fine-grained speech emotion recognition[C]//IEEE InternationalConference on Acoustics,Speech and Signal Processing.2024:10111-10115.
[45]CHANDOLA D,ALTARAWNEH E,JENKIN M,et al.SERC-GCN:Speech emotion recognition in conversation using graph convolutional networks[C]//IEEE International Conference on Acoustics,Speech and Signal Processing.2024:76-80.
[46]ZHANG Y M,ZHANG X,GAO M,et al.Incorporating dynamic convolution and attention mechanism in multilayer perceptron for speech emotion recognition[J].Computer Science and Exploration,2025,19(4):1065-1075.
[47]CEN J,QING C,OU H,et al.Masanet:multi-aspect semanticauxiliary network for visual sentiment analysis[J].IEEE Transactions on Affective Computing,2024,15(3):1439-1450.
[48]WANG L,KANG X,DING F,et al.MSSTNet:Amulti-scalespatio-temporal CNN-transformer network for dynamic facial expression recognition[C]//IEEE International Conference on Acoustics,Speech and Signal Processing.2024:3015-3019.
[49]FEI Y,XU J,QIAO M,et al.MAJoR:Visualemotion analysis via multi-attribute joint reasoning[C]//IEEE International Conference on Acoustics,Speech and Signal Processing.2025:1-5.
[50]WANG Y J,HE J,ZHANG J X,et al.Semi-supervised facial expression recognition robust to head pose empowered by dual consistency constraints[J].Chinese Journal of Image Graphics,2025,30(2):435-450.
[51]YU J,CHEN K,XIA R.Hierarchical interactive multimodaltransformer for aspect-based multimodal sentiment analysis[J].IEEE Transactions on Affective Computing,2022,14(3):1966-1978.
[52]SUN J,LI X,ZHU F.Promptfusion and aspect-oriented filtration for aspect-based multimodal sentiment analysis[C]//IEEE International Conference on Acoustics,Speech and Signal Processing.2025:1-5.
[53]FANG L,LIU G,ZHANG R.Multi-grained multimodal interaction network for sentiment analysis[C]//IEEE International Conference on Acoustics,Speech and Signal Processing.2024:7730-7734.
[54]SUN L,LIAN Z,LIU B,et al.Efficient multimodal transformer with dual-level feature restoration for robust multimodal sentiment analysis[J].IEEE Transactions on Affective Computing,2023,15(1):309-325.
[55]HU R,YI J,CHEN L,et al.Graphrecon struction attentionfusion network for multimodal sentiment analysis[J].IEEE Transactions on Industrial Informatics,2024,21(1):297-306.
[56]SUN D,HE Y,HAN J.Using auxiliary tasks in multimodal fusion of Wav2Vec 2.0 and BERT for multimodal emotion recognition[C]//IEEE International Conference on Acoustics,Speech and Signal Processing.2023:1-5.
[57]SINGH U,ABHISHEK K,AZAD H K.A survey of cutting-edge multimodal sentiment analysis[J].ACM Computing Surveys,2024,56(9):1-38.
[58]RUSSELL J A.A circumplex model of affect[J].Journal of Personality and Social Psychology,1980,39(6):1161-1178.
[59]MEHRABIAN A.Pleasure-arousal-dominance:A general frame-work for describing and measuring individual differences in temperament[J].Current Psychology,1996,14(4):261-292.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!