Computer Science

Computer Science ›› 2024, Vol. 51 ›› Issue (10): 135-143.doi: 10.11896/jsjkx.240400089

• Technology and Application of Intelligent Education • Previous Articles     Next Articles

Recognition and Analysis of Teaching Behavior Based on Multi-scale GCN

LI Jia'nan1, LI Ruiyi1, ZHAO Zhifu2, SONG Juan1, HAN Jialong1, ZHU Tong3   

  1. 1 School of Computer and Technology,Xidian University,Xi'an 710071,China
    2 School of Artificial Intelligence,Xidian University,Xi'an 710071,China
    3 Academy of Advanced Interdisciplinary Research,Xidian University,Xi'an 710071,China
  • Received:2024-04-15 Revised:2024-07-05 Online:2024-10-15 Published:2024-10-11
  • About author:LI Jia'nan,born in 1991,Ph.D,is a member of CCF(No.K8171M).Her main research interests include video understanding and action recognition.
    ZHAO Zhifu,born in 1990,Ph.D,is a member of CCF(No.A0143M).His main research interests include deep learning,video understanding,and compressive sensing.
  • Supported by:
    Key Project of Education Teaching Reform of Xidian University(A2304),Fundamental Research Funds for the Central Universities(ZYTS24092,QTZX24085) and Young Scientists Fund of the National Natural Science Foundation of China(62202356,62302373).

PDF (PC)

274

Abstract: In the field of education,classroom teaching evaluation stands as a pivotal element in enhancing teaching quality.With the widespread adoption of digital education,the quest for an intelligent evaluation method becomes increasingly crucial.Therefore,this paper proposes a novel method based on skeleton action recognition and lagged sequence analysis,aiming to more accurately capture and analyze teachers' teaching behaviors while reducing manpower consumption and diminishing the subjectivity of teaching evaluations.Firstly,a multi-scale feature graph convolutional network is proposed and applied to analyze teacher classroom behaviors.This network utilizes a multi-scale semantic feature fusion module to capture features at two scales,skeleton points,and body parts,in the spatial dimension.In the temporal dimension,a multi-scale temporal feature extraction module is employed to extract temporal features of skeleton data from both global and local perspectives.Subsequently,a dataset for analyzing teachers' classroom behaviors is constructed,and the effectiveness of the proposed method is validated on this dataset.Finally,leveraging the proposed skeleton action recognition model and lagged sequence analysis,a system for recognizing and analyzing teaching behaviors is developed.The proposed method demonstrates significant advantages in classroom behavior recognition and analysis when applied to various classroom teaching scenarios.

Key words: Teaching behavior analysis, Skeleton sequence, Digital education, Graph convolution, Action recognition

CLC Number: 

  • TP391
[1]LI B H,ZHANG X Y.Design and Implementation of Classroom Teaching Video Analysis Software Based on ITIAS[J].Software,2019,40(1):46-50.
[2]ZHANG N L.Research on the Design of a Practical CourseTeaching Process Management System Based on Achievement Analysis[J].Education and Teaching Forum,2021(41):4.
[3]CHEN J T.Research on Intelligent Image Recognition andAnalysis of Classroom Behavior [D].Hangzhou:Zhejiang University,2019.
[4]TAN B,YANG S.Research on Student Classroom Behavior Detection Algorithm Based on Faster R-CNN [J].Modern Computer,2018(22):45-47.
[5]ZHENG Y.A Teacher Teaching Behavior Evaluation MethodBased on Posture Recognition [J].Software Engineering,2021,24(4);6-9.
[6]HUSSEIN M E,TORKI M,GOWAYYED M A,et al.Humanaction recognition using a temporal hierarchy of covariance descriptors on 3D joint locations[C]//International Joint Confe-rence on Artificial Intelligence(IJCAI).2013:2466-2472.
[7]VEMULAPALLI R,ARRATE F,CHELLAPPA R.Human action recognition by representing 3D skeletons as points in a lie group[C]//2014 IEEE Conference on Computer Vision and Pattern Recognition(CVPR).2014:588-595.
[8]VEERIAH V,ZHUANG N,QI G J.Differential recurrent neural networks for action recognition[C]//IEEE International Conference on Computer Vision(ICCV).2015:4041-4049.
[9]ZHANG P,LAN C,XING J,et al.View adaptive recurrent neural networks for high performance human action recognition from skeleton data[C]//IEEE International Conference on Computer Vision(ICCV).2017:2136-2145.
[10]LIU J,WANG G,DUAN L Y,et al.Skeleton-based human action recognition with global context-aware attention LSTM networks[J].IEEE Transactions on Image Processing,2017,27(4):1586-1599.
[11]YAN S,XIONG Y,LIN D.Spatial temporal graph convolutional networks for skeleton-based action recognition[C]//Procee-dings of the AAAI Conference on Artificial Intelligence.2018.
[12]SHI L,ZHANG Y,CHENG J,et al.Two-stream adaptive graph convolutional networks for skeleton-based action recognition[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:12026-12035.
[13]LI B,LI X,ZHANG Z,et al.Spatio-temporal graph routing for skeleton-based action recognition[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2019:8561-8568.
[14]LI S,LI W,COOK C,et al.Independently recurrent neural network(indrnn):Building a longer and deeper rnn[C]//Procee-dings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:5457-5466.
[15]MONTI F,BOSCAINI D,MASCI J,et al.Geometric deep lear-ning on graphs and manifolds using mixture model cnns[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:5115-5124.
[16]LI M,CHEN S,CHEN X,et al.Actional-structural graph con-volutional networks for skeleton-based action recognition[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:3595-3603.
[17]ZHANG X,XU C,TIAN X,et al.Graph edge convolutionalneural networks for skeleton-based action recognition[J].IEEE Transactions on Neural Networks and Learning Systems,2019,31(8):3047-3060.
[18]XU K,YE F,ZHONG Q,et al.Topology-aware convolutional neural network for efficient skeleton-based action recognition[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2022:2866-2874.
[19]CHI H,HA M H,CHI S,et al.Infogcn:Representation learning for human skeleton-based action recognition[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2022:20186-20196.
[20]YANG W,ZHANG J,CAI J,et al.HybridNet:Integrating GCNand CNN for skeleton-based action recognition[J].Applied Intelligence,2023,53(1):574-585.
[21]LIU Z,ZHANG H,CHEN Z,et al.Disentangling and unifying graph convolutions for skeleton-based action recognition[C]//Proceedings of the IEEE/CVFConference on Computer Vision and Pattern Recognition.2020:143-152.
[22]CHEN Y,ZHANG Z,YUAN C,et al.Channel-wise topology refinement graph convolution for skeleton-based action recognition[C]//Proceedings of the IEEE/CVF International Confe-rence on Computer Vision.2021:13359-13368.
[23]LIU Y,ZHANG H,XU D,et al.Graph transformer networkwith temporal kernel attention for skeleton-based action recognition[J].Knowledge-Based Systems,2022,240:108146.
[24]SHAHROUDY A,LIU J,NG T T,et al.Ntu rgb+ d:A large scale dataset for 3d human activity analysis[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:1010-1019.
[25]YAN S,XIONG Y,LIN D.Spatial temporal graph convolutional networks for skeleton-based action recognition[C]//Procee-dings of the AAAI Conference on Artificial Intelligence.2018.
[26]SHI L,ZHANG Y,CHENG J,et al.Two-stream adaptive graph convolutional networks for skeleton-based action recognition[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:12026-12035.
[27]CHEN Z,LI S,YANG B,et al.Multi-scale spatial temporalgraph convolutional network for skeleton-based action recognition[C]//Proceedings of the AAAI Conference on Artiffcial Intelligence.2021:1113-1122.
[28]SONG Y F,ZHANG Z,SHAN C,et al.Constructing stronger and faster baselines for skeleton-based action recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2022,45(2):1474-1488.
[29]LEE J,LEE M,LEE D,et al.Hierarchically decomposed graph convolutional networks for skeleton-based action recognition[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2023:10444-10453.
[1] ZHANG Lu, DUAN Youxiang, LIU Juan, LU Yuxi. Chinese Geological Entity Relation Extraction Based on RoBERTa and Weighted Graph Convolutional Networks [J]. Computer Science, 2024, 51(8): 297-303.
[2] YUAN Lining, FENG Wengang, LIU Zhao. Multi-channel Graph Convolutional Networks Enhanced by Label Propagation Algorithm [J]. Computer Science, 2024, 51(8): 304-312.
[3] LEI Yongsheng, DING Meng, SHEN Yao, LI Juhao, ZHAO Dongyue, CHEN Fushi. Action Recognition Model Based on Improved Two Stream Vision Transformer [J]. Computer Science, 2024, 51(7): 229-235.
[4] WEI Niannian, HAN Shuguang. New Solution for Traveling Salesman Problem Based on Graph Convolution and AttentionNeural Network [J]. Computer Science, 2024, 51(6A): 230700222-8.
[5] HUANG Haixin, CAI Mingqi, WANG Yuyao. Review of Point Cloud Semantic Segmentation Based on Graph Convolutional Neural Networks [J]. Computer Science, 2024, 51(6A): 230400196-7.
[6] HUANG Rui, XU Ji. Text Classification Based on Invariant Graph Convolutional Neural Networks [J]. Computer Science, 2024, 51(6A): 230900018-5.
[7] LIU Hui, JI Ke, CHEN Zhenxiang, SUN Runyuan, MA Kun, WU Jun. Malicious Attack Detection in Recommendation Systems Combining Graph Convolutional Neural Networks and Ensemble Methods [J]. Computer Science, 2024, 51(6A): 230700003-9.
[8] ZHANG Xiaoxi, LI Dongxi. Cancer Subtype Prediction Based on Similar Network Fusion Algorithm [J]. Computer Science, 2024, 51(6A): 230500006-7.
[9] HUANG Chungan, WANG Guiping, WU Bo, BAI Xin. Diversified Recommendation Based on Light Graph Convolution Networks and ImplicitFeedback Enhancement [J]. Computer Science, 2024, 51(6A): 230900038-11.
[10] HOU Lei, LIU Jinhuan, YU Xu, DU Junwei. Review of Graph Neural Networks [J]. Computer Science, 2024, 51(6): 282-298.
[11] LI Yilin, SUN Chengsheng, LUO Lin, JU Shenggen. Aspect-based Sentiment Classification for Word Information Enhancement Based on Sentence Information [J]. Computer Science, 2024, 51(6): 299-308.
[12] ZHANG Liying, SUN Haihang, SUN Yufa , SHI Bingbo. Review of Node Classification Methods Based on Graph Convolutional Neural Networks [J]. Computer Science, 2024, 51(4): 95-105.
[13] YUAN Rong, PENG Lilan, LI Tianrui, LI Chongshou. Traffic Flow Prediction Model Based on Dual Prior-adaptive Graph Neural ODE Network [J]. Computer Science, 2024, 51(4): 151-157.
[14] YAN Wenjie, YIN Yiying. Human Action Recognition Algorithm Based on Adaptive Shifted Graph Convolutional Neural
Network with 3D Skeleton Similarity [J]. Computer Science, 2024, 51(4): 236-242.
[15] ZHANG Mingdao, ZHOU Xin, WU Xiaohong, QING Linbo, HE Xiaohai. Unified Fake News Detection Based on Semantic Expansion and HDGCN [J]. Computer Science, 2024, 51(4): 299-306.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.