Computer Science

Computer Science ›› 2021, Vol. 48 ›› Issue (8): 334-339.doi: 10.11896/jsjkx.201000036

• Human-Machine Interaction • Previous Articles    

Interactive Group Discovery Based on Skeleton Trajectory Aggregation Model in ClassEnvironment

GAO Yan, YAN Qiu-yan, XIA Shi-xiong, ZHANG Zi-han   

  1. School of Computer Science & Technology,China University of Mining and Technology,Xuzhou,Jiangsu 221116,China
  • Received:2020-10-09 Revised:2020-11-08 Published:2021-08-10
  • About author:GAO Yan,born in 1997,postgraduate,is a member of China Computer Federation.Her main research interests include education big data analysis and time series data mining.(TS19170003A31@cumt.edu.cn)YAN Qiu-yan,born in 1978,Ph.D,associate professor,is a member of China Computer Federation.Her main research interests include multi-modal image behavior recognition,education big data analysis and time series data mining.
  • Supported by:
    National Natural Science Foundation of China(61977061,51934007).

PDF (PC)

741

Abstract: Traditional class action recognition methods focus on the recognition of interactive behavior itself,not the group discovery.Accurate positioning and discovery of interactive groups in class environment is the basis for further individual behavior recognition,but there is a problem of missing behavior data caused by occlusion.Skeletal data represent human behavior and motion trajectory,and have the advantages of not being disturbed by light and background,and simple data expression.Aiming at multi-person interactive group discovery of skeleton data,an interactive group discovery algorithm based on skeleton trajectory aggregation (IGSTA) is proposed.Firstly,this paper standardizes the skeleton data into the human-centered coordinate system to reduce the impact on recognition accuracy of different body size and initial position of person.Secondly,a skeleton trajectory aggregation model based on multi-core representation is proposed to accurately describe the changes of students' interactive beha-vior groups.Finally,the aggregated skeleton trajectories are clustered to realize the discovery of interactive group.Kinect is used to obtain the simulated video of classroom student interaction behavior.Experiments proves the validity of the method,that is,in the case of missing skeleton nodes,the interaction group of students can be accurately found in class environment.

Key words: Class interaction, Interactive group, Skeleton data, Trajectory clustering

CLC Number: 

  • TP391
[1]KIM D,KIM D H,KWAK K C.Classification of K-Pop dance movements based on skeleton information obtained by a kinect sensor[J].Sensors,2017,17(6):1261.
[2]MILLE J,LEBORGNE A,TOUGNE L.Euclidean Distance-Based Skeletons:A Few Notes on Average Outward Flux and Ridgeness[J].Journal of Mathematical Imaging and Vision,2019,61(3):310-330.
[3]GHORBEL E,BOUTTEAU R,BOONAERT J,et al.Kinematic Spline Curves:A temporal invariant descriptor for fast action recognition[J].Image and Vision Computing,2018,77:60-71.
[4]BISWAS J,VELOSO M.Depth camera based indoor mobile robot localization and navigation[C]//Proceedings－IEEE International Conference on Robotics and Automation.2011:1697-1702.
[5]WU Q,CHEN Z,ZHOU Y X,et al.Human-computer interaction based on Kinect skeleton tracking technology[J].Journal of Changzhou University (Natural Science Edition),2014,26(3):6-12.
[6]LI J,TONG L J,YING X,et al.Simulation of 3D Human Wal-king Posture Based on Skeleton Data [J].Digital Technology and Application,2017(10):68-71.
[7]GHAZAL S,KHAN U S.Human posture classification using skeleton information[C]//2018 International Conference on Computing,Mathematics and Engineering Technologies (iCoMET).IEEE,2018:1-4.
[8]WEI Y T,QIN D Y,HU J M,et al.The Recognition ofStudents' Classroom Behaviors based on Deep Learning[J].Modern Educational Technology,2019,29(7):88-92.
[9]CAI H Z.Research and Application of Classroom Behavior Reco-gnition Based on Space-Time Interest Points[D].Nanjing:Nanjing Normal University,2014.
[10]CHEN J,XIE R M.Research on the Detection of Students'Classroom States Based on HOG Features[J].Journal of Chongqing University of Science and Technology (Natural Scien-ces Edition),2019,21(4):89-92.
[11]PAN M,WANG J,LUO Z.Modelling Study on Learning Affects for Classroom Teaching/Learning Auto-Evaluation[J].Science,2018,6(3):81-86.
[12]ZALETELJ J,KOŠIR A.Predicting students' attention in the classroom from Kinect facial and body features[J/OL].EURASIP Journal on Image and Video Processing,2017(1):80.https://doi.org/10.1186/s13640-017-0228-8.
[13]HUYNH-THE T,BANOS O,LE B V,et al.PAM-based flexible generative topic model for 3D interactive activity recognition[C]//2015 International Conference on Advanced Technologies for Communications (ATC).IEEE,2015.
[14]JI Y,YE G,CHENG H.Interactive body part contrast miningfor human interaction recognition[C]//IEEE International Conference on Multimedia and Expo Workshops (ICMEW).IEEE,2014.
[15]JI Y,CHENG H,ZHENG Y,et al.Learning contrastive feature distribution model for interaction recognition[J].Journal of Vi-sual Communication and Image Representation,2015,33:340-349.
[16]WU H,SHAO J,XU X,et al.Recognition and Detection ofTwo-Person Interactive Actions Using Automatically Selected Skeleton Features[J].IEEE Transactions on Human-Machine Systems,2017(99):1-7.
[17]BLOOM V,ARGYRIOU V,MAKRIS D.Hierarchical transfer learning for online recognition of compound actions[J].Compu-ter Vision and Image Understanding,2016,144(3):62-72.
[18]COPPOLA C,FARIA D R,NUNES U,et al.Social activity recognition based on probabilistic merging of skeleton features with proximity priors from RGB-D data[C]//2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).IEEE,2016.
[19]XU H,ZHOU Y,LIN W,et al.Unsupervised Trajectory Clustering via Adaptive Multi-kernel Based Shrinkage [C]//IEEE International Conference on Computer Vision.IEEE,2015.
[20]CAO Z,SIMON T,WEI S,et al.Realtime Multi-person 2DPose Estimation Using Part Affinity Fields[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Honolulu,HI,USA,2017:1302-1310.
[21]WU D,SHAO L.Leveraging Hierarchical Parametric Networks for Skeletal Joints Based Action Segmentation and Recognition[C]//IEEE Conference on Computer Vision & Pattern Recognition.IEEE,2014.
[22]DAI S W,WU X J,GAO C F,et al.Fuzzy Clustering Based On Multiple Kernel[J].Computer Engineering and Applications,2016,52(2):65-66.
[1] YU Shu-hao, ZHOU Hui, YE Chun-yang, WANG Tai-zheng. SDFA:Study on Ship Trajectory Clustering Method Based on Multi-feature Fusion [J]. Computer Science, 2022, 49(6A): 256-260.
[2] XIE Yu, YANG Rui-ling, LIU Gong-xu, LI De-yu, WANG Wen-jian. Human Skeleton Action Recognition Algorithm Based on Dynamic Topological Graph [J]. Computer Science, 2022, 49(2): 62-68.
[3] XU Hua-jie, WU Qing-hua, HU Xiao-ming. Privacy Protection Algorithm Based on Multi-characteristics of Trajectory [J]. Computer Science, 2019, 46(1): 190-195.
[4] FAN Jing, RUAN Ti-hong, WU Jia-min and DONG Tian-yang. Vehicle Behavior Recognition Method Based on Quadratic Spectral Clustering and HMM-RF Hybrid Model [J]. Computer Science, 2016, 43(5): 288-293.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.