Computer Science

Computer Science ›› 2022, Vol. 49 ›› Issue (6): 269-275.doi: 10.11896/jsjkx.210500070

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Multi-algorithm Fusion Behavior Classification Method for Body Bone Information Reconstruction

ZHAO Xiao-hu, YE Sheng, LI Xiao   

  1. National, Local Joint Engineering Laboratory of Internet Application Technology on Mine(China University of Mining, Technology), Xuzhou, Jiangsu 221008, China
    School of Information and Control Engineering,China University of Mining and Technology,Xuzhou,Jiangsu 221008,China
  • Received:2021-05-11 Revised:2021-09-06 Online:2022-06-15 Published:2022-06-08
  • About author:ZHAO Xiao-hu,born in 1976,Ph.D,professor,Ph.D supervisor.His main research interests include artificial intelligence,mine informatization,key technology of mine Internet of Things transmission layer.
    YE Sheng,born in 1996,postgraduate.His main research interests include computer vision and so on.
  • Supported by:
    National Key R & D Program of China(2017YFC0804400).

PDF (PC)

595

Abstract: Aiming at the poor measurement effect of behavior monitoring in real life,a new method of extracting human behavior features is proposed.It not only considers the body point information,but also integrates the environmental attribute information of image.Considering that a large number of existing experiments use a variety of complex algorithms for experimental classification on the basis of human body features extraction,it does not take into account the irrationality of only using the body features for algorithm evaluation.Therefore,an image information reconstruction method based on body features is proposed in this paper,which combines the image convolution network of body features,attention mechanism and image recognition method to realize human behavior recognition.The body point information is extracted by Openpose,and then the body points are classified by graph convolution and attention.On the basis of the first classification,the body point expansion coefficient is added to segment the images so as to realize second accurate classification.Finally,the evaluation accuracy on the HMDB51 dataset improves by 5.6%,and it has a big advantage in the actual test.This shows that the method is not only more accurate,but also has more practical application value.

Key words: Action classification, Attention mechanism, Graph convolutional network, Image recognition, Transformer

CLC Number: 

  • TP391
[1] LIU M Z,ZHOU F Y,CHEN K,et al.Co-attention networks based on aspect and context for aspect-level sentiment analysis[J].Knowledge-Based Systems,2021,432(3),217-221.
[2] JEONG S,KANG S,CHUN I.Human-skeleton based Fall-Detection Method using LSTM for Manufacturing Industries[C]//2019 34th International Technical Conference on Circuits/Systems,Computers and Communications(ITC-CSCC).IEEE,2019:1-4.
[3] NIE Q,WANG X,WANG J,et al.A child caring robot for the dangerous behavior detection based on the object recognition and human action recognition[C]//2018 IEEE International Confe-rence on Robotics and Biomimetics (ROBIO).IEEE,2018:1921-1926.
[4] CAI Q.Human Behavior Recognition Algorithm Based on HOG Feature and SVM Classifier[C]//2019 IEEE 10th International Conference on Software Engineering and Service Science(ICSESS).IEEE,2019:233-236.
[5] YE Q,LI R,GUO X.Human Interaction Behavior Recognition based on Local Spatial-Temporal and Global Feature[C]//Journal of Physics:Conference Series.IOP Publishing,2021:1754-1758.
[6] XIANG L,WANG P,YANG X,et al.Fault detection of wind turbine based on SCADA data analysis using CNN and LSTM with attention mechanism[J].Measurement,2021,523(2):175-182.
[7] SHI L,ZHANG Y,CHENG J,et al.Two-streamadaptive graph convolutional networks for skeleton-based action recognition[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:12026-12035.
[8] ZHU S,DING X,YANG K,et al.A Spatial Attention-Enhanced Multi-Timescale Graph Convolutional Network for Skeleton-Based Action Recognition[C]//Proceedings of the 2020 3rd International Conference on Artificial Intelligence and Pattern Recognition.2020:57-62.
[9] YAN S,XIONG Y,LIN D.Spatial temporal graph convolutional networks for skeleton-based action recognition[C]//Procee-dings of the AAAI Conference on Artificial Intelligence.2018:32-36.
[10] GARCIA K D,DE SÁ C R,POEL M,et al.An ensemble of autonomous auto-encoders for human activity recognition[J].Neurocomputing,2021,439(2):271-280.
[11] GAN C,FENG Q,ZHANG Z.Scalable multi-channel dilatedCNN-BiLSTM model with attention mechanism for Chinese textual sentiment analysis[J].Future Generation Computer Systems,2021,118(3):297-309.
[12] XIANG L,WANG P,YANG X,et al.Fault detection of wind turbine based on SCADA data analysis using CNN and LSTM with attention mechanism[J].Measurement,2021,175(2):109-115.
[13] RUAN S,GAO J,XIANG J.Robert_LSTM Short Text Sentiment Classification Model Based on Attention Mechanism[J].International Core Journal of Engineering,2021,7(3):213-219.
[14] LI X,ZHAI W,CAO Y.A tri-attention enhanced graph convolutional network for skeleton-based action recognition[J].IET Computer Vision,2021,15(2):110-121.
[15] ZHOU W N,ZHOU S D.Summary of Model and Applications of Graph Convolutional Network[J].Journal of Research in Science and Engineering,2021,3(1),135-142.
[16] ZI W,XIONG W,CHEN H,et al.TAGCN:Station-level de-mand prediction for bike-sharing system via a temporal attention graph convolution network[J].Information Sciences,2021,561(3):274-285.
[17] MENG L,LI R.An Attention-EnhancedMulti-Scale and Dual Sign Language Recognition Network Based on a Graph Convolution Network[J].Sensors,2021,21(4):1120-1126.
[18] SUN Z,WANG R,LUO Z.Polynomial approximation basedspectral dual graph convolution for scene parsing and segmentation[J].Neurocomputing,2021,438(3):133-144.
[19] QIN J,ZENG X,WU S,et al.E-GCN:graph convolution with estimated labels[J].Applied Intelligence,2021,51(7):1-9.
[20] XING X,LI Q,YUAN M,et al.DS-GCNs:Connectome Classifi-cation using Dynamic Spectral Graph Convolution Networks with Assistant Task Training[J].Cerebral Cortex,2021,31(2):1259-1269.
[21] LI W,WANG X,ZHANG Y,et al.Traffic flow prediction over muti-sensor data correlation with graph convolution network[J].Neurocomputing,2021,427(1):50-63.
[22] CHANG C,LI X,GAO Y.A Graph Convolution model consi-dering label co-occurrence LC_GCN[C]//2020 3rd International Conference on Algorithms,Computing and Artificial Intelligence.2020:1-6.
[23] BAZI Y,BASHMAL L,RAHHAL M M A,et al.Vision Transformers for Remote Sensing Image Classification[J].Remote Sensing,2021,13(3):516-521.
[24] FAN S H,XIA D X.Study on the navigation of patrol robot of transformer substation based on color vision and RFID[C]//Advanced Materials Research.2011:1259-1264.
[25] TRETTENBREIN P C,ZACCARELLA E.Controlling VideoStimuli in Sign Language and Gesture Research:The Open PoseR Package for Analyzing OpenPose Motion-Tracking Data in R[J].Frontiers in Psychology,2021,12(1):411-412.
[26] SASITHRADEVI A,ROOMI S M M.Video classification and retrieval through spatio-temporal Radon features[J].Pattern Recognition,2020,99(2):107-114.
[27] lIAOZ,HU H,ZHANG J,et al.Residual attention unit for action recognition[J].Computer Vision and Image Understan-ding,2019,189(1):102-111.
[28] SUN L,JIA K,YEUNG D Y,et al.Human action recognitionusing factorized spatio-temporal convolutional networks[C]//Proceedings of the IEEE International Conference on Computer Vision.2015:7-13.
[29] SIMONYAN K,ZISSERMANA.Two-stream convolutional networks for action recognition in videos[J].arXiv:1406.2199,2014.
[30] FEICHTENHOFER C,PINZ A,ZISSERMAN A.Convolutional two-stream network fusion for video action recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:1933-1941.
[31] ZHU W,HU J,SUN G,et al.A key volume mining deep framework for action recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:1991-1999.
[32] WANG X,FARHADI A,GUPTA A.Actions~transforma-tions[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:2658-2667.
[1] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[2] ZHOU Fang-quan, CHENG Wei-qing. Sequence Recommendation Based on Global Enhanced Graph Neural Network [J]. Computer Science, 2022, 49(9): 55-63.
[3] DAI Yu, XU Lin-feng. Cross-image Text Reading Method Based on Text Line Matching [J]. Computer Science, 2022, 49(9): 139-145.
[4] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[5] XIONG Li-qin, CAO Lei, LAI Jun, CHEN Xi-liang. Overview of Multi-agent Deep Reinforcement Learning Based on Value Factorization [J]. Computer Science, 2022, 49(9): 172-182.
[6] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[7] WANG Ming, PENG Jian, HUANG Fei-hu. Multi-time Scale Spatial-Temporal Graph Neural Network for Traffic Flow Prediction [J]. Computer Science, 2022, 49(8): 40-48.
[8] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[9] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[10] TAN Ying-ying, WANG Jun-li, ZHANG Chao-bo. Review of Text Classification Methods Based on Graph Convolutional Network [J]. Computer Science, 2022, 49(8): 205-216.
[11] YAN Jia-dan, JIA Cai-yan. Text Classification Method Based on Information Fusion of Dual-graph Neural Network [J]. Computer Science, 2022, 49(8): 230-236.
[12] ZHANG Ying-tao, ZHANG Jie, ZHANG Rui, ZHANG Wen-qiang. Photorealistic Style Transfer Guided by Global Information [J]. Computer Science, 2022, 49(7): 100-105.
[13] ZENG Zhi-xian, CAO Jian-jun, WENG Nian-feng, JIANG Guo-quan, XU Bin. Fine-grained Semantic Association Video-Text Cross-modal Entity Resolution Based on Attention Mechanism [J]. Computer Science, 2022, 49(7): 106-112.
[14] XU Ming-ke, ZHANG Fan. Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition [J]. Computer Science, 2022, 49(7): 132-141.
[15] MENG Yue-bo, MU Si-rong, LIU Guang-hui, XU Sheng-jun, HAN Jiu-qiang. Person Re-identification Method Based on GoogLeNet-GMP Based on Vector Attention Mechanism [J]. Computer Science, 2022, 49(7): 142-147.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.