Computer Science ›› 2019, Vol. 46 ›› Issue (6A): 165-168.

• Pattern Recognition & Image Processing • Previous Articles     Next Articles

Static Gesture Recognition Based on Hybrid Convolution Neural Network

SHI Yu-xin, DENG Hong-min, GUO Wei-lin   

  1. College of Electronics and Information Engineering,Sichuan University,Chengdu 610065,China
  • Online:2019-06-14 Published:2019-07-02

Abstract: Static gesture recognition has caught special attention for its great application value in man-machine interaction.At the same time,the accuracy of gesture recognition is affected by the complexity of gesture background and the diversity of gesture morphology in a certain extent.In order to improve the accuracy of gesture recognition,a method was proposed,which is based on convolutional neural network(CNN) and random forest(RF).Firstly,the image of the static gesture is segmented,then the feature extraction function of convolution network is used to extract feature vectors,and finally the random forest classifier is used to classify these feature vectors.On the one hand,the CNN has the ability of layered learning and is able to collect more representative information on the picture.On the other hand,random forest shows randomness for samples and feature selection,meanwhile,it can be avoided easily that the results of each decision tree is averaged over fitting problem.This paper verified by using the static gesture data set,and the experimental results show that the proposed method can effectively identify the static gestures and achieve an average recognition rate of 94.56%.The method proposed in this paper was further compared with principal component analysis(PCA) and partial binary(LBP).The experimental results show that the classification and recognition effect with feature extraction by CNN is better than PCA and LBP.The recognition rate is 2.44% higher than that of PCA-RF methodand 1.74% higher than that of LBP-RF method.Finally,the recognition rate of the proposed method reaches 97.9%,which is higher than the other two traditional feature extraction methods.

Key words: Convolutional neural network, Random forest, Recognition, Static gesture

CLC Number: 

  • TP183
[1]ZAKI M M,SHAHEEN S I.Sign language recognition using a combination of new vision based features[J].Pattern Recognition Letters,2011,32(4):572-577.
[2]ALKHATEEB J H,KHELIFI F,JIANG J,et al.A new ap-proach for off-line handwritten Arabic word recognition using KNN classifier[C]∥IEEE InternationalConference on Signal and Image Processing Applications.IEEE,2010:191-194.
[3]LIU Y,YIN Y,ZHANG S.Hand Gesture Recognition Based on HU Moments in Interaction of Virtual Reality[C]∥InternationalConference on Intelligent Human-Machine Systems and Cybernetics.IEEE,2012:145-148.
[4]RONCANCIO C.Combined Gesture-Speech Recognition and Synthesis Using Neural Networks[J].IFAC Proceedings Vo-lumes,2008,41(2):2968-2973.
[5]LECUN Y,BENGIO Y.Convolutional networks for images, speech,and time series[M]∥The handbook of brain theory and neural networks.MIT Press,1998.
[6]WAIBEL A,HANAZAWA T,HINTON G,et al.Phoneme recognition using time-delay neural networks[J].Readings in Speech Recognition,1990,1(2):393-404.
[7]VAILLANT R,MONROCQ C,CUN Y L.An original approach for the localization of objects in images[C]∥International Conference on Artificial Neural Networks.IET,1993:26-30.
[8]LAWRENCE S,GILES C L,TSOI A C,et al.Face recognition:a convolutional neural-network approach[J].IEEE Transactions on Neural Networks,1997,8(1):98-113.
[9]NIU X X,SUEN C Y.A novel hybrid CNN-SVM classifier for recognizing handwritten digits[J].Pattern Recognition,2012,45(4):1318-1325.
[10]史鹤欢,许悦雷,马时平,等.PCA预训练的卷积神经网络目标识别算法[J].西安电子科技大学学报(自然科学版),2016,43(3):161-166.
[11]BREIMAN L.Random forest[J].Machine Learning,2001,45: 5-32.
[12]STERGIOPOULOU E,PAPAMARKOS N.Hand gesture re-cognition using a neural network shape fitting technique[J].Engineering Applications of Artificial Intelligence,2009,22(8):1141-1158.
[13]ESCALERA S,RADEVA P,DIMOV D,et al.Graph cuts optimization for multi-limb human segmentation in depth maps[C]∥IEEE Conference on Computer Vision and Pattern Recognition.IEEE Computer Society,2012:726-732.
[14]BELONGIE S,MALIK J,PUZICHA J.Shape matching and object recognition using shape contexts[C]∥IEEE International Conference on Computer Science and Information Technology.IEEE,2010:483-507.
[15]NAIR V,HINTON G E.Rectified linear units improve restric-ted boltzmann machines[C]∥International Conference on International Conference on Machine Learning.Omnipress,2010:807-814.
[16]QUINLAN J R.Bagging,boosting,and C4.5[C]∥Proceedings of the National Conference on Artificial Intelligence.AMER ASSOC ARTFICIAL INTELL,1996:725-730.
[17]JOHNSON R W.An Introduction to the Bootstrap[J].Teaching Statistics,2001,23(2):49-54.
[18]王全才.随机森林特征选择[D].大连:大连理工大学,2011.
[1] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[2] CHEN Yong-quan, JIANG Ying. Analysis Method of APP User Behavior Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(8): 78-85.
[3] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[4] GAO Zhen-zhuo, WANG Zhi-hai, LIU Hai-yang. Random Shapelet Forest Algorithm Embedded with Canonical Time Series Features [J]. Computer Science, 2022, 49(7): 40-49.
[5] YANG Bing-xin, GUO Yan-rong, HAO Shi-jie, Hong Ri-chang. Application of Graph Neural Network Based on Data Augmentation and Model Ensemble in Depression Recognition [J]. Computer Science, 2022, 49(7): 57-63.
[6] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[7] DAI Zhao-xia, LI Jin-xin, ZHANG Xiang-dong, XU Xu, MEI Lin, ZHANG Liang. Super-resolution Reconstruction of MRI Based on DNGAN [J]. Computer Science, 2022, 49(7): 113-119.
[8] LIU Yue-hong, NIU Shao-hua, SHEN Xian-hao. Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(7): 127-131.
[9] XU Ming-ke, ZHANG Fan. Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition [J]. Computer Science, 2022, 49(7): 132-141.
[10] FEI Xing-rui, XIE Yi. Click Streams Recognition for Web Users Based on HMM-NN [J]. Computer Science, 2022, 49(7): 340-349.
[11] WANG Wen-qiang, JIA Xing-xing, LI Peng. Adaptive Ensemble Ordering Algorithm [J]. Computer Science, 2022, 49(6A): 242-246.
[12] YANG Yue, FENG Tao, LIANG Hong, YANG Yang. Image Arbitrary Style Transfer via Criss-cross Attention [J]. Computer Science, 2022, 49(6A): 345-352.
[13] YANG Jian-nan, ZHANG Fan. Classification Method for Small Crops Combining Dual Attention Mechanisms and Hierarchical Network Structure [J]. Computer Science, 2022, 49(6A): 353-357.
[14] HAO Qiang, LI Jie, ZHANG Man, WANG Lu. Spatial Non-cooperative Target Components Recognition Algorithm Based on Improved YOLOv3 [J]. Computer Science, 2022, 49(6A): 358-362.
[15] LIU Wei-ye, LU Hui-min, LI Yu-peng, MA Ning. Survey on Finger Vein Recognition Research [J]. Computer Science, 2022, 49(6A): 1-11.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!