Abstract: Human-machine interaction system is the connection between human and computer.As the advances in computer technology,uses of mouse or keyboard are insufficient,now people need some nature and comfortable methods to manipulate the computers and so on.Gesture recognition-based method is one of the important human-machine interaction system,but there are some issues in the traditional method,such as low prediction accuracy,complex process procedure.To solve these problems,this paper proposed a deep learning-based gesture recognition algorithm.This method abstracts gesture feature heat map by pose estimation,then classified them by using convolutional neural network,overcomes the difficulty of image segmentation in complex background,and improves the accuracy in recognition.The result shows a 98% accuracy in recognition.Finally,a gesture guessing game robot was designed with this method,and the application of gesture recognition in human-machine interaction was presented.

Key words: Deep learning, Gesture recognition, Pose estimation, Pose prediction, Robot