Abstract: In recent decades,visual interpretation of finger and hand gestures has been an attractive direction in both computer vision and human-computer interaction areas．Traditional methods use a monocular RGB camera or multiple RGB cameras to get hand information．But it is limited by clustered backgrounds,lighting conditions,textures and other environment factors,which makes the accuracy,robustness and efficiency cannot satisfy real-time interactions．With the coming of consumer-level RGB-D camera,above limitations can be overcame with depth data got from a RGB-D camera．We first defineed a 3D interaction space with the RGB-D camera and segmented the hand region from backgrounds with the help of depth information．Then we proposed a real-time finger recognition and tracking approach using a depth camera which mainly use the contour of hands．At last,the human-computer interaction was achieved with the position and trajectory of fingers from the above method．Based on the proposed method,we designed several experiments.The results validate the accuracy,effectiveness and robustness of our approach.

Key words: Finger tracking,Gesture recognition,Human-computer interaction,Computer vision,RGB-D camera