Computer Science ›› 2016, Vol. 43 ›› Issue (Z6): 125-129.doi: 10.11896/j.issn.1002-137X.2016.6A.030

Previous Articles     Next Articles

Adaptive Hand Tracking Based on Fusing Depth and Skin Features

NIU Chen-xiao, SUN Jin and DING Yong-hui   

  • Online:2018-12-01 Published:2018-12-01

Abstract: Hand tracking is key to realize natural human-computer interaction.The existing hand tracking algorithms for human-computer interaction can be easily affected by illumination and have poor robustness.In this paper,an adaptive hand tracking by the fusion of depth and skin color features was put forward.Considering the deformation of hand,the algorithm uses the depth threshold to achieve adaptive changes of tracking region with the continuity and smoothness of depth feature and obtains the hand alternative regions.Then,via skin color feature of YCbCr space,the skin normalized histograms were established to describe the alternative regions.Under the framework of particle filter,the hand tracking is converted into Bayes estimation problem and the algorithm determines the hand position based on the maximum a posterior (MAP).The variance of particle weights was monitored to solve the problem of tracking failure.Experimental results show that,the proposed algorithm can achieve accurate and robust tracking performance in real-time with complex background.

Key words: Depth feature,Particle filter,Adaptive hand tracking,Skin normalized histogram

[1] Kass M,Witkin A,Terzopoulos D.Snakes:Active contour mo-dels[J].International journal of computer vision,1988,1(4):321-331
[2] Wachs J P,Klsch M,Stern H,et al.Vision-based hand-gesture applications[J].Communications of the ACM,2011,54(2):60-71
[3] 陈锻生,刘政凯.肤色检测技术综述[J].计算机学报,2006,29(2):194-207
[4] Chai D,Ngan K N.Locating facial region of a head-and-shoulders color image[C]∥1998 Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.1998:124-129
[5] 雷明,董济扬.一种可变光照条件下的肤色检测算法[J].计算机工程与应用,2002,8(24):123-125
[6] Wang R Y,Popovi′ J.Real-time hand-tracking with a color glove[J].ACM Transactions on Graphics (TOG),2009:63
[7] Bellon O R,Silva L.New improvements to range image segmentation by edge detection[J].Signal Processing Letters,IEEE,2002,9(2):43-45
[8] Biswas K,Basu S K.Gesture Recognition using Microsoft Kinect[C]∥2011 5th International Conference on Automation,Robo-tics and Applications (ICARA).2011:100-103
[9] Raheja J L,Chaudhary A,Singal K.Tracking of fingertips and centers of palm using kinect[C]∥2011 Third International Conference on Computational Intelligence,Modelling and Simulation (CIMSiM).2011:248-252
[10] 汤勇,顾宏斌,周来.交互系统中实时手势分割及指尖检测方法[J].光电工程,2010,7(7):145-150
[11] 何小磊.基于深度信息和彩色图像的手势识别[D].武汉:华中科技大学,2012
[12] 杨全,彭进业.采用 SIFT-BoW 和深度图像信息的中国手语识别研究[J].计算机科学,2014,1(2):302-307
[13] 陈子毫.基于深度信息的手势检测与跟踪[D].广东:华南理工大学,2012
[14] 邓瑞,周玲玲,应忍冬.基于 Kinect 深度信息的手势提取与识别研究[J].计算机应用研究,2013,30(4):1263-1265
[15] 王法胜,鲁明羽,赵清杰,等.粒子滤波算法[J].计算机学报,2014(8):1679-94
[16] Swain M J.Interactive Indexing Into Image Databases[J].Sto-rage & Retrieval for Image & Video Databases,1993,1908:95--103
[17] Barla A,Odone F,Verri A.Histogram intersection kernel forimage classification[C]∥2003 International Conference on Image Processing.2003,III(2):513-516
[18] 胡士强,敬忠良.粒子滤波原理及其应用[M].北京:科学出版社,2010
[19] 朱志宇.粒子滤波算法及其应用[M].北京:科学出版社,2010

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!