基于Camshift反馈码本模型的手抓取物跟踪方法

计算机科学 ›› 2015, Vol. 42 ›› Issue (12): 297-301.

基于Camshift反馈码本模型的手抓取物跟踪方法

赵翠莲,王洪,范志坚,郭晶

上海大学机电工程与自动化学院上海市智能制造及机器人重点实验室上海200072,上海大学机电工程与自动化学院上海市智能制造及机器人重点实验室上海200072,上海大学机电工程与自动化学院上海市智能制造及机器人重点实验室上海200072,上海大学机电工程与自动化学院上海市智能制造及机器人重点实验室上海200072

出版日期:2018-11-14 发布日期:2018-11-14

Tracking Method of Hand Grasping Objects Based on Feedback from Camshift to Codebook Model

ZHAO Cui-lian, WANG Hong, FAN Zhi-jian and GUO Jing

Online:2018-11-14 Published:2018-11-14

摘要/Abstract

摘要： 针对Camshift算法在复杂背景下无法自动跟踪目标的问题,提出一种基于Camshift反馈码本模型的运动目标检测和跟踪算法。该算法首先利用码本模型检测前景目标,然后采用Camshift在颜色概率分布图中跟踪前景区域中的目标,通过窗口尺寸比较和直方图相关性判断来解决自动跟踪,通过窗口位置预测和尺寸扩大来改进下一帧Camshift算法的输入搜索窗口,同时并集操作多个目标处理后的矩形窗口,并将其反馈为下一帧码本模型的图像检测区域。最后将该算法应用于手和目标物的抓取状态判断上,具体过程是在静态背景下利用两个摄像头采集到的图像进行手和目标物的检测和跟踪,通过矩形相交性判断抓取次数,以验证跟踪算法的有效性。实验结果表明,通过信息反馈减小了目标检测和跟踪的搜索区域,提高了算法的实时性,在单摄像头下可提高处理帧频130%。

关键词: Camshift,码本模型,跟踪,抓取物

Abstract: In order to solve problem that Camshift algorithm can’t automatically track targets in complex background,an algorithm to detect and track moving objects based on feedback from Camshift to codebook model was proposed.At first,the algorithm detects foreground objects by codebook model and tracks objects in the foreground area by Camshift using color probability distribution.Automatic tracking is achieved by comparison of window sizes and judgment of histogram correlation,and an input search window of the next frame is improved by location prediction and size expansion of window.At the same time,a union of multi-processed rectangular windows is as a feedback to the next frame of the image detection region for codebook model.Finally,the algorithm is applied for determining a grasping status between a hand and objects.The specific process is using the captured images by two cameras to detect and track hand and objects in a static background and then counting the number of grasp by rectangle intersection to verify the tracking algorithm.Since the information feedback reduces the search region of detection and tracking,this algorithm gets a better real-time performance,and some experimental results show that the frame processing rate can increase 130% in a single camera.

Key words: Camshift,Codebook model,Tracking,Grasping objects

赵翠莲,王洪,范志坚,郭晶. 基于Camshift反馈码本模型的手抓取物跟踪方法[J]. 计算机科学, 2015, 42(12): 297-301. https://doi.org/

ZHAO Cui-lian, WANG Hong, FAN Zhi-jian and GUO Jing. Tracking Method of Hand Grasping Objects Based on Feedback from Camshift to Codebook Model[J]. Computer Science, 2015, 42(12): 297-301. https://doi.org/

参考文献

[1] Rautaray S S,Agrawal A.Vision based hand gesture recognition for human computer interaction:a survey[J].Artificial Intelligence Review,2012:1-54
[2] Arias P,Robles-García V,Sanmartín G,et al.Virtual reality as a tool for evaluation of repetitive rhythmic movements in the el-derly and Parkinson’s disease patients[J].EE Times Asia,PloS One,2012,7(1):e30021
[3] Bradski G R.Computer vision face tracking for use in a perceptual user interface[J].EE Time Asia,1998,2(2):1-15
[4] Varona J,Buades J M,Perales F J.Hands and face tracking for VR applications[J].Computers & Graphics,2005,29(2):179-187
[5] Sanmartín G,Flores J,Arias P,et al.Motion capture for clinical purposes,an approach using primesense sensors[M]∥ Articulated Motion and Deformable Objects.Springer Berlin Heidelberg,2012:273-281
[6] Comaniciu D,Meer P.Mean shift:A robust approach towardfeature space analysis[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2002,24(5):603-619
[7] 李劲菊,朱青,王耀南.一种复杂背景下运动目标检测与跟踪方法[J].仪器仪表学报,2010,31(10):2242-2247 Li J J,Zhu Q,Wang Y N.Detecting and tracking method of moving target in complex environment [J].Chinese Journal of Scientific Instrument,2010,31(10):2242-2247
[8] 邬大鹏,程卫平,于盛林.基于帧间差分和运动估计的Camshift目标跟踪算法[J].光电工程,2010,37(1):55-60 Wu D P,Cheng W P,Yu S L.Camshift Object Tracking Algorithm Based on Inter-frame Difference and Motion Prediction [J].Opto-Electronic Engineering,2010,37(1):55-60
[9] Huang S,Hong J.Moving object tracking system based on camshift and Kalman filter[C]∥2011 International Conference on Consumer Electronics,Communications and Networks (CECNet).IEEE,2011:1423-1426
[10] Weia Z,Zhangb L,Kima H,et al.An Improved Object Tracking Algorithm Based on Camshift Combined with Active Contour and Kalman Filter[J].Journal of Information & Computational Science,2014,11(6),1753-1764
[11] Kim K,Chalidabhongse T H,Harwood D,et al.Backgroundmodeling and subtraction by codebook construction[C] ∥2004 International Conference on Image Processing,2004(ICIP’04).IEEE,2004:3061-3064
[12] Kim K,Chalidabhongse T H,Harwood D,et al.Real-time foreground-background segmentation using codebook model[J].Real-time Imaging,2005,11(3):172-185
[13] 张军,代科学,李国辉.基于HSV颜色空间和码本模型的运动目标检测[J].系统工程与电子技术,2008,30(3):423-427 Zhang J,Dai K X,Li G H.HSV color-space and codebook model based moving objects detection [J].Systems Engineering and Electronics,2008,30(3):423-427
[14] Yozbatiran N,Der-Yeghiaian L,Cramer S C.A standardized approach to performing the action research arm test[J].Neurorehabilitation and Neural Repair,2008,22(1):78-90

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed