Computer Science ›› 2019, Vol. 46 ›› Issue (7): 252-257.doi: 10.11896/j.issn.1002-137X.2019.07.038

• Graphics, Image & Pattern Recognition • Previous Articles     Next Articles

Visual Object Tracking Algorithm Based on Correlation Filters with Hierarchical Convolutional Features

LI Jian-peng,SHANG Zhen-hong,LIU Hui   

  1. (Faculty of Information Engineering and Automation,Kunming University of Science and Technology,Kunming 650504,China)
  • Received:2018-08-09 Online:2019-07-15 Published:2019-07-15

Abstract: In the visual object tracking,correlation tracking algorithm is a hot topic and has developed rapidly in recent years.Correlation filter tracking algorithms have the advantages of fast speed and good effect.However,the traditional hand-crafted features are insufficient for target discrimination,and fail to handle challenging situations such as deformation,occlusion and blurring.Recently,convolutional neural networks have achieved great success in many fields.Researchers have combined correlation tracking and convolutional features to surmount the shortcomings of hand-crafted features that lack target semantic information.In order to cope well with the above problems,this paper proposed a vi-sual object tracking algorithm based on correlation filter with hierarchical convolutional features.The proposed algorithm divides the object tracking into two steps,including position prediction and scale estimation.Multi-layer convolutional features are trained and the target position on each convolutional layer is predicted with a coarse-to-fine searching approach.The Histogram of Oriented Gradient features is used to estimate the optimal scale of target.Comprehensive experiments on 20 challenging sequences were performed to verify the proposed algorithm,and the proposed algorithm was compared with other four trackers.The results show that the proposed approach significantly improves the performance by 48.9% and 51.9% in distance precision and overlap precision respectively compared to the DSST tracker based on hand-crafted features.Moreover,the proposed method outperforms the HCFT tracker using convolutional features by 19.1% and 25.2% in distance precision and overlap precision,respectively.The proposed algorithm overcomes the shortcomings of poor representation skills of traditional manual features,and its performance is better than the correlation filtering tracking algorithms using manual features.Compared with the same correlation filtering algorithms using convolutional features,the tracking performance has also been improved.The algorithm can accurately track the target in complex situations such as occlusion and blurring.

Key words: Convolutional feature, Correlation filter, Scale estimation, Visual object tracking

CLC Number: 

  • TP391.4
[1]BOLME D S,BEVERIDGE J R,DRAPER B A,et al.Visual object tracking using adaptive correlation filters[C]∥Computer Vision and Pattern Recognition IEEE Computer Society Confe-rence on Computer Vision and Pattern Recognition.IEEE,2010:2544-2550.<br /> [2]DANELLJAN M,H GER G,KHAN F S,et al.Discriminative scale space tracking[J].IEEE transactions on pattern analysis and machine intelligence,2017,39(8):1561-1575.<br /> [3]HENRIQUES J F,CASEIRO R,MARTINS P,et al.High- speed tracking with kernelized correlation filters[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,37(3):583-596.<br /> [4]ZHANG W,KANG B S.Recent advances in correlation filter- based object tracking:a review[J].Journal of Image and Gra-phics,2017,22(8):1017-1033.(in Chinese)<br /> 张微,康宝生.相关滤波目标跟踪进展综述[J].中国图象图形学报,2017,22(8):1017-1033.<br /> [5]SMEULDERS A W M,CHU D M,CUCCHIARA R,et al.Vi- sual tracking:An experimental survey[J].IEEE transactions on pattern analysis and machine intelligence,2014,36(7):1442-1468.<br /> [6]DANELLJAN M,SHAHBAZ KHAN F,FELSBERG M,et al.Adaptive color attributes for real-time visual tracking[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2014:1090-1097.<br /> [7]LI H,LI Y,PORIKLI F.Robust online visual tracking with a single convolutional neural network[C]∥Asian Conference on Computer Vision.2014:194-209.<br /> [8]WANG L,OUYANG W,WANG X,et al.Visual tracking with fully convolutional networks[C]∥Proceedings of the IEEE international conference on computer vision.Springer-Verlag,2015:3119-3127.<br /> [9]DANELLJAN M,ROBINSON A,KHAN F S,et al.Beyond correlation filters:Learning continuous convolution operators for visual tracking[C]∥European Conference on Computer Vision.Springer-Verlag,2016:472-488.<br /> [10]RUSSAKOVSKY O,DENG J,SU H,et al.Imagenet large scale visual recognition challenge[J].International Journal of Computer Vision,2015,115(3):211-252.<br /> [11]DANELLJAN M,HAGER G,SHAHBAZ KHAN F,et al. Learning spatially regularized correlation filters for visual trac-king[C]∥Proceedings of the IEEE International Confe-rence on Computer Vision.IEEE,2015:4310-4318.<br /> [12]MA C,HUANG J B,YANG X,et al.Hierarchical Convolutional Features for Visual Tracking[C]∥IEEE International Confe-rence on Computer Vision.IEEE,2015:3074-3082.<br /> [13]XU Y,LI Y,WANG J,et al.Multi-scale correlation tracking with convolutional features[C]∥Signal and Image Processing (ICSIP),IEEE International Conference onIEEE International Conference on Signal and Image Processing.IEEE,2016:310-314.<br /> [14]WANG L,LIU T,WANG G,et al.Video tracking using learned hierarchical features[J].IEEE Transactions on Image Proces-sing,2015,24(4):1424-1435.<br /> [15]CHEN H,FAN B.Hierarchical Convolutional Features for Long-Term Correlation Tracking[C]∥CCF Chinese Confe-rence on Computer Vision.Springer-Verlag,2017:677-686.<br /> [16]YANG T,SHI Z,WANG G.Visual Tracking by Assembling Multiple Correlation Filters[C]∥Pacific Rim Conference on Multimedia.Springer-Verlag,2015:310-320.<br /> [17]HE Z,FAN Y,ZHUANG J,et al.Correlation Filters with Weighted Convolution Responses[C]∥ICCV Workshops.IEEE,2017:1992-2000.<br /> [18]VEDALDI A,LENC K.Matconvnet:Convolutional neural networks for matlab[C]∥Proceedings of the 23rd ACM international conference on Multimedia.ACM,2015:689-692.
[1] SHEN Xiang-pei, DING Yan-rui. Multi-detector Fusion-based Depth Correlation Filtering Video Multi-target Tracking Algorithm [J]. Computer Science, 2022, 49(8): 184-190.
[2] ZHAO Yue, YU Zhi-bin, LI Yong-chun. Cross-attention Guided Siamese Network Object Tracking Algorithm [J]. Computer Science, 2022, 49(3): 163-169.
[3] GUO Wen, YIN Tong-ling, ZHANG Tian-zhu, XU Chang-sheng. Temporal Consistency Preserving Multi-Mask Sparse Deep Representation for Visual Tracking [J]. Computer Science, 2021, 48(6): 110-117.
[4] CHEN Yuan, HUI Yan, HU Xiu-hua. Background-aware Correlation Filter Tracking Algorithm with Adaptive Scaling and Learning Rate Adjustment [J]. Computer Science, 2021, 48(5): 177-183.
[5] ZHANG Kai-hua, FAN Jia-qing, LIU Qing-shan. Advances on Visual Object Tracking in Past Decade [J]. Computer Science, 2021, 48(3): 40-49.
[6] ZHAO Qin-yan, LI Zong-min, LIU Yu-jie, LI Hua. Cascaded Siamese Network Visual Tracking Based on Information Entropy [J]. Computer Science, 2020, 47(9): 157-162.
[7] YU Lu, HU Jian-feng, YAO Lei-yue. Correlation Filter Object Tracking Algorithm Based on Global and Local Block Cooperation [J]. Computer Science, 2020, 47(6): 157-163.
[8] TAN Jian-hao, YIN Wang, LIU Li-ming, WANG Yao-nan. Robust Long-term Adaptive Object Tracking Based onMulti-correlation Filtering Strategy [J]. Computer Science, 2020, 47(12): 169-176.
[9] MA Kang, LOU Jing-tao, SU Zhi-yuan, LI Yong-le, ZHU Yuan. Object Tracking Algorithm Based on Feature Fusion and Adaptive Scale Kernel Correlation Filter [J]. Computer Science, 2020, 47(11A): 224-230.
[10] CHEN Wei, LI Jue-long, XING Jian-chun, YANG Qi-liang, ZHOU Qi-zhen. Long-term Object Tracking Based on Kernelized Correlation Filter and Hierarchical Convolution Features [J]. Computer Science, 2019, 46(9): 271-276.
[11] FAN Rong-rong, FAN Jia-qing, LIU Qing-shan. Real-time High-confidence Update Complementary Learner Tracking [J]. Computer Science, 2019, 46(3): 137-141.
[12] QU Zhong and ZHAO Cong-mei. Anti-occlusion Adaptive-scale Object Tracking Algorithm [J]. Computer Science, 2018, 45(4): 296-300.
[13] HUANG Jian, GUO Zhi-bo, LIN Ke-jun. Visual Tracking Algorithm Based on Kernelized Correlation Filter [J]. Computer Science, 2018, 45(11A): 230-233.
[14] GAO Qi-yu and FANG Hu-sheng. HOG Pedestrian Detection Algorithm of Multiple Convolution Feature Fusion [J]. Computer Science, 2017, 44(Z11): 199-201.
[15] ZHU Hang-jiang, ZHU Fan, PAN Zhen-fu and ZHU Yong-li. Visual Object Tracking Method with Motion Estimation and Scale Estimation [J]. Computer Science, 2017, 44(Z11): 193-198.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!