实时高置信度更新补充学习跟踪

doi:10.11896/j.issn.1002-137X.2019.03.020

计算机科学 ›› 2019, Vol. 46 ›› Issue (3): 137-141.doi: 10.11896/j.issn.1002-137X.2019.03.020

• 2018 中国多媒体大会 • 上一篇下一篇

实时高置信度更新补充学习跟踪

范蓉蓉,樊佳庆,刘青山

南京信息工程大学江苏省大数据分析技术重点实验室南京 211800

收稿日期:2018-07-12 修回日期:2018-09-26 出版日期:2019-03-15 发布日期:2019-03-22
通讯作者: 刘青山(1975－),男,博士生导师,CCF高级会员,主要研究方向为计算机视觉、模式识别,E-mail:qsliu@nuist.edu.cn(通信作者)。
作者简介:范蓉蓉(1993－),女,硕士生,主要研究方向为计算机视觉、图像处理,E-mail:frr007@nuist.edu.cn;樊佳庆(1994－),男,硕士生,主要研究方向为目标跟踪、计算机视觉
基金资助:
江苏省研究生科研创新计划(KYCX17_0903)资助

Real-time High-confidence Update Complementary Learner Tracking

FAN Rong-rong, FAN Jia-qing, LIU Qing-shan

Jiangsu Key Laboratory of Big Data Analysis Technology,Nanjing University of Information Science and Technology,Nanjing 211800,China

Received:2018-07-12 Revised:2018-09-26 Online:2019-03-15 Published:2019-03-22

摘要/Abstract

摘要： 为解决补充学习跟踪算法(Staple)在目标被部分遮挡时存在的跟踪失败问题,文中提出了一种简单而有效的高置信度补充学习跟踪算法(High-confidence updata Complementary Learner Tracker,HCLT)。首先,输入当前帧,得到标准相关滤波分类器的检测响应值;然后,计算相关滤波响应的置信度,若计算结果大于阈值则当前帧更新滤波器,否则停止更新;接着,计算出持续不更新的帧数,如果有连续10帧不更新,则强制更新;最后,通过融合颜色补充学习器的响应,得到总的响应结果,其中,响应中最大值的位置即为跟踪结果。将所提算法与补充学习跟踪(Correlation Filter Net tracker,Staple)、端到端表示跟踪(CFNet)、注意力相关滤波网络跟踪(Attentional Correlation Filter Network tracker,ACFN)和对冲深度跟踪(Hedged Deep Tracking,HDT)等先进算法进行实验对比。在OTB100和VOT2016数据集上的结果表明,所提算法在成功率和预期覆盖率方面分别超过基准补充学习跟踪算法(Staple)1.0个百分点和0.4个百分点。另外,在严重遮挡和剧烈光照变化的视频集上的良好表现也充分说明了所提算法在处理表观剧烈变化的情况时很有效。

关键词: 补充学习跟踪, 目标跟踪, 相关滤波, 颜色直方图, 遮挡检测

Abstract: To address the issue that the complementary learner tracking algorithm (Staple) cannot perform well when the target suffers from severe occlusions,a high-confidence update complementary learner tracker (HCLT) was proposed.Firstly,at the input frame,a standard correlation filter is employed to calculate the correlation filter (CF) response.Secondly,the confidence value based on the CF response is calculated and the update of the correlation filter is stopped when the current confidence value exceeds the mean confidence value.Then,if the number of the continuous no-updated frames comes up to ten,the tracker will be forced to update the filter.Finally,the final response is obtained by combining the CF response with the color response,and the location of maximum response is the tracking result.Expe-riment results show that compared with several state-of-the-art trackers including complementary learner(Staple),end-to-end representation correlation filter net tracker(CFNet),attentional correlation filter network tracker(ACFN) and hedged deep tracking(HDT),the proposed algorithm is the best in terms of success rate,outperforming the baseline tracker Staple by 1.0 percentage points and 0.4 percentage points interms of success rate and expected average overlap(EAO)on OTB100 dataset and VOT2016 dataset,respectively.Besides,the performance on heavy occlusion and severe illumination variation sequences demonstrates the effectiveness of proposed tracker when handling drastic appearance variations.

Key words: Color histogram, Complementary learner tracking, Correlation filter, Occlusion detection, Visual tracking

中图分类号:

TP391

范蓉蓉, 樊佳庆, 刘青山. 实时高置信度更新补充学习跟踪[J]. 计算机科学, 2019, 46(3): 137-141. https://doi.org/10.11896/j.issn.1002-137X.2019.03.020

FAN Rong-rong, FAN Jia-qing, LIU Qing-shan. Real-time High-confidence Update Complementary Learner Tracking[J]. Computer Science, 2019, 46(3): 137-141. https://doi.org/10.11896/j.issn.1002-137X.2019.03.020

参考文献

[1]BOLME D S,BEVERIDGE J R,DRAPER B A,et al.Visual object tracking using adaptive correlation filters[C]∥2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE,2010:2544-2550.
[2]HENRIQUES J F,CASEIRO R,MARTINS P,et al.High-
speed tracking with kernelized correlation filters[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,37(3):583-596.
[3]LIU S,ZHANG T,CAO X,et al.Structural correlation filter for robust visual tracking[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2016:4312-4320.
[4]BERTINETTO L,VALMADRE J,GOLODETZ S,et al.Staple:Complementary learners for real-time tracking[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2016:1401-1409.
[5]MUELLER M,SMITH N,GHANEM B.Context-aware correlation filter tracking[C]∥Proc.IEEE Conf.Comput.Vis.Pattern Recognit.(CVPR).IEEE,2017:1396-1404.
[6]GALOOGAHI H K,FAGG A,LUCEY S.Learning back-
ground-aware correlation filters for visual tracking[C]∥Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Honolulu,HI,USA,2017:21-26.
[7]ZHANG T,XU C,YANG M H.Multi-task correlation particle filter for robust object tracking[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2017.
[8]ZHANG T,LIU S,XU C,et al.Correlation particle filter for visual tracking[J].IEEE Transactions on Image Processing,2018,27(6):2676-2687.
[9]WU Y,LIM J,YANG M H.Online object tracking:A.benchmark[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2013:2411-2418.
[10]KRISTAN M,PFLUGFELDER R,LEONARDIS A,et al.The visual object tracking vot2013 challenge results[C]∥Procee-dings of the IEEE International Conference on Computer Vision Workshops.IEEE,2013:98-111.
[11]LUKEZIC A,VOJIR T,ZAJC L C,et al.Discriminative Correlation Filter with Channel and Spatial Reliability∥IEEE Conference on Computer Vision and Pattern Recognition.IEEE Computer Society,2017:4847-4856.
[12]QI Y,ZHANG S,QIN L,et al.Hedged deep tracking[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE〈2016:4303-4311.
[13]BERTINETTO L,VALMADRE J,HENRIQUES J F,et al.
Fully-Convolutional Siamese Networks for Object Tracking∥European Conference on Computer Vision.Cham:Springer,2016:850-865.
[14]VALMADRE J,BERTINETTO L,HENRIQUES J,et al.End-to-End Representation Learning for Correlation Filter Based Tracking∥Proceedings of the IEEE Conference on ComputerVision and Pattern Recognition.IEEE Computer Society,2017:5000-5008.
[15]CHOI J,CHANG H J,YUN S,et al.Attentional Correlation
Filter Network for Adaptive Visual Tracking[C]∥IEEE Conference on Computer Vision and Pattern Recognition.IEEE Computer Society,2017:4828-4837.
[16]LI Y,ZHU J,HOI S C H.Reliable patch trackers:Robust visual tracking by exploiting reliable patches[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2015:353-361.
[17]NING J,YANG J,JIANG S,et al.Object tracking via dual linear
structured SVM and explicit feature map[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2016:4266-4274.
[18]ZHANG J,MA S,SCLAROFF S.MEEM:robust tracking via multiple experts using entropy minimization[C]∥European Conference on Computer Vision.Cham:Springer,2014:188-203.

相关文章 15

[1]	沈祥培, 丁彦蕊. 多检测器融合的深度相关滤波视频多目标跟踪算法 Multi-detector Fusion-based Depth Correlation Filtering Video Multi-target Tracking Algorithm 计算机科学, 2022, 49(8): 184-190. https://doi.org/10.11896/jsjkx.210600004
[2]	文成宇, 房卫东, 陈伟. 多目标跟踪的对象初始化综述 Object Initialization in Multiple Object Tracking:A Review 计算机科学, 2022, 49(3): 152-162. https://doi.org/10.11896/jsjkx.210200048
[3]	赵越, 余志斌, 李永春. 基于互注意力指导的孪生跟踪算法 Cross-attention Guided Siamese Network Object Tracking Algorithm 计算机科学, 2022, 49(3): 163-169. https://doi.org/10.11896/jsjkx.210300066
[4]	陈媛, 惠燕, 胡秀华. 一种自适应尺度与学习速率调整的背景感知相关滤波跟踪算法 Background-aware Correlation Filter Tracking Algorithm with Adaptive Scaling and Learning Rate Adjustment 计算机科学, 2021, 48(5): 177-183. https://doi.org/10.11896/jsjkx.200300109
[5]	程旭, 崔一平, 宋晨, 陈北京, 郑钰辉, 史金钢. 基于时空注意力机制的目标跟踪算法 Object Tracking Algorithm Based on Temporal-Spatial Attention Mechanism 计算机科学, 2021, 48(4): 123-129. https://doi.org/10.11896/jsjkx.200800164
[6]	张开华, 樊佳庆, 刘青山. 视觉目标跟踪十年研究进展 Advances on Visual Object Tracking in Past Decade 计算机科学, 2021, 48(3): 40-49. https://doi.org/10.11896/jsjkx.201100186
[7]	叶阳, 卢奇, 程时伟. 基于质心法的车联网目标跟踪方法与应用 Centroid Method Based Target Tracking and Application for Internet of Vehicles 计算机科学, 2021, 48(11A): 340-344. https://doi.org/10.11896/jsjkx.210200004
[8]	刘彦, 秦品乐, 曾建朝. 基于YOLOv3与分层数据关联的多目标跟踪算法 Multi-object Tracking Algorithm Based on YOLOv3 and Hierarchical Data Association 计算机科学, 2021, 48(11A): 370-375. https://doi.org/10.11896/jsjkx.201000115
[9]	赵钦炎, 李宗民, 刘玉杰, 李华. 基于信息熵的级联Siamese网络目标跟踪 Cascaded Siamese Network Visual Tracking Based on Information Entropy 计算机科学, 2020, 47(9): 157-162. https://doi.org/10.11896/jsjkx.190800160
[10]	程中建, 周双娥, 李康. 基于多尺度自适应权重的稀疏表示目标跟踪算法 Sparse Representation Target Tracking Algorithm Based on Multi-scale Adaptive Weight 计算机科学, 2020, 47(6A): 181-186. https://doi.org/10.11896/JsJkx.190500093
[11]	喻露, 胡剑锋, 姚磊岳. 全局块与局部块协作的相关滤波目标跟踪算法 Correlation Filter Object Tracking Algorithm Based on Global and Local Block Cooperation 计算机科学, 2020, 47(6): 157-163. https://doi.org/10.11896/jsjkx.190500078
[12]	谭建豪, 殷旺, 刘力铭, 王耀南. 采用多相关滤波策略的鲁棒长时自适应目标跟踪 Robust Long-term Adaptive Object Tracking Based onMulti-correlation Filtering Strategy 计算机科学, 2020, 47(12): 169-176. https://doi.org/10.11896/jsjkx.191000021
[13]	马康, 娄静涛, 苏致远, 李永乐, 朱愿. 结合特征融合和尺度自适应的核相关滤波器目标跟踪算法研究 Object Tracking Algorithm Based on Feature Fusion and Adaptive Scale Kernel Correlation Filter 计算机科学, 2020, 47(11A): 224-230. https://doi.org/10.11896/jsjkx.200500084
[14]	张良成, 王运锋. 动态自适应的多雷达信息加权融合方法 Dynamic Adaptive Multi-radar Tracks Weighted Fusion Method 计算机科学, 2020, 47(11A): 321-326. https://doi.org/10.11896/jsjkx.2004000145
[15]	龚轩, 乐孜纯, 王慧, 武玉坤. 多目标跟踪中的数据关联技术综述 Survey of Data Association Technology in Multi-target Tracking 计算机科学, 2020, 47(10): 136-144. https://doi.org/10.11896/jsjkx.200200041

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

实时高置信度更新补充学习跟踪

Real-time High-confidence Update Complementary Learner Tracking

PDF (PC)

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

Metrics

本文评价

推荐阅读 0