计算机科学 ›› 2020, Vol. 47 ›› Issue (11A): 224-230.doi: 10.11896/jsjkx.200500084

• 计算机图形学&多媒体 • 上一篇    下一篇

结合特征融合和尺度自适应的核相关滤波器目标跟踪算法研究

马康1, 娄静涛2, 苏致远1, 李永乐2, 朱愿2   

  1. 1 陆军军事交通学院五大队 天津 300161
    2 陆军军事交通学院军事交通运输研究所 天津 300161
  • 出版日期:2020-11-15 发布日期:2020-11-17
  • 通讯作者: 娄静涛(loujt_1984@tom.com)
  • 作者简介:makangemail@126.com
  • 基金资助:
    军队重点学科专业建设项目(智能无人系统关键技术前沿跟踪研究)

Object Tracking Algorithm Based on Feature Fusion and Adaptive Scale Kernel Correlation Filter

MA Kang1, LOU Jing-tao2, SU Zhi-yuan1, LI Yong-le2, ZHU Yuan2   

  1. 1 Fifth Team of Cadets,Army Military Transportation University,Tianjin 300161,China
    2 Institute of Military Transportation,Army Military Transportation University,Tianjin 300161,China
  • Online:2020-11-15 Published:2020-11-17
  • About author:MA Kang,born in 1989,postgraduate.His main research interests include self-driving and visual tracking.
    LOU Jing-tao,born in 1984,Ph.D.His main research interests include self-driving,artificial intelligence and machine vision.
  • Supported by:
    This work was supported by the Military Key Discipline Professional Construction Project (Tracking Research on Key Technology Frontier of Intelligent Unmanned System)

摘要: 在目标跟踪过程中,改进尺度自适应策略、选择辨别能力强的特征是提高跟踪算法性能的重要途径。为解决核相关滤波算法(Kernel Correlation Filtering,KCF)不能适应目标尺度变化、采用单一的方向梯度直方图(Histogram of Oriented Gra-dient,HOG)特征对目标判别能力有限的问题,通过研究同一目标在不同尺度下相关响应值的大小,在分析大量统计数据的基础上发现其变化规律,提出了一种新的尺度自适应策略,并采取HOG和颜色属性特征(Color Name,CN)线性加权融合的方法提高对目标的判别能力。在OTB数据集上的实验结果表明,所提算法的准确率和成功率相比KCF算法分别提高了8.5%和28.9%,在尺度变化属性视频序列上的准确率和成功率相比KCF算法分别提高了8.1%和38.5%,在其他属性视频序列上的表现也有较大提高,并且跟踪速度达到37.68 fps,可满足实时性要求。

关键词: 核相关滤波, 目标跟踪, 特征融合, 自适应尺度

Abstract: In the process of object tracking,an important way to improve the performance of the tracking algorithm is to improve the scale adaptive strategy and select features with strong discrimination ability.In order to solve the problemthat Kernel Correlation Filtering (KCF) can't adapt to the condition of object scale variation,andonlyusesthe single feature of Histogram of Oriented Gradient(HOG) whose discrimination ability to object is insufficient,a new scale adaptive strategy is proposed by studying the correlation response value of the same object at different scales,and finding the changing rule based on the analysis of a large number of statistical data,the method of linear weighted fusion of HOG and Color Name (CN) is also adopted to improves the object discrimination ability of the algorithm.Experimental results on OTB dataset show that the precision and success rate of the proposed algorithm are 8.5% and 28.9% higher than those of KCF algorithm,8.1% and 38.5% higher than those of KCF algorithm on scale variation attribute video sequence,and the performance on other attribute video sequence is also greatly improved,and the tracking speed reaches 37.68 FPS,which meets the real-time requirements.

Key words: Adaptive scale, Feature fusion, Kernel correlation filtering, Object tracking

中图分类号: 

  • TP391
[1] MENG L,YANG X.A survey of object tracking algorithms[J].Acta Automatica Sinica,2019,45(7):1244-1260.
[2] LIU Q Y,WANG Y R,ZHANG J L,et al.Research progress of visual tracking methods based on correlation filter[J].Acta Auto-matica Sinica,2019,45(2):265-275.
[3] BOLME D S,BEVERIDGE J R,DRAPER B A,et al.Visual object tracking using adaptive correlation filters[C]//2010 IEEEComputer Society Conference on Computer Vision and PatternRecognition.IEEE,2010:2544-2550.
[4] HENRIQUESJF C R.Exploiting the circulant structure oftracking-by-detection with kernels [C]//ECCV.2012:702-715.
[5] JIANG X F,HAN Q L.On designing fuzzy controllers for aclass of nonlinear networked control systems[J].IEEE Transactions on Fuzzy Systems,2008,16(4):1050-1060.
[6] HENRIQUES J F,CASEIRO R,MARTINS P,et al.High-Speed Tracking with Kernelized Correlation Filters.[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,37(3):583-596.
[7] DANELLJAN M,HÄGER G,KHAN F S,et al.Discriminative scale space tracking[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2016,39(8):1561-1575.
[8] DANELLJAN M,HÄGER G,KHAN F,et al.Accurate scaleestimation for robust visual tracking [C]//British Machine Vision Conference.BMVA Press,2014.
[9] LI Y,ZHU J.A scale adaptive kernel correlation filter tracker with feature integration[C]//European Conference on Compu-ter Vision.Springer,Cham,2014:254-265.
[10] DANELLJAN M,SHAHBAZ K F,FELSBERG M,et al.Adaptive color attributes for real-time visual tracking[C]//Procee-dings of the IEEE Conference on Computer Vision and Pattern Recognition.2014:1090-1097.
[11] WU Y,LIM J,YANG M H.Online object tracking:A benchmark [C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2013:2411-2418.
[1] 沈祥培, 丁彦蕊.
多检测器融合的深度相关滤波视频多目标跟踪算法
Multi-detector Fusion-based Depth Correlation Filtering Video Multi-target Tracking Algorithm
计算机科学, 2022, 49(8): 184-190. https://doi.org/10.11896/jsjkx.210600004
[2] 张颖涛, 张杰, 张睿, 张文强.
全局信息引导的真实图像风格迁移
Photorealistic Style Transfer Guided by Global Information
计算机科学, 2022, 49(7): 100-105. https://doi.org/10.11896/jsjkx.210600036
[3] 程成, 降爱莲.
基于多路径特征提取的实时语义分割方法
Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction
计算机科学, 2022, 49(7): 120-126. https://doi.org/10.11896/jsjkx.210500157
[4] 郁舒昊, 周辉, 叶春杨, 王太正.
SDFA:基于多特征融合的船舶轨迹聚类方法研究
SDFA:Study on Ship Trajectory Clustering Method Based on Multi-feature Fusion
计算机科学, 2022, 49(6A): 256-260. https://doi.org/10.11896/jsjkx.211100253
[5] 杨玥, 冯涛, 梁虹, 杨扬.
融合交叉注意力机制的图像任意风格迁移
Image Arbitrary Style Transfer via Criss-cross Attention
计算机科学, 2022, 49(6A): 345-352. https://doi.org/10.11896/jsjkx.210700236
[6] 陈永平, 朱建清, 谢懿, 吴含笑, 曾焕强.
基于外接圆半径差损失的实时安全帽检测算法
Real-time Helmet Detection Algorithm Based on Circumcircle Radius Difference Loss
计算机科学, 2022, 49(6A): 424-428. https://doi.org/10.11896/jsjkx.220100252
[7] 孙洁琪, 李亚峰, 张文博, 刘鹏辉.
基于离散小波变换的双域特征融合深度卷积神经网络
Dual-field Feature Fusion Deep Convolutional Neural Network Based on Discrete Wavelet Transformation
计算机科学, 2022, 49(6A): 434-440. https://doi.org/10.11896/jsjkx.210900199
[8] 蓝凌翔, 池明旻.
基于特征注意力融合网络的遥感变化检测研究
Remote Sensing Change Detection Based on Feature Fusion and Attention Network
计算机科学, 2022, 49(6): 193-198. https://doi.org/10.11896/jsjkx.210500058
[9] 范新南, 赵忠鑫, 严炜, 严锡君, 史朋飞.
结合注意力机制的多尺度特征融合图像去雾算法
Multi-scale Feature Fusion Image Dehazing Algorithm Combined with Attention Mechanism
计算机科学, 2022, 49(5): 50-57. https://doi.org/10.11896/jsjkx.210400093
[10] 李发光, 伊力哈木·亚尔买买提.
基于改进CenterNet的航拍绝缘子缺陷实时检测模型
Real-time Detection Model of Insulator Defect Based on Improved CenterNet
计算机科学, 2022, 49(5): 84-91. https://doi.org/10.11896/jsjkx.210400142
[11] 董奇达, 王喆, 吴松洋.
结合注意力机制与几何信息的特征融合框架
Feature Fusion Framework Combining Attention Mechanism and Geometric Information
计算机科学, 2022, 49(5): 129-134. https://doi.org/10.11896/jsjkx.210300180
[12] 李鹏祖, 李瑶, Ibegbu Nnamdi JULIAN, 孙超, 郭浩, 陈俊杰.
基于多特征融合的重叠组套索脑功能超网络构建及分类
Construction and Classification of Brain Function Hypernetwork Based on Overlapping Group Lasso with Multi-feature Fusion
计算机科学, 2022, 49(5): 206-211. https://doi.org/10.11896/jsjkx.210300049
[13] 许华杰, 秦远卓, 杨洋.
基于多级特征融合与注意力模块的场景识别方法
Scene Recognition Method Based on Multi-level Feature Fusion and Attention Module
计算机科学, 2022, 49(4): 209-214. https://doi.org/10.11896/jsjkx.210100135
[14] 高心悦, 田汉民.
基于改进U-Net网络的液滴分割方法
Droplet Segmentation Method Based on Improved U-Net Network
计算机科学, 2022, 49(4): 227-232. https://doi.org/10.11896/jsjkx.210300193
[15] 徐涛, 陈奕仁, 吕宗磊.
基于改进YOLOv3的机坪工作人员反光背心检测研究
Study on Reflective Vest Detection for Apron Workers Based on Improved YOLOv3 Algorithm
计算机科学, 2022, 49(4): 239-246. https://doi.org/10.11896/jsjkx.210200119
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!