Computer Science ›› 2026, Vol. 53 ›› Issue (3): 231-239.doi: 10.11896/jsjkx.241100094

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Multi-feature Enhanced Association Strategy for Multi-object Tracking

CHEN Yunfang, FANG Qian, LYU Zunwei, ZHANG Wei   

  1. School of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
  • Received:2024-11-15 Revised:2025-02-20 Published:2026-03-12
  • About author:CHEN Yunfang,born in 1976,Ph.D,postgraduate supervisor.His main research interests include artificial intelligence algorithms,domain-specific functional analysis and application development using intelligent systems.
    ZHANG Wei,born in 1973,Ph.D,Ph.D supervisor.His main research interests include smart sensing and cognition in UAV systems,privacy protection and artificial intelligence security.
  • Supported by:
    National Natural Science Foundation of China (62072252).

Abstract: In complex scenarios,multi-target tracking faces problems such as dense target occlusion,nonlinear target motion,poor association matching algorithms leading to identity matching errors,and frequent identity switching.This paper takes ByteTrack as the baseline algorithm and improves its association strategy from three aspects:motion model,weak feature data association,and matching algorithm by fully utilizing existing discriminative features.A multi-objective tracking algorithm with multi discri-minative feature enhanced association strategy is proposed.Firstly,in response to the problem that conventional Kalman filtering is difficult to predict the target position of nonlinear motion,the noise covariance of Kalman filtering is dynamically adjusted using prediction similarity and detection confidence to optimize the motion model and improve the accuracy of target position prediction.Secondly,by integrating a secondary association algorithm,weak feature data association is performed between low-confidence detections and tracks that remain unmatched after the initial association,reducing mismatches between them.Finally,for low confidence detection targets,relative depth is used to decompose the detection targets and trajectories,and a cascaded matching algorithm is used for association,effectively reducing IoU matching collisions and improving the tracking performance of the algorithm in dense occlusion scenes.On the MOT17 and MOT20 test sets,HOTA is 64.5% and 63.2%,respectively,and all evaluation metrics show significant improvement compared to the baseline algorithm.

Key words: Multi-object tracking, Joint detection and tracking, Data association

CLC Number: 

  • TP391
[1]REN S,HE K,GIRSHICK R,et al.Faster R-CNN:Towards Real-Time Object Detection with Region Proposal Networks[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2017,39(6):1137-1149.
[2]REDMON J,FARHADI A.Yolov3:An incremental improve-ment[J].arXiv:1804.02767,2018.
[3]BOCHINSKI E,SENST T,SIKORA T.Extending IOU based multi-object tracking by visual information[C]//2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance(AVSS).IEEE,2018:1-6.
[4]BEWLEY A,GE Z,OTT L,et al.Simple online and realtime tracking[C]//2016 IEEE International Conference on Image Processing(ICIP).IEEE,2016:3464-3468.
[5]KALMAN R E.A New Approach to Linear Filtering and Prediction Problems[J].Journal of Fluids Engineering,1959,82D:35-45.
[6]BERGMANN P,MEINHARDT T,LEAL-TAIXE L.Trackingwithout bells and whistles[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2019:941-951.
[7]DU Y,ZHAO Z,SONG Y,et al.Strongsort:Make deepsortgreat again[J].IEEE Transactions on Multimedia,2023,25:8725-8737.
[8]XIAO T,LI S,WANG B,et al.Joint detection and identification feature learning for person search[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:3415-3424.
[9]LIANG C,ZHANG Z,ZHOU X,et al.Rethinking the competition between detection and ReID in multiobject tracking[J].IEEE Transactions on Image Processing,2022,31:3182-3196.
[10]ZHANG Y,SUN P,JIANG Y,et al.Bytetrack:Multi-objecttracking by associating every detection box[C]//European Conference on Computer Vision.Springer,2022:1-21.
[11]GE Z,LIU S,WANG F,et al.YOLOX:Exceeding YOLO Series in 2021[J].arXiv:2107.08430,2021.
[12]WANG Z,ZHENG L,LIU Y,et al.Towards real-time multi-object tracking[C]//European Conference on Computer Vision.Springer,2020:107-122.
[13]AHARON N,ORFAIG R,BOBROVSKY B Z.BoT-SORT:Robust Associations Multi-Pedestrian Tracking[J].arXiv:2206.14651,2022.
[14]CAO J,PANG J,WENG X,et al.Observation-centric sort:Rethinking sort for robust multi-object tracking[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2023:9686-9696.
[15]WOJKE N,BEWLEY A,PAULUS D.Simple online and real-time tracking with a deep association metric[C]//2017 IEEE International Conference on Image Processing(ICIP).IEEE,2017:3645-3649.
[16]MAGGIOLINO G,AHMAD A,CAO J,et al.Deep oc-sort:Multi-pedestrian tracking by adaptive re-identification[J].ar-Xiv:2302.11813,2023.
[17]ZHANG Y,WANG C,WANG X,et al.Fairmot:On the fairness of detection and re-identification in multiple object tracking[J].International Journal of Computer Vision,2021,129:3069-3087.
[18]MILAN A,LEAL-TAIXÉ L,REID I,et al.MOT16:A benchmark for multi-object tracking[J].arXiv:1603.00831,2016.
[19]DENDORFER P,REZATOFIGHI H,MILAN A,et al.Mot20:A benchmark for multi object tracking in crowded scenes[J].arXiv:2003.09003,2020.
[20]BERNARDIN K,STIEFELHAGEN R.Evaluating multiple object tracking performance:the clear mot metrics[J].EURASIP Journal on Image and Video Processing,2008,2008:1-10.
[21]RISTANI E,SOLERA F,ZOU R,et al.Performance measures and a data set for multi-target,multi-camera tracking[C]//European Conference on Computer Vision.Springer,2016:17-35.
[22]LUITEN J,OSEP A,DENDORFER,et al.Hota:A higher order metric for evaluating multi-object tracking[J].International Journal of Computer Vision,2021,129:548-578.
[23]ZHOU X,KOLTUN V,KRÄHENBÜHL P.Tracking objectsas points[C]//European Conference on Computer Vision.Springer,2020:474-490.
[24]XU Y,BAN Y,DELORME G,et al.TransCenter:Transformers with dense representations for multiple-object tracking[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2022,45(6):7820-7835.
[25]WANG S W,GAO C Q,HUANG X,et al.UAV multiple object tracking based on feature separation[J].Journal of Chongqing University of Posts and Telecommunication(Natural Science Edition),2024,36(5):896-906.
[1] MA Yixin, ZENG Junhao, YANG Xinyan, LIANG Gang. Automatic Recognition of Irrelevant Individuals in Videos Based on Multi-object Tracking [J]. Computer Science, 2025, 52(11A): 241100155-8.
[2] WANG Luo, LI Biao, FU Ruigang. Infrared Ground Multi-object Tracking Method Based on Improved ByteTrack Algorithm [J]. Computer Science, 2023, 50(9): 176-183.
[3] ZENG Zehua, LUO Huilan. Cross-dataset Learning Combining Multi-object Tracking and Human Pose Estimation [J]. Computer Science, 2023, 50(6A): 220400199-7.
[4] WU Han, NIE Jiahao, ZHANG Zhaowei, HE Zhiwei, GAO Mingyu. Deep Learning-based Visual Multiple Object Tracking:A Review [J]. Computer Science, 2023, 50(4): 77-87.
[5] CHEN Yunfang, LU Yangyang, ZHOU Xin, ZHANG Wei. Multi-object Tracking Based on Cross-correlation Attention and Chained Frames [J]. Computer Science, 2023, 50(1): 131-137.
[6] LIU Yan, QIN Pin-le, ZENG Jian-chao. Multi-object Tracking Algorithm Based on YOLOv3 and Hierarchical Data Association [J]. Computer Science, 2021, 48(11A): 370-375.
[7] GONG Xuan, LE Zi-chun, WNAG Hui, WU Yu-kun. Survey of Data Association Technology in Multi-target Tracking [J]. Computer Science, 2020, 47(10): 136-144.
[8] WANG Zheng-ning, ZHOU Yang, LV Xia, ZENG Fan-wei, ZHANG Xiang, ZHANG Feng-jun. Improved MDP Tracking Method by Combining 2D and 3D Information [J]. Computer Science, 2019, 46(3): 97-102.
[9] ZHAO Guang-hui, ZHUO Song, XU Xiao-long. Multi-object Tracking Algorithm Based on Kalman Filter [J]. Computer Science, 2018, 45(8): 253-257.
[10] YUAN Da-long and JI Qing-ge. Multiple Object Tracking Algorithm via Collaborative Motion Status Estimation [J]. Computer Science, 2017, 44(Z11): 154-159.
[11] YAN Lin, RUAN Ning, YAN Shuo and GAO Wei. Description of Data Association Occurring in Related Sets and Specific Example [J]. Computer Science, 2017, 44(1): 283-288.
[12] CAO Wei, WANG Qiu-yue, QIN Xiong-pai and WANG Shan. HY-COCA:A Hybrid-data-distribution-aware Way to Detect Correlation over Bi-dimensional Data Space [J]. Computer Science, 2015, 42(6): 193-203.
[13] YANG Guo-liang and ZHANG Jin-hui. Research on Multi-object Tracking Using Hierarchical Data Association [J]. Computer Science, 2014, 41(9): 306-310.
[14] MA Bing-xian,CUI Ji-peng and ZHANG Zheng-ming. Research on Data Association Location Method for Web Services Composition [J]. Computer Science, 2014, 41(8): 130-134.
[15] . Clustering Data Association Algorithm to Support Multi-target Tracl}ing in WSN [J]. Computer Science, 2012, 39(Z6): 24-27.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!