Computer Science ›› 2023, Vol. 50 ›› Issue (9): 176-183.doi: 10.11896/jsjkx.220900004

• Database & Big Data & Data Science • Previous Articles     Next Articles

Infrared Ground Multi-object Tracking Method Based on Improved ByteTrack Algorithm

WANG Luo, LI Biao, FU Ruigang   

  1. College of Electronic Science and Technology,National University of Defense Technology,Changsha 410000,China
  • Received:2022-09-01 Revised:2023-04-14 Online:2023-09-15 Published:2023-09-01
  • About author:WANG Luo,born in 1995,postgra-duate.His main research interests include image processing,computer vision and automation target recognition.
    FU Ruigang,born in 1991,Ph.D.His main research interests include image processing,computer vision and automation target recognition.
  • Supported by:
    National Natural Science Foundation of China(62001482) and Natural Science Foundation of Hunan Province,China(2021JJ40676).

Abstract: The research of infrared object intelligent detection and tracking technology is always a hot topic in the same field,especially in precision guidance,sea surface surveillance and sky warning.Aiming at the problems that tracking accuracy is reduced due to ground miscellaneous interference,multi-object block interference,platform shaking and other complex scenes,an infrared ground multi-object tracking method based on improved ByteTrack algorithm is proposed.First of all,a modified Kalman filter which could adaptively modulate the noise scale is introduced to alleviate the impact of low-quality detection on vanilla Kalman filter.Secondly,the introduction of enhanced correlation coefficient maximization is used to settle the inter-frame images to compensate the platform shaking impact.Then ByteTrack increases the motion model based on long short-term memory network to solve the prediction error caused by Kalman filter in the non-linear motion state.Finally,two lightweight offline algorithms of link model and Gaussian-smoothed interpolation are introduced to refine the tracking results.Experiment is performed on the infrared ground multi-object dataset and the results show that compared with Sort and DeepSort,the MOTA of the improved algorithm increases by 8.3% and 10.2%,IDF1 increases by 6.5% and 5.6%,respectively.The improved algorithm shows better effectiveness and will be used in the infrared object intelligent detection and tracking scenes.

Key words: Multi-object tracking, Infrared object, ByteTrack, Kalman filter, Long short-term memory network

CLC Number: 

  • TP391.41
[1]LIU C.Multi-object Fault-tolerant Tracking and Trajectory Pre-diction for Unmanned Vehicles [D].Hangzhou:Zhejiang University,2019.
[2]FU R G,FAN H Q,ZHU Y F,et al.A dataset for infrared time-sensitive target detection and tracking for air-ground application [J].China Scientific Data,2022,7(2):203-218.
[3]ZHANG Y F,SUN P Z,JIANG Y,et al.Byte-Track:Multi-object Tracking by Associating Every Detection Box [EB/OL].https://arxiv.org/pdf/2110.06864.pdf,2022.
[4]DU Y H,WAN J F,ZHAO Y Y,et al.A Com-prehensiveFramework for MCMOT With Global Information and Optimizing Strategies in VisDrone 2021[C]//Proceedings of the IEEE/CVF Inter-national Conference on Computer Vision.2021:2809-2819.
[5]ESS A,LEIBE B,SCHINDLER K,et al.A mobile vision system for robust multi-person tracking[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2008:1-8.
[6]DU Y H,SONG Y,YANG B,et al.StrongSORT:Make DeepSORT Great Again [EB/OL].https://arxiv.org/pdf/2202.13514.pdf,2022.
[7]KIM C,LI F,CIPTADI A,et al.Multiple hypothesis trackingrevisited[C]//IEEE International Conference on Computer Vision.2015:4696-4704.
[8]REID D B.An algorithm for tracking multiple targets[J].IEEE Transactions on Automatic Control,1979,24(6):843-854.
[9]YOON J H,YANG M H,LIM J,et al.Bayesian multi-object tracking using motion context from multiple objects[C]//2015 IEEE Winter Conference on Applications of Computer Vision.2015:33-40.
[10]BEWLEY A,GE Z Y,OTT L,et al.Simple Online and Realtime Tracking[C]//2016 IEEE International Conference on Image Processing(ICIP).2016:3464-3468.
[11]WOJKE N,BEWLEY A,PAULUS D,et al.Sim-ple online and real-time tracking with a deep association metric[C]//2017 IEEE International Conference on Image Processing(ICIP).2017:3645-3449.
[12]CHEN L,AI H Z,ZHUANG Z J,et al.Real-Time Multiple People Tracking with Deeply Learned Candidate Selection and Person Re-Identification [EB/OL].https://arxiv.org/pdf/1809.04427.pdf,2018.
[13]WANG Z D,ZHENG L,LIU Y X,et al.Towards real-timemulti-object tracking [EB/OL].https://arxiv.org/pdf/1909.12605.pdf,2018.
[14]ZHANG Y F,WANG C Y,WANG X G,et al.FairMOT:On the fairness of detection and re-identification in multiple object tracking[EB/OL].https://arxiv.org/pdf/2004.01888.pdf.
[15]ZHOU X Y,KOLTUN V,KRAHENBUHL P,et al.Tracking Objects as Points[EB/OL].https://arxiv.org/pdf/2004.01177.pdf,2020.
[16]WANG L X,ZENG D,ZHU X Q.Space Based Infrared Small Target Detection and Tracking System [J].Industry Control Computer,2022,35(5):39-41.
[17]SONG Z Z,YANG J W,ZHANG D F,et al.Real-time infrared multi-class multi-target anchor-free tracking network[J].Systems Engineering and Electronics,2022,44(2):401-409.
[18]YANG B,LIN S Z,LU X F,et al.Multiple aerial infrared target tracking method based on multi-feature fusion and hierarchical data association [J].Journal of Computer Applications,2022,40(10):3075-3080.
[19]XIE X F,LIU H J,ZHANG L J,et al.Infrared Ship TargetRecognition Fused with Lightweight YOLOv4 and KCF Algorithm[J].Journal of Ordnance Equipment Engineering,2021,42(6):175-182.
[20]YANG W,YAO T,GENG X T,et al.Research on application ofinfrared target recognition technology of air defense weapon based on deep learning[J].Journal of Ordnance Equipment Engineering,2022,43(1):125-129.
[21]ZHENG G,LIU S T,WANG F,et al.YOLOX:Exceeding YOLO Series in 2021 [EB/OL].https://arxiv.org/pdf/2107.08430.pdf,2021.
[1] ZENG Zehua, LUO Huilan. Cross-dataset Learning Combining Multi-object Tracking and Human Pose Estimation [J]. Computer Science, 2023, 50(6A): 220400199-7.
[2] WANG Lin, MENG Zuqiang, YANG Lina. Chinese Sentiment Analysis Based on CNN-BiLSTM Model of Multi-level and Multi-scale Feature Extraction [J]. Computer Science, 2023, 50(5): 248-254.
[3] CHEN Yunfang, LU Yangyang, ZHOU Xin, ZHANG Wei. Multi-object Tracking Based on Cross-correlation Attention and Chained Frames [J]. Computer Science, 2023, 50(1): 131-137.
[4] WANG Xin-tong, WANG Xuan, SUN Zhi-xin. Network Traffic Anomaly Detection Method Based on Multi-scale Memory Residual Network [J]. Computer Science, 2022, 49(8): 314-322.
[5] WANG Shan, XU Chu-yi, SHI Chun-xiang, ZHANG Ying. Study on Cloud Classification Method of Satellite Cloud Images Based on CNN-LSTM [J]. Computer Science, 2022, 49(6A): 675-679.
[6] SHI Dian-xi, LIU Cong, SHE Fu-jiang, ZHANG Yong-jun. Cooperation Localization Method Based on Location Confidence of Multi-UAV in GPS-deniedEnvironment [J]. Computer Science, 2022, 49(4): 302-311.
[7] PAN Zhi-hao, ZENG Bi, LIAO Wen-xiong, WEI Peng-fei, WEN Song. Interactive Attention Graph Convolutional Networks for Aspect-based Sentiment Classification [J]. Computer Science, 2022, 49(3): 294-300.
[8] LYU Run, LI Guan-yu, QI Pei, QIAN Wei-xing, WANG Lan-ze, FENG Tai-ping. New SLAM Method of Multi-layer Lidar Assisted by Rotational Strapdown Inertial NavigationSystem [J]. Computer Science, 2022, 49(11A): 211200088-5.
[9] GAO Feng-yue, WANG Yan, ZHU Tie-lan. Resilient Distributed State Estimation Algorithm [J]. Computer Science, 2021, 48(5): 308-312.
[10] PENG Bin, LI Zheng, LIU Yong, WU Yong-hao. Automatic Code Comments Generation Method Based on Convolutional Neural Network [J]. Computer Science, 2021, 48(12): 117-124.
[11] ZHANG Ning, FANG Jing-wen, ZHAO Yu-xuan. Bitcoin Price Forecast Based on Mixed LSTM Model [J]. Computer Science, 2021, 48(11A): 39-45.
[12] LIU Yan, QIN Pin-le, ZENG Jian-chao. Multi-object Tracking Algorithm Based on YOLOv3 and Hierarchical Data Association [J]. Computer Science, 2021, 48(11A): 370-375.
[13] ZHANG Yu-shuai, ZHAO Huan, LI Bo. Semantic Slot Filling Based on BERT and BiLSTM [J]. Computer Science, 2021, 48(1): 247-252.
[14] WANG Bing-zhou, WANG Hui-bin, SHEN Jie, ZHANG Li-li. FastSLAM Algorithm Based on Adaptive Fading Unscented Kalman Filter [J]. Computer Science, 2020, 47(9): 213-218.
[15] MA Hong. Fusion Localization Algorithm of Visual Aided BDS Mobile Robot Based on 5G [J]. Computer Science, 2020, 47(6A): 631-633.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!