Computer Science ›› 2024, Vol. 51 ›› Issue (1): 175-183.doi: 10.11896/jsjkx.230200037

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Method of Infrared Small Target Detection Based on Multi-depth Feature Connection

WANG Weijia1,2, XIONG Wenzhuo1, ZHU Shengjie1,2, SONG Ce1, SUN He1, SONG Yulong1   

  1. 1 Changchun Institute of Optics,Fine Mechanics and Physics,Chinese Academy of Sciences,Changchun 130033,China
    2 Daheng College,University of Chinese Academy of Sciences,Beijing 100049,China
  • Received:2023-02-06 Revised:2023-03-29 Online:2024-01-15 Published:2024-01-12
  • About author:WANG Weijia,born in 1998,master.Her main research interests include computer vision and aerial image target detection.
    XIONG Wenzhuo,born in 1967,master,researcher.His main research interests include aerial photoelectric imaging and photoelectric sensor technology.
  • Supported by:
    National Natural Science Foundation of China(62205332).

Abstract: Small infrared targets have the characteristics of a small number of pixels and a complex background,which leads to the problems of low detection accuracy and high time-consumption.This paper proposes a multi-depth feature connection network.Firstly,the model proposes a multi-depth cross-connect backbone to increase feature transfer between different layers and enhance feature extraction capabilities.Secondly,an attention-guided pyramid structure is designed to enhance the deep features and separate the background from the target.Thirdly,an asymmetric fusion decoding structure is proposed to enhance the preservation of texture information and position information in decoding.Finally,the model introduces point regression loss to get the center coordinates.The proposed network model is trained and tested on the SIRST dataset and the self-built infrared small target dataset.Experimental results show that compared with existing data-driven and model-driven algorithms,the proposed model has higher detection accuracy and faster speed in complex scenes.Compared with the suboptimal model,the average precision of the model is improved by 5.41%,and the detection speed reaches 100.8 FPS.

Key words: Infrared small target detection, Deep learning, Object detection, Feature connection, Attention mechanism

CLC Number: 

  • TP391
[1]DAI X,ZHAO X,LI L P,et al.Infrared dim small target detection algorithm based on improved YOLOv5 in complex background [J].Infrared Technology,2022,44(5):504-512.
[2]ZHANG Q,ZHU H T,CHENG H.Light weight infrared dimsmall target detection algorithm [J].Progress in Laser and Optoelectronics,2022,59(16):282-288.
[3]CHEN M S,SUN W X,LI M Y,et al.Infrared small target detection under various complex backgrounds[J].Journal of Jilin University(Engineering and Technology Edition),2020,50(6):2288-2294.
[4]GAO C Q,MENG D Y,YANG Y,et al.Infrared patch image model for small target detection in a single image [J].IEEE Transactions on Image Processing,2013,22(12):4996-5009.
[5]GAO C,MENG D,YANG Y,et al.Infrared patch-image model for small target detection in a single image[C]//IEEE Transactions on Image Processing.2013:4996-5009.
[6]LI X F,WANG S Q,WENG X,et al.Remote sensing of floating macroalgae blooms in the East China Sea based on UNet deep learning model[J].Acta Optica Sinica,2021,41(2):18-26.
[7]REN S,HE K,GIRSHICK R,et al.Faster R-CNN:towardsreal-time object detection with region proposal networks[C]//International Conference on Neural Information Processing Systems.MIT Press,2015:91-99.
[8]REDMON J,FARHADI A.Yolov3:An incremental improve-ment[J].arXiv:1804.02767,2018.
[9]PAN X H,SHAO Q,LU J G.Small object detection algorithm based on CBD-YOLOv3.Journal of Chinese Computer Systems.2022,43(10):2143-2149.
[10]ZHANG H D,ZHANG R Q,TONG L.A vehicle target detection method based on improved YOLOv5s [J].Journal of Chongqing University of Technology(Natural Science),2023,37(7):80-89.
[11]DAI D E,ZHU R F,CHEN C Z,et al.Aviation small target detection algorithm based on improved Yolov5l [J].Computer Engineering and Design,2023,44(9):2610-2618.
[12]ZHANG S,ZHU X,LEI Z,et al.S3FD:Single shot scale-inva-riant face detector[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:192-201.
[13]ZHU S J,LIU J,TIAN Y,et al.Rapid Vehicle Detection in Ae-rial Images under the Complex Background of Dense Urban Areas[J].Remote Sensing,2022,14(9):2088.
[14]SIMONYAN K,ZISSERMAN A.Very deep convolutional networks for large-scale image recognition[J].arXiv:1409.1556,2014.
[15]HE K,ZHANG X,REN S,et al.Identity mappings in deep residual networks[C]//European Conference on Computer Vision.2016:630-645.
[16]HUANG G,LIU S,VANDER M L,et al.CondenseNet:An efficient DenseNet using learned group convolutions[C]//Procee-dings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:2752-2761.
[17]WANG J,SUN K,CHENG T,et al.Deep high-resolution representation learning for visual recognition [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,43(10):3349-3364.
[18]RONNEBERGER O,FISCHER P,BROX T.U-net:Convolu-tional networks for biomedical image segmentation[C]//International Conference on Medical Image Computing and Computer-assisted Intervention.2015:234-241.
[19]ZHANG T,CAO S,PU T,et al.Agpcnet:Attention-guided pyramid context networks for infrared small target detection[J].arXiv:2111.03580,2021.
[20]NEWELL A,YANG K,DENG J.Stacked hourglass networksfor human pose estimation[C]//European Conference on Computer Vision.2016:483-499.
[21]WANG X,GIRSHICK R,GUPTA A,et al.Non-local neural networks[C]//IEEE Conference on Computer Vision and Pattern Recognition.2018:7794-7803.
[22]CHEN L C,PAPANDREOU G,KOKKINOS I,et al.DeepLab:Semantic image segmentation with deep convolutional nets,atrous convolution,and fully connected CRFs [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,40(4):834-848.
[23]DAI Y,WU Y,ZHOU F,et al.Asymmetric contextual modulation for infrared small target detection[C]//IEEE/CVF Winter Conference on Applications of Computer Vision.2021:950-959.
[24]CHEN C L,LI H,WEI Y T,et al.A local contrast method for small infrared target detection [J].IEEE Transactions on Geoscience and Remote Sensing,2014:52(1):574-581.
[25]DUAN K,BAI S,XIE L,et al.Centernet:Keypoint triplets for object detection[C]//IEEE/CVF International Conference on Computer Vision.2019:6569-6578.
[26]LIN L K,WANG S Y,TANG Z X.Point target detection me-thod of infrared oversampling scanned image based on deep convolution neural network [J].Journal of Infrared and Millimeter Wave,2018,37(2):219-226.
[27]LIU W,ANGUELOV D,ERHAN D,et al.SSD:Single shotmultibox detector[C]//European Conference on Computer Vision.Cham:Springer,2016:21-37.
[28]XU Y,YAN W,YANG G,et al.CenterFace:joint face detection and alignment using face as point[J].Scientific Programming,2020,2020:1-8.
[29]SHI Y,WEI Y,YAO H,et al.High-boost-based multiscale local contrast measure for infrared small target detection[J].IEEE Geoscience and Remote Sensing Letters,2017,15(1):33-37.
[30]MORADI S,MOALLEM P,SABAHI M F.Fast and robustsmall infrared target detection using absolute directional mean difference algorithm[J].Signal Processing,2020,177:107727.
[31]ZHANG H,ZHANG L,YUAN D,et al.Infrared small target detection based on local intensity and gradient properties[J].Infrared Physics & Technology,2018,89:88-96.
[32]WEI Y,YOU X,LI H.Multiscale patch-based contrast measure for small infrared target detection[J].Pattern Recognition,2016,58:216-226.
[1] XU Jinlong, GUI Zhonghua, LI Jia'nan, LI Yingying, HAN Lin. FP8 Quantization and Inference Memory Optimization Based on MLIR [J]. Computer Science, 2024, 51(9): 112-120.
[2] WANG Jiahui, PENG Guangling, DUAN Liang, YUAN Guowu, YUE Kun. Few-shot Shadow Removal Method for Text Recognition [J]. Computer Science, 2024, 51(9): 147-154.
[3] LI Yunchen, ZHANG Rui, WANG Jiabao, LI Yang, WANG Ziqi, CHEN Yao. Re-parameterization Enhanced Dual-modal Realtime Object Detection Model [J]. Computer Science, 2024, 51(9): 162-172.
[4] HU Pengfei, WANG Youguo, ZHAI Qiqing, YAN Jun, BAI Quan. Night Vehicle Detection Algorithm Based on YOLOv5s and Bistable Stochastic Resonance [J]. Computer Science, 2024, 51(9): 173-181.
[5] LIU Qian, BAI Zhihao, CHENG Chunling, GUI Yaocheng. Image-Text Sentiment Classification Model Based on Multi-scale Cross-modal Feature Fusion [J]. Computer Science, 2024, 51(9): 258-264.
[6] LI Zhe, LIU Yiyang, WANG Ke, YANG Jie, LI Yafei, XU Mingliang. Real-time Prediction Model of Carrier Aircraft Landing Trajectory Based on Stagewise Autoencoders and Attention Mechanism [J]. Computer Science, 2024, 51(9): 273-282.
[7] LIU Qilong, LI Bicheng, HUANG Zhiyong. CCSD:Topic-oriented Sarcasm Detection [J]. Computer Science, 2024, 51(9): 310-318.
[8] YAO Yao, YANG Jibin, ZHANG Xiongwei, LI Yihao, SONG Gongkunkun. CLU-Net Speech Enhancement Network for Radio Communication [J]. Computer Science, 2024, 51(9): 338-345.
[9] DU Yu, YU Zishu, PENG Xiaohui, XU Zhiwei. Padding Load:Load Reducing Cluster Resource Waste and Deep Learning Training Costs [J]. Computer Science, 2024, 51(9): 71-79.
[10] ZHANG Lu, DUAN Youxiang, LIU Juan, LU Yuxi. Chinese Geological Entity Relation Extraction Based on RoBERTa and Weighted Graph Convolutional Networks [J]. Computer Science, 2024, 51(8): 297-303.
[11] CHEN Shanshan, YAO Subin. Study on Recommendation Algorithms Based on Knowledge Graph and Neighbor PerceptionAttention Mechanism [J]. Computer Science, 2024, 51(8): 313-323.
[12] CHEN Siyu, MA Hailong, ZHANG Jianhui. Encrypted Traffic Classification of CNN and BiGRU Based on Self-attention [J]. Computer Science, 2024, 51(8): 396-402.
[13] SUN Yumo, LI Xinhang, ZHAO Wenjie, ZHU Li, LIANG Ya’nan. Driving Towards Intelligent Future:The Application of Deep Learning in Rail Transit Innovation [J]. Computer Science, 2024, 51(8): 1-10.
[14] KONG Lingchao, LIU Guozhu. Review of Outlier Detection Algorithms [J]. Computer Science, 2024, 51(8): 20-33.
[15] LIU Sichun, WANG Xiaoping, PEI Xilong, LUO Hangyu. Scene Segmentation Model Based on Dual Learning [J]. Computer Science, 2024, 51(8): 133-142.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!