Computer Science ›› 2020, Vol. 47 ›› Issue (11A): 165-171.doi: 10.11896/jsjkx.190500176

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Survey on Aircraft Detection in Optical Remote Sensing Images

ZHU Wen-tao, XIE Bao-rong, WANG Yan, SHEN Ji, ZHU Hao-wen   

  1. Shanghai Academy of Spaceflight Technology,Shanghai 201109,China
  • Online:2020-11-15 Published:2020-11-17
  • About author:ZHU Wen-tao,born in 1995,engineer.His main research interests include on-board processing product design,image processing and object detection.

Abstract: Aircraft detection technology in optical remote sensing images has been widely used in urban planning,aviation and military reconnaissance.Despite a lot of research,there are still many problems to be solved.The paper review the research status of this technology.Starting from the thoughts on remote sensing image target detection,we divide the aircraft target detection methods into three categories and separately elaborate the concepts and research status of these three types of detection methods and conduct comparative analysis on this basis.We focus on the research of deep learning methods in this field and discuss the issues of sample and data set.Then we state the technical difficulties in aircraft target detection.Finally we consider and discuss the object detection task of high-resolution remote sensing image,and made a prospect for the future development of the field.

Key words: Aircraft detection, Deep learning, Machine learning, Optical remote sensing image, Template matching

CLC Number: 

  • TP753
[1] HONG Z L,JIANG Q S,DONG H L,et al.Fast Ship Detection Based on Multi-threshold Image Segmentation[C]//Proceedings of the 23rd China Database Academic Conference (Technical Reports).2006.
[2] DANG X J,YIN J W.Template matching based moving object tracking method[J].Computer Engineering and Applications,2010,46(5):173-176.
[3] XU C,DUAN H.Artificial bee colony (ABC) optimized edgepotential function (EPF) approach to target recognition for low-altitude aircraft[J].Pattern Recognition Letters,2010,31(13):1759-1772.
[4] LIU G,SUN X,FU K,et al.Interactive geospatial object extraction in high resolution remote sensing images using shape-based global minimization active contour model[J].Pattern Recognition Letters,2013,34(10):1186-1195.
[5] LIN Y,HE H,YIN Z,et al.Rotation-invariant object detection in remote sensing images based on radial-gradient angle[J].IEEE Geoscience and Remote Sensing Letters,2015,12(4):746-750.
[6] SUN H,SUN X,WANG H,et al.Automatic target detect ion in high-resolution remote sensing images using spatial sparsecod-ing bag-of-words model[J].IEEE Geoscience & Remote Sen-sing Letters,2012,9(1):109-113.
[7] ZHANG W,SUN X,FU K,et al.Object detection in high-resolution remote sensing images using rotation invariant parts based model[J].IEEE Geoscience & Remote Sensing Letters,2014,11(1):74-78.
[8] BAI X,ZHANG H,ZHOU J.VHR object detection based on structural feature extraction and query expansion[J].IEEE Transactions on Geoscience & Remote Sensing,2014,52(10):6508-6520.
[9] CHEN X,XIANG S,LIU C L,et al.Aircraft detection by deep belif nets[C]//Iapr Asian Conference on Pattern Recognition.New Jersey:IEEE Press,2013:54-58.
[10] HAN J,ZHANG D,CHENG G,et al.Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning[J].IEEE Transactions on Geoscience &Remote Sensing,2015,53(6):3325-3337.
[11] DIAO W,SUN X,ZHENG X,et al.Efficient saliency-based object detection in remote sensing images using deep belief networks[J].IEEE Geoscience & Remote Sensing Letters,2016,13(2):137-141.
[12] ZHOU P,CHENG G,LIU Z,et al.Weakly supervised target detection in remote sensing images based on transferred deep features and negative bootstrapping[J].Multidimensional Systems &Signal Processing,2016,27(4):925-944.
[13] HAN J,ZHANG D,CHENG G,et al.Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning[J].IEEE Trans.Geosci.Remote Sens.,2015,53(6):3325-3337.
[14] SHAO W,YANG W,LIU G,et al.Car detection from high- resolution aerial imagery using multiple features[C]//Proc.IEEE Int.Geosci.Remote Sens.Symp(IGARSS).2012:4379-4382.
[15] ZHANG F,DU B,ZHANG L.Saliency-guided unsupervised feature learning for scene classification[J].IEEE Trans.Geosci.Remote Sens.,2015,53(4):2175-2184.
[16] HAN J,ZHOU P,ZHANG D,et al.Efficient,simultaneous detection of multi-class geospatial targets based on visual saliency modeling and discriminative learning of sparse coding[J].ISPRS J.Photogram.Remote Sens.,2014,89:37-48.
[17] XIAO Z,LIU Q,TANG G,et al.Elliptic Fourier transforma-tion- based histograms of oriented gradients for rotationally invariant object detection in remote-sensing images[J].Int.J.Remote Sens.,2014,36(2):618-644.
[18] LEI Z,FANG T,HUO H,et al.Rotation-invariant object detection of remotely sensed images based on texton forest and hough voting[J].IEEE Transactions on Geoscience and Remote Sensing,2012,50(4):1206-1217.
[19] LIU L,SHI Z.Airplane detection based on rotation invariant and sparse coding in remote sensing images[J].Optik-International Journal for Light and Electron Optics,2014,125(18):5327-5333.
[20] GRABNER H,NGUYEN T,GRUBER B,et al.On-line boosting-based car detection from aerial images[J].ISPRS Journal of Photogrammetry and Remote Sensing,2008,63(3):382-396.
[21] ZHANG W,SUN X,WANG H,et al.A generic discriminative part-based model for geospatial object detection in optical remote sensing images[J].ISPRS journal of photogrammetry and remote sensing,2015,99:30-44.
[22] CAO L,LUO J,LIANG F,et al.Heterogeneous feature achines for visual recognition[C]//2009 IEEE 2th International Conference on Computer Vision.IEEE,2009:1095-1102.
[23] WANG H,NIE F,HUANG H,et al.Heterogeneous visual features fusion via sparse multimodal machine[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2013:3097-3102.
[24] HARIHARAN B,MALIK J,RAMANAN D.Discriminativedecorrelation for clustering and classification[C]//Proc.Eur.Conf.Comput.Vis.,2012:459-472.
[25] SUGIYAMA M.Dimensionality reduction of multimodal labeled data by local fisher discriminant analysis[J].J.Mach.Learn.Res.2007,8:1027-1061.
[26] ZHAO B,HUANG B,ZHONG Y.Transfer learning with fully pretrained deep convolution networks for land-use classification[J].IEEE Geosci.Remote Sens.Lett.,2017,14(9):1436-1440.
[27] LIN T,GOYAL P,GIRSHICK R B,et al.Focal loss for dense object detection[C]//ICCV.2017.
[28] UIJLINGS J R R,VAN DE SANDE K E A,GEVERS T,et al.Selective search for object recognition[J].Int.J.Comput.Vis.,2013,104(2):154-171.
[29] DING P.A light and faster regional convolutional neural network for object detection in optical remote sensing images[J].ISPRS J.Photogramm.Remote Sens.,2018,141:208-218.
[30] WU H,ZHANG H,ZHANG J F,et al.Fast aircraft detection in satellite images based on convolutional neural networks[C]//2015 IEEE International Conference on Image Processing.IEEE,New York,2015:4210-4214.
[31] CAO Y S,NIU X,DOU Y.Region-based convolutional neuralnetworks for object detection in very high resolution remote sensing images[C]//2016 12th International Conference on Natural Computation,Fuzzy Systems and Knowledge Discovery (IcncFskd).2016:548-554.
[32] DAI W C,JIN L X,LI G N,et al.Real-time airplane detection algorithm in remote-sensing images based on improved YOLOv3[J].Opto-Electronic Engineering,2018,45(12):180350.
[33] GUO L,QIN S Y.Deep learning and optimization algorithm for high efficient searching and detection of aircraft targets in remote sensing images[J].Journal of Beijing University of Aeronautics and Astronautics,2019,45(1):159-173.
[34] YANG J C,ZHU Y,JIANG B,et al.Aircraft detection in remote sensing images based on a deep residual network and Super-Vector coding[J].Remote Sensing Letters,2018,9(3):229-237.
[35] CAICEDO J C,LAZEBNIK S.Active object localization withdeep reinforcement learning[C]//Proceedings of the IEEE International Conference on Computer Vision.Santiago,Chile,2015:2488-2496.
[36] BELLVER M,GIRÓINIETO X,MARQUÉS,et al.Hierarchical Object Detection with Deep Reinforcement Learning[J].arXiv:1611.03718.
[37] JIE Z,LIANG X,FENG J,et al.Tree-structured reinforcement learning for sequential object localization[C]//Proceedings of the Advances in Neural Information Processing Systems.Barcelona,Spain,2016:127-135.
[38] XIA G S,BAI X,DING J,et al.DOTA:A large-scale dataset for object detection in aerial images[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:3974-3983.
[39] ZHU H,CHEN X,DAI W,et al.Orientation Robust Object Detection in Aerial Images Using Deep Convolutional Neural Network[C]//IEEE Int'l Conf.Image Processing.2015.
[40] CHENG G,HAN J,ZHOU P,et al.Multi-class geospatial object detection and geographic imageclassification based on collection of part detectors[J].ISPRS Journal of Photogrammetry and Remote Sensing,2014,98:119-132.
[41] LONG Y,GONG Y,XIAO Z,et al.Accurate Object Localization in Remote Sensing Images Based on Convolutional Neural Networks[C]//IEEE Transactions on Geoscience and Remote Sensing,2017,55(5):2486-2498.
[42] HINTON G,OSINDERO S,TEH Y W.A fast learning algorithm for deep belief nets[J].Neural Comput.,2006,18(7):1527-1554.
[43] DIAO W H,SUN X,ZHENG X,et al.Efficient saliency-based object detection in remote sensing images using deep belief networks.IEEE Geoscience and Remote Sensing Letters,2016,13(2):137-141.
[44] ZHANG F,DU B,ZHANG L,et al.Weakly supervised learning based on coupled convolutional neural networks for aircraft detection[J].IEEE Trans.Geosci.Remote Sens.,2016,54(9):5553-5563.
[45] PAN B,TAI J,ZHENG Q,et al.Cascade convolutional neural network based on transfer-learning for aircraft detection on high-resolution remote sensing images[J].Journal of Sensors,2017,2017:1-14.
[46] ZHENG C H,WANG C C,LIN Z P,et al.Target Recognition Algorithm Research Based on Combined Feature Selection[J].Aerospace Shanghai,2017,34(5):59-64.
[47] WU Z,ZENG J X,GAO Q Q.Aircraft target recognition in remote sensing images based on saliency images and multi-feature combination[J].Journal of Image and Graphics,2017,22(4):532-541.
[48] YIN W B,WANG C B,YUAN C,et al.A Method of Aircraft Recognition in Remote Sensing Images[J].Bulletin of Surveying and Mapping,2017(3):34-37.
[49] ZHANG S,WEN L,BIAN X,et al.Single-shot refinement neural network for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:4203-4212.
[50] YAO Q L,HU X,LEI H.Application of deep convolutional neural network in object detection[J].Computer Engineering and Applications,2018,54(17):1-9.
[1] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[2] LENG Dian-dian, DU Peng, CHEN Jian-ting, XIANG Yang. Automated Container Terminal Oriented Travel Time Estimation of AGV [J]. Computer Science, 2022, 49(9): 208-214.
[3] NING Han-yang, MA Miao, YANG Bo, LIU Shi-chang. Research Progress and Analysis on Intelligent Cryptology [J]. Computer Science, 2022, 49(9): 288-296.
[4] TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[5] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[6] LI Yao, LI Tao, LI Qi-fan, LIANG Jia-rui, Ibegbu Nnamdi JULIAN, CHEN Jun-jie, GUO Hao. Construction and Multi-feature Fusion Classification Research Based on Multi-scale Sparse Brain Functional Hyper-network [J]. Computer Science, 2022, 49(8): 257-266.
[7] WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[8] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[9] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[10] ZHANG Guang-hua, GAO Tian-jiao, CHEN Zhen-guo, YU Nai-wen. Study on Malware Classification Based on N-Gram Static Analysis Technology [J]. Computer Science, 2022, 49(8): 336-343.
[11] HE Qiang, YIN Zhen-yu, HUANG Min, WANG Xing-wei, WANG Yuan-tian, CUI Shuo, ZHAO Yong. Survey of Influence Analysis of Evolutionary Network Based on Big Data [J]. Computer Science, 2022, 49(8): 1-11.
[12] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[13] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[14] CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126.
[15] HOU Yu-tao, ABULIZI Abudukelimu, ABUDUKELIMU Halidanmu. Advances in Chinese Pre-training Models [J]. Computer Science, 2022, 49(7): 148-163.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!