光学遥感图像中的飞机目标检测技术研究综述

doi:10.11896/jsjkx.190500176

摘要/Abstract

摘要： 光学遥感图像中的飞机目标检测技术已被广泛应用于城市规划、航空交通以及军事侦察领域。目前尽管已有大量研究,但仍然存在很多问题亟待解决。文中回顾了该技术研究现状,并从遥感图像目标检测思路出发,将飞机目标检测方法总结为3类,对这3类检测方法的概念和研究情况分别进行了阐述,并在此基础上进行了比较分析,重点研究了深度学习方法在该领域的研究情况并讨论了样本和数据集问题,最后讨论了飞机目标检测的关键技术难点,并对该领域的未来发展趋势做了展望。

关键词: 飞机目标检测, 光学遥感图像, 机器学习, 模板匹配, 深度学习

Abstract: Aircraft detection technology in optical remote sensing images has been widely used in urban planning,aviation and military reconnaissance.Despite a lot of research,there are still many problems to be solved.The paper review the research status of this technology.Starting from the thoughts on remote sensing image target detection,we divide the aircraft target detection methods into three categories and separately elaborate the concepts and research status of these three types of detection methods and conduct comparative analysis on this basis.We focus on the research of deep learning methods in this field and discuss the issues of sample and data set.Then we state the technical difficulties in aircraft target detection.Finally we consider and discuss the object detection task of high-resolution remote sensing image,and made a prospect for the future development of the field.

Key words: Aircraft detection, Deep learning, Machine learning, Optical remote sensing image, Template matching

中图分类号:

TP753

祝文韬, 谢宝蓉, 王琰, 沈霁, 朱浩文. 光学遥感图像中的飞机目标检测技术研究综述[J]. 计算机科学, 2020, 47(11A): 165-171. https://doi.org/10.11896/jsjkx.190500176

ZHU Wen-tao, XIE Bao-rong, WANG Yan, SHEN Ji, ZHU Hao-wen. Survey on Aircraft Detection in Optical Remote Sensing Images[J]. Computer Science, 2020, 47(11A): 165-171. https://doi.org/10.11896/jsjkx.190500176

参考文献

[1] HONG Z L,JIANG Q S,DONG H L,et al.Fast Ship Detection Based on Multi-threshold Image Segmentation[C]//Proceedings of the 23rd China Database Academic Conference (Technical Reports).2006.
[2] DANG X J,YIN J W.Template matching based moving object tracking method[J].Computer Engineering and Applications,2010,46(5):173-176.
[3] XU C,DUAN H.Artificial bee colony (ABC) optimized edgepotential function (EPF) approach to target recognition for low-altitude aircraft[J].Pattern Recognition Letters,2010,31(13):1759-1772.
[4] LIU G,SUN X,FU K,et al.Interactive geospatial object extraction in high resolution remote sensing images using shape-based global minimization active contour model[J].Pattern Recognition Letters,2013,34(10):1186-1195.
[5] LIN Y,HE H,YIN Z,et al.Rotation-invariant object detection in remote sensing images based on radial-gradient angle[J].IEEE Geoscience and Remote Sensing Letters,2015,12(4):746-750.
[6] SUN H,SUN X,WANG H,et al.Automatic target detect ion in high-resolution remote sensing images using spatial sparsecod-ing bag-of-words model[J].IEEE Geoscience & Remote Sen-sing Letters,2012,9(1):109-113.
[7] ZHANG W,SUN X,FU K,et al.Object detection in high-resolution remote sensing images using rotation invariant parts based model[J].IEEE Geoscience & Remote Sensing Letters,2014,11(1):74-78.
[8] BAI X,ZHANG H,ZHOU J.VHR object detection based on structural feature extraction and query expansion[J].IEEE Transactions on Geoscience & Remote Sensing,2014,52(10):6508-6520.
[9] CHEN X,XIANG S,LIU C L,et al.Aircraft detection by deep belif nets[C]//Iapr Asian Conference on Pattern Recognition.New Jersey:IEEE Press,2013:54-58.
[10] HAN J,ZHANG D,CHENG G,et al.Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning[J].IEEE Transactions on Geoscience &Remote Sensing,2015,53(6):3325-3337.
[11] DIAO W,SUN X,ZHENG X,et al.Efficient saliency-based object detection in remote sensing images using deep belief networks[J].IEEE Geoscience & Remote Sensing Letters,2016,13(2):137-141.
[12] ZHOU P,CHENG G,LIU Z,et al.Weakly supervised target detection in remote sensing images based on transferred deep features and negative bootstrapping[J].Multidimensional Systems &Signal Processing,2016,27(4):925-944.
[13] HAN J,ZHANG D,CHENG G,et al.Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning[J].IEEE Trans.Geosci.Remote Sens.,2015,53(6):3325-3337.
[14] SHAO W,YANG W,LIU G,et al.Car detection from high- resolution aerial imagery using multiple features[C]//Proc.IEEE Int.Geosci.Remote Sens.Symp(IGARSS).2012:4379-4382.
[15] ZHANG F,DU B,ZHANG L.Saliency-guided unsupervised feature learning for scene classification[J].IEEE Trans.Geosci.Remote Sens.,2015,53(4):2175-2184.
[16] HAN J,ZHOU P,ZHANG D,et al.Efficient,simultaneous detection of multi-class geospatial targets based on visual saliency modeling and discriminative learning of sparse coding[J].ISPRS J.Photogram.Remote Sens.,2014,89:37-48.
[17] XIAO Z,LIU Q,TANG G,et al.Elliptic Fourier transforma-tion- based histograms of oriented gradients for rotationally invariant object detection in remote-sensing images[J].Int.J.Remote Sens.,2014,36(2):618-644.
[18] LEI Z,FANG T,HUO H,et al.Rotation-invariant object detection of remotely sensed images based on texton forest and hough voting[J].IEEE Transactions on Geoscience and Remote Sensing,2012,50(4):1206-1217.
[19] LIU L,SHI Z.Airplane detection based on rotation invariant and sparse coding in remote sensing images[J].Optik-International Journal for Light and Electron Optics,2014,125(18):5327-5333.
[20] GRABNER H,NGUYEN T,GRUBER B,et al.On-line boosting-based car detection from aerial images[J].ISPRS Journal of Photogrammetry and Remote Sensing,2008,63(3):382-396.
[21] ZHANG W,SUN X,WANG H,et al.A generic discriminative part-based model for geospatial object detection in optical remote sensing images[J].ISPRS journal of photogrammetry and remote sensing,2015,99:30-44.
[22] CAO L,LUO J,LIANG F,et al.Heterogeneous feature achines for visual recognition[C]//2009 IEEE 2th International Conference on Computer Vision.IEEE,2009:1095-1102.
[23] WANG H,NIE F,HUANG H,et al.Heterogeneous visual features fusion via sparse multimodal machine[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2013:3097-3102.
[24] HARIHARAN B,MALIK J,RAMANAN D.Discriminativedecorrelation for clustering and classification[C]//Proc.Eur.Conf.Comput.Vis.,2012:459-472.
[25] SUGIYAMA M.Dimensionality reduction of multimodal labeled data by local fisher discriminant analysis[J].J.Mach.Learn.Res.2007,8:1027-1061.
[26] ZHAO B,HUANG B,ZHONG Y.Transfer learning with fully pretrained deep convolution networks for land-use classification[J].IEEE Geosci.Remote Sens.Lett.,2017,14(9):1436-1440.
[27] LIN T,GOYAL P,GIRSHICK R B,et al.Focal loss for dense object detection[C]//ICCV.2017.
[28] UIJLINGS J R R,VAN DE SANDE K E A,GEVERS T,et al.Selective search for object recognition[J].Int.J.Comput.Vis.,2013,104(2):154-171.
[29] DING P.A light and faster regional convolutional neural network for object detection in optical remote sensing images[J].ISPRS J.Photogramm.Remote Sens.,2018,141:208-218.
[30] WU H,ZHANG H,ZHANG J F,et al.Fast aircraft detection in satellite images based on convolutional neural networks[C]//2015 IEEE International Conference on Image Processing.IEEE,New York,2015:4210-4214.
[31] CAO Y S,NIU X,DOU Y.Region-based convolutional neuralnetworks for object detection in very high resolution remote sensing images[C]//2016 12th International Conference on Natural Computation,Fuzzy Systems and Knowledge Discovery (IcncFskd).2016:548-554.
[32] DAI W C,JIN L X,LI G N,et al.Real-time airplane detection algorithm in remote-sensing images based on improved YOLOv3[J].Opto-Electronic Engineering,2018,45(12):180350.
[33] GUO L,QIN S Y.Deep learning and optimization algorithm for high efficient searching and detection of aircraft targets in remote sensing images[J].Journal of Beijing University of Aeronautics and Astronautics,2019,45(1):159-173.
[34] YANG J C,ZHU Y,JIANG B,et al.Aircraft detection in remote sensing images based on a deep residual network and Super-Vector coding[J].Remote Sensing Letters,2018,9(3):229-237.
[35] CAICEDO J C,LAZEBNIK S.Active object localization withdeep reinforcement learning[C]//Proceedings of the IEEE International Conference on Computer Vision.Santiago,Chile,2015:2488-2496.
[36] BELLVER M,GIRÓINIETO X,MARQUÉS,et al.Hierarchical Object Detection with Deep Reinforcement Learning[J].arXiv:1611.03718.
[37] JIE Z,LIANG X,FENG J,et al.Tree-structured reinforcement learning for sequential object localization[C]//Proceedings of the Advances in Neural Information Processing Systems.Barcelona,Spain,2016:127-135.
[38] XIA G S,BAI X,DING J,et al.DOTA:A large-scale dataset for object detection in aerial images[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:3974-3983.
[39] ZHU H,CHEN X,DAI W,et al.Orientation Robust Object Detection in Aerial Images Using Deep Convolutional Neural Network[C]//IEEE Int'l Conf.Image Processing.2015.
[40] CHENG G,HAN J,ZHOU P,et al.Multi-class geospatial object detection and geographic imageclassification based on collection of part detectors[J].ISPRS Journal of Photogrammetry and Remote Sensing,2014,98:119-132.
[41] LONG Y,GONG Y,XIAO Z,et al.Accurate Object Localization in Remote Sensing Images Based on Convolutional Neural Networks[C]//IEEE Transactions on Geoscience and Remote Sensing,2017,55(5):2486-2498.
[42] HINTON G,OSINDERO S,TEH Y W.A fast learning algorithm for deep belief nets[J].Neural Comput.,2006,18(7):1527-1554.
[43] DIAO W H,SUN X,ZHENG X,et al.Efficient saliency-based object detection in remote sensing images using deep belief networks.IEEE Geoscience and Remote Sensing Letters,2016,13(2):137-141.
[44] ZHANG F,DU B,ZHANG L,et al.Weakly supervised learning based on coupled convolutional neural networks for aircraft detection[J].IEEE Trans.Geosci.Remote Sens.,2016,54(9):5553-5563.
[45] PAN B,TAI J,ZHENG Q,et al.Cascade convolutional neural network based on transfer-learning for aircraft detection on high-resolution remote sensing images[J].Journal of Sensors,2017,2017:1-14.
[46] ZHENG C H,WANG C C,LIN Z P,et al.Target Recognition Algorithm Research Based on Combined Feature Selection[J].Aerospace Shanghai,2017,34(5):59-64.
[47] WU Z,ZENG J X,GAO Q Q.Aircraft target recognition in remote sensing images based on saliency images and multi-feature combination[J].Journal of Image and Graphics,2017,22(4):532-541.
[48] YIN W B,WANG C B,YUAN C,et al.A Method of Aircraft Recognition in Remote Sensing Images[J].Bulletin of Surveying and Mapping,2017(3):34-37.
[49] ZHANG S,WEN L,BIAN X,et al.Single-shot refinement neural network for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:4203-4212.
[50] YAO Q L,HU X,LEI H.Application of deep convolutional neural network in object detection[J].Computer Engineering and Applications,2018,54(17):1-9.

相关文章 15

[1]	徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺. 时序知识图谱表示学习 Temporal Knowledge Graph Representation Learning 计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[2]	饶志双, 贾真, 张凡, 李天瑞. 基于Key-Value关联记忆网络的知识图谱问答方法 Key-Value Relational Memory Networks for Question Answering over Knowledge Graph 计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[3]	冷典典, 杜鹏, 陈建廷, 向阳. 面向自动化集装箱码头的AGV行驶时间估计 Automated Container Terminal Oriented Travel Time Estimation of AGV 计算机科学, 2022, 49(9): 208-214. https://doi.org/10.11896/jsjkx.210700028
[4]	宁晗阳, 马苗, 杨波, 刘士昌. 密码学智能化研究进展与分析 Research Progress and Analysis on Intelligent Cryptology 计算机科学, 2022, 49(9): 288-296. https://doi.org/10.11896/jsjkx.220300053
[5]	汤凌韬, 王迪, 张鲁飞, 刘盛云. 基于安全多方计算和差分隐私的联邦学习方案 Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy 计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108
[6]	孙奇, 吉根林, 张杰. 基于非局部注意力生成对抗网络的视频异常事件检测方法 Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection 计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[7]	李瑶, 李涛, 李埼钒, 梁家瑞, Ibegbu Nnamdi JULIAN, 陈俊杰, 郭浩. 基于多尺度的稀疏脑功能超网络构建及多特征融合分类研究 Construction and Multi-feature Fusion Classification Research Based on Multi-scale Sparse Brain Functional Hyper-network 计算机科学, 2022, 49(8): 257-266. https://doi.org/10.11896/jsjkx.210600094
[8]	王剑, 彭雨琦, 赵宇斐, 杨健. 基于深度学习的社交网络舆情信息抽取方法综述 Survey of Social Network Public Opinion Information Extraction Based on Deep Learning 计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099
[9]	郝志荣, 陈龙, 黄嘉成. 面向文本分类的类别区分式通用对抗攻击方法 Class Discriminative Universal Adversarial Attack for Text Classification 计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[10]	姜梦函, 李邵梅, 郑洪浩, 张建朋. 基于改进位置编码的谣言检测模型 Rumor Detection Model Based on Improved Position Embedding 计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046
[11]	张光华, 高天娇, 陈振国, 于乃文. 基于N-Gram静态分析技术的恶意软件分类研究 Study on Malware Classification Based on N-Gram Static Analysis Technology 计算机科学, 2022, 49(8): 336-343. https://doi.org/10.11896/jsjkx.210900203
[12]	何强, 尹震宇, 黄敏, 王兴伟, 王源田, 崔硕, 赵勇. 基于大数据的进化网络影响力分析研究综述 Survey of Influence Analysis of Evolutionary Network Based on Big Data 计算机科学, 2022, 49(8): 1-11. https://doi.org/10.11896/jsjkx.210700240
[13]	侯钰涛, 阿布都克力木·阿布力孜, 哈里旦木·阿布都克里木. 中文预训练模型研究进展 Advances in Chinese Pre-training Models 计算机科学, 2022, 49(7): 148-163. https://doi.org/10.11896/jsjkx.211200018
[14]	周慧, 施皓晨, 屠要峰, 黄圣君. 基于主动采样的深度鲁棒神经网络学习 Robust Deep Neural Network Learning Based on Active Sampling 计算机科学, 2022, 49(7): 164-169. https://doi.org/10.11896/jsjkx.210600044
[15]	苏丹宁, 曹桂涛, 王燕楠, 王宏, 任赫. 小样本雷达辐射源识别的深度学习方法综述 Survey of Deep Learning for Radar Emitter Identification Based on Small Sample 计算机科学, 2022, 49(7): 226-235. https://doi.org/10.11896/jsjkx.210600138

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed