可见光遥感图像海面目标检测技术综述

doi:10.11896/jsjkx.190300102

摘要/Abstract

摘要： 基于可见光遥感图像的海面目标检测技术是当前遥感领域的研究热点,为推进基于可见光遥感图像的海面目标检测技术的发展,文中对当前主要的检测方法进行了总结。首先,介绍了可见光遥感图像目标特性以及图像目标检测基本流程,并分析了遥感图像目标检测的研究现状;然后,针对海面目标快速检测问题,详细介绍了视觉显著性方法在遥感图像目标检测方面的研究现状;接着,针对遥感图像分类识别问题,详细介绍了卷积神经网络在遥感图像目标检测方面的研究现状;最后,总结了现有方法应用于海面目标检测存在的问题以及未来的研究方向。

关键词: 卷积神经网络, 目标检测, 视觉显著性, 图片分类, 遥感图像

Abstract: Maritime target detection based on visible bands of optical remote sensing images is a research hotspot in the field of remote sensing.In order to promote the development of maritime target detection based on visible bands of optical remote sen-sing images,this paper summarized the current major methods.Firstly,this paper introduced the target characteristics of visible bands of optical remote sensing images and the basic process of image target detection,and analyzed the research status of remote sensing image target detection.Secondly,aiming at the problem of rapid detection of maritime target,this paper introduced the research status of visual saliency method in remote sensing image target detection.Thirdly,aiming at the problem of remote sensing image classification and recognition,this paper introduced the research status of convolutional neural network in remote sensing image target detection.Finally,this paper summarized the existing problems and future research directions of the current methods for maritime target detection.

Key words: Convolutional neural network, Image classification, Remote sensing image, Target detection, Visual saliency

中图分类号:

TP391

刘俊琦,李智,张学阳. 可见光遥感图像海面目标检测技术综述[J]. 计算机科学, 2020, 47(3): 116-123. https://doi.org/10.11896/jsjkx.190300102

LIU Jun-qi,LI Zhi,ZHANG Xue-yang. Review of Maritime Target Detection in Visible Bands of Optical Remote Sensing Images[J]. Computer Science, 2020, 47(3): 116-123. https://doi.org/10.11896/jsjkx.190300102

参考文献

[1]DigitalGlobe.World-class technology[EB/OL].[2019-02-23].http://worldview4.digitalglobe.com.
[2]ZHANG B.Intelligent remote sensing satellite system [J].Journal of Remote Sensing,2011,15(3):415-431.
[3]UIJLINGS J R R, VAN DE SANDE K E A,GEVERS T,et al.Selective search for object recognition[J].International journal of computer vision,2013,104(2):154-171.
[4]LOWE D G.Distinctive image features from scale-invariant keypoints [J].International journal of computer vision,2004,60(2):91-110.
[5]DALAL N,TRIGGS B.Histograms of oriented gradients for human detection[C]∥Proceedings of the Computer Vision and Pattern Recognition.2005.
[6]VIOLA P A,JONES M J.Rapid object detection using a boosted cascade of simple features[C]∥Proceedings of the Computer Vision and Pattern Recognition.2001.
[7]BURGES C J C.A tutorial on support vector machines for pattern recognition[J].Data mining and knowledge discovery,1998,2(2):121-167.
[8]QUINLAN J R.Induction on decision tree[J].Machine Lear- ning,1986,1(1):81-106.
[9]FLANDERS D,HALL-BEYER M,PEREVERZOFF J.Preliminary evaluation of eCognition object-based software for cut block delineation and feature extraction [J].Canadian Journal of Remote Sensing,2003,29(4):441-452.
[10]GUINDON B.Computer-based aerial image understanding:A review and assessment of its application to planimetric information extraction from very high resolution satellite images[J].Canadian journal of remote sensing,1997,23(1):38-47.
[11]OHTA Y I,KANADE T,SAKAI T.Color information for region segmentation [J].Computer graphics and image proces-sing,1980,13(3):222-241.
[12] PROIA N,PAGÉ V.Characterization of a bayesian ship detection method in optical satellite images[J].IEEE Geoscience and Remote Sensing Letters,2010,7(2):226-230.
[13]HOU L,YIN D,Y X J.An automatic extraction method for buildings in remote sensing images[J].Computer Simulation,2006,23(4):184-187.
[14]XI X Q,WANG R S.An automatic recognition system for specific targets of remote sensing image[J].Remote Sensing Technology and Application,2000,15(3):179-183.
[15]GUO J.Research on visible bands of optical remote sensing images target detection and recognition method with context information [D].Changsha:National University of Defense Techno-logy,2014.
[16]HAN X W.Research on key technologies of typical target recognition in large-format visible bands of optical remote sensingimages [D].Harbin:Harbin Institute of Technology,2013.
[17]WU Y J.Research on aircraft target detection method in high-resolution visible bands of optical remote sensing images [D].Changsha:National University of Defense Technology,2015.
[18]GAO B,CHEN Z,LIU S S.Research on port ship target detection based on location prior information registration and visual significance [J].Computer and Digital Engineering,2018(4).
[19]MOUNTRAKIS G,IM J,OGOLE C.Support vector machines in remote sensing:A review[J].ISPRS Journal of Photogrammetry and Remote Sensing,2011,66(3):247-259.
[20]FU G,LIU C,ZHOU R,et al.Classification for High Resolution Remote Sensing Imagery Using a Fully Convolutional Network[J].Remote Sensing,2017,9(6):498.
[21]MASJEDI A,MAGHSOUDI Y,ZOEJ M J V.A novel contex- tual classifier based on SVM and MRF for remote sensing images[C]∥2015 IEEE International Geoscience and Remote Sen-sing Symposium (IGARSS).IEEE,2015:4368-4371.
[22]YOKOYA N,IWASAKI A.Object Detection Based on Sparse Representation and Hough Voting for Optical Remote Sensing Imagery [J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2015,8(5):2053-2062.
[23]LIU Z,HU J,WENG L,et al.Rotated region based CNN for ship detection[C]∥2017 IEEE International Conference on Ima-ge Processing (ICIP).IEEE,2018.
[24]CHEN C,GONG W,HU Y,et al.Learning Oriented Region-based Convolutional Neural Networks for Building Detection in Satellite Remote Sensing Images[J].The International Archives of Photogrammetry,Remote Sensing and Spatial Information Sciences,2017,42:461.
[25]CHEN Z,GAO X.An Improved Algorithm for Ship Target Detection in SAR Images Based on Faster R-CNN[C]∥2018 Ninth International Conference on Intelligent Control and Information Processing (ICICIP).IEEE,2018:39-43.
[26]YE Q,HUO H,ZHU T,et al.Harbor Detection in Large-Scale Remote Sensing Images Using Both Deep-Learned and Topolo-gical Structure Features[C]∥2017 10th International Sympo-sium on Computational Intelligence and Design (ISCID).IEEE,2017:218-222.
[27]DESIMONE R,DUNCAN J.Neural mechanisms of selective visual attention[J].Annual Review of Neuroscience,1995,18(1):193-222.
[28]ITTI L,KOCH C,NIEBUR E.A model of saliency-based visual attention for rapid scene analysis[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1998,20(11):1254-1259.
[29]HOU X,ZHANG L.Saliency detection:A spectral residual approach[C]∥IEEE Conference on Computer Vision and Pattern Recognition(CVPR’07).IEEE,2007:1-8.
[30]ACHANTA R,ESTRADA F,WILS P,et al.Salient region detection and segmentation[C]∥International Conference on Computer Vision Systems.Berlin:Springer,2008:66-75.
[31]HAREL J,KOCH C,PERONA P.Graph-based visual saliency[C]∥Advances in Neural Information Processing Systems.2007:545-552.
[32]GAO D,HAN S,VASCONCELOS N.Discriminant saliency,the detection of suspicious coincidences,and applications to visual recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2009,31(6):989-1005.
[33]GU E,WANG J,BADLER N I.Generating sequence of eye fixations using decision-theoretic attention model[C]∥International Workshop on Attention in Cognitive Systems.Berlin:Springer,2007:277-292.
[34]ZHANG L,TONG M H,MARKS T K,et al.SUN:A Bayesian framework for saliency using natural statistics [J].Journal of Vision,2008,8(7):32.
[35]YE Q G,ZHA X,LI H B.High resolution remote sensing image ship detection based on visual significance[J].Hydrographic Surveying and Charting,2018(4):48-52.
[36]SONG Z,SUI H,WANG Y.Automatic ship detection for optical satellite images based on visual attention model and LBP[C]∥2014 IEEE Workshop on Electronics,Computer and Applications (IWECA).IEEE,2014.
[37]SHI D,GUO Y,WAN L,et al.Fusing local texture description of saliency map and enhanced global statistics for ship scene detection[C]∥IEEE International Conference on Progress in Informatics & Computing.IEEE,2016.
[38]ZHU C,ZHOU H,WANG R,et al.A Novel Hierarchical Method of Ship Detection from Spaceborne Optical Image Based on Shape and Texture Features[J].IEEE Transactions on Geoscience and Remote Sensing,2010,48(9):3446-3456.
[39]WEN Q,LI L L,LIU Q J,et al.Artificial target region extraction in high-resolution remote sensing images based on visual significance and image segmentation[J].Acta Geodaetica et Cartographica Sinica,2013(6):831-837.
[40]LEI R,CHAOJIAN S,XIN R.Salient target detection method under sea surface environment based on multi-scale phase spectrum[C]∥2011 Seventh International Conference on Natural Computation (ICNC).IEEE,2011:977-981.
[41]XU F.Research on key techniques of maritime target detection in visible bands of optical remote sensing images[D].Beijing:University of Chinese Academy of Sciences,2013.
[42]JUBELIN G,KHENCHAF A.Multiscale algorithm for ship detection in mid,high and very high resolution optical imagery[C]∥2014 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).IEEE,2014:2289-2292.
[43]QI S,MA J,LIN J,et al.Unsupervised ship detection based on saliency and S-HOG descriptor from optical satellite images[J].IEEE Geoscience and Remote Sensing Letters,2015,12(7):1451-1455.
[44]MONROY R,LUTZ S,CHALASANI T,et al.Salnet360:Saliency maps for omni-directional images with cnn[J].Signal Processing:Image Communication,2018,69:26-34.
[45]MAMOGˇLU N,ZHANG C,SHMODA W,et al.Saliency detection by forward and backward cues in deep-CNN[C]∥2017 IEEE International Conference on Image Processing (ICIP).IEEE,2017:430-434.
[46]TANG Y,WU X.Saliency detection via combining region-level and pixel-level predictions with cnns[C]∥European Conference on Computer Vision.Springer,2016:809-825.
[47]LIU Y,CAI K,ZHANG M,et al.Target detection in remote sensing image based on saliency computation of spiking neural network[C]∥2018 IEEE International Geoscience and Remote Sensing Symposium.IEEE,2018:2865-2868.
[48]GIRSHICK R.Fast R-CNN[C]∥Proceedings of the IEEE International Conference on Computer Vision.2015:1440-1448.
[49]REN S,HE K,GIRSHICK R,et al.Faster R-CNN:towards real-time object detection with region proposal networks [J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2017(6):1137-1149.
[50]REDMON J,DIVVALA S,GIRSHICK R,et al.You only look once:Unified,real-time object detection[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:779-788.
[51]REDMON J,FARHADI A.YOLO9000:Better,Faster,Stronger[C]∥IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2017:6517-6525.
[52]REDMON J,FARHADI A.YOLOv3:An Incremental Improvement[J].arXiv:1804.02767.
[53]LIU W,ANGUELOV D,ERHAN D,et al.SSD:Single shot multibox detector[C]∥European Conference on Computer Vision.Springer,2016:21-37.
[54]PAN S J,YANG Q.A Survey on Transfer Learning[J].IEEE Transactions on Knowledge and Data Engineering,2010,22(10):1345-1359.
[55]WEISS K,KHOSHGOFTAAR T M,WANG D D.A survey of transfer learning[J].Journal of Big Data,2016,3(1):9.
[56]LECLERC M,THARMARASA R,FLOREA M C,et al.Ship Classification Using Deep Learning Techniques for Maritime Target Tracking[C]∥2018 21st International Conference on Information Fusion (FUSION).IEEE,2018:737-744.
[57]HUANG J,JIANG Z G,ZHANG H P,et al.Remote sensing image ship target detection based on convolutional neural network[J].Journal of Beijing University of Aeronautics and As-tronautics,2017,43(9):1841-1848.
[58]WANG J C,TAN X C,WANG Z H,et al.Research on remotesensing image target recognition method based on Faster R-CNN[J].Geo-Information Science,2018,20(10):1500-1508.
[59]YU Y,GONG Z,ZHONG P,et al.Unsupervised Representation Learning with Deep Convolutional Neural Network for Remote Sensing Images[C]∥International Conference on Image and Graphics.Springer,2017:97-108.
[60]HE K,GKIOXARI G,DOLLAR P,et al.Mask R-CNN[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence,2017,PP(99):1-1.
[61]WU J L,WANG G,LIANG S,et al.Research on ship target detection based on Mask R-CNN[J].Radio Engineering,2018(11):39-44.
[62]NIE S,JIANG Z,ZHANG H,et al.Inshore Ship Detection Based on Mask R-CNN[C]∥2018 IEEE International Geoscience and Remote Sensing Symposium.IEEE,2018:693-696.
[63]YUAN Z,GENG J,DAI T.Ship Detection from Remote Sensing Images Based on Deep Learning[C]∥International Conference on Geo-spatial Knowledge & Intelligence.Singapore:Springer,2017.
[64]Ma X,Li W,Shi Z.Attention-Based Convolutional Networks for Ship Detection in High-Resolution Remote Sensing Images[C]∥Chinese Conference on Pattern Recognition and Computer Vision.Springer,2018.
[65]HU G,YANG Z,HAN J,et al.Aircraft detection in remote sensing images based on saliency and convolution neuralnetwork[J].EURASIP Journal on Wireless Communications and Networking,2018,2018(1):26.
[66]ZHAO C H,ZHOU Y.Ship target detection and recognition based on the improved Faster R-CNN[J].Journal of Shenyang University,2018 (5):366-371,380.
[67]YANG X,SUN H,FU K,et al.Automatic ship detection in re- mote sensing images from google earth of complex scenes based on multiscale rotation dense feature pyramid networks[J].Remote Sensing,2018,10(1):132.
[68]PANG J,LI C,SHI J,et al.R2-CNN:Fast Tiny Object Detection in Large-Scale Remote Sensing Images[C]∥IEEE Transactions on Geoscience and Remote Sensing.2019:1-13.
[69]MAGGIORI E,TARABALKA Y,CHARPIAT G,et al.Fully convolutional neural networks for remote sensing image classification[C]∥2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).IEEE,2016:5071-5074.

相关文章 15

[1]	周乐员, 张剑华, 袁甜甜, 陈胜勇. 多层注意力机制融合的序列到序列中国连续手语识别和翻译 Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion 计算机科学, 2022, 49(9): 155-161. https://doi.org/10.11896/jsjkx.210800026
[2]	李宗民, 张玉鹏, 刘玉杰, 李华. 基于可变形图卷积的点云表征学习 Deformable Graph Convolutional Networks Based Point Cloud Representation Learning 计算机科学, 2022, 49(8): 273-278. https://doi.org/10.11896/jsjkx.210900023
[3]	陈泳全, 姜瑛. 基于卷积神经网络的APP用户行为分析方法 Analysis Method of APP User Behavior Based on Convolutional Neural Network 计算机科学, 2022, 49(8): 78-85. https://doi.org/10.11896/jsjkx.210700121
[4]	朱承璋, 黄嘉儿, 肖亚龙, 王晗, 邹北骥. 基于注意力机制的医学影像深度哈希检索算法 Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism 计算机科学, 2022, 49(8): 113-119. https://doi.org/10.11896/jsjkx.210700153
[5]	王坤姝, 张泽辉, 高铁杠. 基于Hachimoji DNA和QR分解的遥感图像可逆隐藏算法 Reversible Hidden Algorithm for Remote Sensing Images Based on Hachimoji DNA and QR Decomposition 计算机科学, 2022, 49(8): 127-135. https://doi.org/10.11896/jsjkx.210700216
[6]	刘冬梅, 徐洋, 吴泽彬, 刘倩, 宋斌, 韦志辉. 基于边框距离度量的增量目标检测方法 Incremental Object Detection Method Based on Border Distance Measurement 计算机科学, 2022, 49(8): 136-142. https://doi.org/10.11896/jsjkx.220100132
[7]	王灿, 刘永坚, 解庆, 马艳春. 基于软标签和样本权重优化的Anchor Free目标检测算法 Anchor Free Object Detection Algorithm Based on Soft Label and Sample Weight Optimization 计算机科学, 2022, 49(8): 157-164. https://doi.org/10.11896/jsjkx.210600240
[8]	檀莹莹, 王俊丽, 张超波. 基于图卷积神经网络的文本分类方法研究综述 Review of Text Classification Methods Based on Graph Convolutional Network 计算机科学, 2022, 49(8): 205-216. https://doi.org/10.11896/jsjkx.210800064
[9]	张颖涛, 张杰, 张睿, 张文强. 全局信息引导的真实图像风格迁移 Photorealistic Style Transfer Guided by Global Information 计算机科学, 2022, 49(7): 100-105. https://doi.org/10.11896/jsjkx.210600036
[10]	戴朝霞, 李锦欣, 张向东, 徐旭, 梅林, 张亮. 基于DNGAN的磁共振图像超分辨率重建算法 Super-resolution Reconstruction of MRI Based on DNGAN 计算机科学, 2022, 49(7): 113-119. https://doi.org/10.11896/jsjkx.210600105
[11]	刘月红, 牛少华, 神显豪. 基于卷积神经网络的虚拟现实视频帧内预测编码 Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network 计算机科学, 2022, 49(7): 127-131. https://doi.org/10.11896/jsjkx.211100179
[12]	徐鸣珂, 张帆. Head Fusion:一种提高语音情绪识别的准确性和鲁棒性的方法 Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition 计算机科学, 2022, 49(7): 132-141. https://doi.org/10.11896/jsjkx.210100085
[13]	金方焱, 王秀利. 融合RACNN和BiLSTM的金融领域事件隐式因果关系抽取 Implicit Causality Extraction of Financial Events Integrating RACNN and BiLSTM 计算机科学, 2022, 49(7): 179-186. https://doi.org/10.11896/jsjkx.210500190
[14]	杨玥, 冯涛, 梁虹, 杨扬. 融合交叉注意力机制的图像任意风格迁移 Image Arbitrary Style Transfer via Criss-cross Attention 计算机科学, 2022, 49(6A): 345-352. https://doi.org/10.11896/jsjkx.210700236
[15]	杨健楠, 张帆. 一种结合双注意力机制和层次网络结构的细碎农作物分类方法 Classification Method for Small Crops Combining Dual Attention Mechanisms and Hierarchical Network Structure 计算机科学, 2022, 49(6A): 353-357. https://doi.org/10.11896/jsjkx.210200169

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed