Computer Science ›› 2020, Vol. 47 ›› Issue (3): 116-123.doi: 10.11896/jsjkx.190300102

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Review of Maritime Target Detection in Visible Bands of Optical Remote Sensing Images

LIU Jun-qi1,LI Zhi2,ZHANG Xue-yang2   

  1. (Graduate School, Space Engineering University, Beijing 101416, China)1;
    (Space Engineering University, Beijing 101416, China)2
  • Received:2019-03-21 Online:2020-03-15 Published:2020-03-30
  • About author:LIU Jun-qi,born in 1995,postgra-duate.His main research interests include object detection and artificial intelligence. LI Zhi,born in 1973,Ph.D,professor,Ph.D supervisor.His main research interests include space system application and so on.
  • Supported by:
    This work was supported by the Space Engineering University Youth Innovation Foundation (520613).

Abstract: Maritime target detection based on visible bands of optical remote sensing images is a research hotspot in the field of remote sensing.In order to promote the development of maritime target detection based on visible bands of optical remote sen-sing images,this paper summarized the current major methods.Firstly,this paper introduced the target characteristics of visible bands of optical remote sensing images and the basic process of image target detection,and analyzed the research status of remote sensing image target detection.Secondly,aiming at the problem of rapid detection of maritime target,this paper introduced the research status of visual saliency method in remote sensing image target detection.Thirdly,aiming at the problem of remote sensing image classification and recognition,this paper introduced the research status of convolutional neural network in remote sensing image target detection.Finally,this paper summarized the existing problems and future research directions of the current methods for maritime target detection.

Key words: Convolutional neural network, Image classification, Remote sensing image, Target detection, Visual saliency

CLC Number: 

  • TP391
[1]DigitalGlobe.World-class technology[EB/OL].[2019-02-23].http://worldview4.digitalglobe.com.
[2]ZHANG B.Intelligent remote sensing satellite system [J].Journal of Remote Sensing,2011,15(3):415-431.
[3]UIJLINGS J R R, VAN DE SANDE K E A,GEVERS T,et al.Selective search for object recognition[J].International journal of computer vision,2013,104(2):154-171.
[4]LOWE D G.Distinctive image features from scale-invariant keypoints [J].International journal of computer vision,2004,60(2):91-110.
[5]DALAL N,TRIGGS B.Histograms of oriented gradients for human detection[C]∥Proceedings of the Computer Vision and Pattern Recognition.2005.
[6]VIOLA P A,JONES M J.Rapid object detection using a boosted cascade of simple features[C]∥Proceedings of the Computer Vision and Pattern Recognition.2001.
[7]BURGES C J C.A tutorial on support vector machines for pattern recognition[J].Data mining and knowledge discovery,1998,2(2):121-167.
[8]QUINLAN J R.Induction on decision tree[J].Machine Lear- ning,1986,1(1):81-106.
[9]FLANDERS D,HALL-BEYER M,PEREVERZOFF J.Preliminary evaluation of eCognition object-based software for cut block delineation and feature extraction [J].Canadian Journal of Remote Sensing,2003,29(4):441-452.
[10]GUINDON B.Computer-based aerial image understanding:A review and assessment of its application to planimetric information extraction from very high resolution satellite images[J].Canadian journal of remote sensing,1997,23(1):38-47.
[11]OHTA Y I,KANADE T,SAKAI T.Color information for region segmentation [J].Computer graphics and image proces-sing,1980,13(3):222-241.
[12] PROIA N,PAGÉ V.Characterization of a bayesian ship detection method in optical satellite images[J].IEEE Geoscience and Remote Sensing Letters,2010,7(2):226-230.
[13]HOU L,YIN D,Y X J.An automatic extraction method for buildings in remote sensing images[J].Computer Simulation,2006,23(4):184-187.
[14]XI X Q,WANG R S.An automatic recognition system for specific targets of remote sensing image[J].Remote Sensing Technology and Application,2000,15(3):179-183.
[15]GUO J.Research on visible bands of optical remote sensing images target detection and recognition method with context information [D].Changsha:National University of Defense Techno-logy,2014.
[16]HAN X W.Research on key technologies of typical target recognition in large-format visible bands of optical remote sensingimages [D].Harbin:Harbin Institute of Technology,2013.
[17]WU Y J.Research on aircraft target detection method in high-resolution visible bands of optical remote sensing images [D].Changsha:National University of Defense Technology,2015.
[18]GAO B,CHEN Z,LIU S S.Research on port ship target detection based on location prior information registration and visual significance [J].Computer and Digital Engineering,2018(4).
[19]MOUNTRAKIS G,IM J,OGOLE C.Support vector machines in remote sensing:A review[J].ISPRS Journal of Photogrammetry and Remote Sensing,2011,66(3):247-259.
[20]FU G,LIU C,ZHOU R,et al.Classification for High Resolution Remote Sensing Imagery Using a Fully Convolutional Network[J].Remote Sensing,2017,9(6):498.
[21]MASJEDI A,MAGHSOUDI Y,ZOEJ M J V.A novel contex- tual classifier based on SVM and MRF for remote sensing images[C]∥2015 IEEE International Geoscience and Remote Sen-sing Symposium (IGARSS).IEEE,2015:4368-4371.
[22]YOKOYA N,IWASAKI A.Object Detection Based on Sparse Representation and Hough Voting for Optical Remote Sensing Imagery [J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2015,8(5):2053-2062.
[23]LIU Z,HU J,WENG L,et al.Rotated region based CNN for ship detection[C]∥2017 IEEE International Conference on Ima-ge Processing (ICIP).IEEE,2018.
[24]CHEN C,GONG W,HU Y,et al.Learning Oriented Region-based Convolutional Neural Networks for Building Detection in Satellite Remote Sensing Images[J].The International Archives of Photogrammetry,Remote Sensing and Spatial Information Sciences,2017,42:461.
[25]CHEN Z,GAO X.An Improved Algorithm for Ship Target Detection in SAR Images Based on Faster R-CNN[C]∥2018 Ninth International Conference on Intelligent Control and Information Processing (ICICIP).IEEE,2018:39-43.
[26]YE Q,HUO H,ZHU T,et al.Harbor Detection in Large-Scale Remote Sensing Images Using Both Deep-Learned and Topolo-gical Structure Features[C]∥2017 10th International Sympo-sium on Computational Intelligence and Design (ISCID).IEEE,2017:218-222.
[27]DESIMONE R,DUNCAN J.Neural mechanisms of selective visual attention[J].Annual Review of Neuroscience,1995,18(1):193-222.
[28]ITTI L,KOCH C,NIEBUR E.A model of saliency-based visual attention for rapid scene analysis[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1998,20(11):1254-1259.
[29]HOU X,ZHANG L.Saliency detection:A spectral residual approach[C]∥IEEE Conference on Computer Vision and Pattern Recognition(CVPR’07).IEEE,2007:1-8.
[30]ACHANTA R,ESTRADA F,WILS P,et al.Salient region detection and segmentation[C]∥International Conference on Computer Vision Systems.Berlin:Springer,2008:66-75.
[31]HAREL J,KOCH C,PERONA P.Graph-based visual saliency[C]∥Advances in Neural Information Processing Systems.2007:545-552.
[32]GAO D,HAN S,VASCONCELOS N.Discriminant saliency,the detection of suspicious coincidences,and applications to visual recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2009,31(6):989-1005.
[33]GU E,WANG J,BADLER N I.Generating sequence of eye fixations using decision-theoretic attention model[C]∥International Workshop on Attention in Cognitive Systems.Berlin:Springer,2007:277-292.
[34]ZHANG L,TONG M H,MARKS T K,et al.SUN:A Bayesian framework for saliency using natural statistics [J].Journal of Vision,2008,8(7):32.
[35]YE Q G,ZHA X,LI H B.High resolution remote sensing image ship detection based on visual significance[J].Hydrographic Surveying and Charting,2018(4):48-52.
[36]SONG Z,SUI H,WANG Y.Automatic ship detection for optical satellite images based on visual attention model and LBP[C]∥2014 IEEE Workshop on Electronics,Computer and Applications (IWECA).IEEE,2014.
[37]SHI D,GUO Y,WAN L,et al.Fusing local texture description of saliency map and enhanced global statistics for ship scene detection[C]∥IEEE International Conference on Progress in Informatics & Computing.IEEE,2016.
[38]ZHU C,ZHOU H,WANG R,et al.A Novel Hierarchical Method of Ship Detection from Spaceborne Optical Image Based on Shape and Texture Features[J].IEEE Transactions on Geoscience and Remote Sensing,2010,48(9):3446-3456.
[39]WEN Q,LI L L,LIU Q J,et al.Artificial target region extraction in high-resolution remote sensing images based on visual significance and image segmentation[J].Acta Geodaetica et Cartographica Sinica,2013(6):831-837.
[40]LEI R,CHAOJIAN S,XIN R.Salient target detection method under sea surface environment based on multi-scale phase spectrum[C]∥2011 Seventh International Conference on Natural Computation (ICNC).IEEE,2011:977-981.
[41]XU F.Research on key techniques of maritime target detection in visible bands of optical remote sensing images[D].Beijing:University of Chinese Academy of Sciences,2013.
[42]JUBELIN G,KHENCHAF A.Multiscale algorithm for ship detection in mid,high and very high resolution optical imagery[C]∥2014 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).IEEE,2014:2289-2292.
[43]QI S,MA J,LIN J,et al.Unsupervised ship detection based on saliency and S-HOG descriptor from optical satellite images[J].IEEE Geoscience and Remote Sensing Letters,2015,12(7):1451-1455.
[44]MONROY R,LUTZ S,CHALASANI T,et al.Salnet360:Saliency maps for omni-directional images with cnn[J].Signal Processing:Image Communication,2018,69:26-34.
[45]MAMOGˇLU N,ZHANG C,SHMODA W,et al.Saliency detection by forward and backward cues in deep-CNN[C]∥2017 IEEE International Conference on Image Processing (ICIP).IEEE,2017:430-434.
[46]TANG Y,WU X.Saliency detection via combining region-level and pixel-level predictions with cnns[C]∥European Conference on Computer Vision.Springer,2016:809-825.
[47]LIU Y,CAI K,ZHANG M,et al.Target detection in remote sensing image based on saliency computation of spiking neural network[C]∥2018 IEEE International Geoscience and Remote Sensing Symposium.IEEE,2018:2865-2868.
[48]GIRSHICK R.Fast R-CNN[C]∥Proceedings of the IEEE International Conference on Computer Vision.2015:1440-1448.
[49]REN S,HE K,GIRSHICK R,et al.Faster R-CNN:towards real-time object detection with region proposal networks [J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2017(6):1137-1149.
[50]REDMON J,DIVVALA S,GIRSHICK R,et al.You only look once:Unified,real-time object detection[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:779-788.
[51]REDMON J,FARHADI A.YOLO9000:Better,Faster,Stronger[C]∥IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2017:6517-6525.
[52]REDMON J,FARHADI A.YOLOv3:An Incremental Improvement[J].arXiv:1804.02767.
[53]LIU W,ANGUELOV D,ERHAN D,et al.SSD:Single shot multibox detector[C]∥European Conference on Computer Vision.Springer,2016:21-37.
[54]PAN S J,YANG Q.A Survey on Transfer Learning[J].IEEE Transactions on Knowledge and Data Engineering,2010,22(10):1345-1359.
[55]WEISS K,KHOSHGOFTAAR T M,WANG D D.A survey of transfer learning[J].Journal of Big Data,2016,3(1):9.
[56]LECLERC M,THARMARASA R,FLOREA M C,et al.Ship Classification Using Deep Learning Techniques for Maritime Target Tracking[C]∥2018 21st International Conference on Information Fusion (FUSION).IEEE,2018:737-744.
[57]HUANG J,JIANG Z G,ZHANG H P,et al.Remote sensing image ship target detection based on convolutional neural network[J].Journal of Beijing University of Aeronautics and As-tronautics,2017,43(9):1841-1848.
[58]WANG J C,TAN X C,WANG Z H,et al.Research on remotesensing image target recognition method based on Faster R-CNN[J].Geo-Information Science,2018,20(10):1500-1508.
[59]YU Y,GONG Z,ZHONG P,et al.Unsupervised Representation Learning with Deep Convolutional Neural Network for Remote Sensing Images[C]∥International Conference on Image and Graphics.Springer,2017:97-108.
[60]HE K,GKIOXARI G,DOLLAR P,et al.Mask R-CNN[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence,2017,PP(99):1-1.
[61]WU J L,WANG G,LIANG S,et al.Research on ship target detection based on Mask R-CNN[J].Radio Engineering,2018(11):39-44.
[62]NIE S,JIANG Z,ZHANG H,et al.Inshore Ship Detection Based on Mask R-CNN[C]∥2018 IEEE International Geoscience and Remote Sensing Symposium.IEEE,2018:693-696.
[63]YUAN Z,GENG J,DAI T.Ship Detection from Remote Sensing Images Based on Deep Learning[C]∥International Conference on Geo-spatial Knowledge & Intelligence.Singapore:Springer,2017.
[64]Ma X,Li W,Shi Z.Attention-Based Convolutional Networks for Ship Detection in High-Resolution Remote Sensing Images[C]∥Chinese Conference on Pattern Recognition and Computer Vision.Springer,2018.
[65]HU G,YANG Z,HAN J,et al.Aircraft detection in remote sensing images based on saliency and convolution neuralnetwork[J].EURASIP Journal on Wireless Communications and Networking,2018,2018(1):26.
[66]ZHAO C H,ZHOU Y.Ship target detection and recognition based on the improved Faster R-CNN[J].Journal of Shenyang University,2018 (5):366-371,380.
[67]YANG X,SUN H,FU K,et al.Automatic ship detection in re- mote sensing images from google earth of complex scenes based on multiscale rotation dense feature pyramid networks[J].Remote Sensing,2018,10(1):132.
[68]PANG J,LI C,SHI J,et al.R2-CNN:Fast Tiny Object Detection in Large-Scale Remote Sensing Images[C]∥IEEE Transactions on Geoscience and Remote Sensing.2019:1-13.
[69]MAGGIORI E,TARABALKA Y,CHARPIAT G,et al.Fully convolutional neural networks for remote sensing image classification[C]∥2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).IEEE,2016:5071-5074.
[1] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[2] WU Hong-xin, HAN Meng, CHEN Zhi-qiang, ZHANG Xi-long, LI Mu-hang. Survey of Multi-label Classification Based on Supervised and Semi-supervised Learning [J]. Computer Science, 2022, 49(8): 12-25.
[3] CHEN Yong-quan, JIANG Ying. Analysis Method of APP User Behavior Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(8): 78-85.
[4] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[5] WANG Kun-shu, ZHANG Ze-hui, GAO Tie-gang. Reversible Hidden Algorithm for Remote Sensing Images Based on Hachimoji DNA and QR Decomposition [J]. Computer Science, 2022, 49(8): 127-135.
[6] DAI Zhao-xia, LI Jin-xin, ZHANG Xiang-dong, XU Xu, MEI Lin, ZHANG Liang. Super-resolution Reconstruction of MRI Based on DNGAN [J]. Computer Science, 2022, 49(7): 113-119.
[7] LIU Yue-hong, NIU Shao-hua, SHEN Xian-hao. Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(7): 127-131.
[8] XU Ming-ke, ZHANG Fan. Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition [J]. Computer Science, 2022, 49(7): 132-141.
[9] DU Li-jun, TANG Xi-lu, ZHOU Jiao, CHEN Yu-lan, CHENG Jian. Alzheimer's Disease Classification Method Based on Attention Mechanism and Multi-task Learning [J]. Computer Science, 2022, 49(6A): 60-65.
[10] WU Zi-bin, YAN Qiao. Projected Gradient Descent Algorithm with Momentum [J]. Computer Science, 2022, 49(6A): 178-183.
[11] ZHANG Jia-hao, LIU Feng, QI Jia-yin. Lightweight Micro-expression Recognition Architecture Based on Bottleneck Transformer [J]. Computer Science, 2022, 49(6A): 370-377.
[12] ZHU Wen-tao, LAN Xian-chao, LUO Huan-lin, YUE Bing, WANG Yang. Remote Sensing Aircraft Target Detection Based on Improved Faster R-CNN [J]. Computer Science, 2022, 49(6A): 378-383.
[13] WANG Jian-ming, CHEN Xiang-yu, YANG Zi-zhong, SHI Chen-yang, ZHANG Yu-hang, QIAN Zheng-kun. Influence of Different Data Augmentation Methods on Model Recognition Accuracy [J]. Computer Science, 2022, 49(6A): 418-423.
[14] SUN Jie-qi, LI Ya-feng, ZHANG Wen-bo, LIU Peng-hui. Dual-field Feature Fusion Deep Convolutional Neural Network Based on Discrete Wavelet Transformation [J]. Computer Science, 2022, 49(6A): 434-440.
[15] YANG Yue, FENG Tao, LIANG Hong, YANG Yang. Image Arbitrary Style Transfer via Criss-cross Attention [J]. Computer Science, 2022, 49(6A): 345-352.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!