Computer Science ›› 2024, Vol. 51 ›› Issue (6A): 230700166-7.doi: 10.11896/jsjkx.230700166

• Image Processing & Multimedia Technolog • Previous Articles     Next Articles

Ships Detection in Remote Sensing Images Based on Improved FCOS

CHEN Tianpeng, HU Jianwen   

  1. School of Electrical and Information Engineering,Changsha University of Science and Technology,Changsha 410114,China
  • Published:2024-06-06
  • About author:CHEN Tianpeng,born in 1996,postgraduate.His main research interests include deep learning and object detection in remote sensing images.
    HU Jianwen,born in 1985,Ph.D,postgraduate supervisor.His main research interests include artificial intelligence, computer vision and machine learning.
  • Supported by:
    National Natural Science Foundation of China(62271087),Natural Science Foundation of Hunan Province,China(2021JJ40609),Research Project of Hunan Provincial Department of Education(21B0330)and Natural Science Foundation of Changsha(kq2208403).

Abstract: Ships in remote sensing images are arranged in arbitrary directions.The general target detection algorithm based on deep learning use horizontal bounding box to locate object,which will select a large number of backgrounds when detecting ships.The ships detection performance based on general object detection method is not good.An improved ships detection algorithm based on fully convolutional one-stage(FCOS) object detection network is proposed.Taking FCOS as the baseline,an offset regression branch is added to detection head,and a rotating bounding box is generated by shifting the upper midpoint and the right midpoint of the horizontal bounding box.The ships usually have high aspect ratio,and the angle deviation between the predicted bounding box and the real bounding box has a great influence on the intersection over union(IoU),which damages the detection accuracy of the model.In order to solve this problem,a weighting factor related to the aspect ratio of ships is introduced to calculate the offset loss,so that the target with a large aspect ratio can obtain relatively large offset loss.The proposed method and several mainstream rotating target detection algorithms are tested on HRSC2016 dataset.The results show that the average accuracy of the proposed method is 89.00% and the detection speed is 19.8FPS.Compared with the same type of algorithms without anchor,the proposed method has superior detection speed and accuracy.

Key words: Remote sensing image, Ships detection, FCOS, Anchor-free algorithm, Offset branch

CLC Number: 

  • TP391
[1]ZHU Y,FANG G S,ZHENG B B,et al.Research on detection method of refined rotated boxes in remote sensing[J].Acta Automatica Sinica,2023,49(2):415-424.
[2]DING J,XUE N,XIA G S,et al.Object detection in aerial images:A large-scale benchmark and challenges[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2021,44(11):7778-7796.
[3]ZHANG Z,YI H H,ZHENG J.Focusing on small objects detector in aerial images[J].Acta Electronica Sinica,2023,51:994.
[4]YANG X,SUN H,FU K,et al.Automatic ship detection in remote sensing images from google earth of complex scenes based on multiscale rotation dense feature pyramid networks[J].Remote Sensing,2018,10(1):132.
[5]SONG Z N,LI S,YANG J M,XU C.Remote sensing ship target detection based on feature and region localization enhancement[J/OL].Computer Engineering,2023,49(8):257-264.
[6]FU J,LIU J,TIAN H,et al.Dual attention network for scene segmentation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:3146-3154.
[7]ZHOU G Q,HUANG L,SUN Q.Fine-grained detection method for remote sensing ship targets with improved Oriented R-CNN[J].Computer Engineering and Applications,2022,44(6):1823-1832.
[8]ZHANG T,YANG X G,LU X Q,et al.Ship detection in remote sensing image based on dense RFB and LSTM[J].National Remote Sensing Bulletin,2022,26(9):1859-1871.
[9]JIAO J F,JING W,XIONG X.SAR images nearshore ship detection based on RetinaNet algorithm with rotated Rectangular box[J].Journal of Geomatics Science and Technology,2020,37(6):603-609.
[10]ZHAO Y,ZHAO L,XIONG B,et al.Attention receptive pyramid network for ship detection in SAR images[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2020,13:2738-2756.
[11]SHAO Z K,ZHANG X L,ZHANG T W,et al.A SAR ship detection method based on adaptive anchor and scale enhancement[J].Systems Engineering and Electronics,2024,46(4):1204-1211.
[12]WANG H Y,WANG C P,FU Q,et al.Ship detection based on lightweight optical remote sensing images for embedded platform[J].Acta Optica Sinica,2023,43(12):121-134.
[13]BUKHSH Z A,JANSEN N,SAEED A.Damage detection using in-domain and cross-domain transfer learning[J].Neural Computing and Applications,2021,33(24):16921-16936.
[14]LIU X B,XIAO X,WANG L,et al.Anchor-free based object detection methods and its application progress in complex scenes[J].Acta Automatica Sinica,2022,48(x):1-23.
[15]TIAN Z,SHEN C,CHEN H,et al.Fcos:Fully convolutional one-stage object detection[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2019:9627-9636.
[16]LIU S,ZHANG L,LU H,et al.Center-boundary dual attention for oriented object detection in remote sensing images[J].IEEE Transactions on Geoscience and Remote Sensing,2021,60:1-14.
[17]HE K,ZHANG X,REN S,et al.Deep residual learning forimage recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:770-778.
[18]LIN T Y,DOLLAR P,GIRSHICK R,et al.Feature pyramidnetworks for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:2117-2125.
[19]YU J,JIANG Y,WANG Z,et al.Unitbox:An advanced object detection network[C]//Proceedings of the 24th ACM International Conference on Multimedia.2016:516-520.
[20]REZATOFIGHI H,TSOI N,GWAK J Y,et al.Generalized intersection over union:A metric and a loss for bounding box regression[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:658-666.
[21]ZHENG Z,WANG P,LIU W,et al.Distance-IoU loss:Fasterand better learning for bounding box regression[C]//Procee-dings of the AAAI Conference on Artificial Intelligence.2020,34(7):12993-13000.
[22]NEUBECK A,VAN GOOL L.Efficient non-maximum suppression[C]//18th International Conference on Pattern Recognition(ICPR’06).IEEE,2006,3:850-855.
[23]LIN T Y,GOYAL P,GIRSHICK R,et al.Focal loss for dense object detection[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:2980-2988.
[24]GIRSHICK R.Fast r-cnn[C]//Proceedings of the IEEE International Conference on Computer Vision.2015:1440-1448.
[25]LIU Z,YUAN L,WENG L,et al.A high resolution optical sa-tellite image dataset for ship recognition and some new baselines[C]//ICPRAM.2017:324-331.
[26]LI W,CHEN Y,HU K,et al.Oriented reppoints for aerial object detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2022:1829-1838.
[27]ZHOU Y,YANG X,ZHANG G,et al.Mmrotate:A rotated object detection benchmark using pytorch[C]//Proceedings of the 30th ACM International Conference on Multimedia.2022:7331-7334.
[28]GAO L,GAO H,WANG Y,et al.Center-ness and repulsion:Constraints to improve remote sensing object detection via reppoints[J].Remote Sensing,2023,15(6):1479.
[29]GUO Z,LIU C,ZHANG X,et al.Beyond bounding-box:Con-vex-hull feature adaptation for oriented and densely packed object detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:8792-8801.
[30]CHEN K,WANG J,PANG J,et al.MMDetection:Open mmlab detection toolbox and benchmark[J].arXiv:1906.07155,2019.
[31]YANG X,YAN J.On the arbitrary-oriented object detection:Classification based approaches revisited[J].International Journal of Computer Vision,2022,130(5):1340-1365.
[1] HOU Linhao, LIU Fan. Remote Sensing Image Fusion Combining Multi-scale Convolution Blocks and Dense Convolution Blocks [J]. Computer Science, 2024, 51(6A): 230400110-6.
[2] HE Xinyu, LU Chenxin, FENG Shuyi, OUYANG Shangrong, MU Wentao. Ship Detection and Recognition of Optical Remote Sensing Images for Embedded Platform [J]. Computer Science, 2024, 51(6A): 230700117-7.
[3] ZHANG Yang, XIA Ying. Object Detection Method with Multi-scale Feature Fusion for Remote Sensing Images [J]. Computer Science, 2024, 51(3): 165-173.
[4] LI Yu, YANG Xiangli, ZHANG Le, LIANG Yalin, GAO Xian, YANG Jianxi. Combined Road Segmentation and Contour Extraction for Remote Sensing Images Based on Cascaded U-Net [J]. Computer Science, 2024, 51(3): 174-182.
[5] LIU Changxin, WU Ning, HU Lirui, GAO Ba, GAO Xueshan. Recursive Gated Convolution Based Super-resolution Network for Remote Sensing Images [J]. Computer Science, 2024, 51(2): 205-216.
[6] YAN Yan, SUI Yi, SI Jianwei. Remote Sensing Image Pan-sharpening Method Based on Generative Adversarial Network [J]. Computer Science, 2023, 50(8): 133-141.
[7] GU Yuhang, HAO Jie, CHEN Bing. Semi-supervised Semantic Segmentation for High-resolution Remote Sensing Images Based on DataFusion [J]. Computer Science, 2023, 50(6A): 220500001-6.
[8] YANG Xing, SONG Lingling, WANG Shihui. Remote Sensing Image Classification Based on Improved ResNeXt Network Structure [J]. Computer Science, 2023, 50(6A): 220100158-6.
[9] LI Tao, WANG Hairui. Remote Sensing Image Change Detection of Construction Land Based on Siamese AttentionNetwork [J]. Computer Science, 2023, 50(6A): 220500040-5.
[10] HU Shaokai, HE Xiaohui, TIAN Zhihui. Land Use Multi-classification Method of High Resolution Remote Sensing Images Based on MLUM-Net [J]. Computer Science, 2023, 50(5): 161-169.
[11] LI Tao, WANG Hairui, ZHU Guifu. Detection of Farmland Change Based on Unified Attention Fusion Network [J]. Computer Science, 2023, 50(11A): 221100060-6.
[12] WANG Kun-shu, ZHANG Ze-hui, GAO Tie-gang. Reversible Hidden Algorithm for Remote Sensing Images Based on Hachimoji DNA and QR Decomposition [J]. Computer Science, 2022, 49(8): 127-135.
[13] ZHU Wen-tao, LAN Xian-chao, LUO Huan-lin, YUE Bing, WANG Yang. Remote Sensing Aircraft Target Detection Based on Improved Faster R-CNN [J]. Computer Science, 2022, 49(6A): 378-383.
[14] YUAN Lei, LIU Zi-yan, ZHU Ming-cheng, MA Shan-shan, CHEN Lin-zhou-ting. Improved YOLOv3 Remote Sensing Target Detection Based on Improved Dense Connection and Distributional Ranking Loss [J]. Computer Science, 2021, 48(9): 168-173.
[15] WANG Shi-yun, YANG Fan. Remote Sensing Image Semantic Segmentation Method Based on U-Net Feature Fusion Optimization Strategy [J]. Computer Science, 2021, 48(8): 162-168.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!