计算机科学 ›› 2021, Vol. 48 ›› Issue (4): 174-179.doi: 10.11896/jsjkx.191200027

• 计算机图形学&多媒体 • 上一篇    下一篇

基于显著性特征和角度信息的遥感图像目标检测

袁星星, 吴秦   

  1. 江南大学人工智能与计算机学院 江苏 无锡214122;
    江南大学江苏省模式识别与计算智能工程实验室 江苏 无锡214122
  • 收稿日期:2020-06-24 修回日期:2020-05-15 出版日期:2021-04-15 发布日期:2021-04-09
  • 通讯作者: 吴秦(qinwu@jiangnan.edu.cn)
  • 基金资助:
    国家自然科学基金(61972180);江苏省自然科学基金(BK20181341)

Object Detection in Remote Sensing Images Based on Saliency Feature and Angle Information

YUAN Xing-xing, WU Qin   

  1. School of Artificial Intelligence and Computer Science,Jiangnan University,Wuxi,Jiangsu 214122,China
    Jiangsu Provincial Engineering Laboratory for Pattern Recognition and Computational Intelligence,Wuxi,Jiangsu 214122,China
  • Received:2020-06-24 Revised:2020-05-15 Online:2021-04-15 Published:2021-04-09
  • About author:YUAN Xing-xing,born in 1994,postgraduate.Her main research interests include image processing and artificial intelligence.(6171914011@stu.jiangnan.edu.cn)
    WU Qin,born in 1978,Ph.D,associate professor.Her main research interests include computer vision and pattern recognition.
  • Supported by:
    National Natural Science Foundation of China(61972180) and Natural Science Foundation of Jiangsu Province of China(BK20181341).

摘要: 遥感图像中的目标具有密集性、多尺度和多角度等特性,这使得遥感图像多类别目标检测成为一项具有挑战性的课题。因此,文中提出了一种新的端到端的遥感图像目标检测框架。该框架通过提取显著性特征和不同卷积通道之间的相互关系来增强目标信息,抑制非目标信息,从而提高特征的表示能力。同时,在不增加模型参数的情况下,在卷积模块中添加多尺度特征模块来捕获更多的上下文信息。为了解决遥感图像中目标角度多变这一问题,该框架在区域建议网络中加入了角度信息,得到有角度的矩形候选框,并在训练过程中添加注意力损失函数来引导网络学习显著性特征。该框架在公开的遥感图像数据集上进行了相关验证,在水平任务框和方向任务框上的实验结果证明了所提方法的有效性。

关键词: 多尺度特征, 目标检测, 通道自学习, 显著性学习, 遥感图像

Abstract: Multi-class object detection of remote sensing images is a challenging subject since objects in remote sensing images are dense,multi-oriented and multi-scale.This paper presents a new framework for object detection in remote sensing images.The framework enhances object information,suppresses non-object information,and improves the ability of feature representation by extracting salient features and the relationship between different convolutional channels.Meanwhile,multi-scale features are added to the convolution module to capture more context information without adding extra parameters to the model.To solve the problem of variable object angle in rencote sensing image,we add angle information to the Region Proposal Network (RPN) to get oriented rectangular object proposals.In the training stage,the attention loss function is added to guide the significance of network learning.The proposed framework is validated on the public remote sensing image data set,and the experimental results on the horizontal boxes task and the oriented boxes task prove the effectiveness of the proposed method.

Key words: Channel self-learning, Multi-scale feature, Object detection, Remote sensing image, Saliency learning

中图分类号: 

  • TP391
[1] BLASCHKE T.Object based image analysis for remote sensing [J].Remote Sens,2010,65(1):2-16.
[2]BONTEMPS S,BOGAERT P,TITEUX N,et al.An object-based change detection method accounting for temporal depen-dencies in time series with medium to coarse spatial resolution [J].Remote Sensing of Environment,2008,112(6):3181-3191.
[3] CHEN S Z,WANG H,XU F,et al.Target classification using the deep convolutional networks for SAR images [J].IEEE Transaction on Geoscience and Remote Sensing,2016,54(8):4806-4817.
[4] ZHONG P,WANG R A.A multiple conditional random field’s ensemble frame work for urban area detection in remote sensing optical images [J].IEEE Transaction on Geoscience and Remote Sensing,2007,45(12):3978-3988.
[5] STANKOV K,HE D C.Detection of buildings in multispectral very high spatial resolution images using the percentage occupancy hit-or-miss transform[J].Remote Sens,2014,7(10):4069-4080.
[6] WEN X,SHAO L,FANG W,et al.Efficient feature selection and classification for vehicle detection [J].IEEE Trans.Circuits Syst.Video Technol,2015,25(3):508-517.
[7] LINE E,LARS A,HANS K.Classification-based vehicle detection in high resolution satellite images [J].ISPRS J.Photogrammetry.Remote Sens,2009,64(5):65-72.
[8] LIU L,SHI Z.Airplane detection based on rotation invariant and sparse coding in remote sensing ima-ges[J].Optik-International Journal for Light and Electron Optics,2014,125(18):5327-5333.
[9] XU Z,XU X,WANG L,et al.Deformable convnet with aspect ratio constrained NMS for object detection in remote sensing imagery[J].Remote Sensing,2017,9(12):1312.
[10]GIRSHICK R,DONAHUE J,DARRELL T,et al.Region-based convolutional networks for accurate object detection and segmentation [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2016,38(1):142-158.
[11]REN S,HE K,GIRSHICK R,et al.Faster R-CNN:Towards Real-Time Object Detection with Region Proposal Networks [J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2017,39(6):1137-1149.
[12]REN S,HE K,GIRSHICK R,et al.Faster r-cnn:Towards real-time object detection with region proposal networks [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,39(6):1137-1149.
[13]REDMON J,DIVVALA S,GIRSHICK R,et al.You only look once:Unified real-time object detection[C]//Proceeding of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2016:779-788.
[14]LIU W,ANGUELOV D,ERHAN D,et al.SSD:Single Shot Multi Box Detector[C]//Proceeding of the 14th European Conference on Computer Vision.New York,2016:21-37.
[15]XIA G S,BAI X,DING J,et al.Dota:A large-scale dataset for object detection in aerial images[C]//2018 IEEE/CVF Confe-rence on Computer Vision and Pattern Recognition.2018.
[16]HAN X,ZHONG Y,ZHANG L.An efficient and robust integrated geospatial object detection framework for high spatial resolution remote sensing imagery [J].Remote Sensing,2017,9(7):666.
[17]GUO W,YANG W,ZHANG H J,et al.Geospatial object detection in high resolution satellite images based on multi-scale convolutional neural network [J].Remote Sensing,2018,10(1):131.
[18]HU J,SHEN L,ALBANIE S,et al.Squeeze-and-excitation networks [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2018:42(8):99.
[19]WANG J,YUAN Y,YU G.Face attention network:An effective face detector for the occluded faces[J].arXiv:1711.07246,2017.
[20]TANG T,ZHOU S,DENG Z,et al.Arbitrary oriented vehicle detection in aerial imagery with single convolutional neural networks [J].Remote Sensing,2017,9(11):1170.
[21]DAI J,LI Y,HE K,SUN J.R-FCN:object detection via region-based fully convolutional networks[C]//Advances in Neural Information Processing Systems 29.Cambridge:The MIT Press,2016:379-387.
[1] 王坤姝, 张泽辉, 高铁杠.
基于Hachimoji DNA和QR分解的遥感图像可逆隐藏算法
Reversible Hidden Algorithm for Remote Sensing Images Based on Hachimoji DNA and QR Decomposition
计算机科学, 2022, 49(8): 127-135. https://doi.org/10.11896/jsjkx.210700216
[2] 刘冬梅, 徐洋, 吴泽彬, 刘倩, 宋斌, 韦志辉.
基于边框距离度量的增量目标检测方法
Incremental Object Detection Method Based on Border Distance Measurement
计算机科学, 2022, 49(8): 136-142. https://doi.org/10.11896/jsjkx.220100132
[3] 王灿, 刘永坚, 解庆, 马艳春.
基于软标签和样本权重优化的Anchor Free目标检测算法
Anchor Free Object Detection Algorithm Based on Soft Label and Sample Weight Optimization
计算机科学, 2022, 49(8): 157-164. https://doi.org/10.11896/jsjkx.210600240
[4] 孙福权, 崔志清, 邹彭, 张琨.
基于多尺度特征的脑肿瘤分割算法
Brain Tumor Segmentation Algorithm Based on Multi-scale Features
计算机科学, 2022, 49(6A): 12-16. https://doi.org/10.11896/jsjkx.210700217
[5] 祝文韬, 兰先超, 罗唤霖, 岳彬, 汪洋.
改进Faster R-CNN的光学遥感飞机目标检测
Remote Sensing Aircraft Target Detection Based on Improved Faster R-CNN
计算机科学, 2022, 49(6A): 378-383. https://doi.org/10.11896/jsjkx.210300121
[6] 马宾, 付永康, 王春鹏, 李健, 王玉立.
基于GDIoU损失函数的YOLOv4绝缘子高效定位算法
High Performance Insulators Location Scheme Based on YOLOv4 with GDIoU Loss Function
计算机科学, 2022, 49(6A): 412-417. https://doi.org/10.11896/jsjkx.210600089
[7] 陈永平, 朱建清, 谢懿, 吴含笑, 曾焕强.
基于外接圆半径差损失的实时安全帽检测算法
Real-time Helmet Detection Algorithm Based on Circumcircle Radius Difference Loss
计算机科学, 2022, 49(6A): 424-428. https://doi.org/10.11896/jsjkx.220100252
[8] 陈佳舟, 赵熠波, 徐阳辉, 马骥, 金灵枫, 秦绪佳.
三维城市场景中的小物体检测
Small Object Detection in 3D Urban Scenes
计算机科学, 2022, 49(6): 238-244. https://doi.org/10.11896/jsjkx.210400174
[9] 胡伏原, 万新军, 沈鸣飞, 徐江浪, 姚睿, 陶重犇.
深度卷积神经网络图像实例分割方法研究进展
Survey Progress on Image Instance Segmentation Methods of Deep Convolutional Neural Network
计算机科学, 2022, 49(5): 10-24. https://doi.org/10.11896/jsjkx.210200038
[10] 范新南, 赵忠鑫, 严炜, 严锡君, 史朋飞.
结合注意力机制的多尺度特征融合图像去雾算法
Multi-scale Feature Fusion Image Dehazing Algorithm Combined with Attention Mechanism
计算机科学, 2022, 49(5): 50-57. https://doi.org/10.11896/jsjkx.210400093
[11] 徐涛, 陈奕仁, 吕宗磊.
基于改进YOLOv3的机坪工作人员反光背心检测研究
Study on Reflective Vest Detection for Apron Workers Based on Improved YOLOv3 Algorithm
计算机科学, 2022, 49(4): 239-246. https://doi.org/10.11896/jsjkx.210200119
[12] 张侣, 周博文, 吴亮红.
基于改进卷积注意力模块与残差结构的SSD网络
SSD Network Based on Improved Convolutional Attention Module and Residual Structure
计算机科学, 2022, 49(3): 211-217. https://doi.org/10.11896/jsjkx.201200019
[13] 陈贵强, 何军.
自然场景下遥感图像超分辨率重建算法研究
Study on Super-resolution Reconstruction Algorithm of Remote Sensing Images in Natural Scene
计算机科学, 2022, 49(2): 116-122. https://doi.org/10.11896/jsjkx.210700095
[14] 赫晓慧, 邱芳冰, 程淅杰, 田智慧, 周广胜.
基于边缘特征融合的高分影像建筑物目标检测
High-resolution Image Building Target Detection Based on Edge Feature Fusion
计算机科学, 2021, 48(9): 140-145. https://doi.org/10.11896/jsjkx.200800002
[15] 袁磊, 刘紫燕, 朱明成, 马珊珊, 陈霖周廷.
融合改进密集连接和分布排序损失的遥感图像检测
Improved YOLOv3 Remote Sensing Target Detection Based on Improved Dense Connection and Distributional Ranking Loss
计算机科学, 2021, 48(9): 168-173. https://doi.org/10.11896/jsjkx.200800001
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!