Computer Science ›› 2021, Vol. 48 ›› Issue (6A): 80-84.doi: 10.11896/jsjkx.200700185

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Augmentation Technology of Remote Sensing Dataset Based on Improved DCGAN Algorithm

ZHANG Man, LI Jie, ZHU Xin-zhong, SHEN Ji, CHENG Hao-tian   

  1. Shanghai Aerospace Electronics Technology Research Institute,Shanghai 201109,China
  • Online:2021-06-10 Published:2021-06-17
  • About author:ZHANG Man,born in 1993,master's.Her main research interests include image processing and remote sensing application.

Abstract: The scale of the remote sensing dataset is a crucial factor to object detection algorithm's performance based on deep learning technology.How to generate large number of labeled images by using a small amount of data has become a hot research topic.To solve the problem,we propose an augmenting method of remote sensing dataset based on improved DCGAN algorithm using the secondary mask technology.In addition,the algorithmproposed in this paper can realize the amplification of images and labels by determining the number and location of targets to be generated,to solve the problem of no corresponding label generation in GAN-based image augmentation algorithm.Moreover,a multi-scale feature fusion technique for optimizing DCGAN algorithm is proposed to solve the problem of poor image quality generated by DCGAN algorithm.Experiments show that the improved DCGAN algorithm is superior to the DCGAN algorithm on both MNIST and PlANE datasets in terms of image quality and image diversity.The AP value of the dataset expanded based on the method we arranged is up to 84.45% in the design experiment using the Tiny-YoloV2 algorithm.Compared with the unaugmented algorithm and the traditional augmented method,the AP value of the method adopted in this paper is increased by 16.05% and 2.88% respectively,which fully verifies the effectiveness of the the technical scheme designed in this paper.

Key words: Augmentation of dataset, DCGAN, Feature fusion, Multi-feature map, Object detection, Remote sensing images

CLC Number: 

  • TP751
[1] LECLERC M,THARMARASA R,FLOREA M C,et al.Ship Classification Using Deep Learning Techniques for Maritime Target Tracking[C]//2018 21st International Conference on Information Fusion(FUSION).IEEE,2018:737-744.
[2] GIRSHICK R.Fast r-cnn[C]//Proceedings of the IEEE Internat Ional Conference on Computer Vision.2015:1440-1448.
[3] LIU W,ANGUELOV D,ERHAN D,et al.SSD:Single shotmultibox detector[C]//European Conference on Computer Vision.Cham:Springer,2016:21-37.
[4] REDMON J,DIVVALA S,GIRSHICK R,et al.You only look once:Unif ied,real-time object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:779-788.
[5] LONG J,SHELHAMER E,DARRELL T.Fully convolutionanetworks for semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:3431-3440.
[6] HINTON G E,OSINDERO S,THE Y W.A fast learning algorithm for deep belief nets [J].Neural Computation,2014,18(7):1527-1554.
[7] CHATFIELD K,SIMONYAN K,VEDALDI A,et al.Return of the devil in the details:delving deep into convolutional nets [EB/OL] [2019-01-10].
[8] RAITOHARJU J,RIABCHENKO E,MEISSNER K,et al.Data enrichment in fine-grained classification of aquatic macroinverte-brates [C]//Proceedings of the ICPR 2nd Workshop on Computer Vision for Analysis of Underwater Imagery.Washington,DC:IEEE Computer Society,2016:43-48.
[9] GOODFELLOW I J,POUGET-ABADIE J,MIRZA M,et al.Generative adversarial nets[C]//Proceedings of the 27th International Conference on Neural Information Processing Systems.Montreal Quebec,Canada,2014:2672-2680.
[10] RADFORD A,METZ L,CHINTALA S.Unsupervised representation learning with deep convolutional generative adversarial networks[J].arXiv:1511.06434,2015.
[11] ZEILER M D,KRISHNAN D,TAYLOR G W,et al.Deconvolutional networks[C]//2010 IEEE Conference on Computer Vision and Pattern Recognition(CVPR).IEEE,2010:2528-2535.
[12] RATLIFFL J,BURDEN S A,SASTRYS S,et al.Characteriza-tion and Computation of Local Nash Equilibria in Continuous Games[C]//Proceedings of the 51st Annual Allerton Conference on Communication,Control,and Computing.Piscataway:IEEE Press,2013:917-924
[13] XIA G S,BAI X.DOTA:A Large-scale Dataset for Object Detection in Aerial Images[C]//IEEE Conference on Computer Vision and Pattern Recogniton.2018
[14] SZEGEDY C,LIU W,JIA Y,et al.Going deeper with convolutions [C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2015:1-9.
[15] HE K,ZHANG X,REN S,et al.Deep Residual Learning forImage Recognition[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition(CVPR).2016.
[1] WANG Kun-shu, ZHANG Ze-hui, GAO Tie-gang. Reversible Hidden Algorithm for Remote Sensing Images Based on Hachimoji DNA and QR Decomposition [J]. Computer Science, 2022, 49(8): 127-135.
[2] LIU Dong-mei, XU Yang, WU Ze-bin, LIU Qian, SONG Bin, WEI Zhi-hui. Incremental Object Detection Method Based on Border Distance Measurement [J]. Computer Science, 2022, 49(8): 136-142.
[3] WANG Can, LIU Yong-jian, XIE Qing, MA Yan-chun. Anchor Free Object Detection Algorithm Based on Soft Label and Sample Weight Optimization [J]. Computer Science, 2022, 49(8): 157-164.
[4] ZHANG Ying-tao, ZHANG Jie, ZHANG Rui, ZHANG Wen-qiang. Photorealistic Style Transfer Guided by Global Information [J]. Computer Science, 2022, 49(7): 100-105.
[5] CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126.
[6] CHEN Yong-ping, ZHU Jian-qing, XIE Yi, WU Han-xiao, ZENG Huan-qiang. Real-time Helmet Detection Algorithm Based on Circumcircle Radius Difference Loss [J]. Computer Science, 2022, 49(6A): 424-428.
[7] SUN Jie-qi, LI Ya-feng, ZHANG Wen-bo, LIU Peng-hui. Dual-field Feature Fusion Deep Convolutional Neural Network Based on Discrete Wavelet Transformation [J]. Computer Science, 2022, 49(6A): 434-440.
[8] YU Shu-hao, ZHOU Hui, YE Chun-yang, WANG Tai-zheng. SDFA:Study on Ship Trajectory Clustering Method Based on Multi-feature Fusion [J]. Computer Science, 2022, 49(6A): 256-260.
[9] YANG Yue, FENG Tao, LIANG Hong, YANG Yang. Image Arbitrary Style Transfer via Criss-cross Attention [J]. Computer Science, 2022, 49(6A): 345-352.
[10] LAN Ling-xiang, CHI Ming-min. Remote Sensing Change Detection Based on Feature Fusion and Attention Network [J]. Computer Science, 2022, 49(6): 193-198.
[11] CHEN Jia-zhou, ZHAO Yi-bo, XU Yang-hui, MA Ji, JIN Ling-feng, QIN Xu-jia. Small Object Detection in 3D Urban Scenes [J]. Computer Science, 2022, 49(6): 238-244.
[12] LI Fa-guang, YILIHAMU·Yaermaimaiti. Real-time Detection Model of Insulator Defect Based on Improved CenterNet [J]. Computer Science, 2022, 49(5): 84-91.
[13] DONG Qi-da, WANG Zhe, WU Song-yang. Feature Fusion Framework Combining Attention Mechanism and Geometric Information [J]. Computer Science, 2022, 49(5): 129-134.
[14] LI Peng-zu, LI Yao, Ibegbu Nnamdi JULIAN, SUN Chao, GUO Hao, CHEN Jun-jie. Construction and Classification of Brain Function Hypernetwork Based on Overlapping Group Lasso with Multi-feature Fusion [J]. Computer Science, 2022, 49(5): 206-211.
[15] HU Fu-yuan, WAN Xin-jun, SHEN Ming-fei, XU Jiang-lang, YAO Rui, TAO Zhong-ben. Survey Progress on Image Instance Segmentation Methods of Deep Convolutional Neural Network [J]. Computer Science, 2022, 49(5): 10-24.
Full text



No Suggested Reading articles found!