Computer Science ›› 2022, Vol. 49 ›› Issue (2): 116-122.doi: 10.11896/jsjkx.210700095

• Computer Vision: Theory and Application • Previous Articles     Next Articles

Study on Super-resolution Reconstruction Algorithm of Remote Sensing Images in Natural Scene

CHEN Gui-qiang, HE Jun   

  1. College of Computer Science,Sichuan University,Chengdu 610065,China
  • Received:2021-07-09 Revised:2021-10-15 Online:2022-02-15 Published:2022-02-23
  • About author:CHEN Gui-qiang,born in 1990,postgraduate,is a member of China Computer Federation.His main research interests include deep learning and computer vision.
    HE Jun,born in 1970,Ph.D,vice professor,postgraduate supervisor.His main research interests include computer network and intelligent control system.
  • Supported by:
    National Nature Science Foundation of China(U1836103) and Key Research and Development Projects of Science and Technology of Sichuan Province(18ZDYF2039).

Abstract: Due to the lack of paired datasets in the field of remote sensing image super-resolution reconstruction,current methods obtain low resolution images by bicubic interpolation,in which the degradation model is too idealized,resulting in unsatisfied reconstruction results in real low resolution remote sensing images situations.This paper proposes a super resolution reconstruction algorithm for real remote sensing images.For datasets that lack paired images,this paper builds a more reasonable degradation model,in which a prior of degradation in the imaging process (like blur,noise,down sampling,etc.) is randomly shuffled to generate realistic low-resolution images for training,simulating the generation process of low-resolution remote sensing images.Also,this paper improves a reconstruction algorithm based on generative adversarial networks(GAN) to enhance texture details by introducing attention mechanism.Experiments on UC Merced dataset show a promotion of 1.407 1 dB/0.067 2,0.821 1 dB/0.023 5 compared with ESRGAN and RCAN on the evaluation index of PSNR/SSIM,experiments on Alsat2B dataset promote 1.758 4 dB/0.048 5 compared with the baseline,which show the effective of the degradation model and reconstruction architecture.

Key words: Attention mechanism, Degradation, Generative adversarial network, Remote sensing, Super-resolution reconstruction

CLC Number: 

  • TP399
[1]DONG C,CHEN C L,HE K M,et al.Learning a deep convolu-tional network for image super-resolution[C]//Proceedings of 13th European Conference on Computer Vision.Springer,2014:184-199.
[2]KIM J W,LEE J K,LEE K M.Deeply-recursive convolutionalnetwork for image super-resolution[C]//29th IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2016:1637-1645.
[3]KIM J W,LEE J K,LEE K M.Accurate Image Super-Resolution Using Very Deep Convolutional Networks [C]//29th IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2016:1646-1654.
[4]LEDIG C,THEIS L,HUSZAR F,et al.Photo-realistic singleimage super-resolution using a generative adversarial network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2017:105-114.
[5]ZHANG Z Z,GAO K,LI W,et al.A Survey on the Optical Remote Sensing Image Super-resolution Technology[J].Space Recovery & Remote Sensing,2020,41(6):21-33.
[6]SU J M,YANG L X.Super Resolution of Single Frame Remote Sensing Image Based on Generative Adversarial Nets [J].Computer Engineering and Applications,2019,55(12):202-207,214.
[7]JIANG K,WANG Z Y,YI P,et al.GAN-based multi-level mapping network for satellite imagery super-resolution[C]//International Conference on Multimedia and Expo.IEEE,2019.
[8]RENG H F,ZHU H Q,TANG Y,et al.Multi-level FeatureSparse Representation Based Remote Sensing Image Classification[J].Journal of Chongqing University of Technology(Natural Science),2021,35(7):131-138.
[9]WANG Y,LI A,WANG S Q.Research on the Influence ofTraining Set on Automatic Target Recognition Under Super-Resolution of Remote Sensing Images[J].Journal of Chongqing University of Technology(Natural Science),2021,35(2):136-143.
[10]YANG Y,NEWSAM S D.Bag-of-visual-words and spatial extensions for land-use classification[C]//18th SIGSPATIAL International Conference Advance Geographic Information System.2010:270-279.
[11]ACHRAF D,KHELIFA D,MOUSSA S K,et al.A new public Alsat-2B dataset for single-image super-resolution[EB/OL].(2021-03-21)[2021-07-06].https://arxiv.org/abs/2103.12547.
[12]CAI J R,ZENG H,YONG H W,et al.Toward Real-World Single Image Super-Resolution:A New Benchmark and A New Model[C]//International Conference on Computer Vision.IEEE,2019:3086-3095.
[13]WEI P X,XIE Z W,LU H N,et al.Component Divide-and-Con-quer for Real-World Image Super-Resolution [C]//European Conference on Computer Vision.Springer,2020:101-117.
[14]YUAN Y,LIU S Y,ZHANG J W,et al.Unsupervised ImageSuper-Resolution Using Cycle-in-Cycle Generative Adversarial Networks[C]//Computer Society Conference on Computer Vision and Pattern Recognition Workshops.IEEE,2018:814-823.
[15]MANUEL F,GU S H,RADU T,et al.Frequency Separation forReal-World Super-Resolution[C]//Proceedings of the IEEE International Conference on Computer Vision.IEEE,2019:3599-3608.
[16]SEFI B K,ASSAF S,MICHAL I.Blind super-resolution kernelestimation using an internal-gan[C]//Advances in Neural Information Processing Systems.2019:284-293.
[17]JI X Z,CAO Y,TAI Y,et al.Real-World Super-Resolution via Kernel Estimation and Noise Injection [C]//Conference on Computer Vision and Pattern Recognition Workshops.IEEE,2020:1914-1923.
[18]ZHANG K,ZUO W M,ZHANG L.Learning a Single Convolutional Super-Resolution Network for Multiple Degradations[C]//Conference on Computer Vision and Pattern Recognition.IEEE,2018:3262-3271.
[19]GU J J,LU H N,ZUO W M,et al.Blind Super-Resolution With Iterative Kernel Correction[C]//Conference on Computer Vision and Pattern Recognition Workshops.IEEE,2019.
[20]ZHANG N,WANG Y C,ZHANG X,et al.A Multi-Degradation Aided Method for Unsupervised Remote Sensing Image Super Resolution With Convolution Neural Networks[J].IEEE Tran-sactions on Geoscience and Remote Sensing,2020.
[21]ZHU X,TALEBI H,SHI X W,et al.Super-resolution commercial satellite imagery using realistic training data[C]//International Conference on Image Processing.IEEE,2020:498-502.
[22]ZHANG K,LIANG J Y,GOOL L V,et al.Designing a Practical Degradation Model for Deep Blind Image Super-Resolution[EB/OL].(2021-03-25)[2021-07-06].https://arxiv.org/abs/2103.14006.
[23]TANG L,LIU L,SU J H.Modeling and Simulation Research of Infrared Image Noise[J].Infrared Technology,2014,36(7):542-548.
[24]GAO G,ZHANG J,LV X M,et al.Analysis of MultiplicativeNosie Models in SAR Imagery[J].Signal Precessing,2008,24(2):161-167.
[25]WANG X T,YU K,WU S X,et al.ESRGAN:Enhanced Super-Resolution Generative Adversarial Networks[C]//15th European Conference on Computer Vision.Verlag:Springer,2019:63-79.
[26]ZHANG Y L,LI K P,LI K,et al.Image Super-Resolution Using Very Deep Residual Channel Attention Networks[C]//the European Conference on Computer Vision.2018:286-301.
[27]LIM B,SON S,KIM H,et al.Enhanced deep residual networks for single image super-resolution [C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops.2017:136-144.
[28]LIU J,TANG J,WU G S.Residual feature distillation network for lightweight image super resolution[EB/OL].(2020-09-24)[2021-07-06].https://arxiv.org/abs/2009.11551.
[1] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[2] ZHANG Jia, DONG Shou-bin. Cross-domain Recommendation Based on Review Aspect-level User Preference Transfer [J]. Computer Science, 2022, 49(9): 41-47.
[3] ZHOU Fang-quan, CHENG Wei-qing. Sequence Recommendation Based on Global Enhanced Graph Neural Network [J]. Computer Science, 2022, 49(9): 55-63.
[4] DAI Yu, XU Lin-feng. Cross-image Text Reading Method Based on Text Line Matching [J]. Computer Science, 2022, 49(9): 139-145.
[5] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[6] XIONG Li-qin, CAO Lei, LAI Jun, CHEN Xi-liang. Overview of Multi-agent Deep Reinforcement Learning Based on Value Factorization [J]. Computer Science, 2022, 49(9): 172-182.
[7] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[8] WANG Ming, PENG Jian, HUANG Fei-hu. Multi-time Scale Spatial-Temporal Graph Neural Network for Traffic Flow Prediction [J]. Computer Science, 2022, 49(8): 40-48.
[9] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[10] WANG Kun-shu, ZHANG Ze-hui, GAO Tie-gang. Reversible Hidden Algorithm for Remote Sensing Images Based on Hachimoji DNA and QR Decomposition [J]. Computer Science, 2022, 49(8): 127-135.
[11] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[12] YAN Jia-dan, JIA Cai-yan. Text Classification Method Based on Information Fusion of Dual-graph Neural Network [J]. Computer Science, 2022, 49(8): 230-236.
[13] ZHANG Ying-tao, ZHANG Jie, ZHANG Rui, ZHANG Wen-qiang. Photorealistic Style Transfer Guided by Global Information [J]. Computer Science, 2022, 49(7): 100-105.
[14] ZENG Zhi-xian, CAO Jian-jun, WENG Nian-feng, JIANG Guo-quan, XU Bin. Fine-grained Semantic Association Video-Text Cross-modal Entity Resolution Based on Attention Mechanism [J]. Computer Science, 2022, 49(7): 106-112.
[15] DAI Zhao-xia, LI Jin-xin, ZHANG Xiang-dong, XU Xu, MEI Lin, ZHANG Liang. Super-resolution Reconstruction of MRI Based on DNGAN [J]. Computer Science, 2022, 49(7): 113-119.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!