Computer Science

Computer Science ›› 2023, Vol. 50 ›› Issue (6A): 220600182-6.doi: 10.11896/jsjkx.220600182

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Combining Multi-focus Fusion and DSGEF Two-stage Network to Reconstruct Solar Speckle Image

JIN Yahui1, JIANG Murong1, LI Fuhai1, YANG Lei2, CHEN Junyi2   

  1. 1 School of Information Science and Engineering,Kunming 650500,China;
    2 Yunnan Observatories,Chinese Academy of Sciences,Kunming 650011,China
  • Online:2023-06-10 Published:2023-06-12
  • About author:JIN Yahui,born in 1996,postgraduate.His main research interests include image reconstruction and so on. JIANG Murong,born in 1963,professor.Her main research interests include mathematical method of image proces-sing and intelligent calculation.
  • Supported by:
    National Natural Science Foundation of China(11773073),Science and Technology Innovation Team Support Project of Yunnan Province(IRTSTYN) and Graduate Research Innovation Fund Project of Yunnan University(2021Y273).

PDF (PC)

207

Abstract: Because the solar speckle image has the characteristics of low contrast,similar structure of rice grains and small diffe-rence between frames,there are some problems such as insufficient high-frequency features and unrecoverable local details when using the existing reconstruction network for single frame deblurring.In this paper,a high-resolution reconstruction method of solar speckle image is proposed by combining multi-focus fusion and building gradient enhancement and FPN two-stage network.Firstly,the block-focused image fusion algorithm is performed to compensate for high-frequency details lost in the images by utilizing the complementary characteristics of similar information between sequence images.Secondly,a two-stage reconstruction network DSGEF is constructed based on the generative adversarial network(GAN),which combines gradient branches and structural feature branches to enhance high-frequency details,uses FPN network for multi-scale feature reconstruction to improve the definition of rice grain edges.Finally,a joint training loss including adversarial loss,pixel loss and perceptual loss is introduced to guide the network to implement high-resolution reconstruction of solar speckle images.Experimental results show that,compared with existing deep learning methods,the proposed method can significantly improve the image peak signal-to-noise ratio(PSNR) and structural similarity(SSIM) indicators,and can meet the requirements of high-resolution reconstruction of solar observation images.

Key words: Multi-focus integration, Two-stage network, Gradient enhancement, Solar speckle image, Image reconstruction

CLC Number: 

  • TP391.41
[1]CUI W H,JIANG M R,YANG L,et al.Combining McycleGAN and RFCNN to achieve high resolution reconstruction of solar speckle image[J].Computer Science,2021,48(6A):38-42.
[2]KUPYN O,MARTYNIUK T,WU J,et al.Deblurgan-v2:de-blurring(orders-of-magnitude) faster and better[C]//Procee-dings of the IEEE/CVF International Conference on Computer Vision.New York:IEEE Press,2019:8878-8887.
[3]NAH S,HYNU K T,MU L K.Deep multi-scale convolutional neural network for dynamic scene deblurring[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.New York:IEEE Press,2017:3883-3891.
[4]TAO X,GAO H,SHEN X,et al.Scale-recurrent network fordeep image deblurring[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. New York:IEEE Press,2018:8174-8182.
[5]LI F H,JANG M R,YANG L,et al.Gradient Guided Deblurring of Sun Speckle Images Based on Generative Adversarial Networks[J].Computer Applications,2021,41(11):3345-3352.
[6]REN Y H.Research on single-frame sun spot image reconstruction algorithm based on generative adversarial network[D].Yunnan:Yunnan University,2020.
[7]ZHU J Y,PARK T,ISOLA P,et al.Unpaired image to image translation using cycle consistent adversarial networks[C]//Proceedings of the IEEE International Conference on Computer Vision.New York:IEEE Press,2017:2223-2232.
[8]LIN T Y,DOLLAR P,GIRSHICK R,et al.Feature pyramidnetworks for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.New York:IEEE Press,2017:2117-2125.
[9]RAHMAN Z,JOBSON D J,WOODELL G A.Multiscale retinex for color image enhancement[C]//Proceedings of 3rd IEEE International Conference on Image Processing.New York:IEEE Press,1996:1003-1006.
[10]ZHANG J X,YANG H.Low-light color image enhancementbased on homomorphic high-low-pass filtering and multi-scale retinex[J].Computer Applications and Software,2021,38(1):678-684.
[11]HAGHIGHAT M B A,AGHAGOLZADEH A,SEYEDARABI H.Multi-focus image fusion for visual sensor networks in DCT domain[J].Computers & Electrical Engineering,2011,37(5):789-797.
[12]WANG X,YU K,WU S,et al.Esrgan:Enhanced super resolution generative adversarial networks[C]//Proceedings of the European Conference on Computer Vision(ECCV) Workshops.Germany:Springer Press,2018:984-990.
[13]ZHANG H,XU H,XIAO Y,et al.Rethinking the image fusion:a fast unified image fusion network based on proportional maintenance of gradient and intensity[C]//Proceedings of the AAAI Conference on Artificial Intelligence.New York:AAAI press,2020,12797-12804.
[14]JOLICOEU A.The relativistic discriminator:a key elementmissing from standard GAN.[EB/OL].(2018-09-10)[2021-12-10].https://arxiv.org/pdf/1807.00734.pdf.
[15]JOHNSON J,ALAHI A,FEI L.Perceptual losses for real time style transfer and super resolution[C]//European Conference on Computer Vision.Germany:Springer Press,2016:694-711.
[16]MA C,RAO Y,CHENG Y,et al.Structure preserving super resolution with gradient guidance[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.New York:IEEE Press,2020:7769-7778.
[17]SIMONYAN K,ZISSERMAN A.Very deep convolutional networks for large-scale image recognition.[EB/OL].(2015-04-10)[2021-12-10].https://arxiv.org/pdf/1409.1556.pdf.
[18]XIANG Y Y.Research on high-resolution high speed recon-struction algorithm of the sun[D].Beijing:University of Chinese Academy of Sciences.2016.
[19]ZHANG K,LUO W,ZHONG Y,et al.Deblurring by real-isticblurring[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.New York:IEEE Press,2020:2737-2746.
[1] CUI Wen-hao, JIANG Mu-rong, YANG Lei, FU Peng-ming, ZHU Ling-xiao. Combining MCycleGAN and RFCNN to Realize High Resolution Reconstruction of Solar Speckle Image [J]. Computer Science, 2021, 48(6A): 38-42.
[2] SUN Zheng, ZHANG Xiao-xue. Review on Methods of Reducing Acoustic Reflection Artifact in Biological Photoacoustic Imaging [J]. Computer Science, 2021, 48(6A): 10-14.
[3] SUN Zheng and WANG Xin-yu. Application of Deep Learning in Photoacoustic Imaging [J]. Computer Science, 2020, 47(6A): 148-152.
[4] LAN Zhang-li, SHEN De-xing, CAO Juan and ZHANG Yu-xin. Content-independent Method for Basis Image Extraction and Image Reconstruction [J]. Computer Science, 2020, 47(6A): 226-229.
[5] ZHANG Sai, RUI Ting, REN Tong-wei, YANG Cheng-song, ZOU Jun-hua. Image Reconstruction Based on Supervised Learning Deep Auto-encoder [J]. Computer Science, 2018, 45(11): 267-271.
[6] LIU Ya-nan, YANG Xiao-mei and CHEN Chao-nan. Super-resolution Image Reconstruction Based on Fractional Order Total Variation Regularization [J]. Computer Science, 2016, 43(5): 274-278.
[7] LV Li-zhi and QIANG Yan. Medical CT Image Enhancement Algorithm Based on Laplacian Pyramid and Wavelet Transform [J]. Computer Science, 2016, 43(11): 300-303.
[8] CHEN Xiu-mei, WANG Jing-shi, WANG Wei, ZHAO Yang and TANG Min. Compressed Sensing Reconstruction of MRI Images Based on Nonsubsampled Contourlet Transform [J]. Computer Science, 2015, 42(11): 299-304.
[9] LUO Yan-hong. Study on Exponential Filter of Filter Back Projection Algorithm for CT Image Reconstruction [J]. Computer Science, 2014, 41(Z6): 220-223.
[10] CHENG Li-jun,ZHANG Yu-bo and XU Cong-fu. Image Reconstruction Algorithm Based on Graph Cuts and Gradient-based Algorithms [J]. Computer Science, 2014, 41(4): 314-318.
[11] . Image Reconstruction Method Using Smoothed-to and Dual-tree Wavelet Transform [J]. Computer Science, 2013, 40(3): 263-265.
[12] . Fast Calculation of Simulation Projection for Cone-beam CT Based on Shepp-Logan Head Phantom [J]. Computer Science, 2012, 39(5): 257-260.
[13] ZHANG Shun-li,ZHANG Ding-hua,CHENG Yun-yong,ZHANG Xiao-bo. Fast Calculation of CT Simulation Projection Based on Pixel Phantom [J]. Computer Science, 2011, 38(7): 290-293.
[14] ZHANG Yan-jun,CHEN Yu,CHEN De-yun,YU Xiao-yang. Analyze of Sensitivity Field Characteristics and Image Reconstruction for Electrical Resistance Tomography System [J]. Computer Science, 2010, 37(8): 257-261.
[15] ZHANG Shun-lil,ZHANG Ding-hua,LI Ming-jun,GUO Xin-ming. Fast Image Reconstruction for Cone-beam CT Based on Minimal Cylindrical Reconstruction Region [J]. Computer Science, 2010, 37(5): 257-260.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.