Computer Science ›› 2022, Vol. 49 ›› Issue (11A): 210900202-8.doi: 10.11896/jsjkx.210900202

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Image Super-resolution Reconstruction Network Based on Dynamic Pyramid and Subspace Attention

HE Peng-hao, YU Ying, XU Chao-yue   

  1. School of Information Science and Engineering,Yunnan University,Kunming 650091,China
  • Online:2022-11-10 Published:2022-11-21
  • About author:HE Peng-hao,born in 1996,postgra-duate.His main research interests include computer vision and deep lear-ning.
    YU Ying,born in 1977,Ph.D,associate professor.His main research interests include image and vision,artificial neural network.
  • Supported by:
    National Natural Science Foundation of China(62166048,61263048) and Yunnan Province Applied Basic Research Project(2018FB102).

Abstract: Aiming at the problems of excessive model parameters and reconstruction distortion in existing single-image super-reso-lution convolutional neural networks,a lightweight single-image super-resolution network model based on dynamic pyramid structure and subspace attention module is proposed.First,the network body with dynamic multi-scale pyramid feature combination module consists of dynamic convolution and pyramid grouping convolution.Dynamic convolution can adaptively perform different convolution operations for different images,so as to extract different features for different images.Pyramid grouping convolution not only can better extract multi-scale features,but also can effectively reduce the number of parameters of the network model.Finally,a subspace attention module is used at the end of the network model to divide the channel space of images into multiple subspaces and learn different attention maps for each subspace,which not only can better capture the cross-channel rela-ted information of images,but also allows for effective fusion of image feature information of each subspace.Compared with the existing mainstream algorithms,the proposed method not only has a smaller number of model parameters,but also the reconstructed super-resolution images can achieve better performance in terms of visual effects and quantitative analysis.

Key words: Super-resolution, Lightweight, Dynamic convolution, Pyramid grouping convolution, Subspace attention block

CLC Number: 

  • TP391
[1]FREEMAN W T,PAZSTOR E C,CARMICHAEL O T.Lear-ning low-level vision[J].International Journal of Computer Vision,2000,40(1):25-47.
[2]ZHANG Y,FAN Q,BAO F,et al.Single-image super-resolution based on rational fractal interpolation[J].IEEE Transactions on Image Processing,2018,27(8):3782-3797.
[3]YANG M C,WANG Y C F.A self-learning approach to single image super-resolution[J].IEEE Transactions on Multimedia,2012,15(3):498-508.
[4]DONG C,LOY C C,HE K,et al.Learning a deep convolutional network for image super-resolution[C]//European Conference on Computer Vision.Springer,2014:184-199.
[5]DONG C,LOY C C,TANG X.Accelerating the super-resolution convolutional neural network[C]//European Conference on Computer Vision.Springer,2016:391-407.
[6]LIM B,SON S,KIM H,et al.Enhanced deep residual networks for single image super-resolution[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops.IEEE,2017:136-144.
[7]TONG T,LI G,LIU X,et al.Image super-resolution usingdense skip connections[C]//Proceedings of the IEEE International Conference on Computer Vision.IEEE,2017:4799-4807.
[8]ZHANG Y,TIAN Y,KONG Y,et al.Residual dense network for image super-resolution[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2018:2472-2481.
[9]HUANG G,LIU Z,VAN DER MAATEN L,et al.Densely connected convolutional networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2017:4700-4708.
[10]HE K,ZHANG X,REN S,et al.Deep residual learning forimage recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2016:770-778.
[11]ZHANG Y L,LI K P,LI K,et al.Image super-resolution using very deep residual channel attention networks[C]//Proceedings of the European Conference on Computer Vision(ECCV).Springer,2018:286-301.
[12]LIU J,ZHANG W,TANG Y,et al.Residual feature aggregation network for image super-resolution[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.IEEE,2020:2359-2368.
[13]ANWAR S,BARNES N.Densely residuallaplacian super-resolution[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,1(1):1-1.
[14]LI J,FANG F,MEI K,et al.Multi-scale residual network forimage super-resolution[C]//Proceedings of the European Conference on Computer Vision(ECCV).Springer,2018:517-532.
[15]KIM J,LEE J K,LEE K M.Deeply-recursive convolutional network for image super-resolution[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2016:1637-1645.
[16]TAI Y,YANG J,LIU X.Image super-resolution via deep recursive residual network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2017:3147-3155.
[17]AHN N,KANG B,SOHN K A.Fast,accurate,and lightweight super-resolution with cascading residual network[C]//Procee-dings of the European Conference on Computer Vision(ECCV).Springer,2018:252-268.
[18]LAI W S,HUANG J B,AHUJA N,et al.Deeplaplacian pyramid networks for fast and accurate super-resolution[C]//Procee-dings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2017:624-632.
[19]HUI Z,GAO X,YANG Y,et al.Lightweight image super-resolution with information multi-distillation network[C]//Procee-dings of the 27th ACM International Conference on Multimedia.ACM,2019:2024-2032.
[20]WOO S,PARK J,LEE J Y,et al.Cbam:Convolutional block attention module[C]//Proceedings of the European Conference on Computer Vision(ECCV).Springer,2018:3-19.
[21]BOUREAU Y L,BACH F,LECUN Y,et al.Learning mid-level features for recognition[C]//2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.IEEE,2010:2559-2566.
[22]AGUSTSSON E,TIMOFTE R.Ntire 2017 challenge on single image super-resolution:Dataset and study[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops.IEEE,2017:126-135.
[23]BEVILACQUA M,ROUMY A,GUILLEMOT C,et al.Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding[C]//Proceedings of the 23rd British Machine Vision Conference.BMVA Press,2012:135.1-135.10.
[24]ZEYDE R,ELAD M,PROTTER M.On single image scale-up using sparse-representations[C]//International Conference on Curves and Surfaces.Springer,2010:711-730.
[25]MARTIN D,FOWLKES C,TAL D,et al.A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics[C]//Proceedings of the Eighth IEEE International Conference on Computer Vision.IEEE,2001:416-423.
[26]HUANG J B,SINGH A,AHUJA N.Single image super-resolution from transformed self-exemplars[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2015:5197-5206.
[27]KIM J,KWON LEE J,MU LEE K.Accurate image super-resolution using very deep convolutional networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2016:1646-1654.
[28]TAI Y,YANG J,LIU X,et al.A persistent memory network for image restoration[C]//Proceedings of the IEEE International Conference on Computer Vision.IEEE,2017:4549-4557.
[29]ZHANG K,ZUO W,ZHANG L.Learning a single convolutional super-resolution network for multiple degradations[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2018:3262-3271.
[30]LI Z,YANG J,LIU Z,et al.Feedback network for image super-resolution[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.IEEE,2019:3867-3876.
[31]ZHU F,ZHAO Q.Efficient single image super-resolution viahybrid residual feature learning with compact back-projection network[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops.IEEE,2019.
[32]LI J X,HUANG Z Y,LI W B,et al.Image super-resolution based on multi-level feature fusion[J/OL].Acta Automatica Sinica,2021:1-11.http://www.aas.net.cn/cn/article/doi/10.16383/j.aas.c200585.
[1] DAI Zhao-xia, LI Jin-xin, ZHANG Xiang-dong, XU Xu, MEI Lin, ZHANG Liang. Super-resolution Reconstruction of MRI Based on DNGAN [J]. Computer Science, 2022, 49(7): 113-119.
[2] HAO Qiang, LI Jie, ZHANG Man, WANG Lu. Spatial Non-cooperative Target Components Recognition Algorithm Based on Improved YOLOv3 [J]. Computer Science, 2022, 49(6A): 358-362.
[3] ZHOU Ying, CHANG Ming-xin, YE Hong, ZHANG Yan. Super Resolution Reconstruction Method of Solar Panel Defect Images Based on Meta-transfer [J]. Computer Science, 2022, 49(3): 185-191.
[4] CHEN Gui-qiang, HE Jun. Study on Super-resolution Reconstruction Algorithm of Remote Sensing Images in Natural Scene [J]. Computer Science, 2022, 49(2): 116-122.
[5] LENG Jia-xu, WANG Jia, MO Meng-jing-cheng, CHEN Tai-yue, GAO Xin-bo. Survey on Video Super-resolution Based on Deep Learning [J]. Computer Science, 2022, 49(2): 123-133.
[6] Abudukelimu ABULIZI, ZHANG Yu-ning, Alimujiang YASEN, GUO Wen-qiang, Abudukelimu HALIDANMU. Survey of Research on Extended Models of Pre-trained Language Models [J]. Computer Science, 2022, 49(11A): 210800125-12.
[7] GONG Hao-tian, ZHANG Meng. Lightweight Anchor-free Object Detection Algorithm Based on Keypoint Detection [J]. Computer Science, 2021, 48(8): 106-110.
[8] GUO Lin, LI Chen, CHEN Chen, ZHAO Rui, FAN Shi-lin, XU Xing-yu. Image Super-resolution Reconstruction Using Recursive ResidualNetwork Based on ChannelAttention [J]. Computer Science, 2021, 48(8): 139-144.
[9] CHENG Song-sheng, PAN Jin-shan. Video Super-resolution Method Based on Deep Learning Feature Warping [J]. Computer Science, 2021, 48(7): 184-189.
[10] LI Shan, XU Xin-zheng. Parallel Pruning from Two Aspects for VGG16 Optimization [J]. Computer Science, 2021, 48(6): 227-233.
[11] PAN Ming-yuan, SONG Hui-hui, ZHANG Kai-hua, LIU Qing-shan. Learning Global Guided Progressive Feature Aggregation Lightweight Network for Salient Object Detection [J]. Computer Science, 2021, 48(6): 103-109.
[12] WANG Wei, HU Tao, LI Xin-wei, SHEN Si-wan, JIANG Xiao-ming, LIU Jun-yuan. Study on Super-resolution Image Reconstruction of Leukocytes [J]. Computer Science, 2021, 48(4): 164-168.
[13] LU Yao-yao, YUAN Jia-bin, HE Shan, WANG Tian-xing. Low-quality Video Face Recognition Method Based on Super-resolution Reconstruction [J]. Computer Science, 2021, 48(11A): 295-302.
[14] LIU Yan, QIN Pin-le, ZENG Jian-chao. Multi-object Tracking Algorithm Based on YOLOv3 and Hierarchical Data Association [J]. Computer Science, 2021, 48(11A): 370-375.
[15] CHEN Hao-nan, LEI Yin-jie, WANG Hao. Lightweight Lane Detection Model Based on Row-column Decoupled Sampling [J]. Computer Science, 2021, 48(11A): 416-419.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!