Computer Science ›› 2023, Vol. 50 ›› Issue (4): 133-140.doi: 10.11896/jsjkx.220100090

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Image Denoising Algorithm Based on Deep Multi-scale Convolution Sparse Coding

YIN Haitao, WANG Tianyou   

  1. College of Automation and College of Artificial Intelligence,Nanjing University of Posts and Telecommunications,Nanjing 210023,China
  • Received:2022-01-10 Revised:2022-08-14 Online:2023-04-15 Published:2023-04-06
  • About author:YIN Haitao,born in 1985,Ph.D,asso-ciate professor,is a member of China Computer Federation.His main research interests include image proces-sing and deep learning.
  • Supported by:
    National Natural Science Foundation of China(61971237).

Abstract: Aiming at the problem of lacking of interpretability of deep image denoising networks,this paper proposes a multi-scale convolutional sparse coding network(MSCSC-Net)for image denoising using the idea of deep unfolding.Firstly,a multi-scale convolutional sparse coding(MSCSC)model is developed by exploiting the multi-scale convolutional dictionary,which can effectively express the multi-scale structure of image.Then,the traditional iterative optimization solution for solving the MSCSC model is unfolded into a deep neural network,namely MSCSC-Net.Each layer of MSCSC-Net corresponds to each iteration of the optimization solution.Therefore,the parameters of MSCSC-Net can be accurately defined through the traditional optimization model,which improves the interpretability.In addition,in order to preserve the structural of original image,the proposed MSCSC-Net adopts a revised residual learning idea,in which the weighted results of input noisy image and intermediate denoised image of previous layer are used as the input of next layer.Such revised residual learning can improve denoising performance further.Experimental results on public datasets show that MSCSC-Net is competitive to existing typical deep learning-based algorithms.Speci-fically,for the CBSD68 dataset at noise level 75,MSCSC-Net obtains 0.77% and 2.2% improvements over FFDNet in terms of the average PSNR and SSIM,respectively.

Key words: Image denoising, Multi-scale convolutional sparse coding, Residual learning, Deep neural network, Deep unfolding

CLC Number: 

  • TP391
[1]HE W,YAO Q,LI C,et al.Non-local meets global:An integra-ted paradigm for hyperspectral denoising[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:6868-6877.
[2]HE W,ZHANG H,ZHANG L,et al.Hyperspectral image denoising via noise-adjusted iterative low-rank matrix approximation[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2015,8(6):3050-3061.
[3]ZHENG J W,HUANG J J,QIN M J,et al.Hyperspectral image denoising based on non-local similarity and weighted-truncated nuclear norm[J].Computer Science,2021,48(9):160-167.
[4]YUAN Q,ZHANG L,SHEN H.Hyperspectral image denoising employing a spectral-spatial adaptive total variation model[J].IEEE Transactions on Geoscience and Remote Sensing,2012,50(10):3660-3677.
[5]CHAN T F,SHEN J,ZHOU H M.Total variation wavelet inpainting[J].Journal of Mathematical imaging and Vision,2006,25(1):107-125.
[6]TAO X P,XU H H,ZHENG J W,et al.Hyperspectral Image denoising based on nonconvex low rank matrix approximation and total variation regularization[J].Computer Science,2021,48(8):125-133.
[7]AHARON M,ELAD M,BRUCKSTEIN A.K-SVD:An algo-rithm for designing overcomplete dictionaries for sparse representation[J].IEEE Transactions on Signal Processing,2006,54(11):4311-4322.
[8]LI G H,LI J J,FAN H.Image denoising algorithm based onadaptive matching pursuit[J].Computer Science,2020,47(1):176-185.
[9]CHENG Z J,ZHOU S E,LI K.Sparse representation target tracking algorithm based on multi-scale adaptive weight[J].Computer Science,2020,47(6A):181-186.
[10]BUADES A,COLL B,MOREL J M.A non-local algorithm for image denoising[C]//IEEE Computer Society Conference on Computer Vision and Pattern Recognition.2005,2:60-65.
[11]GU S,ZHANG L,ZUO W,et al.Weighted nuclear norm minimization with application to image denoising[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2014:2862-2869.
[12]ZAYYANI H,BABAIE-ZADEH M,JUTTEN C.Bayesian pursuit algorithm for sparse representation[C]//2009 IEEE International Conference on Acoustics,Speech and Signal Processing.IEEE,2009:1549-1552.
[13]LIN Z X,ZHANG M K,WU C M,et al.Face image inpainting with generative adversarial network[J].Computer Science,2021,48(9):174-180.
[14]ZHANG K,ZUO W,ZHANG L.Learning a single convolutional super-resolution network for multiple degradations[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:3262-3271.
[15]DONG W,WANG P,YIN W,et al.Denoising prior driven deep neural network for image restoration[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2018,41(10):2305-2318.
[16]ZHANG K,ZUO W,CHEN Y,et al.Beyond a gaussian denoi-ser:Residual learning of deep cnn for image denoising[J].IEEE Transactions on Image Processing,2017,26(7):3142-3155.
[17]ZHANG K,ZUO W,ZHANG L.FFDNet:Toward a fast andflexible solution for CNN-based image denoising[J].IEEE Transactions on Image Processing,2018,27(9):4608-4622.
[18]LEFKIMMIATIS S.Non-local color image denoising with con-volutional neural networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:3587-3596.
[19]GREGOR K,LECUN Y.Learning fast approximations of sparse coding[C]//International Conference on Machine Learning.2010:399-406.
[20]QIAN Q,XIONG F,ZHOU J.Deep unfolded iterative shrin-kage-thresholding model for hyperspectral unmixing[C]//IEEE International Geoscience and Remote Sensing Symposium.2019:2151-2154.
[21]AGARWAL C,KHOBAHI S,BOSE A,et al.Deep-URL:Amodel-aware approach to blind deconvolution based on deep unfolded Richardson-Lucy network[C]//IEEE International Conference on Image Processing(ICIP).2020:3299-3303.
[22]SIMON D,ELAD M.Rethinking the CSC model for naturalimages[C]//Advances in Neural Information Processing Systems.2019:2274-2284.
[23]LECOUAT B,PONCE J,MAIRAL J.Fully trainable and interpretable non-local sparse models for image restoration[C]//European Conference on Computer Vision.2020:238-254.
[24]DABOV K,FOI A,KATKOVNIK V,et al.Image denoising by sparse 3-D transform-domain collaborative filtering[J].IEEE Transactions on Image Processing,2007,16(8):2080-2095.
[1] BAI Zhixu, WANG Hengjun, GUO Kexiang. Adversarial Examples Generation Method Based on Image Color Random Transformation [J]. Computer Science, 2023, 50(4): 88-95.
[2] RAO Dan, SHI Hongwei. Study on Air Traffic Flow Recognition and Anomaly Detection Based on Deep Clustering [J]. Computer Science, 2023, 50(3): 121-128.
[3] WANG Xiangwei, HAN Rui, Chi Harold LIU. Hierarchical Memory Pool Based Edge Semi-supervised Continual Learning Method [J]. Computer Science, 2023, 50(2): 23-31.
[4] WEI Hui, CHEN Ze-mao, ZHANG Li-qiang. Anomaly Detection Framework of System Call Trace Based on Sequence and Frequency Patterns [J]. Computer Science, 2022, 49(6): 350-355.
[5] JIAO Xiang, WEI Xiang-lin, XUE Yu, WANG Chao, DUAN Qiang. Automatic Modulation Recognition Based on Deep Learning [J]. Computer Science, 2022, 49(5): 266-278.
[6] GAO Jie, LIU Sha, HUANG Ze-qiang, ZHENG Tian-yu, LIU Xin, QI Feng-bin. Deep Neural Network Operator Acceleration Library Optimization Based on Domestic Many-core Processor [J]. Computer Science, 2022, 49(5): 355-362.
[7] GAO Yuan-hao, LUO Xiao-qing, ZHANG Zhan-cheng. Infrared and Visible Image Fusion Based on Feature Separation [J]. Computer Science, 2022, 49(5): 58-63.
[8] QIAN Dong-wei, CUI Yang-guang, WEI Tong-quan. Secondary Modeling of Pollutant Concentration Prediction Based on Deep Neural Networks with Federal Learning [J]. Computer Science, 2022, 49(11A): 211200084-5.
[9] ZHAO Hong, CHANG You-kang, WANG Wei-jie. Survey of Adversarial Attacks and Defense Methods for Deep Neural Networks [J]. Computer Science, 2022, 49(11A): 210900163-11.
[10] JIN Yu-jie, CHU Xu, WANG Ya-sha, ZHAO Jun-feng. Variational Domain Adaptation Driven Semantic Segmentation of Urban Scenes [J]. Computer Science, 2022, 49(11): 126-133.
[11] FAN Hong-jie, LI Xue-dong, YE Song-tao. Aided Disease Diagnosis Method for EMR Semantic Analysis [J]. Computer Science, 2022, 49(1): 153-158.
[12] ZHOU Xin, LIU Shuo-di, PAN Wei, CHEN Yuan-yuan. Vehicle Color Recognition in Natural Traffic Scene [J]. Computer Science, 2021, 48(6A): 15-20.
[13] LIU Dong, WANG Ye-fei, LIN Jian-ping, MA Hai-chuan, YANG Run-yu. Advances in End-to-End Optimized Image Compression Technologies [J]. Computer Science, 2021, 48(3): 1-8.
[14] WANG Li-fang, WANG Rui-fang, LIN Su-zhen, QIN Pin-le, GAO Yuan, ZHANG Jin. Multimodal Medical Image Fusion Based on Dual Residual Hyper Densely Networks [J]. Computer Science, 2021, 48(2): 160-166.
[15] WU Yong, LIU Yong-jian, TANG Tang, WANG Hong-lin, ZHENG Jian-cheng. Hyperspectral Image Denoising Based on Robust Low Rank Tensor Restoration [J]. Computer Science, 2021, 48(11A): 303-307.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!