计算机科学 ›› 2023, Vol. 50 ›› Issue (4): 133-140.doi: 10.11896/jsjkx.220100090

• 计算机图形学&多媒体 • 上一篇    下一篇

基于深度多尺度卷积稀疏编码的图像去噪算法

尹海涛, 王天由   

  1. 南京邮电大学自动化学院、人工智能学院 南京 210023
  • 收稿日期:2022-01-10 修回日期:2022-08-14 出版日期:2023-04-15 发布日期:2023-04-06
  • 通讯作者: 尹海涛(haitaoyin@njupt.edu.cn)
  • 基金资助:
    国家自然科学基金(61971237)

Image Denoising Algorithm Based on Deep Multi-scale Convolution Sparse Coding

YIN Haitao, WANG Tianyou   

  1. College of Automation and College of Artificial Intelligence,Nanjing University of Posts and Telecommunications,Nanjing 210023,China
  • Received:2022-01-10 Revised:2022-08-14 Online:2023-04-15 Published:2023-04-06
  • About author:YIN Haitao,born in 1985,Ph.D,asso-ciate professor,is a member of China Computer Federation.His main research interests include image proces-sing and deep learning.
  • Supported by:
    National Natural Science Foundation of China(61971237).

摘要: 针对图像去噪深度网络缺乏可解释性的问题,利用深度展开思想,提出了一种基于多尺度卷积稀疏编码的深度去噪网络(MSCSC-Net)。首先利用多尺度卷积字典,构建了多尺度卷积稀疏编码模型,能有效地刻画图像中的多尺度结构特征,然后将多尺度卷积稀疏编码模型的传统迭代优化解展开为深度神经网络架构,即MSCSC-Net,其中网络的每层对应优化解的每次迭代。因此,提出的深度网络中参数可以通过优化模型来准确定义,提高了网络的可解释性。此外,为了更加有效地保留原始图像中的结构信息,MSCSC-Net采用了一种改进的残差学习思想,将输入噪声图像与上一层的中间去噪结果进行加权,并作为下一层的输入图像,以进一步提高网络的去噪效果。在公开数据集上的实验结果表明,与现有典型的基于深度学习去噪算法相比,MSCSC-Net具有一定的竞争力。特别地,在CBSD68数据集上,噪声等级为75时,MSCSC-Net的平均PSNR指标和SSIM指标比FFDNet分别提高了0.77%和2.2%。

关键词: 图像去噪, 多尺度卷积稀疏编码, 残差学习, 深度神经网络, 深度展开

Abstract: Aiming at the problem of lacking of interpretability of deep image denoising networks,this paper proposes a multi-scale convolutional sparse coding network(MSCSC-Net)for image denoising using the idea of deep unfolding.Firstly,a multi-scale convolutional sparse coding(MSCSC)model is developed by exploiting the multi-scale convolutional dictionary,which can effectively express the multi-scale structure of image.Then,the traditional iterative optimization solution for solving the MSCSC model is unfolded into a deep neural network,namely MSCSC-Net.Each layer of MSCSC-Net corresponds to each iteration of the optimization solution.Therefore,the parameters of MSCSC-Net can be accurately defined through the traditional optimization model,which improves the interpretability.In addition,in order to preserve the structural of original image,the proposed MSCSC-Net adopts a revised residual learning idea,in which the weighted results of input noisy image and intermediate denoised image of previous layer are used as the input of next layer.Such revised residual learning can improve denoising performance further.Experimental results on public datasets show that MSCSC-Net is competitive to existing typical deep learning-based algorithms.Speci-fically,for the CBSD68 dataset at noise level 75,MSCSC-Net obtains 0.77% and 2.2% improvements over FFDNet in terms of the average PSNR and SSIM,respectively.

Key words: Image denoising, Multi-scale convolutional sparse coding, Residual learning, Deep neural network, Deep unfolding

中图分类号: 

  • TP391
[1]HE W,YAO Q,LI C,et al.Non-local meets global:An integra-ted paradigm for hyperspectral denoising[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:6868-6877.
[2]HE W,ZHANG H,ZHANG L,et al.Hyperspectral image denoising via noise-adjusted iterative low-rank matrix approximation[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2015,8(6):3050-3061.
[3]ZHENG J W,HUANG J J,QIN M J,et al.Hyperspectral image denoising based on non-local similarity and weighted-truncated nuclear norm[J].Computer Science,2021,48(9):160-167.
[4]YUAN Q,ZHANG L,SHEN H.Hyperspectral image denoising employing a spectral-spatial adaptive total variation model[J].IEEE Transactions on Geoscience and Remote Sensing,2012,50(10):3660-3677.
[5]CHAN T F,SHEN J,ZHOU H M.Total variation wavelet inpainting[J].Journal of Mathematical imaging and Vision,2006,25(1):107-125.
[6]TAO X P,XU H H,ZHENG J W,et al.Hyperspectral Image denoising based on nonconvex low rank matrix approximation and total variation regularization[J].Computer Science,2021,48(8):125-133.
[7]AHARON M,ELAD M,BRUCKSTEIN A.K-SVD:An algo-rithm for designing overcomplete dictionaries for sparse representation[J].IEEE Transactions on Signal Processing,2006,54(11):4311-4322.
[8]LI G H,LI J J,FAN H.Image denoising algorithm based onadaptive matching pursuit[J].Computer Science,2020,47(1):176-185.
[9]CHENG Z J,ZHOU S E,LI K.Sparse representation target tracking algorithm based on multi-scale adaptive weight[J].Computer Science,2020,47(6A):181-186.
[10]BUADES A,COLL B,MOREL J M.A non-local algorithm for image denoising[C]//IEEE Computer Society Conference on Computer Vision and Pattern Recognition.2005,2:60-65.
[11]GU S,ZHANG L,ZUO W,et al.Weighted nuclear norm minimization with application to image denoising[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2014:2862-2869.
[12]ZAYYANI H,BABAIE-ZADEH M,JUTTEN C.Bayesian pursuit algorithm for sparse representation[C]//2009 IEEE International Conference on Acoustics,Speech and Signal Processing.IEEE,2009:1549-1552.
[13]LIN Z X,ZHANG M K,WU C M,et al.Face image inpainting with generative adversarial network[J].Computer Science,2021,48(9):174-180.
[14]ZHANG K,ZUO W,ZHANG L.Learning a single convolutional super-resolution network for multiple degradations[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:3262-3271.
[15]DONG W,WANG P,YIN W,et al.Denoising prior driven deep neural network for image restoration[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2018,41(10):2305-2318.
[16]ZHANG K,ZUO W,CHEN Y,et al.Beyond a gaussian denoi-ser:Residual learning of deep cnn for image denoising[J].IEEE Transactions on Image Processing,2017,26(7):3142-3155.
[17]ZHANG K,ZUO W,ZHANG L.FFDNet:Toward a fast andflexible solution for CNN-based image denoising[J].IEEE Transactions on Image Processing,2018,27(9):4608-4622.
[18]LEFKIMMIATIS S.Non-local color image denoising with con-volutional neural networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:3587-3596.
[19]GREGOR K,LECUN Y.Learning fast approximations of sparse coding[C]//International Conference on Machine Learning.2010:399-406.
[20]QIAN Q,XIONG F,ZHOU J.Deep unfolded iterative shrin-kage-thresholding model for hyperspectral unmixing[C]//IEEE International Geoscience and Remote Sensing Symposium.2019:2151-2154.
[21]AGARWAL C,KHOBAHI S,BOSE A,et al.Deep-URL:Amodel-aware approach to blind deconvolution based on deep unfolded Richardson-Lucy network[C]//IEEE International Conference on Image Processing(ICIP).2020:3299-3303.
[22]SIMON D,ELAD M.Rethinking the CSC model for naturalimages[C]//Advances in Neural Information Processing Systems.2019:2274-2284.
[23]LECOUAT B,PONCE J,MAIRAL J.Fully trainable and interpretable non-local sparse models for image restoration[C]//European Conference on Computer Vision.2020:238-254.
[24]DABOV K,FOI A,KATKOVNIK V,et al.Image denoising by sparse 3-D transform-domain collaborative filtering[J].IEEE Transactions on Image Processing,2007,16(8):2080-2095.
[1] 白祉旭, 王衡军, 郭可翔.
基于图像颜色随机变换的对抗样本生成方法
Adversarial Examples Generation Method Based on Image Color Random Transformation
计算机科学, 2023, 50(4): 88-95. https://doi.org/10.11896/jsjkx.211100164
[2] 饶丹, 时宏伟.
基于深度聚类的航空交通流识别与异常检测研究
Study on Air Traffic Flow Recognition and Anomaly Detection Based on Deep Clustering
计算机科学, 2023, 50(3): 121-128. https://doi.org/10.11896/jsjkx.220100086
[3] 王祥炜, 韩锐, 刘驰.
基于层级化数据记忆池的边缘侧半监督持续学习方法
Hierarchical Memory Pool Based Edge Semi-supervised Continual Learning Method
计算机科学, 2023, 50(2): 23-31. https://doi.org/10.11896/jsjkx.221100133
[4] 高元浩, 罗晓清, 张战成.
基于特征分离的红外与可见光图像融合算法
Infrared and Visible Image Fusion Based on Feature Separation
计算机科学, 2022, 49(5): 58-63. https://doi.org/10.11896/jsjkx.210200148
[5] 焦翔, 魏祥麟, 薛羽, 王超, 段强.
基于深度学习的自动调制识别研究
Automatic Modulation Recognition Based on Deep Learning
计算机科学, 2022, 49(5): 266-278. https://doi.org/10.11896/jsjkx.211000085
[6] 高捷, 刘沙, 黄则强, 郑天宇, 刘鑫, 漆锋滨.
基于国产众核处理器的深度神经网络算子加速库优化
Deep Neural Network Operator Acceleration Library Optimization Based on Domestic Many-core Processor
计算机科学, 2022, 49(5): 355-362. https://doi.org/10.11896/jsjkx.210500226
[7] 赵宏, 常有康, 王伟杰.
深度神经网络的对抗攻击及防御方法综述
Survey of Adversarial Attacks and Defense Methods for Deep Neural Networks
计算机科学, 2022, 49(11A): 210900163-11. https://doi.org/10.11896/jsjkx.210900163
[8] 钱栋炜, 崔阳光, 魏同权.
基于深度神经网络与联邦学习的污染物浓度预测二次建模
Secondary Modeling of Pollutant Concentration Prediction Based on Deep Neural Networks with Federal Learning
计算机科学, 2022, 49(11A): 211200084-5. https://doi.org/10.11896/jsjkx.211200084
[9] 金玉杰, 初旭, 王亚沙, 赵俊峰.
变分推断域适配驱动的城市街景语义分割
Variational Domain Adaptation Driven Semantic Segmentation of Urban Scenes
计算机科学, 2022, 49(11): 126-133. https://doi.org/10.11896/jsjkx.220500193
[10] 范红杰, 李雪冬, 叶松涛.
面向电子病历语义解析的疾病辅助诊断方法
Aided Disease Diagnosis Method for EMR Semantic Analysis
计算机科学, 2022, 49(1): 153-158. https://doi.org/10.11896/jsjkx.201100125
[11] 周欣, 刘硕迪, 潘薇, 陈媛媛.
自然交通场景中的车辆颜色识别
Vehicle Color Recognition in Natural Traffic Scene
计算机科学, 2021, 48(6A): 15-20. https://doi.org/10.11896/jsjkx.200800078
[12] 刘东, 王叶斐, 林建平, 马海川, 杨闰宇.
端到端优化的图像压缩技术进展
Advances in End-to-End Optimized Image Compression Technologies
计算机科学, 2021, 48(3): 1-8. https://doi.org/10.11896/jsjkx.201100134
[13] 王丽芳, 王蕊芳, 蔺素珍, 秦品乐, 高媛, 张晋.
基于双残差超密集网络的多模态医学图像融合
Multimodal Medical Image Fusion Based on Dual Residual Hyper Densely Networks
计算机科学, 2021, 48(2): 160-166. https://doi.org/10.11896/jsjkx.200400095
[14] 潘雨, 邹军华, 王帅辉, 胡谷雨, 潘志松.
基于网络表示学习的深度社团发现方法
Deep Community Detection Algorithm Based on Network Representation Learning
计算机科学, 2021, 48(11A): 198-203. https://doi.org/10.11896/jsjkx.210200113
[15] 巫勇, 刘永坚, 唐瑭, 王洪林, 郑建成.
基于鲁棒低秩张量恢复的高光谱图像去噪
Hyperspectral Image Denoising Based on Robust Low Rank Tensor Restoration
计算机科学, 2021, 48(11A): 303-307. https://doi.org/10.11896/jsjkx.210200103
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!