计算机科学 ›› 2018, Vol. 45 ›› Issue (11): 283-287.doi: 10.11896/j.issn.1002-137X.2018.11.045

• 图形图像与模式识别 • 上一篇    下一篇

一种新型的基于深度学习的单幅图像去雨方法

钟菲, 杨斌   

  1. (南华大学电气工程学院 湖南 衡阳421001)
  • 收稿日期:2017-10-14 发布日期:2019-02-25
  • 作者简介:钟 菲(1991-),女,硕士生,主要研究方向为图像处理、模式识别和深度学习;杨 斌(1980-),男,博士,副教授,主要研究方向为图像信息融合、稀疏表示理论、多尺度几何分析、视觉神经计算机理及网络模型等,E-mail:yangbin01420@163.com(通信作者)。

Novel Single Image Raindrop Removal Algorithm Based on Deep Learning

ZHONG Fei, YANG Bin   

  1. (School of Electrical Engineering,University of South China,Hengyang,Hunan 421001,China)
  • Received:2017-10-14 Published:2019-02-25

摘要: 雨滴严重影响了图像的视觉效果和后续的图像处理应用。目前,基于深度学习的单幅图像去雨方法能够有效挖掘图像的深度特征,其去雨效果优于传统方法;然而,随着网络深度的增加,网络容易出现过拟合的现象,使得去雨效果遇到瓶颈。文中在继承深度学习优点的基础上,学习有雨/无雨图像之间的残差,然后将残差与源图像进行重构,从而获得无雨图像。该方式大幅增加了网络深度,并加快了算法的收敛速度。分别利用通过不同方式获取的雨滴图像对所提方法进行实验验证,并将该方法与当前最新的去雨滴方法作比较,结果表明所提算法的去雨效果更好。

关键词: 卷积神经网络, 深度学习, 雨滴去除

Abstract: Raindrops seriously affect the visual effect of images and subsequent image processing applications.At pre-sent,the single image raindrop removal method based on deep learning can effectively mining depth features of image,so its effect of removing rain is better than traditional methods.However,with the increasing of network depth,overfitting is easy to occur,resulting in the bottleneck of rain removal effect.This paper proposed a novel single image raindrop removal algorithm based on deep learning.Firstly,on the basis of inheriting the advantages of deep learning,network learns the residuals between rain images and no-rain images.Secondly,the raindrop-removed image is reconstructed from the residual image and the source image.Through these steps,the depth of network is increased and the convergence speed is accelerated.In terms of performance evaluations,a dataset consisting of images in various scenes was used to test the proposed method,and the results were also compared with those of the state-of-the-art raindrop removal methods.The experimental results show the superiority of the proposed algorithm.

Key words: Convolutional neural network, Deep learning, Raindrop removal

中图分类号: 

  • TP391.41
[1]JOACHIMS T.Making Large-scale SVM Learning Practical [J].Advanced in Kernel Methods-Support Vector Learning,1999,8(3):499-526.
[2]ZAKZESKI J,BRUIJNINCX P C,JONGERIUS A L,et al.The Catalytic Valorization of Lignin for The Production of Renewa-ble Chemicals[J].Chemical Reviews,2010,110(6):3552.
[3]HUANG D A,KANG L W,WANG Y C F,et al.Self-Learning Based Image Decomposition with Applications to Single Image Denoising[J].IEEE Transactions on Multimedia,2013,16(1):83-93.
[4]KANG L W,LIN C W,FU Y H.Automatic Single-image-based Rain Streaks Removal via Image Decomposition[J].IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society,2011,21(4):1742-1755.
[5]LUO Y,XU Y,JI H.Removing Rain from a Single Image via Discriminative Sparse Coding[C]∥Proceedings of IEEE Confe-rence on Computer Vision.Santiago:IEEE Press,2015:3397-3405.
[6]YIN B C,WANG W T,WANG L C.Review of Deep Learning[J].Journal of Beijing University of Technology,2015,41(1):48-59.(in Chinese)
尹宝才,王文通,王立春.深度学习研究综述[J].北京工业大学学报,2015,41(1):48-59.
[7]HE K,ZHANG X,REN S,et al.Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2015,37(9):1904-1916.
[8]EIGEN D,KRISHNAN D,FERGUS R.Restoring an Image Taken through a Window Covered with Dirt or Rain[C]∥Proceedings of IEEE International Conference on Computer Vision.Sydney:IEEE Press,2013:633-640.
[9]FU X,HUANG J,DING X,et al.Clearing the Skies:A Deep Network Architecture for Single-image Rain Streaks Removal[J].IEEE Transactions on Image Processing,2017,26(6):2944-2956.
[10]FU X,HUANG J,ZENG D,et al.Removing Rain from Single Images via a Deep Detail Network[C]∥Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Hawaii:IEEE Press,2017:1715-1723.
[11]ZHANG K,CHEN Y,CHEN Y,et al.Beyond a Gaussian Denoiser:Residual Learning of Deep CNN for Image Denoising[J].IEEE Transactions on Image Processing,2016,26(7):3142-3155.
[12]KIM J,LEE J K,LEE K M.Accurate Image Super-Resolution Using Very Deep Convolutional Networks [C]∥Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Sichuan:IEEE Press,2016:1646-1654.
[13]HINTON G E,OSINDERO S,AND TEH Y W.A Fast Lear- ning Algorithm for Deep Belief Nets[J].Neural Computation,2014,18(7):1527-1554.
[14]HE K,ZHANG X,REN S,et al.Deep Residual Learning for Image Recognition[C]∥Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Nevada:IEEE Press,2016:770-778.
[15]DONG C,CHEN C L,HE K,et al.Image Super-Resolution Using Deep Convolutional Networks[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2016,38(2):295-307.
[16]LI Y,TAN R T,GUO X,et al.Rain Streak Removal using Layer Priors[C]∥Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Chengdu:IEEE Press,2016:2736-2744.
[17]JIA Y Q,SHELHAMER,et al.Caffe:Convolutional Architecture for Fast Feature Embedding[C]∥Proceedings of the 22nd ACM International Conference on Multimedia.Florida:IEEE Press,2014:675-678.
[18]VEDALDI A,LENC K.MatConvNet:Convolutional Neural Networks for MATLAB[C]∥Proceedings of the 23nd ACM International Conference on Multimedia.Brisbane:IEEE Press,2015:689-692.
[19]SCHAEFER G.UCID:An Uncompressed Color Image Database[C]∥Proceedings of Storage & Retrieval Methods & Applications for Multimedia.CA:IEEE Press,2003:472-480.
[20]BARNUM P C,NARASIMHAN S,KANADE T.Analysis of Rain and Snow in Frequency Space[J].International Journal of Computer Vision,2010,86(2):256-274.
[1] 周乐员, 张剑华, 袁甜甜, 陈胜勇.
多层注意力机制融合的序列到序列中国连续手语识别和翻译
Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion
计算机科学, 2022, 49(9): 155-161. https://doi.org/10.11896/jsjkx.210800026
[2] 徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺.
时序知识图谱表示学习
Temporal Knowledge Graph Representation Learning
计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[3] 饶志双, 贾真, 张凡, 李天瑞.
基于Key-Value关联记忆网络的知识图谱问答方法
Key-Value Relational Memory Networks for Question Answering over Knowledge Graph
计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[4] 汤凌韬, 王迪, 张鲁飞, 刘盛云.
基于安全多方计算和差分隐私的联邦学习方案
Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy
计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108
[5] 李宗民, 张玉鹏, 刘玉杰, 李华.
基于可变形图卷积的点云表征学习
Deformable Graph Convolutional Networks Based Point Cloud Representation Learning
计算机科学, 2022, 49(8): 273-278. https://doi.org/10.11896/jsjkx.210900023
[6] 王剑, 彭雨琦, 赵宇斐, 杨健.
基于深度学习的社交网络舆情信息抽取方法综述
Survey of Social Network Public Opinion Information Extraction Based on Deep Learning
计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099
[7] 郝志荣, 陈龙, 黄嘉成.
面向文本分类的类别区分式通用对抗攻击方法
Class Discriminative Universal Adversarial Attack for Text Classification
计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[8] 姜梦函, 李邵梅, 郑洪浩, 张建朋.
基于改进位置编码的谣言检测模型
Rumor Detection Model Based on Improved Position Embedding
计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046
[9] 陈泳全, 姜瑛.
基于卷积神经网络的APP用户行为分析方法
Analysis Method of APP User Behavior Based on Convolutional Neural Network
计算机科学, 2022, 49(8): 78-85. https://doi.org/10.11896/jsjkx.210700121
[10] 朱承璋, 黄嘉儿, 肖亚龙, 王晗, 邹北骥.
基于注意力机制的医学影像深度哈希检索算法
Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism
计算机科学, 2022, 49(8): 113-119. https://doi.org/10.11896/jsjkx.210700153
[11] 孙奇, 吉根林, 张杰.
基于非局部注意力生成对抗网络的视频异常事件检测方法
Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection
计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[12] 檀莹莹, 王俊丽, 张超波.
基于图卷积神经网络的文本分类方法研究综述
Review of Text Classification Methods Based on Graph Convolutional Network
计算机科学, 2022, 49(8): 205-216. https://doi.org/10.11896/jsjkx.210800064
[13] 胡艳羽, 赵龙, 董祥军.
一种用于癌症分类的两阶段深度特征选择提取算法
Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification
计算机科学, 2022, 49(7): 73-78. https://doi.org/10.11896/jsjkx.210500092
[14] 张颖涛, 张杰, 张睿, 张文强.
全局信息引导的真实图像风格迁移
Photorealistic Style Transfer Guided by Global Information
计算机科学, 2022, 49(7): 100-105. https://doi.org/10.11896/jsjkx.210600036
[15] 戴朝霞, 李锦欣, 张向东, 徐旭, 梅林, 张亮.
基于DNGAN的磁共振图像超分辨率重建算法
Super-resolution Reconstruction of MRI Based on DNGAN
计算机科学, 2022, 49(7): 113-119. https://doi.org/10.11896/jsjkx.210600105
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!