Computer Science ›› 2018, Vol. 45 ›› Issue (11): 283-287.doi: 10.11896/j.issn.1002-137X.2018.11.045

• Graphics, Image & Pattern Recognition • Previous Articles     Next Articles

Novel Single Image Raindrop Removal Algorithm Based on Deep Learning

ZHONG Fei, YANG Bin   

  1. (School of Electrical Engineering,University of South China,Hengyang,Hunan 421001,China)
  • Received:2017-10-14 Published:2019-02-25

Abstract: Raindrops seriously affect the visual effect of images and subsequent image processing applications.At pre-sent,the single image raindrop removal method based on deep learning can effectively mining depth features of image,so its effect of removing rain is better than traditional methods.However,with the increasing of network depth,overfitting is easy to occur,resulting in the bottleneck of rain removal effect.This paper proposed a novel single image raindrop removal algorithm based on deep learning.Firstly,on the basis of inheriting the advantages of deep learning,network learns the residuals between rain images and no-rain images.Secondly,the raindrop-removed image is reconstructed from the residual image and the source image.Through these steps,the depth of network is increased and the convergence speed is accelerated.In terms of performance evaluations,a dataset consisting of images in various scenes was used to test the proposed method,and the results were also compared with those of the state-of-the-art raindrop removal methods.The experimental results show the superiority of the proposed algorithm.

Key words: Convolutional neural network, Deep learning, Raindrop removal

CLC Number: 

  • TP391.41
[1]JOACHIMS T.Making Large-scale SVM Learning Practical [J].Advanced in Kernel Methods-Support Vector Learning,1999,8(3):499-526.
[2]ZAKZESKI J,BRUIJNINCX P C,JONGERIUS A L,et al.The Catalytic Valorization of Lignin for The Production of Renewa-ble Chemicals[J].Chemical Reviews,2010,110(6):3552.
[3]HUANG D A,KANG L W,WANG Y C F,et al.Self-Learning Based Image Decomposition with Applications to Single Image Denoising[J].IEEE Transactions on Multimedia,2013,16(1):83-93.
[4]KANG L W,LIN C W,FU Y H.Automatic Single-image-based Rain Streaks Removal via Image Decomposition[J].IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society,2011,21(4):1742-1755.
[5]LUO Y,XU Y,JI H.Removing Rain from a Single Image via Discriminative Sparse Coding[C]∥Proceedings of IEEE Confe-rence on Computer Vision.Santiago:IEEE Press,2015:3397-3405.
[6]YIN B C,WANG W T,WANG L C.Review of Deep Learning[J].Journal of Beijing University of Technology,2015,41(1):48-59.(in Chinese)
尹宝才,王文通,王立春.深度学习研究综述[J].北京工业大学学报,2015,41(1):48-59.
[7]HE K,ZHANG X,REN S,et al.Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2015,37(9):1904-1916.
[8]EIGEN D,KRISHNAN D,FERGUS R.Restoring an Image Taken through a Window Covered with Dirt or Rain[C]∥Proceedings of IEEE International Conference on Computer Vision.Sydney:IEEE Press,2013:633-640.
[9]FU X,HUANG J,DING X,et al.Clearing the Skies:A Deep Network Architecture for Single-image Rain Streaks Removal[J].IEEE Transactions on Image Processing,2017,26(6):2944-2956.
[10]FU X,HUANG J,ZENG D,et al.Removing Rain from Single Images via a Deep Detail Network[C]∥Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Hawaii:IEEE Press,2017:1715-1723.
[11]ZHANG K,CHEN Y,CHEN Y,et al.Beyond a Gaussian Denoiser:Residual Learning of Deep CNN for Image Denoising[J].IEEE Transactions on Image Processing,2016,26(7):3142-3155.
[12]KIM J,LEE J K,LEE K M.Accurate Image Super-Resolution Using Very Deep Convolutional Networks [C]∥Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Sichuan:IEEE Press,2016:1646-1654.
[13]HINTON G E,OSINDERO S,AND TEH Y W.A Fast Lear- ning Algorithm for Deep Belief Nets[J].Neural Computation,2014,18(7):1527-1554.
[14]HE K,ZHANG X,REN S,et al.Deep Residual Learning for Image Recognition[C]∥Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Nevada:IEEE Press,2016:770-778.
[15]DONG C,CHEN C L,HE K,et al.Image Super-Resolution Using Deep Convolutional Networks[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2016,38(2):295-307.
[16]LI Y,TAN R T,GUO X,et al.Rain Streak Removal using Layer Priors[C]∥Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Chengdu:IEEE Press,2016:2736-2744.
[17]JIA Y Q,SHELHAMER,et al.Caffe:Convolutional Architecture for Fast Feature Embedding[C]∥Proceedings of the 22nd ACM International Conference on Multimedia.Florida:IEEE Press,2014:675-678.
[18]VEDALDI A,LENC K.MatConvNet:Convolutional Neural Networks for MATLAB[C]∥Proceedings of the 23nd ACM International Conference on Multimedia.Brisbane:IEEE Press,2015:689-692.
[19]SCHAEFER G.UCID:An Uncompressed Color Image Database[C]∥Proceedings of Storage & Retrieval Methods & Applications for Multimedia.CA:IEEE Press,2003:472-480.
[20]BARNUM P C,NARASIMHAN S,KANADE T.Analysis of Rain and Snow in Frequency Space[J].International Journal of Computer Vision,2010,86(2):256-274.
[1] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[2] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[3] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[4] TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[5] WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[6] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[7] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[8] CHEN Yong-quan, JIANG Ying. Analysis Method of APP User Behavior Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(8): 78-85.
[9] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[10] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[11] HOU Yu-tao, ABULIZI Abudukelimu, ABUDUKELIMU Halidanmu. Advances in Chinese Pre-training Models [J]. Computer Science, 2022, 49(7): 148-163.
[12] ZHOU Hui, SHI Hao-chen, TU Yao-feng, HUANG Sheng-jun. Robust Deep Neural Network Learning Based on Active Sampling [J]. Computer Science, 2022, 49(7): 164-169.
[13] SU Dan-ning, CAO Gui-tao, WANG Yan-nan, WANG Hong, REN He. Survey of Deep Learning for Radar Emitter Identification Based on Small Sample [J]. Computer Science, 2022, 49(7): 226-235.
[14] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[15] DAI Zhao-xia, LI Jin-xin, ZHANG Xiang-dong, XU Xu, MEI Lin, ZHANG Liang. Super-resolution Reconstruction of MRI Based on DNGAN [J]. Computer Science, 2022, 49(7): 113-119.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!