图像去雨算法在云物联网应用中的研究综述

doi:10.11896/jsjkx.201000055

Abstract

Abstract: According to the “White Paper on China's Intelligent Internet of Things (AIoT) 2020”,with the prompt development of China's 5G network,the rapid popularization of large-capacity with low-price IoT sensor devices and the explosive growth of data,image processing is widely used in various fields of Internet of Things,such as smart city,smart transportation,smart healthcare,and other industry,etc.In these research areas,researchers usually ignore the actual problems in the data collection process,for instance,data degradation caused by time changes:seasonal shifting,diurnal variation,weather changes,and noise problems caused by spatial changes:object superposition,blur,and partial occlusion.Among those problems,the weather pro-blems represented by rainy days are the most challenging and common.Therefore,this paper systematically investigates the actual problems in the data collection process above,classifies and summarizes the image rain-removal algorithms under complex weather conditions.At the same time,regarding the compute-intensive execution of such algorithms,we utilize the Amazon EC2 cloud instance G4 and P3 series to quantitatively evaluate the processing time and effect of various reviewed rain removal algorithms.Finally,we illustrate the characteristics of various rain removal algorithms and the latest trends in Cloud-IoT applications.

Key words: Big data, Cloud-IoT, Deep learning, Image processing, Rain removal algorithm

CLC Number:

TP391

ZHANG Yu-long, WANG Qiang, CHEN Ming-kang, SUN Jing-tao. Survey of Intelligent Rain Removal Algorithms for Cloud-IoT Systems[J].Computer Science, 2021, 48(12): 231-242.

References

[1]ABBAS N,ZHANG Y,TAHERKORDI A,et al.Mobile Edge Computing:A Survey[J].IEEE Internet of Things Journal,2018,5(1):450-465.
[2]HONG K,LILLETHUN D,RAMACHANDRAN U,et al.Mobile fog:A programming model for large-scale applications on the internet of things[C]//MCC 2013 - Proceedings of the 2nd,2013 ACM SIGCOMM Workshop on Mobile Cloud Computing.New York,NY,USA:Association for Computing Machinery,2013:15-20.
[3]FARRIS I,MILITANO L,NITTI M,et al.MIFaaS:A Mobile-IoT-Federation-as-a-Service Model for dynamic cooperation of IoT Cloud Providers[J].Future Generation Computer Systems,2017,70(December):126-137.
[4]BAI Y,CHEUNG G,LIU X,et al.Graph-based blind image deblurring from a single photograph[J].IEEE Transactions on Image Processing,2019,28(3):1404-1418.
[5]FU X,HUANG J,DING X,et al.Clearing the skies:A deep net- work architecture for single-image rain removal[J].IEEE Transactions on Image Processing,2017,26(6):2944-2956.
[6]ZHENG Z,WU L,MA H,et al.Going Clear from Misty Rain in Dark Channel Guided Network[C]//IJCAI Workshop on AI for Internet of Things.2017.
[7]WANG J,GUO Y,YING Y,et al.Fast non-local algorithm for image denoising[J].Proceedings - International Conference on Image Processing,ICIP,2006:1429-1432.
[8]LI R,CHEONG L F,TAN R T.Heavy rain image restoration:Integrating physics model and conditional adversarial learning[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition,2019.2019(1):1633-1642.
[9]EIGEN D,KRISHNAN D,FERGUS R.Restoring an image taken through a window covered with dirt or rain[J].Procee-dings of the IEEE International Conference on Computer Vision,2013:633-640.
[10]YANG W,LIU J,FENG J.Frame-consistent recurrent video deraining with dual-level flow[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Re-cognition,2019.2019:1661-1670.
[11]WANG Y,ZHANG H,LIU Y,et al.Gradient Information Guided Deraining with A Novel Network and Adversarial Trai-ning[J].arXiv:1910.03839,2019.
[12]PRUSTY P,NAYAK J.Detection and removal of rain from static background videos[J].International Journal of Applied Engineering Research,2015,10(9):22791-22797.
[13]MARSHALL J S,PALMER W M K.the Distribution of Raindrops With Size[J].Journal of Meteorology,1948,5(4):165-166.
[14]FOOTE G B,DU TOIT P S.Terminal Velocity of Raindrops Aloft[J].Journal of Applied Meteorology,1969,8(2):249-253.
[15]BARNUM P,KANADE T,NARASIMHAN S.Spatio-Temporal Frequency Analysis for Removing Rain and Snow from Vi-deos[J].the First International Workshop on Photometric Analysis for Computer Vision,2007:8.
[16]KANG L W,LIN C W,FU Y H.Automatic single-image-based rain streaks removal via image decomposition[J].IEEE Tran-sactions on Image Processing,2012,21(4):1742-1755.
[17]LUO Y,XU Y,JI H.Removing rain from a single image via discriminative sparse coding[C]//Proceedings of the IEEE International Conference on Computer Vision,2015.2015:3397-3405.
[18]HU X,FU C W,ZHU L,et al.Depth-attentional features for single-image rain removal[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Re-cognition,2019.2019:8014-8023.
[19]YANG W,TAN R T,WANG S,et al.Single Image Deraining:From Model-Based to Data-Driven and Beyond[J].IEEE Tran-sactions on Pattern Analysis and Machine Intelligence,2020(2012):1-1.
[20]KIM J H,LEE C,SIM J Y,et al.Single-image deraining using an adaptive nonlocal means filter[C]//2013 IEEE International Conference on Image Processing(ICIP 2013).IEEE,2013(1):914-917.
[21]BOSSU J,HAUTIÈRE N,TAREL J P.Rain or snow detection in image sequences through use of a histogram of orientation of streaks[J].International Journal of Computer Vision,2011,93(3):348-367.
[22]KANG L W,LIN C W,LIN C T,et al.Self-learning-based rain streak removal for image/video[C]//2012 IEEE International Symposium on Circuits and Systems(ISCAS 2012).2012:1871-1874.
[23]RAMYA C,SUBHA RANI S.Rain removal in image sequence using sparse coding[J].Communications in Computer and Information Science,2012,330 CCIS:361-370.
[24]ZHENG X,LIAO Y,GUO W,et al.Single-image-based rain and snow removal using multi-guided filter[C]//Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics).2013,8228 LNCS(PART 3):258-265.
[25]CHEN D Y,CHEN C C,KANG L W.Visual depth guided color image rain streaks removal using sparse coding[J].IEEETran-sactions on Circuits and Systems for Video Technology,2014,24(8):1430-1455.
[26]XU J,ZHAO W,LIU P,et al.An Improved Guidance Image Based Method to Remove Rain and Snow in a Single Image[J].Computer and Information Science,2012,5(3):49-55.
[27]TALLEY N J.Update on the role of drug therapy in non-ulcer dyspepsia[J].Reviews in Gastroenterological Disorders,2003,3(1):25-30.
[28]SHIH Y,KRISHNAN D,DURAND F,et al.Reflection removal using ghosting cues[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.2015:3193-3201.
[29]LI Y,TAN R T,GUO X,et al.Rain Streak Removal Using La- yer Priors[J].Proceedings of the IEEE Computer Society Confe-rence on Computer Vision and Pattern Recognition,2016:2736-2744.
[30]LIU Y F,JAW D W,HUANG S C,et al.DesnowNet:Context-Aware Deep Network for Snow Removal[J].IEEE Transactions on Image Processing,IEEE,2018,27(6):3064-3073.
[31]HUANG D A,KANG L W,WANG Y C F,et al.Self-learning based image decomposition with applications to single image denoising[J].IEEE Transactions on Multimedia,IEEE,2014,16(1):83-93.
[32]WANG Y,CHEN C,ZHU S,et al.A framework of single-image deraining method based on analysis of rain characteristics[C]//Proceedings - International Conference on Image Processing.IEEE,2016:4087-4091.
[33]GHOSH S,MANDAL A K,CHAUDHURY K N.Pruned non-local means[J].IET Image Processing,2017,11(5):317-323.
[34]DONG C,LOY C C,HE K,et al.Image Super-Resolution Using Deep Convolutional Networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2016,38(2):295-307.
[35]XIE J,XU L,CHEN E.Image denoising and inpainting with deep neural networks[J].Advances in Neural Information Processing Systems,2012,1:341-349.
[36]HUANG D A,KANG L W,YANG M C,et al.Context-aware single image rain removal[C]//Proceedings-IEEE InternationalConference on Multimedia and Expo.2012(July):164-169.
[37]YANG W,TAN R T,FENG J,et al.Deep joint rain detection and removal from a single image[C]//Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition(CVPR 2017).2017:1685-1694.
[38]ZHANG H,SINDAGI V,PATEL V M.Image De-raining Using a Conditional Generative Adversarial Network[C]//IEEE Transactions on Circuits and Systems for Video Technology.2019:1-1.
[39]QIAN R,TAN R T,YANG W,et al.Attentive Generative Adversarial Network for Raindrop Removal from A Single Image[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.2018:2482-2491.
[40]FU X,HUANG J,ZENG D,et al.Removing rain from single images via a deep detail network[C]//Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition(CVPR 2017).2017:1715-1723.
[41]FU X,LIANG B,HUANG Y,et al.Lightweight Pyramid Networks for Image Deraining[J].IEEE Transactions on Neural Networks and Learning Systems,2020,31(6):1794-1807.
[42]REN D,ZUO W,HU Q,et al.Progressive image deraining networks:A better and simpler baseline[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.2019:3932-3941.
[43]YASARLA R,SINDAGI V A,PATEL V M.Syn2Real Transfer Learning for Image Deraining Using Gaussian Processes [C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:2726-2736.
[44]LIU L,LIU B,HUANG H,et al.No-reference image quality assessment based on spatial and spectral entropies[J].Signal Pro-cessing:Image Communication,Elsevier,2014,29(8):856-863.
[45]WANG Z M.Review of no-reference image quality assessment[J].Zidonghua Xuebao/Acta Automatica Sinica,2015,41(6):1062-1079.
[46]WU Y,LING H,YU J,et al.Blurred target tracking by blur-driven tracker[C]//Proceedings of the IEEE International Conference on Computer Vision.2011:1100-1107.
[47]ZHAO S,ZHANG S,ZHANG L.Towards occlusion handling:Object tracking with background estimation[J].IEEE Transactions on Cybernetics,2018,48(7):2086-2100.
[48]HENRIQUES J F,CASEIRO R,MARTINS P,et al.High- speed tracking with kernelized correlation filters[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,37(3):583-596.
[49]LI M,LIU J,YANG W,et al.Structure-Revealing Low-Light Image Enhancement Via Robust Retinex Model[J].IEEE Transactions on Image Processing,2018,27(6):2828-2841.
[50]SUN J,YANG C,TANJO T,et al.Implementation of self-adaptive middleware for mobile vehicle tracking applications on edge computing[C]//International Conference on Internet and Distributed Computing Systems.Springer,Cham,2018:1-15.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

Comments

Recommended 0

No Suggested Reading articles found!

Survey of Intelligent Rain Removal Algorithms for Cloud-IoT Systems

PDF (PC)

Abstract

Cite this article

share this article

References

Related Articles 15

Metrics

Comments

Recommended 0

[1]	RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[2]	TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[3]	XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[4]	WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[5]	HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[6]	JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[7]	CHEN Jing, WU Ling-ling. Mixed Attribute Feature Detection Method of Internet of Vehicles Big Datain Multi-source Heterogeneous Environment [J]. Computer Science, 2022, 49(8): 108-112.
[8]	SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[9]	HE Qiang, YIN Zhen-yu, HUANG Min, WANG Xing-wei, WANG Yuan-tian, CUI Shuo, ZHAO Yong. Survey of Influence Analysis of Evolutionary Network Based on Big Data [J]. Computer Science, 2022, 49(8): 1-11.
[10]	HOU Yu-tao, ABULIZI Abudukelimu, ABUDUKELIMU Halidanmu. Advances in Chinese Pre-training Models [J]. Computer Science, 2022, 49(7): 148-163.
[11]	ZHOU Hui, SHI Hao-chen, TU Yao-feng, HUANG Sheng-jun. Robust Deep Neural Network Learning Based on Active Sampling [J]. Computer Science, 2022, 49(7): 164-169.
[12]	SU Dan-ning, CAO Gui-tao, WANG Yan-nan, WANG Hong, REN He. Survey of Deep Learning for Radar Emitter Identification Based on Small Sample [J]. Computer Science, 2022, 49(7): 226-235.
[13]	HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[14]	CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126.
[15]	LAI Teng-fei, ZHOU Hai-yang, YU Fei-hong. Real-time Extend Depth of Field Algorithm for Video Processing [J]. Computer Science, 2022, 49(6A): 314-318.