Computer Science ›› 2025, Vol. 52 ›› Issue (11): 206-212.doi: 10.11896/jsjkx.240900013

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Image Deraining Based on Union Attention Mechanism and Multi-stage Feature Extraction

LIN Zukai, HOU Guojia, WANG Guodong, PAN Zhenkuan   

  1. College of Computer Science & Technology,Qingdao University,Qingdao,Shandong 266071,China
  • Received:2024-09-02 Revised:2024-11-26 Online:2025-11-15 Published:2025-11-06
  • About author:LIN Zukai,born in 2000,postgraduate,is a member of CCF(No.U6520G).His main research interest is image proces-sing.
    HOU Guojia,born in 1986,Ph.D,asso-ciate professor,master supervisor,is a member of CCF(No.76713M).His main research interests include image processing and pattern recognition.
  • Supported by:
    Natural Science Foundation of Shandong Province(ZR2024MF125),Natural Science Foundation of Qingdao Municipality(24-4-4-zrjj-122-jch) and National Natural Science Foundation of China(61901240).

Abstract: Existing image deraining networks predominantly rely on the large-scale synthetic paired datasets for training,ignoring the difference in spatial distribution characteristics and the difference in channel importance between synthetic and real data,resulting in blurred texture details and diminished generalization performance.To address these issues,this paper develops an unsupervised network model for image deraining based on a union attention mechanism with multi-stage feature extraction.To adapt to the spatial locality of rain streaks,the feature-aware module is initially designed to extract rain streaks through the combination of spatial and channel attention mechanisms,while dilation convolution is used to enhance the sensory field of rain feature extraction.In addition,a recurrent neural network is introduced to extract the rain stripe features gradually,and the useful information of the previous stage is retained in the cycle to improve the rain stripe feature extraction ability.To further enhance the discrimination of local micro-details and global texture structure features,it designs a multi-scale discriminator for distinguishing images at three different scales and guideings the generator to produce higher quality images.Qualitative and quantitative experiments on synthetic and real datasets show that the proposed method is superior to some supervised,semi-supervised and unsupervised me-thods on PSNR,SSIM and NIQE metrics,which verifies its effectiveness and generalization.

Key words: Image processing, Image deraining, Multi-attention mechanism, Multi-stage feature extraction, Unsupervised learning

CLC Number: 

  • TP391
[1]ZHAO Z Q,ZHENG P,XU S T,et al.Object detection withdeep learning:A review[J].IEEE Transactions on Neural Networks and Learning Systems,2019,30(11):3212-3232.
[2]YU J,TAN M,ZHANG H Y,et al.Hierarchical deep click feature prediction for fine-grained image recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2022,44(2):563-578.
[3]MARVASTI-ZADEH S M,CHENG L,GHANEI-YAKHDANH,et al.Deep learning for visual tracking:A comprehensive survey[J].IEEE Transactions on Intelligent Transportation Systems,2022,23(5):3943-3968.
[4]YANG W H,TAN R T,WANG S Q,et al.Single image derai-ning:From model-based to data-driven and beyond[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2021,43(11):4059-4077.
[5]ZHANG Z,WEI Y Y,ZHANG H J,et al.Data-driven single image deraining:A comprehensive review and new perspectives[J].Pattern Recognition,2023,143:109740.
[6]MENG X Y,XUE X H,LI W L,et al.Motion-estimation based space-temporal feature aggregation network for multi-frames rain removal[J].Computer Science,2021,48(5):170-176.
[7]XIE Q Q,ZHANG H,GAI S.Multi-resolution context aggregation network for single image rain removal[J].Journal of Computer-Aided Design & Conputer Graphics,2022,34(2):232-244.
[8]WEI Y Y,ZHANG Z,WANG Y,et al.Deraincyclegan:Rain at-tentive cyclegan for single image deraining and rainmaking[J].IEEE Transactions on Image Processing,2021,30:4788-4801.
[9]CHEN M M,WANG P,SHANG D H,et al.Cycle-attention-derain:Unsupervised rain removal with CycleGAN[J].The Visual Computer,2023,39(8):3727-3739.
[10]KANG L W,LIN C W,FU Y H.Automatic single-image-based rain streaks removal via image decomposition[J].IEEE Transactions on Image Processing,2012,21(4):1742-1755.
[11]DU S L,LIU Y G,YE M,et al.Single image deraining via decorrelating the rain streaks and background scene in gradient domain[J].Pattern Recognition,2018,79:303-317.
[12]WANG H,XIE Q,ZHAO Q,et al.A Model-Driven Deep Neural Network for Single Image Rain Removal[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:3103-3112.
[13]HSU W Y,CHANG W C.Recurrent wavelet structure-preser-ving residual network for single image deraining[J].Pattern Recognition,2023,137:109294.
[14]CHEN X,PAN J H,DONG J.Bidirectional Multi-Scale Implicit Neural Representations for Image Deraining[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2024:25627-25636.
[15]QIU Y R,YAO G L,FENG J,et al.Single image de-raining algorithm based on semi-supervised learning[J].Journal of Computer Applications,2022,42(5):1577-1582.
[16]JIANG N F,LUO J W,LIN J H,et al.Lightweight semi-supervised network for single image rain removal[J].Pattern Recognition,2023,137:109277.
[17]CHEN X,PAN J S,JIANG K,et al.Unpaired Deep Image Deraining Using Dual Contrastive Learning[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022:2017-2026.
[18]YASARLA R,SINDAGI V A,PATEL V M.Syn2real Transfer Learning for Image Deraining Using Gaussian Processes[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:2726-2736.
[19]YE Y T,YU C F,CHANG Y,et al.Unsupervised Deraining:Where Contrastive Learning Meets Self-Similarity[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2022:5821-5830.
[20]WEN Y B,GAO T,CHEN T.Neural schrödinger bridge for unpaired real-world image deraining[J].Information Sciences,2024,682:121199.
[21]YANG W H,TAN R T,FENG J S,et al.Deep Joint Rain Detection and Removal from a Single Image[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:1357-1366.
[22]HU J,SHEN L,SUN G.Squeeze-and-Excitation Networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:7132-7141.
[23]JADERBERG M,SIMONYAN K,ZISSERMAN A,et al.Spatial transformer networks[C]//Proceedings of the 29th InternationalConference on Neural Information Processing Systems.2015:2017-2025.
[24]LI Y,TAN R T,GUO X J,et al.Rain Streak Removal Using Layer Priors[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:2736-2744.
[25]WANG T Y,YANG X,XU K,et al.Spatial Attentive Single-Image Deraining with a High Quality Real Rain Dataset[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:12270-12279.
[26]GUO Y,XIAO X Y,ChANG Y,et al.From Sky to the Ground:A Large-Scale Benchmark and Simple Baseline Towards Real Rain Removal[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2023:12097-12107.
[27]ZHANG H,JIA D L,HAN Z X.Dual-task complementary networks for single-image deraining[J].Signal,Image and Video Processing,2023,17(8):4171-4179.
[28]ZHU J Y,PARK T,ISOLA P,et al.Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks[C]//Proceedings of the IEEE International Conference on Computer Vision.2017:2223-2232.
[1] JIANG Rui, FAN Shuwen, WANG Xiaoming, XU Youyun. Clustering Algorithm Based on Improved SOM Model [J]. Computer Science, 2025, 52(8): 162-170.
[2] DING Zhengze, NIE Rencan, LI Jintao, SU Huaping, XU Hang. MTFuse:An Infrared and Visible Image Fusion Network Based on Mamba and Transformer [J]. Computer Science, 2025, 52(8): 188-194.
[3] SHI Xincheng, WANG Baohui, YU Litao, DU Hui. Study on Segmentation Algorithm of Lower Limb Bone Anatomical Structure Based on 3D CTImages [J]. Computer Science, 2025, 52(6A): 240500119-9.
[4] AN Rui, LU Jin, YANG Jingjing. Deep Clustering Method Based on Dual-branch Wavelet Convolutional Autoencoder and DataAugmentation [J]. Computer Science, 2025, 52(4): 129-137.
[5] HE Liren, PENG Bo, CHI Mingmin. Unsupervised Multi-class Anomaly Detection Based on Prototype Reverse Distillation [J]. Computer Science, 2025, 52(2): 202-211.
[6] DING Xinyu, KONG Bing, CHEN Hongmei, BAO Chongming, ZHOU Lihua. Path-masked Autoencoder Guiding Unsupervised Attribute Graph Node Clustering [J]. Computer Science, 2025, 52(1): 160-169.
[7] LIU Yuming, DAI Yu, CHEN Gongping. Review of Federated Learning in Medical Image Processing [J]. Computer Science, 2025, 52(1): 183-193.
[8] LI Dongyang, NIE Rencan, PAN Linna, LI He. UMGN:An Infrared and Visible Image Fusion Network Based on Unsupervised Significance MaskGuidance [J]. Computer Science, 2024, 51(6A): 230600170-5.
[9] TAN Peng, OU Bo. Medical Image Reversible Contrast Enhancement Based on Adaptive Histogram Equalization [J]. Computer Science, 2024, 51(6A): 230700124-7.
[10] LOU Ren, HE Renqiang, ZHAO Sanyuan, HAO Xin, ZHOU Yueqi, WANG Xinyuan, LI Fangfang. Single Stage Unsupervised Visible-infrared Person Re-identification [J]. Computer Science, 2024, 51(6A): 230600138-7.
[11] ZHANG Tianchi, LIU Yuxuan. Research Progress of Underwater Image Processing Based on Deep Learning [J]. Computer Science, 2024, 51(6A): 230400107-12.
[12] LU Dongsheng, LONG Hua. Method for Homologous Spectrum Monitoring Data Identification Based on Spectrum SIFT [J]. Computer Science, 2024, 51(6A): 230300177-7.
[13] HE Yifan, HE Yulin, CUI Laizhong, HUANG Zhexue. Subspace-based I-nice Clustering Algorithm [J]. Computer Science, 2024, 51(6): 153-160.
[14] LIU Jiasen, HUANG Jun. Center Point Target Detection Algorithm Based on Improved Swin Transformer [J]. Computer Science, 2024, 51(6): 264-271.
[15] XUE Jinqiang, WU Qin. Progressive Multi-stage Image Denoising Algorithm Combining Convolutional Neural Network and
Multi-layer Perceptron
[J]. Computer Science, 2024, 51(4): 243-253.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!