Computer Science ›› 2022, Vol. 49 ›› Issue (5): 50-57.doi: 10.11896/jsjkx.210400093

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Multi-scale Feature Fusion Image Dehazing Algorithm Combined with Attention Mechanism

FAN Xin-nan1, ZHAO Zhong-xin2, YAN Wei1, YAN Xi-jun2, SHI Peng-fei1   

  1. 1 College of Internet of Things Engineering,Hohai University,Changzhou,Jiangsu 213022,China
    2 School of Computer and Information,Hohai University,Nanjing 211100,China
  • Received:2021-04-09 Revised:2021-09-09 Online:2022-05-15 Published:2022-05-06
  • About author:FAN Xin-nan,born in 1965,Ph.D,professor,Ph.D supervisor.His main research interests include information acquisition and processing,image proces-sing and machine vision.
    SHI Peng-fei,born in 1985,Ph.D,associate professor.His main research inte-rests include machine vision,image processing and multi-source information fusion.
  • Supported by:
    Applied Basic Research Programs of Changzhou (CJ20200061).

Abstract: Aiming at the problems that traditional image dehazing algorithms are easily restricted by prior knowledge and color distortion,a multi-scale feature fusion image dehazing algorithm combined with attention mechanism is proposed.The algorithm first obtains feature maps of multiple scales through down-sampling operations,and then uses skip connections between feature maps of different scales to connect the feature maps of the encoder part and the decoder part for feature fusion.At the same time,a feature attention module composed of channel attention submodule and pixel attention submodule is added to the network to control the importance of different channels and pixels.This feature attention module allows the network to pay more attention to detailed information and important features,therefore,a better dehazing effect can be achieved.In order to verify the effectiveness of the proposed algorithm,qualitative and quantitative comparative experiments are carried out on the RESIDE dataset with five popular dehazing algorithms.The experimental results show that the proposed algorithm can more completely dehazing,and the preservation of image color is better.At the same time,the average values on the two evaluation indicators PSNR (Peak Signal to Noise Ratio) and SSIM (Structure Similarity) are 28.83 dB and 0.957 5,respectively,which are 2.23 dB and 0.017 2 higher than the second-performance model in the comparison algorithm.Then,qualitative comparison experiments are performed between the proposed algorithm and five comparison algorithms on the MSD data set and real images.The experimental results further prove that the proposed algorithm has good dehazing performance and color retention.

Key words: Attention mechanism, Color retention, Dehazing algorithm, Dehazing performance, Multi-scale feature fusion

CLC Number: 

  • TP391
[1]GAO Z Z,WEI W B,PAN Z K,et al.Image dehazing combining dark channel prior and Hessian regular term[J].Journal of Graphics,2020,41(1):73-80.
[2]CHEN Y,GUO H G,AI Y P.Single image dehazing method based on multi-scale convolution neural network[J].Acta Optica Sinica,2019,39(10):1-10.
[3]LENG J W,LI P.Single image defogging algorithm based onhigh-order markov random fields[J].Journal of Graphics,2017,38(5):745-753.
[4]LI B Y,REN W Q,FU D P,et al.Benchmarking single-image dehazing and beyond[J].IEEE Transactions on Image Proces-sing,2018,28(1):492-505.
[5]XIAO M X,LU C H,WEI H C,et al.Study on monitoring technology of straw burning based on UAV aerial image dehazing enhancement algorithm[J].Journal of Electronic Measurement and Instrumentation,2017:31(4):543-548.
[6]ZHANG H,PATEL V M.Densely connected pyramid dehazing network[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.Salt Lake City:IEEE Press,2018:3194-3203.
[7]CHU G S,SONG Y L,LI X C,et al.Near infrared dehazed imaging system based on SCMOS sensor[J].Chinese Journal of Scientific Instrument,2014,35(6):138-141.
[8]WU J W,YU Z C,LI Z Y,et al.A two-stage image dehazing network based on deep learning[J].Computer Applications and Software,2020,37(4):197-202.
[9]HE K M,SUN J,TANG X O.Single image haze removal using dark channel prior[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(12):2341-2353.
[10]MENG G F,WANG Y,DUAN J Y,et al.Efficient image deha-zing with boundary constraint and contextual regularization[C]//2013 IEEE International Conference on Computer Vision.Sydney:IEEE Press,2013:617-624.
[11]ZHU Q S,MAI J M,SHAO L.A fast single image haze removal algorithm using color attenuation prior[J].IEEE Transactions on Image Processing,2015,24(11):3522-3533.
[12]CAI B L,XU X M,JIA K,et al.DehazeNet:an end-to-end system for single image haze removal[J].IEEE Transactions on Image Processing,2016,25(11):5187-5198.
[13]REN W Q,LIU S,ZHANG H,et al.Single image dehazing via multi-scale convolutional neural networks[C]//2016 European Conference on Computer Vision.Amsterdam:Springer Press,2016:154-169.
[14]LI B Y,PENG X L,WANG Z Y,et al.Aod-net:all-in-one dehazing network[C]//2017 IEEE International Conference on Computer Vision.Venice:IEEE Press,2017:4780-4788.
[15]REN W Q,MA L,ZHANG J W,et al.Gated fusion network for single image dehazing[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.Salt Lake City:IEEE Press,2018:3253-3261.
[16]CHEN D D,HE M M,FAN Q N,et al.Gated context aggregation network for image dehazing and deraining[C]//2019 IEEE Winter Conference on Applications of Computer Vision.Waikoloa Village:IEEE Press,2019:1375-1383.
[17]CHOI H,LIM H,YU S,et al.Haze removal of multispectral remote sensing imagery using atmospheric scattering model-based haze thickness map[C]//2020 IEEE International Conference on Consumer Electronics-Asia.Seoul:IEEE Press,2020:1-2.
[18]TANG K T,YANG J C,WANG J.Investigating haze-relevant features in a learning framework for image dehazing[C]//2014 IEEE Conference on Computer Vision and Pattern Recognition.Columbus:IEEE Press,2014:2995-3002.
[19]HE K M,ZHANG X Y,REN S Q,et al.Deep residual learning for image recognition[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition.Las Vegas:IEEE Press,2016:770-778.
[20]CHEN L,ZHANG H W,XIAO J,et al.Sca-cnn:Spatial andchannel-wise attention in convolutional networks for image captioning[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition.Honolulu:IEEE Press,2017:6298-6306.
[21]SILBERMAN N,HOIEM D,KOHLI P,et al.Indoor segmentation and support inference from rgbd images[C]//12th Euro-pean Conference on Computer Vision.Florence:Springer Press,2012:746-760.
[22]HE T,ZHANG Z,ZHANG H,et al.Bag of tricks for image classification with convolutional neural networks[C]//2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition.Long Beach:IEEE Press,2019:558-567.
[1] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[2] ZHOU Fang-quan, CHENG Wei-qing. Sequence Recommendation Based on Global Enhanced Graph Neural Network [J]. Computer Science, 2022, 49(9): 55-63.
[3] DAI Yu, XU Lin-feng. Cross-image Text Reading Method Based on Text Line Matching [J]. Computer Science, 2022, 49(9): 139-145.
[4] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[5] XIONG Li-qin, CAO Lei, LAI Jun, CHEN Xi-liang. Overview of Multi-agent Deep Reinforcement Learning Based on Value Factorization [J]. Computer Science, 2022, 49(9): 172-182.
[6] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[7] WANG Ming, PENG Jian, HUANG Fei-hu. Multi-time Scale Spatial-Temporal Graph Neural Network for Traffic Flow Prediction [J]. Computer Science, 2022, 49(8): 40-48.
[8] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[9] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[10] YAN Jia-dan, JIA Cai-yan. Text Classification Method Based on Information Fusion of Dual-graph Neural Network [J]. Computer Science, 2022, 49(8): 230-236.
[11] JIN Fang-yan, WANG Xiu-li. Implicit Causality Extraction of Financial Events Integrating RACNN and BiLSTM [J]. Computer Science, 2022, 49(7): 179-186.
[12] XIONG Luo-geng, ZHENG Shang, ZOU Hai-tao, YU Hua-long, GAO Shang. Software Self-admitted Technical Debt Identification with Bidirectional Gate Recurrent Unit and Attention Mechanism [J]. Computer Science, 2022, 49(7): 212-219.
[13] PENG Shuang, WU Jiang-jiang, CHEN Hao, DU Chun, LI Jun. Satellite Onboard Observation Task Planning Based on Attention Neural Network [J]. Computer Science, 2022, 49(7): 242-247.
[14] ZHANG Ying-tao, ZHANG Jie, ZHANG Rui, ZHANG Wen-qiang. Photorealistic Style Transfer Guided by Global Information [J]. Computer Science, 2022, 49(7): 100-105.
[15] ZENG Zhi-xian, CAO Jian-jun, WENG Nian-feng, JIANG Guo-quan, XU Bin. Fine-grained Semantic Association Video-Text Cross-modal Entity Resolution Based on Attention Mechanism [J]. Computer Science, 2022, 49(7): 106-112.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!