基于多补丁和多尺度层级聚合网络的快速非均匀图像去雾

doi:10.11896/jsjkx.200900058

Abstract

Abstract: Despite dehazing algorithms based on convolutional neural networks have made tremendous progress in synthetic uniform hazy datasets,they still perform poorly on real nonhomogeneous hazy images.In order to achieve fast and effective nonhomogeneous image dehazing,we propose a multi-patch and multi-scale hierarchical aggregation network (MPSHAN),which fuses multi-patch local information and multi-scale global information.Secondly,we propose a hierarchical fusion module (HFM),which not only decouples residual fusion to achieve richer non-linear feature expression,but also improves the feature fusion qua-lity at key locations through the channel attention mechanism.At the same time,dilated convolution is used on hierarchies to obtain multi-scale information,which enhances feature maps to optimize the fusion effect.In addition,in the loss function,we add frequency domain loss to restore better edge quality.The experimental results show that the proposed algorithm has good robustness on nonhomogeneous hazy images,and the average processing time of 1 200×1 600 high-resolution images is only 0.044 s.Compared with other dehazing algorithms,it achieves a better balance between image dehazing effect and running time.

Key words: Attention mechanism, Dilated convolution, Hierarchical fusion module, Image dehazing, Multi-patch, Multi-scale

CLC Number:

TP391

YANG Kun, ZHANG Juan, FANG Zhi-jun. Multi-patch and Multi-scale Hierarchical Aggregation Network for Fast Nonhomogeneous ImageDehazing[J].Computer Science, 2021, 48(11): 250-257.

References

[1]REN S,HE K,GIRSHICK R,et al.Faster R-CNN:Towards Real-Time Object Detection with Region Proposal Networks[J].IEEE Transactions Pattern Analysis Machine Intelligence,2017,39(6):1137-1149.
[2]SHELHAMER E,LONG J,DARRELL T.Fully Convolutional Networks for Semantic Segmentation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,39(4):640-651.
[3]RANJAN R,PATEL V M,CHELLAPPA R.HyperFace:ADeep Multi-Task Learning Framework for Face Detection,Landmark Localization,Pose Estimation,and Gender Recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2019,41(1):121-135.
[4]CAI B,XU X,JIA K,et al.DehazeNet:An End-to-End System for Single Image Haze Removal[J].IEEE Transactions on Image Processing,2016,25(11):5187-5198.
[5]REN W,LIU S,ZHANG H,et al.Single Image Dehazing via Multi-scale Convolutional Neural Networks[C]//Proceedings of the European Conference on Computer Vision(ECCV).Sprin-ger,2016:154-169.
[6]LI B,PENG X,WANG Z,et al.AOD-Net:All-in-One Dehazing Network[C]//Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV).IEEE,2017:4780-4788.
[7]ZHAO J,ZHANG J,LI Z,et al.DD-CycleGAN:Unpaired image dehazing via Double-Discriminator Cycle-Consistent Generative Adversarial Network[J].Engineering Applications of Artificial Intelligence,2019,82:263-271.
[8]CHEN D,HE M,FAN Q,et al.Gated Context AggregationNetwork for Image Dehazing and Deraining[C]//Proceedings of the 2019 IEEE Winter Conference on Applications of Computer Vision (WACV).IEEE,2019:1375-1383.
[9]LIU X,MA Y,SHI Z,et al.GridDehazeNet:Attention-BasedMulti-Scale Network for Image Dehazing[C]//Proceedings of the 2019 IEEE International Conference on Computer Vision (ICCV).IEEE,2019:7313-7322.
[10]QIN X,WANG Z,BAI Y,et al.FFA-Net:Feature Fusion Attention Network for Single Image Dehazing[C]//Proceedings of the AAAI Conference on Artificial Intelligence.AAAI,2020:11908-11915.
[11]ANCUTI C O,ANCUTI C,TIMOFTE R.NH-HAZE:AnImage Dehazing Benchmark with Non-Homogeneous Hazy and Haze-Free Images[C]//Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).IEEE,2020:1798-1805.
[12]DAS S D,DUTTA S.Fast Deep Multi-patch Hierarchical Network for Nonhomogeneous Image Dehazing[C]//Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).IEEE,2020:1994-2001.
[13]HIDE R.Optics of the Atmosphere:Scattering by Molecules andParticles[J].Physics Bulletin,1977,28(11):521.
[14]HE K M,SUN J,TANG X O.Single image haze removal using dark channel prior[C]//Proceedings of the 2009 IEEEConfe-rence on Computer Vision and Pattern Recognition.IEEE,2009:1956-1963.
[15]ZHU Z,HUANG R,ZANG T G,et al.Single Image Defogging Method Based on Weighted Near-InFrared Image Fusion[J].Computer Science,2020,47(8):241-244.
[16]CHEN Z Y,LONG D Y,WANG X,et al.Dark Channel Defogging Algorithm Based on Inverse Channel and Improved Guided Filtering[J].Computer Engineering,2021,47(6):245-252.
[17]LIU J,WU H,XIE Y,et al.Trident Dehazing Network[C]//Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).IEEE,2020:1732-1741.
[18]ZHANG H,DAI Y,LI H,et al.Deep Stacked HierarchicalMulti-Patch Network for Image Deblurring[C]//Proceedings of the 2019 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE,2019:5971-5979.
[19]CHEN L,PAPANDREOU G,KOKKINOS I,et al.DeepLab:Semantic Image Segmentation with Deep Convolutional Nets,Atrous Convolution,and Fully Connected CRFs[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2018,40(4):834-848.
[20]HU J,SHEN L,SUN G.Squeeze-and-Excitation Networks[C]//Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition(CVPR).IEEE,2018:7132-7141.
[21]WOO S,PARK J,LEE J Y,et al.CBAM:Convolutional Block Attention Module[C]//Proceedings of the European Conference on Computer Vision(ECCV).Springer,2018:3-19.
[22]ZHONG Z,LIN Z Q,BIDART R,et al.Squeeze-and-Attention Networks for Semantic Segmentation[C]//Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).IEEE,2020:13062-13071.
[23]HOU Q,ZHANG L,CHENG M M,et al.Strip Pooling:Rethinking Spatial Pooling for Scene Parsing[C]//Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).IEEE,2020:4002-4011.
[24]ANCUTI C O,ANCUTI C,SBERT M,et al.Dense-Haze:ABenchmark for Image Dehazing with Dense-Haze and Haze-Free Images[C]//Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP).IEEE,2019:1014-1018.
[25]KINGMA D ,BA J.Adam:A Method for Stochastic Optimization[C]//Proceedings of the International Conference for Learning Representations (ICLR).2015:1-15.
[26]JOHNSON J,ALAHI A,LI F F.Perceptual Losses for Real-Time Style Transfer and Super-Resolution[C]//Proceedings of the European Conference on Computer Vision(ECCV).Sprin-ger,2016:694-711.
[27]SIMONYAN K,ZISSERMAN A.Very Deep Convolutional Networks for Large-Scale Image Recognition[J].arXiv:1409.1556,2014.
[28]ZHOU W,BOVIK A C,SHEIKH H R,et al.Image quality assessment:from error visibility to structural similarity[J].IEEE Transactions on Image Processing,2004,13(4):600-612.

Related Articles 15

[1]	RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[2]	ZHOU Fang-quan, CHENG Wei-qing. Sequence Recommendation Based on Global Enhanced Graph Neural Network [J]. Computer Science, 2022, 49(9): 55-63.
[3]	DAI Yu, XU Lin-feng. Cross-image Text Reading Method Based on Text Line Matching [J]. Computer Science, 2022, 49(9): 139-145.
[4]	ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[5]	XIONG Li-qin, CAO Lei, LAI Jun, CHEN Xi-liang. Overview of Multi-agent Deep Reinforcement Learning Based on Value Factorization [J]. Computer Science, 2022, 49(9): 172-182.
[6]	LI Yao, LI Tao, LI Qi-fan, LIANG Jia-rui, Ibegbu Nnamdi JULIAN, CHEN Jun-jie, GUO Hao. Construction and Multi-feature Fusion Classification Research Based on Multi-scale Sparse Brain Functional Hyper-network [J]. Computer Science, 2022, 49(8): 257-266.
[7]	WANG Xin-tong, WANG Xuan, SUN Zhi-xin. Network Traffic Anomaly Detection Method Based on Multi-scale Memory Residual Network [J]. Computer Science, 2022, 49(8): 314-322.
[8]	JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[9]	ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[10]	WEI Kai-xuan, FU Ying. Re-parameterized Multi-scale Fusion Network for Efficient Extreme Low-light Raw Denoising [J]. Computer Science, 2022, 49(8): 120-126.
[11]	SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[12]	YAN Jia-dan, JIA Cai-yan. Text Classification Method Based on Information Fusion of Dual-graph Neural Network [J]. Computer Science, 2022, 49(8): 230-236.
[13]	WANG Ming, PENG Jian, HUANG Fei-hu. Multi-time Scale Spatial-Temporal Graph Neural Network for Traffic Flow Prediction [J]. Computer Science, 2022, 49(8): 40-48.
[14]	JIN Fang-yan, WANG Xiu-li. Implicit Causality Extraction of Financial Events Integrating RACNN and BiLSTM [J]. Computer Science, 2022, 49(7): 179-186.
[15]	XIONG Luo-geng, ZHENG Shang, ZOU Hai-tao, YU Hua-long, GAO Shang. Software Self-admitted Technical Debt Identification with Bidirectional Gate Recurrent Unit and Attention Mechanism [J]. Computer Science, 2022, 49(7): 212-219.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

Comments

Recommended 0

No Suggested Reading articles found!

Multi-patch and Multi-scale Hierarchical Aggregation Network for Fast Nonhomogeneous ImageDehazing

PDF (PC)

Abstract

Cite this article

share this article

References

Related Articles 15

Metrics

Comments

Recommended 0