Computer Science ›› 2023, Vol. 50 ›› Issue (1): 123-130.doi: 10.11896/jsjkx.211100058

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Study on Unsupervised Image Dehazing and Low-light Image Enhancement Algorithms Based on Luminance Adjustment

WANG Bin, LIANG Yudong, LIU Zhe, ZHANG Chao, LI Deyu   

  1. School of Computer and Information Technology,Shanxi University,Taiyuan 030006,China
  • Received:2021-11-05 Revised:2022-07-28 Online:2023-01-15 Published:2023-01-09
  • About author:WANG Bin,born in 1998,master.His main research interests include compu-ter vision and image processing.
    LIANG Yudong,born in 1988,associate professor.His main research interests include computer vision,image proces-sing and deep learning based applications.
  • Supported by:
    National Natural Science Foundation of China(61802237,62272284,61906114),Natural Science Foundation of Shanxi Province(201901D211176,201901D211170,202103021223464),Scientific and Technological Innovation Programs of Higher Education Institutions in Shanxi(2019L0066),Science and Technology Major Project of Shanxi Province(202101020101019),Key R & D Program of Shanxi Province(International Cooperation,201903D421041,Energy Conservation and Environmental Protection,202102070301019) and Special Fund for Science and Technology Innovation Teams of Shanxi Province.

Abstract: Among the degradations of low-quality images,luminance deviations such as brighter or darker images are very common image degradation phenomena.The image enhancement method based on fully supervised learning faces the dilemma that the training data is difficult to obtain or the acquisition cost is too high,and the training data is inconsistent with the application scene.To handle these problems,an unsupervised image dehazing and low-light enhancement algorithm based on luminance adjustment is proposed in this paper.A deep architecture with channel attention and pixel attention mechanism are designed to measure the differences between enhanced images and input low-quality images.A variable quadratic function has been applied to adjust the pixel luminance of the image.Multiple unsupervised losses i.e.,brightness saturation loss,spatial consistency loss,illumination smoothness loss and pseudo-label supervision loss are utilized to alleviate the illumination deviations but to ensure the identity between the enhanced images and the input low-quality images,which efficiently improve the quality of the images.Empirically,an intensity compression strategy is applied for the hazy images to darken the hazy images to have a similar intensity range with low-light images.Thus,the hazy images can be treated equally with low-light images with our deep network to adjust the luminance of the image.For the dehazing task,compared with the second-best method,our method improves the PSNR value for 2.8 dB and SSIM value for 0.01 in RESIDE dehazing dataset.For the low-light enhancement task,our method outperforms the second-best method for 0.56 dB and 0.01 separately measured by PSNR and SSIM in the SICE dataset.The proposed image dehazing and low-light enhancement algorithms can restore high-quality images from hazy images and low-light images.It effectively overcomes the difficulty of acquiring the targeted enhanced data or alleviates the problem of domain gap between training data and application data in the low-level vision tasks,which improves its adaptivity in real applications.

Key words: Unsupervised learning, Luminance adjustment, Image dehazing, Low-light enhancement, Deep Learning

CLC Number: 

  • TP391
[1]ABDULLAH-AL-WADUD M,KABIR M H,DEWAN M A A,et al.A dynamic histogram equalization for image contrast enhancement[J].IEEE Transactions on Consumer Electronics,2007,53(2):593-600.
[2]HE K,SUN J,TANG X.Single image haze removal using dark channel prior[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2010,33(12):2341-2353.
[3]LAND E H.The retinex theory of color vision[J].ScientificAmerican,1977,237(6):108-129.
[4]CAI B,XU X,JIA K,et al.Dehazenet:An end-to-end system for single image haze removal[J].IEEE Transactions on Image Processing,2016,25(11):5187-5198.
[5]WEI C,WANG W,YANG W,et al.Deep retinex decomposition for low-light enhancement[J].arXiv:1808.04560,2018.
[6]YAN L,ZHENG W,GOU C,et al.Feature Aggregation Attention Network for Single Image Dehazing[C]//2020 IEEE International Conference on Image Processing(ICIP).IEEE,2020:923-927.
[7]PIZER S M,JOHSON R E,ERICKSEN J P,et al.Contrast-li-mited adaptive histogram equalization:Speed and effectiveness[C]//Proceedings of the First Conference on Visualization in Biomedical Computing,Atlanta,Georgia.1990,337:1.
[8]JOBSON D J,RAHMAN Z,WOODELL G A.Properties andperformance of a center/surround retinex[J].IEEE Transactions on Image Processing,1997,6(3):451-462.
[9]WANG S,ZHENG J,HU H M,et al.Naturalness preserved enhancement algorithm for non-uniform illumination images[J].IEEE Transactions on Image Processing,2013,22(9):3538-3548.
[10]CAI J,GU S,ZHANG L.Learning a deep single image contrast enhancer from multi-exposure images[J].IEEE Transactions on Image Processing,2018,27(4):2049-2062.
[11]REN W,LIU S,MA L,et al.Low-light image enhancement via a deep hybrid network[J].IEEE Transactions on Image Proces-sing,2019,28(9):4364-4375.
[12]LORE K G,AKINTAYO A,SARKAR S.LLNet:A deep autoencoder approach to natural low-light image enhancement[J].Pattern Recognition,2017,61:650-662.
[13]YANG W,WANG S,FANG Y,et al.From fidelity to perceptual quality:A semi-supervised approach for low-light image enhancement[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:3063-3072.
[14]JIANG Y,GONG X,LIU D,et al.Enlightengan:Deep light enhancement without paired supervision[J].IEEE Transactions on Image Processing,2021,30:2340-2349.
[15]BERMAN D,AVIDAN S.Non-local image dehazing[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:1674-1682.
[16]ZHANG H,PATEL V M.Densely connected pyramid dehazing network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:3194-3203.
[17]LI L,DONG Y,REN W,et al.Semi-supervised image dehazing[J].IEEE Transactions on Image Processing,2019,29:2766-2779.
[18]GANDELSMAN Y,SHOCHER A,IRANI M.“Double-DIP”:Unsupervised Image Decomposition via Coupled Deep-Image-Priors[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:11026-11035.
[19]CHEN Y S,WANG Y C,KAO M H,et al.Deep photo enhancer:Unpaired learning for image enhancement from photographs with gans[C]//Proceedings of the IEEE Conference on Compu-ter Vision and Pattern Recognition.2018:6306-6314.
[20]DING Y J,HUANG S.An Improved Generative AdversarialNetwork for Image Dehazing[J].Computer Engineering,2022,48(6):207-212.
[21]HE T,YU S M,XU H.Single Image Dehazing Method Based on Conditional Generative Adversarial Network and Knowledge Distillation[J].Computer Engineering,2022,48(4):165-172.
[22]GODARD C,MAC AODHA O,BROSTOW G J.Unsupervised monocular depth estimation with left-right consistency[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:270-279.
[23]KRULL A,BUCHHOLZ T O,JUG F.Noise2void-learning denoising from single noisy images[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:2129-2137.
[24]GUO C,LI C,GUO J,et al.Zero-reference deep curve estimation for low-light image enhancement[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:1780-1789.
[25]LI B,REN W,FU D,et al.Reside:A benchmark for singleimage dehazing[J].arXiv:1712.04143,2017.
[26]GEIGER A,LENZ P,STILLER C,et al.Vision meets robotics:The kitti dataset[J].The International Journal of Robotics Research,2013,32(11):1231-1237.
[27]FU X,ZENG D,HUANG Y,et al.A weighted variational model for simultaneous reflectance and illumination estimation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:2782-2790.
[28]GUO X,LI Y,LING H.LIME:Low-light image enhancementvia illumination map estimation[J].IEEE Transactions on image processing,2016,26(2):982-993.
[29]ULYANOV D,VEDALDI A,LEMPITSKY V.Deep image prior[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:9446-9454.
[1] LI Xuehui, ZHANG Yongjun, SHI Dianxi, XU Huachi, SHI Yanyan. AFTM:Anchor-free Object Tracking Method with Attention Features [J]. Computer Science, 2023, 50(1): 138-146.
[2] SUN Kaili, LUO Xudong , Michael Y.LUO. Survey of Applications of Pretrained Language Models [J]. Computer Science, 2023, 50(1): 176-184.
[3] ZHENG Cheng, MEI Liang, ZHAO Yiyan, ZHANG Suhang. Text Classification Method Based on Bidirectional Attention and Gated Graph Convolutional Networks [J]. Computer Science, 2023, 50(1): 221-228.
[4] LI Xiaoling, WU Haotian, ZHOU Tao, LU Hui. Password Guessing Model Based on Reinforcement Learning [J]. Computer Science, 2023, 50(1): 334-341.
[5] CAI Xiao, CEHN Zhihua, SHENG Bin. SPT:Swin Pyramid Transformer for Object Detection of Remote Sensing [J]. Computer Science, 2023, 50(1): 105-113.
[6] TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[7] SONG Jie, LIANG Mei-yu, XUE Zhe, DU Jun-ping, KOU Fei-fei. Scientific Paper Heterogeneous Graph Node Representation Learning Method Based onUnsupervised Clustering Level [J]. Computer Science, 2022, 49(9): 64-69.
[8] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[9] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[10] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[11] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[12] WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[13] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[14] SU Dan-ning, CAO Gui-tao, WANG Yan-nan, WANG Hong, REN He. Survey of Deep Learning for Radar Emitter Identification Based on Small Sample [J]. Computer Science, 2022, 49(7): 226-235.
[15] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!