Computer Science ›› 2023, Vol. 50 ›› Issue (6A): 220600171-6.doi: 10.11896/jsjkx.220600171

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Contrastive Learning for Low-light Image Enhancement

WU Jufeng1,3, ZHAO Xungang1,3, ZHOU Qiang1,3, RAO Ning1,2   

  1. 1 State Key Laboratory of Bridge Structure Health and Safety,Wuhan 430050,China;
    2 School of Computer Science and Engineering,Wuhan Institute of Technology,Wuhan 430205,China;
    3 China Railway Bridge Scientific Research Institute Co.,Ltd,Wuhan 430034,China
  • Online:2023-06-10 Published:2023-06-12
  • About author:WU Jufeng,born in 1983,postgraduate,senior engineer.His main research interest is bridge information technology. RAO Ning,born in 1998,postgraduate.Her main research interest is image restoration.
  • Supported by:
    Hubei Province Science and Technology Major Project(2020ACA006).

Abstract: Insufficient lighting in image capturing can significantly degrade the visibility and quality of images.To tackle this problem,this paper proposes a low-light image enhancement network based on contrastive learning.It is a challenging work to apply image-to-image translation task to image enhancement since the gap between low and normal light is too huge and complex for pixel-level restoration.Therefore,the proposed method takes in two steps.In order to build intermediate states that lie between the low and normal light,this paper first adopts a traditional method based on Retinex theory to initially enhance the low-light images.Second,in order to make the mappings between two domains,the subsequent enhancement is decomposed into two stages,content enhancement and degradation learning.This work is based on contrastive learning,which can enhance the representation ability of the networks,and achieves high-naturalness recovery.Extensive experimental results demonstrate the efficiency of proposed method,which can enhance the low-light image effectively with better image quality and detail restoration ability than the SOTA low-light image enhancement methods.

Key words: Insufficient lighting, Image enhancement, Image-to-Image translation, Contrastive learning, Degradation learning

CLC Number: 

  • TP37
[1]IBRAHIM H,KONG N S P.Brightness preserving dynamic histogram equalization for image contrast enhancement[J].IEEE Transactions on Consumer Electronics,2007,53(4):1752-1758.
[2]ARICI T,DIKBAS S,ALTUNBASAK Y.A histogram modification framework and its application for image contrast enhancement[J].IEEE Transactions on Image Processing,2009,18(9):1921-1935.
[3]RAHMAN S,RAHMAN M M,ABDULLAH-AL-WADUD M,et al.An adaptive gamma correction for image enhancement[J].EURASIP Journal on Image and Video Processing,2016,2016(1):1-13.
[4]LAND E H.The retinex theory of color vision[J].ScientificAmerican,1977,237(6):108-129.
[5]GUO X,LI Y,LING H.LIME:Low-light image enhancement via illumination map estimation[J].IEEE Transactions on Image Processing,2016,26(2):982-993.
[6]WANG S,ZHENG J,HU H M,et al.Naturalness preserved enhancement algorithm for non-uniform illumination images[J].IEEE Transactions on Image Processing,2013,22(9):3538-3548.
[7]LORE K G,AKINTAYO A,SARKAR S.LLNet:A deep autoencoder approach to natural low-light image enhancement[J].Pattern Recognition,2017,61:650-662.
[8]LV F,LU F,WU J,et al.MBLLEN:Low-Light Image/Video Enhancement Using CNNs[C]//BMVC.2018:220.
[9]WEI C,WANG W,YANG W,et al.Deep retinex decomposition for low-light enhancement[C]//British Machine Vision Confe-rence.2018.
[10]WANG R,ZHANG Q,FU C W,et al.Underexposed photo enhancement using deep illumination estimation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:6849-6857.
[11]ZHANG Y,ZHANG J,GUO X.Kindling the darkness:A practical low-light image enhancer[C]//Proceedings of the 27th ACM International Conference on Multimedia.2019:1632-1640.
[12]ZHANG Y,GUO X,MA J,et al.Beyond Brightening Low-light Images[J].International Journal of Computer Vision,2021,129(4):1013-1037.
[13]RONNEBERGER O,FISCHER P,BROX T.U-net:Convolu-tional networks for biomedical image segmentation[C]//International Conference on Medical image computing and computer-assisted intervention.Cham:Springer,2015:234-241.
[14]WANG Y,CAO Y,ZHA Z J,et al.Progressive retinex:Mutually reinforced illumination-noise perception network for low-light image enhancement[C]//Proceedings of the 27th ACM International Conference on Multimedia.2019:2015-2023.
[15]FAN M,WANG W,YANG W,et al.Integrating semantic segmentation and retinex model for low-light image enhancement[C]//Proceedings of the 28th ACM International Conference on Multimedia.2020:2317-2325.
[16]RAO N,LU T,ZHOU Q,et al.Seeing in the Dark by Component-GAN[J].IEEE Signal Processing Letters,2021,28:1250-1254.
[17]JIANG Y,GONG X,LIU D,et al.Enlightengan:Deep light enhancement without paired supervision[J].IEEE Transactions on Image Processing,2021,30:2340-2349.
[18]GUO C,LI C,GUO J,et al.Zero-reference deep curve estimation for low-light image enhancement[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:1780-1789.
[19]LI C,GUO C,LOY C C.Learning to enhance low-light image via zero-reference deep curve estimation[J].arXiv:2103.00860,2021.
[20]YANG W,WANG S,FANG Y,et al.From fidelity to perceptual quality:A semi-supervised approach for low-light image enhancement[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:3063-3072.
[21]PARK T,EFROS A A,ZHANG R,et al.Contrastive learning for unpaired image-to-image translation[C]//European Confe-rence on Computer Vision.Cham:Springer,2020:319-345.
[22]HAN J,SHOEIBY M,PETERSSON L,et al.Dual Contrastive Learning for Unsupervised Image-to-Image Translation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:746-755.
[23]GUTMANN M,HYVÄRINEN A.Noise-contrastive estima-tion:A new estimation principle for unnormalized statistical models[C]//Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics.JMLR Workshop and Conference Proceedings,2010:297-304.
[24]HE K,ZHANG X,REN S,et al.Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2016:770-778.
[25]ISOLA P,ZHU J Y,ZHOU T,et al.Image-to-image translation with conditional adversarial networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:1125-1134.
[1] WANG Mingxia, XIONG Yun. Disease Diagnosis Prediction Algorithm Based on Contrastive Learning [J]. Computer Science, 2023, 50(7): 46-52.
[2] HE Chao, CHEN Jinjie, JIN Zhao, LEI Yinjie. Automatic Modulation Recognition Method Based on Multimodal Time-Frequency Feature Fusion [J]. Computer Science, 2023, 50(4): 226-232.
[3] ZHAO Ming-hua, ZHOU Tong-tong, DU Shuang-li, SHI Zheng-hao. Single Backlit Image Enhancement Based on Virtual Exposure Method [J]. Computer Science, 2022, 49(6A): 384-389.
[4] ZHAO Zheng-peng, LI Jun-gang, PU Yuan-yuan. Low-light Image Enhancement Based on Retinex Theory by Convolutional Neural Network [J]. Computer Science, 2022, 49(6): 199-209.
[5] YUAN De-sen, LIU Xiu-jing, WU Qing-bo, LI Hong-liang, MENG Fan-man, NGAN King-ngi, XU Lin-feng. Visual Question Answering Method Based on Counterfactual Thinking [J]. Computer Science, 2022, 49(12): 229-235.
[6] YANG Xiu-zhang, WU Shuai, XIA Huan, YU Xiao-min. Research on Shui Characters Extraction and Recognition Based on Adaptive Image Enhancement Technology [J]. Computer Science, 2021, 48(6A): 74-79.
[7] HUANG Xue-bing, WEI Jia-yi, SHEN Wen-yu, LING Li. MR Image Enhancement Based on Adaptive Weighted Duplicate Filtering and Homomorphic Filtering [J]. Computer Science, 2021, 48(6A): 21-27.
[8] LI Chang-xing, LEI Liu, ZHANG Xiao-lu. Brain CT and MRI Image Fusion Based on Morphological Image Enhancement and PCNN [J]. Computer Science, 2020, 47(10): 194-199.
[9] XU Min-min, KOU Guang-jie, MA Yun-yan, YUE Jun, JIA Shi-xiang, ZHANG Zhi-wang. Color Image Enhancement Algorithm Based on PCNN Internal Activities [J]. Computer Science, 2019, 46(6A): 259-262.
[10] YAO Zhe-wei, YANG Feng, HUANG Jing, LIU Ya-qin. Improved CycleGANs for Intravascular Ultrasound Image Enhancement [J]. Computer Science, 2019, 46(5): 221-227.
[11] YANG Xiu-zhang, XIA Huan, YU Xiao-min. Image Enhancement and Recognition Method Based on Shui-characters [J]. Computer Science, 2019, 46(11A): 324-328.
[12] LIU Yang, ZHANG Jie, ZHANG Hui. Study and Application of Improved Retinex Algorithm in Image Defogging [J]. Computer Science, 2018, 45(6A): 242-243.
[13] ZHOU Li-jun. Low-contrast Crack Extraction Method Based on Image Enhancement and Watershed Segmentation [J]. Computer Science, 2018, 45(6A): 259-261.
[14] ZHAO Jun-hui, WU Yu-feng, HU Kun-rong and PU Bin. Color Image Enhancement Algorithm Based on Lab Color Space and Tone Mapping [J]. Computer Science, 2018, 45(2): 297-300.
[15] ZHANG Xiang, WANG Wei, XIAO Di. Improved Image Enhancemengt Algorithm Based on Multi-scale Retinex with Chromaticity Preservation [J]. Computer Science, 2018, 45(10): 246-249.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!