Computer Science ›› 2021, Vol. 48 ›› Issue (11A): 327-333.doi: 10.11896/jsjkx.210300072

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Nighttime Image Dehazing Method Based on Adaptive Light Source Region

WANG Tong-sen1, SHI Qin-zhong1, WANG De-fa1, DONG Shuo2, YANG Guo-wei1, YU Teng1   

  1. 1 College of Electronic Information,Qingdao University,Qingdao,Shandong 266071,China
    2 College of Computing,Qingdao University,Qingdao,Shandong 266071,China
  • Online:2021-11-10 Published:2021-11-12
  • About author:WANG Tong-sen,born in 2000,is a member of China Computer Federation.His main research interests include image processing and computer vision.
    YU Teng,born in 1988,associate professor.His main research interests include artificial intelligence and computer vision.
  • Supported by:
    National Key R&D Program of China(2017YFC080-4000) and National Natural Science Foundation of China(61772277,61873071).

Abstract: Nighttime hazy image will cause image quality degradation,mainly reflected in the uneven illumination,low contrast and serious color deviation of nighttime hazy image,and artificial light source makes the ambient light nonuniformity.The existing mainstream algorithms are mainly for daytime image processing,but are not suitable for night scene dehazing processing.This makes night dehazing more difficult.In order to solve the above problems,this paper analyzes the imaging features of night image with fog and proposes a new night image dehazing algorithm.Aiming at the problem of color deviation of hazy images at night,this paper proposes an improved maximum reflectance prior algorithm (MRP) for color correction.This method operates each color channel separately for color correction,so as to reduce the halo effect around the light source area caused by MRP.As for the characteristics of nonuniformity of ambient light in night scene,a minimum reflectance prior algorithm based on low frequency component of hazy images is proposed.In order to solve the problem that the dark channel prior (DCP) estimation of transmittance fails at the light source,we propose a region adaptive algorithm of transmittance estimation based on the light source.The experimental results show that the proposed algorithm can suppress the halo and the divergence of the light source area.At the same time,it can better reproduce the dark details and restore the image with better brightness.

Key words: Image dehazing, Image restoration, Nighttime image dehazing

CLC Number: 

  • TP391
[1]HE K M,SUN J,TANG X O.Single image haze removal using dark channel prior[C]//CVPR 2009:2009 IEEE Conference on Computer Vision and Pattern Recognition.Miami,FL,USA,2009:1956-1963.
[2]YANG A P,ZHAO M Q,WANG H X,et al.Nighttime Image Dehazing Based on Low-Pass Filtering and Joint Optimization of Multi-Feature[J].Acta Optica Sinica,2018,38(10):167-176.
[3]ZHANG J,CAO Y,FANG S,et al.Fast Haze Removal forNighttime Image Using Maximum Reflectance Prior[C]//CVPR 2017:2017 IEEE Conference on Computer Vision and Pattern Recognition.Honolulu,HI,2017:7016-7024.
[4]LI Y,TAN R T,BROWN M S.Nighttime Haze Removal with Glow and Multiple Light Colors[C]//2015 IEEE International Conference on Computer Vision(ICCV 2015).Santiago,2015:226-234.
[5]WANG J D,ZHANG W T,WANGZ R,et al.A fast aerizl image de-haze algorithm[J].Acta Aeronautica et Astronautica Sinica,2013,34(3):636-643.
[6]BERMAN D,TREITIBZ T,AVIDAN S.Non-local Image De-hazing[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition(CVPR 2016).Las Vegas,NV,2016:1674-1682.
[7]QU Y,CHEN Y,HUANG J,et al.Enhanced Pix2pix Dehazing Network[C]//2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR 2019).Long Beach,CA,USA,2019:8152-8160.
[8]CHEN C,LI S,WANG Y,et al.Video saliency detection viaspatial-temporal fusion and low-rank coherency diffusion[J].IEEETransaction on Image Processing,2017,26(7):3156-3170.
[9]CHEN C,LI S,QIN H,et al.Bilevel feature learning for video saliency detection[J].IEEE Transaction on Multimedia,2018,20(20):3324-3336.
[10]CHENG C,WANG G,PENG C,et al.Improved robust video saliency detection based on long-term spatial-temporal information[J].IEEE Trans.Image Process,2020,29:1090-1100.
[11]CHEN C,WEI J,PENG C,et al.Improved saliency detection in RGB-D images using two-phase depth estimation and selective deep fusion[J].IEEE Trans.Image Process,2020,29:4296-4307.
[12]MA G,CHEN C,LI S,et al.Salient object detection via multiple instance joint re-learning[J].IEEE Trans.Multimedia,2020,22(2):324-336.
[13]XU X,YU T,XU X,et al.Variational total curvature model for multiplicative noise removal[J].IET Comput.Vis,2018,12(4):542-552.
[14]ISRAËL H,KASTEN F.Koschmieders theorie der horizontalen sichtweite[C]//Die Sichtweite Im Nebel Und Die Möglichkeiten Ihrer künstlichen Beeinflussung.Berlin,Germany:Springer,1959.
[15]ZHU Q,MAI J,SHAO L.A fast single image haze removal algorithm using color attenuation prior[J].IEEE Trans.Image Process,2015,24(11):3522-3533.
[16]PEI S C,LEE T Y.Nighttime haze removal using color transfer pre-processing and dark channel prior[C]//2012 19th IEEE International Conference on Image Processing(ICIP 2012).Orlando,FL,2012:957-960.
[17]LI Y,TAN R T,BROWN M S.Nighttime haze removal with glow and multiple light colors[C]//2015 IEEE International Conference on Computer Vision(ICCV 2015).Santiago,2015:226-234.
[18]ANCUTI C,ANCUTI C O,DE VLEESCHOUWER C,et al.Night-time dehazing by fusion[C]//2016 IEEE International Conference on Image Processing(ICIP 2016).Phoenix,AZ,2016:2256-2260.
[19]YU T,SONG K,MIAO P,et al.Nighttime single image dehaz-ing via pixel-wise alpha blending[J].IEEE Access,2019,7:114619-114630.
[20]ZHANG J,CAO Y,WANG Z.Nighttime haze removal based on a new imaging model[C]//2014 IEEE International Conference on Image Processing(ICIP 2014).Paris,2014:4557-4561.
[21]GUO X,LI Y,LING H.LIME:Low-light image enhancement via illumination map estimation[J].IEEE Trans.Image Process.,2017,26(2):982-993.
[22]KUANAR S,RAO K R,MAHAPATRA D,et al.Night timehaze and glow removal using deep dilated convolutional network[EB/OL].[2021-02-10].https://arxiv.org/abs/1902.008-55v1.
[23]SHI Z,FENG Y,ZHAO M,et al.A joint deep neural networks-based method for single nighttime rainy image enhancement[J].Neural Comput.Appl.,2020,32(7):1913-1926.
[24]WEI C,WANG W,YANG W,et al.Deep retinex decomposition for low-light enhancement[EB/OL].[2021-02-10].https://arxiv.org/abs/1808.04560.
[25]LOU W,LI Y,YANG G,et al.Integrating Haze Density Features for Fast Nighttime Image Dehazing[J].IEEE Access,2020,8:113318-113330.
[26]HUANG W J,LI J,QI C.A Defogging Algorithm for Dense Fog Images via Low-Rank and Dictionary Expression Decomposition[J].Journal of Xi'an Jiaotong University,2020,54(4):118-125.
[27]TANG X Q,FAN C N,LIU X.A Fast Removing Algorithm of Single Image Using Edge Preserving Filtering[J].Journal of Xi'an Jiaotong University,2015,49(3):143-150.
[28]XIAO J S,SHEN M Y,LEI J F,et al.Image Conversion Algorithm for Haze Scene Based on Generative Adversarial Networks[J].Chinese Journal of Computers,2020,43(1):165-176.
[29]WANG Y F,WANG Y Y.MP-CGAN:night single image dehazing algorithm based on Msmall-Patch training[J].Journal of Computer Applications,2020,40(3):865-871.
[30]DUAN L.Nighttime Image Dehazing Based on Illumination Estimation and Fast Guided Filter[J].Modern Computer,2019(36):76-81.
[31]QIU D F,HUANG G H,LIU X,et al.Dark channel haze removal based on adaptive transmission and airlight estimation[J].Journal of Computer Applications,2017,37(S1):176-179,186.
[32]YU S Y,ZHU H.Lighting model construction and haze removal for nighttime image[J].Optics and Precision Engineering,2017,25(3):729-734.
[33]NARASIMHAN S G,NAYAR S K.Vision and the Atmosphere[J].International Journal of Computer Vision,2002,48(3):233-254.
[1] HE Tao, ZHAO Ting, XU He. Novel Algorithm of Single Image Dehazing Based on Dark Channel Prior [J]. Computer Science, 2021, 48(7): 219-224.
[2] YANG Kun, ZHANG Juan, FANG Zhi-jun. Multi-patch and Multi-scale Hierarchical Aggregation Network for Fast Nonhomogeneous ImageDehazing [J]. Computer Science, 2021, 48(11): 250-257.
[3] LI Ze-wen, LI Zi-ming, FEI Tian-lu, WANG Rui-lin and XIE Zai-peng. Face Image Restoration Based on Residual Generative Adversarial Network [J]. Computer Science, 2020, 47(6A): 230-236.
[4] ZHANG Mo-hua, PENG Jian-hua. Integration of Internal and External Priors Based on Dirichlet Process Mixture Model [J]. Computer Science, 2020, 47(5): 172-180.
[5] ZOU Peng, CHEN Yu-zhang, CHEN Long-biao, ZENG Zhang-fan. Night Vision Restoration Algorithm Based on Neural Network for Illumination Distribution Prediction [J]. Computer Science, 2019, 46(11A): 329-333.
[6] ZHANG Ming-qi, CAO Guo, CHEN Qiang, SUN Quan-sen. Image Restoration Method Based on Improved Inverse Filtering for Diffractive Optic Imaging Spectrometer [J]. Computer Science, 2019, 46(1): 86-93.
[7] LIU Yang, ZHANG Jie, ZHANG Hui. Study and Application of Improved Retinex Algorithm in Image Defogging [J]. Computer Science, 2018, 45(6A): 242-243.
[8] CUI Qian-nan, TIAN Xiao-ping and WU Cheng-mao. Improved Algorithm of Haze Removal Based on Guided Filtering and Dark Channel Prior [J]. Computer Science, 2018, 45(5): 285-290.
[9] ZHAO Sheng-nan, WEI Wei-bo, PAN Zhen-kuan and LI Shuai. Single Color Image Dehazing Based on Dark Channel Prior and MTV Model [J]. Computer Science, 2018, 45(3): 274-276.
[10] XU Ying and LI Qiang-yi. Blind Binary Image Deconvolution Based on Sparse Property [J]. Computer Science, 2018, 45(3): 253-257.
[11] LU Zhao and ZHU Xiao-shu. Research on Image Processing Algorithm Based on Compressed Sensing [J]. Computer Science, 2017, 44(6): 312-316.
[12] MIAO Qi-guang and LI Yu-nan. Research Status and Prospect of Image Dehazing [J]. Computer Science, 2017, 44(11): 1-8.
[13] ZHAO Zhi-gang, CHEN Ying-ying, ZHAO Yi, ZHANG Wei-zhong, LV Hui-xian and PAN Zhen-kuan. Motion Deblurring Based on Edge Prior Model [J]. Computer Science, 2015, 42(5): 305-308.
[14] SUI Dan and GAO Guo-wei. Image Restoration Algorithm of Unknown Priori Pixel Based on Artificial Fish Swarm Decomposition [J]. Computer Science, 2015, 42(3): 316-320.
[15] LIU Xiao-yan and FENG Xiang-chu. High-order Regularization Model for Image Denoising in Symmetric Tensor Space [J]. Computer Science, 2013, 40(Z11): 359-362.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!