计算机科学 ›› 2022, Vol. 49 ›› Issue (6A): 384-389.doi: 10.11896/jsjkx.210400243

• 图像处理&多媒体技术 • 上一篇    下一篇

基于虚拟曝光方法的单幅逆光图像增强

赵明华1,2, 周童童1, 都双丽1, 石争浩1   

  1. 1 西安理工大学计算机科学与工程学院 西安 710048
    2 陕西省网络计算与安全技术重点实验室 西安 710048
  • 出版日期:2022-06-10 发布日期:2022-06-08
  • 通讯作者: 都双丽(dusl@xaut.edu.cn)
  • 作者简介:(mh_zhao@126.com)
  • 基金资助:
    国家重点研发计划(2017YFB1402103-3);陕西省教育厅重点实验室项目(18JS078,20JS086);国家自然科学基金(61901363,61901362);陕西省自然科学基金 (2019JM-381,2019JQ-729)

Single Backlit Image Enhancement Based on Virtual Exposure Method

ZHAO Ming-hua1,2, ZHOU Tong-tong1, DU Shuang-li1, SHI Zheng-hao1   

  1. 1 School of Computer Science and Engineering,Xi'an University of Technology,Xi'an 710048,China
    2 Shaanxi Key Laboratory of Network Computing and Security Technology,Xi'an 710048,China
  • Online:2022-06-10 Published:2022-06-08
  • About author:ZHAO Ming-hua,born in 1979,Ph.D,professor,is a senior member of China Computer Federation.Her main research interests include computer vision,and pattern recognition.
    DU Shuang-li,born in 1990,Ph.D,lecturer.Her main research interests include computer vision and so on.
  • Supported by:
    National Key R & D Program of China(2017YFB1402103-3),Key Laboratory Project of Shaanxi Provincial Department of Education(18JS078,20JS086),National Natural Science Foundation of China(61901363,61901362) and Natural Science Foundation of Shaanxi Province,China(2019JM-381,2019JQ-729).

摘要: 逆光图像目标区域可视质量低、背景区域过度曝光,是影响图像质量的重要因素之一。针对现有的逆光图像增强方法在增强暗区细节信息时不能很好地抑制明亮区域过度增强的问题,提出了一种基于虚拟曝光的单幅逆光图像增强方法。首先,引入虚拟曝光图像,并根据参数确定最佳低曝光图像和高曝光图像;然后,使用非线性亮度增强方法和基于邻域相关对比度增强方法分别处理暗区和亮区;最后,采用拉普拉斯金字塔融合方法将暗区、亮区的细节和特征融合。使用自然图像和合成图像对所提方法进行实验,结果表明所提方法具有更少的颜色和亮度失真,视觉效果更加自然。

关键词: 对比度增强, 非线性图像增强, 逆光图像, 图像融合, 虚拟曝光方法

Abstract: The visual quality of backlit image in target area is low and its background area is overexposed,which are important factors affecting image quality.Aiming at the problem that the existing backlit image enhancement methods cannot suppress the excessive enhancement of bright areas while enhancing the detail information of dark areas well,a single backlit image enhancement method based on virtual exposure is proposed in this paper.First,the virtual exposure image is introduced,and the best low-exposure image and high-exposure image are determined according to parameters.Then,the dark and bright areas are processed by nonlinear enhancement method and the neighborhood correlation method respectively.Finally,the details and features of the dark and bright areas are fused by Laplacian pyramid fusion method.Experiments results based on natural images and synthetic images show that the proposed method has less color and brightness distortion,and the visual effect is more natural.

Key words: Backlit image, Contrast enhancement, Image fusion, Nonlinear image enhancement, Virtual exposure method

中图分类号: 

  • TP391
[1] KIM Y C,KIM Y M,KIM S G,et al.Development of the Meche-nical system and Vision Algorithm for the External Appearance Test Using Vision Image Processing[J].Journal of the Korea Academia-Industrial Cooperation Society,2016,17(2):202-208.
[2] XU X.Research on Several Theoretical Methods and Applications of Image Enhancement [D].Nanjing:Nanjing University,2010.
[4] PE L,LI E.Contrast in complex images.Journal of the Optical Society of America A-optics[J].Image Science & Vision,1990,7(10):2032-2040.
[5] CHEN Z,JIANG Y C,YIN F L.Low-light video image enhancement method using β function mapping and inter-frame information fusion[J].Signal Processing,2013,29(12):1632-1637.
[6] WANG D,YAN W,ZHU T,et al.An Adaptive Correction Algorithm for Non-Uniform Illumination Panoramic Images Based on the Improved Bilateral Gamma Function[C]//International Conference on Digital Image Computing:Techniques and Applications(DICTA).Sydney,NSW,2017:1-6.
[7] ZIMMERMAN J B,PIZER S M,STAAB E V,et al.An Evaluation of the Effectiveness of Adaptive Histogram Equalization for Contrast Enhancement[J].IEEE Transaction on Medical Imaging,1998,7(4):304-312.
[8] KIM T K,PAIK J K,KANG B S.Contrast Enhancement Systemusing Spatially Adaptive Histogram Equalization with Temporal Filtering[J].IEEE Transa-ctions on Consumer Electronics,1998,44(1):82-87.
[9] IBRAHIM H,KONG N S P.Brightness preserving dynamic histogram equalization for image contrast enhancement[J].IEEE Transactions on Consumer Electronics,2007,53(4):1752-1758.
[10] LI Y.Research and implementation of low-light image enhancement algorithm based on Retinex theory[D].Xi'an:Xidian University,2018.
[11] WANG Q,FU X,ZHANG X,et al.A fusion-based method for single backlit image enhancement[C]//2016 IEEE International Conference on Image Processing(ICIP).Phoenix,AZ,2016:4077-4081.
[12] GUO Q,ZHU Z F,CHANG D X,et al.Backlit image enhancement algorithm combining global and local area brightness[J].Signal Processing,2018,34(2):140-147.
[13] LI Z,WU X.Learning-Based Restoration of Backlit Images[J].IEEE Transactions on Image Processing,2018,27(2):976-986.
[14] LEE C H,CHEN L H,WANG W K.Image contrast enhancement using classified virtual exposure image fusion[J].IEEE Transactions on Consumer Electronics,2012,58(4):1253-1261.
[15] TAO L,ASARI V K.Adaptive and integrated neighborhood-dependent approach for nonlinear enhancement of color images[J].Journal of Electronic Imaging,2005,14(4):043006.1-043006.14.
[16] GHIMIRE D,LEE J.Color Image Enhancement in HSV Space Using Nonlinear Transfer Function and Neighborhood Depen-dent Approach with Preserving Details[C]//2010 Fourth Pacific-Rim Symposium on Image and Video Technology.Singapore,2010:422-426.
[17] MITTAL A,MOORTHY A K,BOVIK A C.No-referenceimage quality assessment in the spatial dom[J].IEEE Transactions on Image Processing,2012,21(12):4695.
[18] ZHANG L,SHEN Y,LI H.VSI:A Visual Saliency-Induced Index for Perceptual Image Quality Assessment[J].IEEE Transactions on Image Processing,2014,23(10):4270-4281.
[19] WANG S,MA K,YEGANEH H,et al.A Patch-Structure Representation Method for Quality Assessment of Contrast Changed Images[J].IEEE Signal Processing Letters,2015,22(12):2387-2390.
[20] PETRO A B,SBERT C,MOREL J M.Multiscale retinex[C]//Image Process.Line,2014:71-88.
[21] DONG X.Fast efficient algorithm for enhancement of low ligh-ting video[C]//IEEE International Conference on Multimedia and Expo.2011:1-6.
[22] GUO X,LI,LING H.Lime:Low-light image enha-ncement via illumination map estimation[J].IEEE Transactions on Image Processing,2017,26(2):982-993.
[23] LI Z,WU X.Learning-Based Restoration of Backlit Images[J].IEEE Transactions on Image Processing,2018,27(2):976-986.
[24] FU X,ZENG D,HUANG Y,et al.A Weighted VariationalModel for Simultaneous Reflectance and Illumination Estimation[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition(CVPR).Las Vegas,NV,2016:2782-2790.
[25] MOORTHYA K,BOVIK A C.A Two-Step Framework forConstructing Blind Image Quality Indices[J].Signal Processing Letters,2010,17(5):513-516.
[1] 来腾飞, 周海洋, 余飞鸿.
视频流的实时景深延拓算法
Real-time Extend Depth of Field Algorithm for Video Processing
计算机科学, 2022, 49(6A): 314-318. https://doi.org/10.11896/jsjkx.201100187
[2] 高元浩, 罗晓清, 张战成.
基于特征分离的红外与可见光图像融合算法
Infrared and Visible Image Fusion Based on Feature Separation
计算机科学, 2022, 49(5): 58-63. https://doi.org/10.11896/jsjkx.210200148
[3] 颜敏, 罗晓清, 张战成.
基于光传输模型学习的红外和可见光图像融合网络设计
Infrared and Visible Image Fusion Network Based on Optical Transmission Model Learning
计算机科学, 2022, 49(4): 215-220. https://doi.org/10.11896/jsjkx.210200174
[4] 官铮, 邓扬琳, 聂仁灿.
光谱重建约束非负矩阵分解的高光谱与全色图像融合
Non-negative Matrix Factorization Based on Spectral Reconstruction Constraint for Hyperspectral and Panchromatic Image Fusion
计算机科学, 2021, 48(9): 153-159. https://doi.org/10.11896/jsjkx.200900054
[5] 黄晓生, 徐静.
基于PCANet的非下采样剪切波域多聚焦图像融合
Multi-focus Image Fusion Method Based on PCANet in NSST Domain
计算机科学, 2021, 48(9): 181-186. https://doi.org/10.11896/jsjkx.200800064
[6] 田嵩旺, 蔺素珍, 杨博.
基于多判别器的多波段图像自监督融合方法
Multi-band Image Self-supervised Fusion Method Based on Multi-discriminator
计算机科学, 2021, 48(8): 185-190. https://doi.org/10.11896/jsjkx.200600132
[7] 王丽芳, 王蕊芳, 蔺素珍, 秦品乐, 高媛, 张晋.
基于双残差超密集网络的多模态医学图像融合
Multimodal Medical Image Fusion Based on Dual Residual Hyper Densely Networks
计算机科学, 2021, 48(2): 160-166. https://doi.org/10.11896/jsjkx.200400095
[8] 朱珍, 黄锐, 臧铁钢, 卢世军.
基于加权近红外图像融合的单幅图像除雾方法
Single Image Defogging Method Based on Weighted Near-InFrared Image Fusion
计算机科学, 2020, 47(8): 241-244. https://doi.org/10.11896/jsjkx.200300068
[9] 朱莹,夏亦犁,裴文江.
基于改进的BEMD的红外与可见光图像融合方法
Fusion of Infrared and Color Visible Images Based on Improved BEMD
计算机科学, 2020, 47(3): 124-129. https://doi.org/10.11896/jsjkx.190100038
[10] 李昌兴, 雷柳, 张晓璐.
基于形态学图像增强和PCNN的脑部CT与MRI图像融合
Brain CT and MRI Image Fusion Based on Morphological Image Enhancement and PCNN
计算机科学, 2020, 47(10): 194-199. https://doi.org/10.11896/jsjkx.190700185
[11] 李笑宇,高清维,卢一相,孙冬.
一种根据图像能量调整的图像融合方法
Image Fusion Method Based on Image Energy Adjustment
计算机科学, 2020, 47(1): 153-158. https://doi.org/10.11896/jsjkx.181202437
[12] 张冰, 谢从华, 刘哲.
基于显著稀疏表示和邻域信息的多聚焦图像融合
Multi-focus Image Fusion Based on Latent Sparse Representation and Neighborhood Information
计算机科学, 2019, 46(9): 254-258. https://doi.org/10.11896/j.issn.1002-137X.2019.09.038
[13] 刘斌,谌文江,辛迦楠.
基于四通道不可分加性小波的多聚焦图像融合
Multifocus Image Fusion Based on Four Channel Non-separable Additive Wavelet
计算机科学, 2019, 46(7): 268-273. https://doi.org/10.11896/j.issn.1002-137X.2019.07.041
[14] 王丽芳, 史超宇, 蔺素珍, 秦品乐, 高媛.
基于联合图像块聚类自适应字典学习的多模态医学图像融合
Multi-modal Medical Image Fusion Based on Joint Patch Clustering of Adaptive Dictionary Learning
计算机科学, 2019, 46(7): 238-245. https://doi.org/10.11896/j.issn.1002-137X.2019.07.036
[15] 席新星, 罗晓清, 张战成.
基于3-D剪切波和广义高斯模型的多模态医学序列图像融合
Multi-modal Medical Volumetric Image Fusion Based on 3-D Shearlet Transform
and Generalized Gaussian Model
计算机科学, 2019, 46(5): 254-259. https://doi.org/10.11896/j.issn.1002-137X.2019.05.039
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!