高动态范围成像技术中的鬼影检测与去除方法综述

doi:10.11896/j.issn.1002-137X.2016.08.003

摘要/Abstract

摘要： 由于广泛的实用价值与理论价值,高动态范围成像(HDRI)技术成为图像处理领域的一个研究热点,如何检测及去除成像过程中产生的干扰影像(即“鬼影”)也引起了研究者的广泛关注。将鬼影检测与去除方法按照运动物体是否属于拍摄目标及算法操作域进行系统分类,将鬼影检测算法分为无参考图像、有参考图像两大类并将每一大类分为辐射域检测、图像域检测两类,将鬼影去除算法分为辐射域去除、图像域去除两大类,对其中每一类算法分别全面综述了其特点及最新研究成果,并对不同方法的优缺点进行了比较分析。最后总结了不同方法的适用条件并给出了关于这一课题未来发展的思考。

关键词: 高动态范围成像,鬼影,参考图像,辐射域,图像域

Abstract: Because of its extensive practical and theoretical values,the high dynamic range imaging (HDRI) technique has become a hot topic in the areas of image processing.How to deal with the ghost produced in the process has attracted many researchers’ attentions.This paper respectively categorized ghost detection and removal methods according to whether the moving objects belong to the shooting target and operation domain into two categories.The ghost detection was classified into radiation field detection and image domain detection.The removal methods was classified into radiation field removal and image domain removal.For each category,the state-of-the-art research achievements were reviewed comprehensively.We also analyzed the characteristics of different algorithms.Thoughts and foresights of this field were given at the end of this paper.

Key words: High dynamic range imaging,Ghost,Reference image,Radiance domain,Image domain

胡胜男,张伟,刘侃,顾建军. 高动态范围成像技术中的鬼影检测与去除方法综述[J]. 计算机科学, 2016, 43(8): 13-18. https://doi.org/10.11896/j.issn.1002-137X.2016.08.003

HU Sheng-nan, ZHANG Wei, LIU Kan and GU Jian-jun. Survey of Ghost Detection and Removal Methods in HDR Imaging Technology[J]. Computer Science, 2016, 43(8): 13-18. https://doi.org/10.11896/j.issn.1002-137X.2016.08.003

参考文献

[1] Mitsunaga T,Nayar S K.High dynamic range imaging:spatially varying pixel exposures[C]∥Proceedings of the IEEE International Conference on ComputerVision and Pattern Recognition.IEEE Press,2000:472-479
[2] Wen D D.High dynamic range charge-coupled device[P].US,4873561,1989
[3] Street R.A.High dynamic range segmented pixel sensor array[P].US,5789737,1998
[4] Tumblin J,Agrawal A,Raskar R.Why I want a gradient camera[C]∥Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition.IEEE Press,2005:103-110
[5] Aggarwal M,Ahuja N.Split aperture imaging for high-dynamic-range[J].International Journal of Computer Vision,2004,58:7-17
[6] Reinhard E,Ward G,Pattanaik S,et al.High Dynamic Range Imaging:Acquisition,Display and Image-Based Lighting[M].San Francisco,US:Morgan Kaufmann Publishers,2005
[7] Srikantha A,Sidibé D.Ghost detection and removal for high dynamic range images:Recent advances[J].Signal Processing:Ima-ge Communication,2012,27(6):650-662
[8] Debevec P,Malik J.Recovering high dynamic range radiancemaps from photographs[C]∥Proceedings of the SIGGRAPH 97 Conference.1997:369-378
[9] Mann S,Picard R.Being ‘undigital’ with digital cameras:extending dynamic range by combining differently exposed pictures[C]∥Proceedings of the IS&T 46th Annual Conference.1995:422-428
[10] Mitsunaga T,Nayar S K.Radiometric self-calibration[C]∥Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition.IEEE Press,1999:374-380
[11] Grossberg M D,Nayar S K.Determining the camera response from images:what is knowable?[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2003,25:1455-1467
[12] Krawczyk G,Myszkowski K,Seidel H P.Lightness perception in tone reproduction for high dynamic range images[J].Computer Graphics Forum,Wiley Online Library,2005,24(3):635-645
[13] Reinhard E,Stark M,Shirley P,et al.Photographic tone reproduction for digital images[J].ACM Transactions on Graphics,2002,1(3):267-276
[14] Durand F,Dorsey J.Fast bilateral filtering for the display of high dynamic range images[J].ACM Transactions on Graphics,2002,21(3):257-266
[15] Fattal R,Lischinski D,Werman M.Gradient domain high dynamic range compression[J].ACM Transactions on Graphics,2012,21(3):249-256
[16] Li Y,Sharan L,Adelson E H.Compressing and compandinghigh dynamic range images with subband architectures[J].ACM Transactions on Graphics,2010,4(3):836-844
[17] Mertens T,Kautz J,Van Reeth F.Exposure fusion:A simple andpractical alternative to high dynamic range photography[J].ComputerGraphics Forum,Wiley Online Library,2009,28(1):161-171
[18] Bogoni L,Hansen M.Pattern-selective Color image fusion[J].Pattern Recongnition,2001,4(8):1515-1526
[19] Goshtasby A A.Fusion of multi-exposure images[J].Image and Vision Computing,2005,23:611-618
[20] Raman S,Chaudhuri S.Bilateral filter based compositing forvariable exposure photographs[C]∥Proceedings of the Eurographics Conference.2009:1-4
[21] Jacobs K,Loscos C,Ward G.Automatic high dynamic range image generation of dynamic environments[J].IEEE Computer Graphics and Applications,2008,28(2):84-93
[22] Sidibe D,Puech W,Strauss O.Ghost detection and removal in high dynamic range images[C]∥Proceedings of the 17th European Signal Processing Conference.2009:2240-2244
[23] Grosch T.Fast and robust high dynamic range image generation with camera and object movement[C]∥Proceedings of Vision,Modeling and Visualization Conference.2006:277-284
[24] Pece F,Kautz J.Bitmap movement detection:HDR for dynamic scenes[C]∥Proceedings of Visual Media Production.2010:1-8
[25] Zhang W,Cham W K.Gradient-directed composition of multi-exposure images[C]∥Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition.IEEE Press,2010:530-536
[26] Zhang W,Cham W K.Gradient-directed multi-exposure composition[J].IEEE Transactions on Image Processing,2012,21(4):2318-2323
[27] Gallo O,Gelfand N,Chen W C,et al.Artifact-free high dynamic range imaging[C]∥Proceedings of the IEEE International Conference on Computational Photography.IEEE Press,2009:1-7
[28] Min T H,Park R H,Chang S K.Histogram based ghost removal in high dynamic range images[C]∥Proceedings of the International Conference on Multimedia and Expo.2009:530-533
[29] Sung H S,Park R H,Lee D K,et al.Feature based ghost removalin high dynamic range imaging[J].International Journal of Computer Graphics and Animation,2013,3(4):23-39
[30] Hu J,Gallo O,Pulli K,et al.Hdr deghosting:How to deal with saturation?[C]∥IEEE Conference on Computer Vision and Pattern Recognition.IEEE Press,2013:1163-1170
[31] Sen P,Kalantari N K,Yaesoubi M,et al.Robust patch-based hdr reconstruction of dynamic scenes[J].ACM Transactions on Graphics,2012,31(6):439-445
[32] Zheng J,Li Z,Zhu Z,et al.Hybrid patching for a sequence of differently exposed images with moving objects[J].IEEE Transactions on Image Processing,2013,22(12):5190-5201
[33] Zhang W,Cham W K.Reference-guided exposure fusion in dynamic scenes[J].Journal of Visual Communication and Image Representation,2012,23:467-475
[34] Heo Y S,Lee K M,Lee S U,et al.Ghost-free high dynamicrange imaging[C]∥Proceedings of the 10th Asian Conference on Computer Vision.2010:486-500
[35] Khan E A,Akyuz A O,Reinhard E.Ghost removal in high dynamic range images[C]∥Proceedings of the IEEE International Conference on Image Processing.IEEE Press,2006:2005-2008
[36] Pedone M,Heikkila J.Constrain propagation for ghost removal in high dynamic range images[C]∥Proceedings of the International Conference on Computer Vision Theory and Applications.2008:36-41
[37] Kang S B,Uyttendaele M,Winder S,et al.High dynamic range video[J].ACM Transactions on Graphics,2003,22(3):319-325
[38] Zimmer H,Bruhn A,Weickert J.Freehand hdr imaging of moving scenes with simultaneous resolution enhancement[J].Computer Graphics Forum,2011,30(2):405-414
[39] HaCohen Y,Shechtman E,Goldman D,et al.Non-rigid densecorrespondence with applications for image enhancement[J].ACM Transactions on Graphics,2011,30(4):76-79
[40] Hu J,Gallo O,Pulli K.Exposure stacks of live scenes with hand-held cameras[C]∥European Conference on Computer Vision.Springer,2012:499-512
[41] Lee C,Li Y,Monga V.Ghost-free high dynamic range imaging via rank minimization[J].IEEE Signal Processing Letters,2014,21(9):1045-1049
[42] Boykov Y,Veksler O,Zabih R.Fast approximate energy minimization via graph cuts[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2001,23:1222-1239

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed