Practical High Dynamic Range Imaging of Everyday Scenes: Photographing the world as we see it with our own eyes

High dynamic range (HDR) imaging enables the capture of an extremely wide range of the illumination present in a scene and so produces images that more closely resemble what we see with our own eyes. In this article, we explain the problem of limited dynamic range in the standard imaging pipeline and then present a survey of state-of-the-art research in HDR imaging, including the technology's history, specialized cameras that capture HDR images directly, and algorithms for capturing HDR images using sequential stacks of differently exposed images. Because this last is among the most common methods for capturing HDR images using conventional digital cameras, we also discuss algorithms to address artifacts that occur when using with this method for dynamic scenes. Finally, we consider systems for the capture of HDR video and conclude by reviewing open problems and challenges in HDR imaging.

[1]  Erik Reinhard,et al.  Ghost Removal in High Dynamic Range Images , 2006, 2006 International Conference on Image Processing.

[2]  Takeo Kanade,et al.  A sorting image sensor: an example of massively parallel intensity-to-time processing for low-latency computational sensors , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[3]  Steve Mann,et al.  ON BEING `UNDIGITAL' WITH DIGITAL CAMERAS: EXTENDING DYNAMIC RANGE BY COMBINING DIFFERENTLY EXPOSED PICTURES , 1995 .

[4]  Jun Hu,et al.  HDR Deghosting: How to Deal with Saturation? , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Julie Delon,et al.  Single shot high dynamic range imaging using piecewise linear estimators , 2014, 2014 IEEE International Conference on Computational Photography (ICCP).

[6]  Pradeep Sen,et al.  A versatile HDR video production system , 2011, ACM Trans. Graph..

[7]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[8]  Joachim Weickert,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Freehand Hdr Imaging of Moving Scenes with Simultaneous Resolution Enhancement Freehand Hdr Imaging of Moving Scenes with Simultaneous Resolution Enhancement Freehand Hdr Imaging of Moving Scenes with Simultaneous Resolution Enhancement , 2022 .

[9]  Pradeep Sen,et al.  Robust Radiometric Calibration for Dynamic Scenes in the Wild , 2015, 2015 IEEE International Conference on Computational Photography (ICCP).

[10]  Keigo Hirakawa,et al.  Single-shot high dynamic range imaging with conventional camera hardware , 2011, 2011 International Conference on Computer Vision.

[11]  Patrick Le Callet,et al.  High Dynamic Range Video - From Acquisition, to Display and Applications , 2016 .

[12]  Shree K. Nayar,et al.  High dynamic range imaging: spatially varying pixel exposures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[13]  Luca Bogoni,et al.  Extending dynamic range of monochrome and color images through fusion , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[14]  Marius Tico,et al.  Artifact-free High Dynamic Range imaging , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[15]  Eli Shechtman,et al.  Patch-based high dynamic range video , 2013, ACM Trans. Graph..

[16]  Richard Szeliski,et al.  High dynamic range video , 2003, ACM Trans. Graph..

[17]  Orazio Gallo,et al.  Stack-Based Algorithms for HDR Capture and Reconstruction , 2016 .

[18]  Julie Delon,et al.  Best Algorithms for HDR Image Generation. A Study of Performance Bounds , 2014, SIAM J. Imaging Sci..

[19]  Thorsten Grosch,et al.  Fast and Robust High Dynamic Range Image Generation with Camera and Object Movement , 2006 .

[20]  K. R. Ramakrishnan,et al.  High Dynamic Range Imaging , 2013, 2013 International Conference on Communication Systems and Network Technologies.

[21]  Aykut Erdem,et al.  The State of the Art in HDR Deghosting: A Survey and Evaluation , 2015, Comput. Graph. Forum.

[22]  Anna Tomaszewska,et al.  Image Registration for Multi-exposure High Dynamic Range Image Acquisition , 2007 .

[23]  B. C. Madden,et al.  Extended Intensity Range Imaging , 1993 .

[24]  Julie Delon,et al.  Simultaneous HDR image reconstruction and denoising for dynamic scenes , 2013, IEEE International Conference on Computational Photography (ICCP).

[25]  Eli Shechtman,et al.  Robust patch-based hdr reconstruction of dynamic scenes , 2012, ACM Trans. Graph..

[26]  Shree K. Nayar,et al.  Fibonacci Exposure Bracketing for High Dynamic Range Imaging , 2013, 2013 IEEE International Conference on Computer Vision.

[27]  Tae-Hyun Oh,et al.  Robust High Dynamic Range Imaging by Rank Minimization , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Ramesh Raskar,et al.  Unbounded High Dynamic Range Photography Using a Modulo Camera , 2015, 2015 IEEE International Conference on Computational Photography (ICCP).

[29]  Hans-Peter Seidel,et al.  Optimal HDR reconstruction with linear digital cameras , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[31]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[32]  Chul Lee,et al.  Ghost-Free High Dynamic Range Imaging via Rank Minimization , 2014, IEEE Signal Processing Letters.

[33]  Shree K. Nayar,et al.  Programmable Imaging: Towards a Flexible Camera , 2006, International Journal of Computer Vision.

[34]  Narendra Ahuja,et al.  Split Aperture Imaging for High Dynamic Range , 2004, International Journal of Computer Vision.

[35]  André Kaup,et al.  High dynamic range video by spatially non-regular optical filtering , 2012, 2012 19th IEEE International Conference on Image Processing.

[36]  Gordon Wetzstein,et al.  Convolutional Sparse Coding for High Dynamic Range Imaging , 2016, Comput. Graph. Forum.