Creating HDR Video Using Retargetting

Capturing HDR videos is still a challenging task because HDR camera systems are either very costly (commercial systems) or have not matured enough to reach consumer markets (research prototypes). Recently, unofficial firmware for cameras has started to appear, and the firmware allows for reprogramming of the system to capture footage with an extended dynamic range. The dynamic range that can be captured in a single shot, however, is still limited and does not fully cover the dynamic range found in high-contrast scenes. There is, therefore, a need for low-cost techniques that allow for HDR-video capture using off-the-shelf equipment. This chapter describes methods for enhancing the standard dynamic range using previously captured HDR photographs of the same scene.

[1]  Aykut Erdem,et al.  The State of the Art in HDR Deghosting: A Survey and Evaluation , 2015, Comput. Graph. Forum.

[2]  Pradeep Sen,et al.  A versatile HDR video production system , 2011, SIGGRAPH 2011.

[3]  Jonas Unger,et al.  HDR Reconstruction for Alternating Gain (ISO) Sensor Readout , 2014, Eurographics.

[4]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[5]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[6]  Kurt Debattista,et al.  Advanced High Dynamic Range Imaging: Theory and Practice , 2011 .

[7]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Harald Brendel,et al.  Creating cinematic wide gamut HDR-video for the evaluation of tone mapping operators and HDR-displays , 2014, Electronic Imaging.

[9]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[10]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[11]  Maneesh Agrawala,et al.  Using Photographs to Enhance Videos of a Static Scene , 2007, Rendering Techniques.

[12]  Olga Sorkine-Hornung,et al.  Image Content Retargeting - Maintaining Color, Tone, and Spatial Consistency , 2016 .

[13]  Shree K. Nayar,et al.  High dynamic range imaging: spatially varying pixel exposures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[14]  Mark Ollila,et al.  A Real Time Light Probe , 2004, Eurographics.

[15]  Michael Cohen,et al.  Enhancing and experiencing spacetime resolution with videos and stills , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[16]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[17]  Jiawen Chen,et al.  Real-time edge-aware image processing with the bilateral grid , 2007, SIGGRAPH 2007.

[18]  Oscar Firschein,et al.  Readings in computer vision: issues, problems, principles, and paradigms , 1987 .

[19]  Kun Zhou,et al.  High dynamic range image hallucination , 2007, SIGGRAPH '07.

[20]  Robert L. Stevenson,et al.  Dynamic range improvement through multiple exposures , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[21]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[22]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[23]  Anders Ynnerman,et al.  A unified framework for multi-sensor HDR video reconstruction , 2013, Signal Process. Image Commun..

[24]  Stefan Gustavson,et al.  Unified HDR reconstruction from raw CFA data , 2013, IEEE International Conference on Computational Photography (ICCP).

[25]  Stefan Gustavson,et al.  High-dynamic-range video for photometric measurement of illumination , 2007, Electronic Imaging.

[26]  Sing Bing Kang,et al.  Stereo for Image-Based Rendering using Image Over-Segmentation , 2007, International Journal of Computer Vision.

[27]  W. Press,et al.  Numerical Recipes: The Art of Scientific Computing , 1987 .

[28]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[29]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[30]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[31]  Michael F. Cohen,et al.  GradientShop: A gradient-domain optimization framework for image and video filtering , 2010, TOGS.

[32]  Paolo Cignoni,et al.  A Low‐Memory, Straightforward and Fast Bilateral Filter Through Subsampling in Spatial Domain , 2012, Comput. Graph. Forum.

[33]  Roberto Scopigno,et al.  Enhancement of Low Dynamic Range Videos using High Dynamic Range Backgrounds , 2011, Eurographics.

[34]  Cosmin Ancuti,et al.  Video enhancement using reference photographs , 2007, SIGGRAPH '07.