A versatile HDR video production system

Although High Dynamic Range (HDR) imaging has been the subject of significant research over the past fifteen years, the goal of acquiring cinema-quality HDR images of fast-moving scenes using available components has not yet been achieved. In this work, we present an optical architecture for HDR imaging that allows simultaneous capture of high, medium, and low-exposure images on three sensors at high fidelity with efficient use of the available light. We also present an HDR merging algorithm to complement this architecture, which avoids undesired artifacts when there is a large exposure difference between the images. We implemented a prototype high-definition HDR-video system and we present still frames from the acquired HDR video, tonemapped with various techniques.

[1]  Peter H. N. de With,et al.  Non-linear locally-adaptive video contrast enhancement algorithm without artifacts , 2008, IEEE Transactions on Consumer Electronics.

[2]  Jan Kautz,et al.  Exposure Fusion , 2009, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[3]  Shree K. Nayar,et al.  Optical Splitting Trees for High-Precision Monocular Imaging , 2007, IEEE Computer Graphics and Applications.

[4]  Frédo Durand,et al.  Noise-optimal capture for high dynamic range photography , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Karol Myszkowski,et al.  High Dynamic Range Video , 2008, Synthesis Lectures on Computer Graphics and Animation.

[6]  Robert L. Stevenson,et al.  Estimation-theoretic approach to dynamic range enhancement using multiple exposures , 2003, J. Electronic Imaging.

[7]  Shree K. Nayar,et al.  Adaptive dynamic range imaging: optical control of pixel exposures over space and time , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[8]  Richard Szeliski,et al.  High dynamic range video , 2003, ACM Trans. Graph..

[9]  Wen-Chung Kao.  High Dynamic Range Imaging by Fusing Multiple Raw Images and Tone Reproduction , 2008, IEEE Transactions on Consumer Electronics.

[10]  Karol Myszkowski,et al.  Selected problems of high dynamic range video compression and GPU-based contrast domain tone mapping , 2008, SCCG.

[11]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[12]  Hans-Peter Seidel,et al.  Optimal HDR reconstruction with linear digital cameras , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Stefan Gustavson,et al.  High-dynamic-range video for photometric measurement of illumination , 2007, Electronic Imaging.

[14]  Narendra Ahuja,et al.  Split Aperture Imaging for High Dynamic Range , 2004, International Journal of Computer Vision.

[15]  Alessandro Rizzi,et al.  Veiling glare: the dynamic range limit of HDR images , 2007, Electronic Imaging.

[16]  Shree K. Nayar,et al.  Radiometric self calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[17]  Narendra Ahuja,et al.  High Dynamic Range Video Using Split Aperture Camera , 2005 .

[18]  Henrique S. Malvar,et al.  High-quality linear interpolation for demosaicing of Bayer-patterned color images , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[19]  Hans-Peter Seidel,et al.  Demosaicing by smoothing along 1D features , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Hans-Peter Seidel,et al.  Beyond Tone Mapping: Enhanced Depiction of Tone Mapped HDR Images , 2006, Comput. Graph. Forum.

[21]  Takeo Kanade,et al.  A sorting image sensor: an example of massively parallel intensity-to-time processing for low-latency computational sensors , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[22]  Shree K. Nayar,et al.  High dynamic range imaging: spatially varying pixel exposures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[23]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[24]  David Salesin,et al.  Interactive digital photomontage , 2004, SIGGRAPH 2004.

[25]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .