Pseudo-Multiple-Exposure-Based Tone Fusion With Local Region Adjustment

New generations of display technologies provide a significantly improved dynamic range compared to conventional display devices. Inverse tone mapping methods have been proposed to convert low dynamic range (LDR) images to HDR ones, and several of them require multiple exposure LDR images of the same scene as inputs. However, the vast majority of LDR images and videos available have only one single exposure. In this paper, we propose a region-based enhancement of the pseudo-exposures to generate an HDR image. First, we present an exposure dependent curve to convert one LDR image to the pseudo-multiple-exposures. Only certain regions of the pseudo-exposures contain noticeable detail information. We propose a region-based enhancement on the pseudo-exposures to boost details in the most distinct region. Thereby the region-enhanced pseudo-exposures are fused into an HDR image. The fused image thus enhances details in the bright region of the dark image and the dark region of the bright image. Compared with other inverse tone mapped methods, our method generates lower total contrast error measured under the dynamic range independent image quality assessment method in [1].

[1]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[2]  Roberto Scopigno,et al.  Real-Time High Fidelity Inverse Tone Mapping for Low Dynamic Range Content , 2013, Eurographics.

[3]  Laurence Meylan,et al.  The Reproduction of Specular Highlights on High Dynamic Range Displays , 2006, CIC.

[4]  Wolfgang Heidrich,et al.  25.3: Observations of Luminance, Contrast and Amplitude Resolution of Displays , 2006 .

[5]  Scott J. Daly,et al.  Bit-depth extension using spatiotemporal microdither based on models of the equivalent input noise of the visual system , 2003, IS&T/SPIE Electronic Imaging.

[6]  Steve Mann,et al.  ON BEING `UNDIGITAL' WITH DIGITAL CAMERAS: EXTENDING DYNAMIC RANGE BY COMBINING DIFFERENTLY EXPOSED PICTURES , 1995 .

[7]  Hiroshi Nagahashi,et al.  Cross-Parameterization for Triangular Meshes with Semantic Features , 2007 .

[8]  Fan Yang,et al.  An inverse tone mapping method for displaying images on HDR monitor , 2013 .

[9]  Kurt Debattista,et al.  A Psychophysical Evaluation of Inverse Tone Mapping Techniques , 2009, Comput. Graph. Forum.

[10]  Manuel Menezes de Oliveira Neto,et al.  High-quality brightness enhancement functions for real-time reverse tone mapping , 2009, The Visual Computer.

[11]  Scott J. Daly,et al.  Decontouring: prevention and removal of false contour artifacts , 2004, IS&T/SPIE Electronic Imaging.

[12]  Hans-Peter Seidel,et al.  Dynamic range independent image quality assessment , 2008, ACM Trans. Graph..

[13]  Roberto Scopigno,et al.  Enhancement of Low Dynamic Range Videos using High Dynamic Range Backgrounds , 2011, Eurographics.

[14]  André Kaup,et al.  Evaluation of a high dynamic range video camera with non-regular sensor , 2013, Electronic Imaging.

[15]  G. Ward,et al.  54.2: A High Dynamic Range Display Using Low and High Resolution Modulators , 2003 .

[16]  Hans-Peter Seidel,et al.  Enhancement of Bright Video Features for HDR Displays , 2008 .

[17]  Sebastiano Battiato,et al.  Image quality improvement by adaptive exposure correction techniques , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[18]  Diego Gutierrez,et al.  Evaluation of reverse tone mapping through varying exposure conditions , 2009, ACM Trans. Graph..

[19]  Eiichiro Ikeda Image data processing apparatus for processing combined image signals in order to extend dynamic range , 1994 .

[20]  Kurt Debattista,et al.  High-dynamic-range video solution , 2009, SIGGRAPH ASIA '09.

[21]  Jan Kautz,et al.  Exposure Fusion , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[22]  Kurt Debattista,et al.  Expanding low dynamic range videos for high dynamic range applications , 2008, SCCG.

[23]  Laurence Meylan,et al.  Tone mapping for high dynamic range displays , 2007, Electronic Imaging.

[24]  Hayden Landis,et al.  Production-Ready Global Illumination , 2004 .

[25]  E. Reinhard Photographic Tone Reproduction for Digital Images , 2002 .

[26]  Timo Kunkel,et al.  Image display algorithms for high‐ and low‐dynamic‐range display devices , 2007 .

[27]  Kurt Debattista,et al.  Advanced High Dynamic Range Imaging: Theory and Practice , 2011 .

[28]  Erik Reinhard,et al.  Do HDR displays support LDR content?: a psychophysical evaluation , 2007, ACM Trans. Graph..

[29]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[30]  Shree K. Nayar,et al.  High dynamic range imaging: spatially varying pixel exposures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[31]  Kanad K. Biswas,et al.  A Simple Spatial Tone Mapping Operator for High Dynamic Range Images , 2005, Color Imaging Conference.

[32]  Kurt Debattista,et al.  A framework for inverse tone mapping , 2007, The Visual Computer.

[33]  Hans-Peter Seidel,et al.  Predicting visible differences in high dynamic range images: model and its calibration , 2005, IS&T/SPIE Electronic Imaging.

[34]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[35]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, SIGGRAPH 2011.

[36]  Kun Zhou,et al.  High dynamic range image hallucination , 2007, SIGGRAPH '07.

[37]  Francesco Banterle,et al.  Inverse tone mapping , 2006, GRAPHITE '06.

[38]  Robert L. Stevenson,et al.  Dynamic range improvement through multiple exposures , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[39]  Wolfgang Heidrich,et al.  Ldr2Hdr: on-the-fly reverse tone mapping of legacy video and photographs , 2007, SIGGRAPH 2007.