HDR image noise estimation for denoising tone mapped images

Tone mapping operators are designed to compress the dynamic range of high dynamic range (HDR) images while preserving the perceived image brightness, but they often enhance image noise in the process, specially in low-light conditions. We propose a method for reducing noise in images created by any tone mapping operator. Our approach leverages the noise distribution of the HDR image to guide the range kernel of a cross bilateral filter that is used to denoise the tone mapped image. When the noise distribution is unknown, we use a new method to automatically estimate it assuming that the HDR image was produced as an average of multiple exposures taken in RAW or JPEG compressed format. Our method performs quantitatively better than existing denoising methods applied on either the original HDR or the tone-mapped images directly, and a user study confirms that it produces visually preferable results.

[1]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Donald P. Greenberg,et al.  Time-dependent visual adaptation for fast realistic image display , 2000, SIGGRAPH.

[3]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[4]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[5]  References , 1971 .

[6]  Gregory Shakhnarovich,et al.  Diverse M-Best Solutions in Markov Random Fields , 2012, ECCV.

[7]  Robert L. Stevenson,et al.  Estimation-theoretic approach to dynamic range enhancement using multiple exposures , 2003, J. Electronic Imaging.

[8]  Peyman Milanfar,et al.  A Tour of Modern Image Filtering: New Insights and Methods, Both Practical and Theoretical , 2013, IEEE Signal Processing Magazine.

[9]  Steve Mann,et al.  ON BEING `UNDIGITAL' WITH DIGITAL CAMERAS: EXTENDING DYNAMIC RANGE BY COMBINING DIFFERENTLY EXPOSED PICTURES , 1995 .

[10]  Steve Marschner,et al.  Perceptually based tone mapping of high dynamic range image streams , 2005, EGSR '05.

[11]  Hans Jørgen Andersen,et al.  Noise Characterization of Weighting Schemes for Combination of Multiple Exposures , 2006, BMVC.

[12]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[13]  Peyman Milanfar,et al.  Is Denoising Dead? , 2010, IEEE Transactions on Image Processing.

[14]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[15]  J. Janesick,et al.  Scientific Charge-Coupled Devices , 2001 .

[16]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[17]  James F. O'Brien,et al.  Perceptually based tone mapping for low-light conditions , 2011, ACM Trans. Graph..

[18]  F. Durand,et al.  Flash photography enhancement via intrinsic relighting , 2004, ACM Trans. Graph..

[19]  Hans-Peter Seidel,et al.  A perceptual framework for contrast processing of high dynamic range images , 2006, TAP.

[20]  Kari Pulli,et al.  FlexISP , 2014, ACM Trans. Graph..

[21]  Miguel Granados,et al.  Automatic noise modeling for ghost-free HDR reconstruction , 2013, ACM Trans. Graph..

[22]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[23]  Hans-Peter Seidel,et al.  New measurements reveal weaknesses of image quality metrics in evaluating graphics artifacts , 2012, ACM Trans. Graph..

[24]  Donald P. Greenberg,et al.  A model of visual adaptation for realistic image synthesis , 1996, SIGGRAPH.

[25]  Paria Mehrani,et al.  Superpixels and Supervoxels in an Energy Optimization Framework , 2010, ECCV.

[26]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[27]  Tunç Ozan Aydin,et al.  Contrast-Use Metrics for Tone Mapping Images , 2015, 2015 IEEE International Conference on Computational Photography (ICCP).

[28]  Richard Szeliski,et al.  Automatic Estimation and Removal of Noise from a Single Image , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Manuel Menezes de Oliveira Neto,et al.  Adaptive manifolds for real-time high-dimensional filtering , 2012, ACM Trans. Graph..

[30]  Karen O. Egiazarian,et al.  Practical Poissonian-Gaussian Noise Modeling and Fitting for Single-Image Raw-Data , 2008, IEEE Transactions on Image Processing.

[31]  Hans-Peter Seidel,et al.  Optimal HDR reconstruction with linear digital cameras , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.