Enhancement tuning and control for high dynamic range images in multi-scale locally adaptive contrast enhancement algorithms

For real-time imaging in surveillance applications, visibility of details is of primary importance to ensure customer confidence. If we display High Dynamic-Range (HDR) scenes whose contrast spans four or more orders of magnitude on a conventional monitor without additional processing, results are unacceptable. Compression of the dynamic range is therefore a compulsory part of any high-end video processing chain because standard monitors are inherently Low- Dynamic Range (LDR) devices with maximally two orders of display dynamic range. In real-time camera processing, many complex scenes are improved with local contrast enhancements, bringing details to the best possible visibility. In this paper, we show how a multi-scale high-frequency enhancement scheme, in which gain is a non-linear function of the detail energy, can be used for the dynamic range compression of HDR real-time video camera signals. We also show the connection of our enhancement scheme to the processing way of the Human Visual System (HVS). Our algorithm simultaneously controls perceived sharpness, ringing ("halo") artifacts (contrast) and noise, resulting in a good balance between visibility of details and non-disturbance of artifacts. The overall quality enhancement, suitable for both HDR and LDR scenes, is based on a careful selection of the filter types for the multi-band decomposition and a detailed analysis of the signal per frequency band.

[1]  Peter H. N. de With,et al.  Optimization of tone-mapping functions in video cameras for high dynamic range images , 2008, Electronic Imaging.

[2]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[3]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997 .

[4]  Christine D. Piatko,et al.  A Visibility Matching Tone Reproduction Operator for High Dynamic Range Scenes , 1997, IEEE Trans. Vis. Comput. Graph..

[5]  Erik Reinhard,et al.  Parameter Estimation for Photographic Tone Reproduction , 2002, J. Graphics, GPU, & Game Tools.

[6]  E. Peli Contrast in complex images. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[7]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[8]  Brian A. Wandell,et al.  Rendering high dynamic range images , 2000, Electronic Imaging.

[9]  Edward H. Adelson,et al.  Compressing and companding high dynamic range images with subband architectures , 2005, ACM Trans. Graph..

[10]  P. D. De with,et al.  Multi-band locally-adaptive contrast enhancement algorithm with built-in noise and artifact suppression mechanisms , 2008, Electronic Imaging.

[11]  Rahman Zia-ur,et al.  A Multiscale Retinex for Color Rendition and Dynamic Range Compression , 1996 .

[12]  Berthold K. P. Horn,et al.  Determining lightness from an image , 1974, Comput. Graph. Image Process..

[13]  Donald P. Greenberg,et al.  A multiscale model of adaptation and spatial vision for realistic image display , 1998, SIGGRAPH.

[14]  Peter H. N. de With,et al.  Image enhancement circuit using nonlinear processing curve and constrained histogram range equalization , 2004, IS&T/SPIE Electronic Imaging.

[15]  Peter H. N. de With,et al.  Non-linear locally-adaptive video contrast enhancement algorithm without artifacts , 2008, IEEE Transactions on Consumer Electronics.

[16]  Greg Turk,et al.  LCIS: a boundary hierarchy for detail-preserving contrast reduction , 1999, SIGGRAPH.