Spatio-temporal Tone Mapping Operator Based on a Retina Model

From moonlight to bright sun shine, real world visual scenes contain a very wide range of luminance; they are said to be High Dynamic Range (HDR). Our visual system is well adapted to explore and analyze such a variable visual content. It is now possible to acquire such HDR contents with digital cameras; however it is not possible to render them all on standard displays, which have only Low Dynamic Range (LDR) capabilities. This rendering usually generates bad exposure or loss of information. It is necessary to develop locally adaptive Tone Mapping Operators (TMO) to compress a HDR content to a LDR one and keep as much information as possible. The human retina is known to perform such a task to overcome the limited range of values which can be coded by neurons. The purpose of this paper is to present a TMO inspired from the retina properties. The presented biological model allows reliable dynamic range compression with natural color constancy properties. Moreover, its non-separable spatio-temporal filter enhances HDR video content processing with an added temporal constancy.

[1]  Michael J. Berry,et al.  Adaptation of retinal processing to image contrast and spatial scale , 1997, Nature.

[2]  Laurence Meylan,et al.  Model of retinal local adaptation for the tone mapping of color filter array images. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[3]  B. Hoefflinger.  High-Dynamic-Range (HDR) Vision: Microelectronics, Image Processing, Computer Graphics (Springer Series in Advanced Microelectronics) , 2007 .

[4]  Hans-Peter Seidel,et al.  Enhancement of Bright Video Features for HDR Displays , 2008 .

[5]  Jeanny Hérault,et al.  Modeling Visual Perception for Image Processing , 2007, IWANN.

[6]  Hiroshi Yamaguchi,et al.  Evaluating HDR rendering algorithms , 2007, TAP.

[7]  Hans-Peter Seidel,et al.  Dynamic range independent image quality assessment , 2008, ACM Trans. Graph..

[8]  Rafal Mantiuk,et al.  Display adaptive tone mapping , 2008, SIGGRAPH 2008.

[9]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting (The Morgan Kaufmann Series in Computer Graphics) , 2005 .

[10]  Alberto Prieto,et al.  Computational and ambient intelligence , 2009, Neurocomputing.

[11]  Jeanny Hérault,et al.  Practical implementation of LMMSE demosaicing using luminance and chrominance spaces , 2007, Comput. Vis. Image Underst..

[12]  Garrett M. Johnson.  Cares and concerns of CIE TC8-08: spatial appearance modeling and HDR rendering , 2005, IS&T/SPIE Electronic Imaging.

[13]  Erik Reinhard,et al.  Perceptual evaluation of tone-reproduction operators using the Cornsweet--Craik--O'Brien illusion , 2008, TAP.

[14]  Gregory J. Ward,et al.  The RADIANCE lighting simulation and rendering system , 1994, SIGGRAPH.

[15]  Hans-Peter Seidel,et al.  Perceptual evaluation of tone mapping operators with real-world scenes , 2005, IS&T/SPIE Electronic Imaging.

[16]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[17]  Hans-Peter Seidel,et al.  A perceptual framework for contrast processing of high dynamic range images , 2006, TAP.