Model of retinal local adaptation for the tone mapping of color filter array images.

We present a tone mapping algorithm that is derived from a model of retinal processing. Our approach has two major improvements over existing methods. First, tone mapping is applied directly on the mosaic image captured by the sensor, analogous to the human visual system that applies a nonlinearity to the chromatic responses captured by the cone mosaic. This reduces the number of necessary operations by a factor 3. Second, we introduce a variation of the center/surround class of local tone mapping algorithms, which are known to increase the local contrast of images but tend to create artifacts. Our method gives a good improvement in contrast while avoiding halos and maintaining good global appearance. Like traditional center/surround algorithms, our method uses a weighted average of surrounding pixel values. Instead of being used directly, the weighted average serves as a variable in the Naka-Rushton equation, which models the photoreceptors' nonlinearity. Our algorithm provides pleasing results on various images with different scene content and dynamic range.

[1]  Greg Ward,et al.  High dynamic range imaging , 2001, SIGGRAPH '04.

[2]  David Williams,et al.  The arrangement of the three cone classes in the living human eye , 1999, Nature.

[3]  K. Naka,et al.  S‐potentials from luminosity units in the retina of fish (Cyprinidae) , 1966, The Journal of physiology.

[4]  H Spekreijse,et al.  The feedback pathway from horizontal cells to cones A mini review with a look ahead , 1999, Vision Research.

[5]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[6]  C. R. Ingling,et al.  The spatiotemporal properties of the r-g X-cell channel , 1985, Vision Research.

[7]  E. Carter Colour Engineering: Achieving Device Independent Colour , 2004 .

[8]  J. Pokorny,et al.  Chromatic discrimination with variation in chromaticity and luminance: Data and theory , 1993, Vision Research.

[9]  Christine D. Piatko,et al.  A Visibility Matching Tone Reproduction Operator for High Dynamic Range Scenes , 1997, IEEE Trans. Vis. Comput. Graph..

[10]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[11]  Hiroshi Yamaguchi,et al.  Testing HDR Image Rendering Algorithms , 2004, CIC.

[12]  K. Mullen The contrast sensitivity of human colour vision to red‐green and blue‐yellow chromatic gratings. , 1985, The Journal of physiology.

[13]  Michael H. Brill,et al.  Colour Engineering: Achieving Device Independent Colour , 2004 .

[14]  Mark D. Fairchild,et al.  Image lightness rescaling using sigmoidal contrast enhancement functions , 1999, J. Electronic Imaging.

[15]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997, SIGGRAPH '97.

[16]  Lindsay William Macdonald,et al.  Colour Imaging: Vision and Technology , 1999 .

[17]  Sabine Süsstrunk,et al.  Linear demosaicing inspired by the human visual system , 2005, IEEE Transactions on Image Processing.

[18]  Laurence Meylan,et al.  HDR CFA image rendering , 2006, 2006 14th European Signal Processing Conference.

[19]  Alan Chalmers,et al.  Evaluation of tone mapping operators using a High Dynamic Range display , 2005, ACM Trans. Graph..

[20]  Zia-ur Rahman,et al.  Retinex processing for automatic image enhancement , 2002, IS&T/SPIE Electronic Imaging.

[21]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[22]  D. Hood,et al.  Lower-level visual processing and models of light adaptation. , 1998, Annual review of psychology.

[23]  Michael Ashikhmin,et al.  A Tone Mapping Algorithm for High Contrast Images , 2002, Rendering Techniques.

[24]  M. Webster,et al.  Changes in colour appearance following post-receptoral adaptation , 1991, Nature.

[25]  Yap-Peng Tan,et al.  Improved color filter array demosaicking by accurate luminance estimation , 2005, IEEE International Conference on Image Processing 2005.

[26]  Hedva Spitzer,et al.  Color constancy: a biological model and its application for still and video images , 2002, Pattern Recognit..

[27]  P. Lennie,et al.  Packing arrangement of the three cone classes in primate retina , 2001, Vision Research.

[28]  Emanuele Trucco,et al.  Computer and Robot Vision , 1995 .

[29]  Eric Dubois,et al.  Frequency-domain methods for demosaicking of Bayer-sampled color images , 2005, IEEE Signal Processing Letters.

[30]  C. Enroth-Cugell,et al.  Chapter 9 Visual adaptation and retinal gain controls , 1984 .

[31]  Brian V. Funt,et al.  Investigations into Multi-Scale Retinex , 1998 .

[32]  Matthias Schwab,et al.  Making scientific computations reproducible , 2000, Comput. Sci. Eng..

[33]  J. H. van Hateren,et al.  Encoding of high dynamic range video with a model of human cones , 2006, TOGS.

[34]  Kate Devlin,et al.  A review of tone reproduction techniques , 2002 .

[35]  Laurence Meylan,et al.  High dynamic range image rendering with a retinex-based adaptive filter , 2006, IEEE Transactions on Image Processing.