A Retina Inspired Model for High Dynamic Range Image Rendering

We propose a new tone mapping model to render high dynamic range (HDR) images in limited dynamic range devices in this paper. This neural network model is inspired by the retinal information processing mechanisms of the biological visual system, including the adaptive gap junction between horizontal cells (HCs), the negative HC-cone feedback pathway, and the center-surround antagonistic receptive fields of bipolar cells (BCs). The key novelty of the proposed model lies in the adaptive adjustment of the receptive field size of HCs based on the local brightness, which simulates the dynamic gap junction between HCs. This enables the brightness of distinct regions to be recovered into clearly visible ranges while reducing halo artifacts common to other methods. The BCs serve to enhance the local contrast with their center-surround RF structure. By comparing with the state-of-the-art tone mapping methods qualitatively and quantitatively, our method shows competitive performance in term of improving details in both dark and bright areas.

[1]  Wallace B. Thoreson,et al.  Lateral interactions in the outer retina , 2012, Progress in Retinal and Eye Research.

[2]  Laurence Meylan,et al.  HDR CFA image rendering , 2006, 2006 14th European Signal Processing Conference.

[3]  Michael Ashikhmin,et al.  A Tone Mapping Algorithm for High Contrast Images , 2002, Rendering Techniques.

[4]  Rabab Kreidieh Ward,et al.  Optimizing a Tone Curve for Backward-Compatible High Dynamic Range Image and Video Compression , 2011, IEEE Transactions on Image Processing.

[5]  Erik Reinhard,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Dynamic Range Reduction Inspired by Photoreceptor Physiology , 2022 .

[6]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[7]  S. Bloomfield,et al.  Dark‐ and light‐induced changes in coupling between horizontal cells in mammalian retina , 1999, The Journal of comparative neurology.

[8]  C. Enroth-Cugell,et al.  The contrast sensitivity of retinal ganglion cells of the cat , 1966, The Journal of physiology.

[9]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, SIGGRAPH 2011.

[10]  Jessica K. Hodgins,et al.  Two methods for display of high contrast images , 1999, TOGS.

[11]  Karol Myszkowski,et al.  Design of a tone mapping operator for high-dynamic range images based upon psychophysical evaluation and preference mapping , 2003, IS&T/SPIE Electronic Imaging.

[12]  Edoardo Provenzi,et al.  An Analysis of Visual Adaptation and Contrast Perception for Tone Mapping , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[14]  Rafal Mantiuk,et al.  Display adaptive tone mapping , 2008, SIGGRAPH 2008.

[15]  Laurence Meylan,et al.  High dynamic range image rendering with a retinex-based adaptive filter , 2006, IEEE Transactions on Image Processing.

[16]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[17]  C. Joselevitch,et al.  Human retinal circuitry and physiology , 2008 .

[18]  Karol Myszkowski,et al.  Adaptive Logarithmic Mapping For Displaying High Contrast Scenes , 2003, Comput. Graph. Forum.

[19]  Greg Ward,et al.  A Contrast-Based Scalefactor for Luminance Display , 1994, Graphics Gems.

[20]  Donald P. Greenberg,et al.  Time-dependent visual adaptation for fast realistic image display , 2000, SIGGRAPH.

[21]  B. Völgyi,et al.  The diverse functional roles and regulation of neuronal gap junctions in the retina , 2009, Nature Reviews Neuroscience.

[22]  J. H. van Hateren,et al.  Encoding of high dynamic range video with a model of human cones , 2006, TOGS.

[23]  R. Masland The Neuronal Organization of the Retina , 2012, Neuron.

[24]  S. Bloomfield,et al.  A comparison of receptive field and tracer coupling size of horizontal cells in the rabbit retina , 1995, Visual Neuroscience.

[25]  Zia-ur Rahman,et al.  Retinex processing for automatic image enhancement , 2004, J. Electronic Imaging.