Perceptually based tone mapping for low-light conditions

In this paper we present a perceptually based algorithm for modeling the color shift that occurs for human viewers in low-light scenes. Known as the Purkinje effect, this color shift occurs as the eye transitions from photopic, cone-mediated vision in well-lit scenes to scotopic, rod-mediated vision in dark scenes. At intermediate light levels vision is mesopic with both the rods and cones active. Although the rods have a spectral response distinct from the cones, they still share the same neural pathways. As light levels decrease and the rods become increasingly active they cause a perceived shift in color. We model this process so that we can compute perceived colors for mesopic and scotopic scenes from spectral image data. We also describe how the effect can be approximated from standard high dynamic range RGB images. Once we have determined rod and cone responses, we map them to RGB values that can be displayed on a standard monitor to elicit the intended color perception when viewed photopically. Our method focuses on computing the color shift associated with low-light conditions and leverages current HDR techniques to control the image's dynamic range. We include results generated from both spectral and RGB input images.

[1]  Ramesh Raskar,et al.  Agile Spectrum Imaging: Programmable Wavelength Modulation for Cameras and Projectors , 2008, Comput. Graph. Forum.

[2]  Oscar Firschein,et al.  Readings in computer vision: issues, problems, principles, and paradigms , 1987 .

[3]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[4]  J. Pokorny,et al.  How surrounds affect chromaticity discrimination. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[5]  John D. Bullough,et al.  Simulated driving performance and peripheral detection at mesopic and low photopic light levels , 2000 .

[6]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, International Journal of Computer Vision.

[7]  Mark D. Fairchild,et al.  iCAM06: A refined image appearance model for HDR image rendering , 2007, J. Vis. Commun. Image Represent..

[8]  Donald P. Greenberg,et al.  A multiscale model of adaptation and spatial vision for realistic image display , 1998, SIGGRAPH.

[9]  Saad M. Khan,et al.  Modelling blue shift in moonlit scenes using rod cone interaction , 2004 .

[10]  S. Shioiri,et al.  Change of Color Appearance in Photopic, Mesopic and Scotopic Vision , 2004 .

[11]  L. Maloney,et al.  Color constancy: a method for recovering surface spectral reflectance , 1987 .

[12]  Shree K. Nayar,et al.  Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum , 2010, IEEE Transactions on Image Processing.

[13]  Bruce H. Walker Basic Optical Instruments , 2009 .

[14]  Hirohisa Yaguchi,et al.  A Color Appearance Model Applicable in Mesopic Vision , 2004 .

[15]  Donald P. Greenberg,et al.  A model of visual adaptation for realistic image synthesis , 1996, SIGGRAPH.

[16]  Peter D. Burns,et al.  Analysis Multispectral Image Capture , 1996, CIC.

[17]  Mrityunjay Kumar,et al.  New digital camera sensor architecture for low light imaging , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[18]  Joel Pokorny,et al.  Rod contributions to color perception: Linear with rod contrast , 2007, Vision Research.

[19]  Jussi Parkkinen,et al.  Databases for spectral color science , 2006 .

[20]  Frédo Durand,et al.  Interactive Tone Mapping , 2000, Rendering Techniques.

[21]  Shree K. Nayar,et al.  Multispectral Imaging Using Multiplexed Illumination , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  S. Buck,et al.  Opponent-color models and the influence of rod signals on the loci of unique hues , 2000, Vision Research.

[23]  Holly E. Rushmeier,et al.  Tone reproduction for realistic images , 1993, IEEE Computer Graphics and Applications.

[24]  Wolfgang Heidrich,et al.  Display considerations for night and low-illumination viewing , 2009, APGV '09.

[25]  Shree K. Nayar,et al.  Generalized Mosaicing: Wide Field of View Multispectral Imaging , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Douglas S. Goodman,et al.  4 Basic Optical Instruments , 1989 .

[27]  J. Kris Malkiewicz,et al.  Film Lighting: Talks with Hollywood's Cinematographers and Gaffers , 1986 .

[28]  A. Stockman,et al.  The spectral sensitivities of the middle- and long-wavelength-sensitive cones derived from measurements in observers of known genotype , 2000, Vision Research.