Perceptually based tone mapping for low-light conditions

In this paper we present a perceptually based algorithm for modeling the color shift that occurs for human viewers in low-light scenes. Known as the Purkinje effect, this color shift occurs as the eye transitions from photopic, cone-mediated vision in well-lit scenes to scotopic, rod-mediated vision in dark scenes. At intermediate light levels vision is mesopic with both the rods and cones active. Although the rods have a spectral response distinct from the cones, they still share the same neural pathways. As light levels decrease and the rods become increasingly active they cause a perceived shift in color. We model this process so that we can compute perceived colors for mesopic and scotopic scenes from spectral image data. We also describe how the effect can be approximated from standard high dynamic range RGB images. Once we have determined rod and cone responses, we map them to RGB values that can be displayed on a standard monitor to elicit the intended color perception when viewed photopically. Our method focuses on computing the color shift associated with low-light conditions and leverages current HDR techniques to control the image's dynamic range. We include results generated from both spectral and RGB input images.

[1]  Oscar Firschein,et al.  Readings in computer vision: issues, problems, principles, and paradigms , 1987 .

[2]  Bruce H. Walker Basic Optical Instruments , 2009 .

[3]  S. Buck,et al.  Opponent-color models and the influence of rod signals on the loci of unique hues , 2000, Vision Research.

[4]  Hirohisa Yaguchi,et al.  A Color Appearance Model Applicable in Mesopic Vision , 2004 .

[5]  Joel Pokorny,et al.  Rod contributions to color perception: Linear with rod contrast , 2007, Vision Research.

[6]  John D. Bullough,et al.  Simulated driving performance and peripheral detection at mesopic and low photopic light levels , 2000 .

[7]  Frédo Durand,et al.  Interactive Tone Mapping , 2000, Rendering Techniques.

[8]  Sumanta N. Pattanaik,et al.  Modeling Blue shift in Moonlit Scenes by Rod Cone Interaction , 2006 .

[9]  Shree K. Nayar,et al.  Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum , 2010, IEEE Transactions on Image Processing.

[10]  Donald P. Greenberg,et al.  A multiscale model of adaptation and spatial vision for realistic image display , 1998, SIGGRAPH.

[11]  L. Maloney,et al.  Color constancy: a method for recovering surface spectral reflectance , 1987 .

[12]  Jussi Parkkinen,et al.  Databases for spectral color science , 2006 .

[13]  J. Pokorny,et al.  How surrounds affect chromaticity discrimination. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[14]  S. Shioiri,et al.  Change of Color Appearance in Photopic, Mesopic and Scotopic Vision , 2004 .

[15]  J. Kris Malkiewicz,et al.  Film Lighting: Talks with Hollywood's Cinematographers and Gaffers , 1986 .

[16]  A. Stockman,et al.  The spectral sensitivities of the middle- and long-wavelength-sensitive cones derived from measurements in observers of known genotype , 2000, Vision Research.

[17]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[18]  Shree K. Nayar,et al.  Multispectral Imaging Using Multiplexed Illumination , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[19]  Mark D. Fairchild,et al.  iCAM06: A refined image appearance model for HDR image rendering , 2007, J. Vis. Commun. Image Represent..

[20]  Ramesh Raskar,et al.  Agile Spectrum Imaging: Programmable Wavelength Modulation for Cameras and Projectors , 2008, Comput. Graph. Forum.

[21]  Mrityunjay Kumar,et al.  New digital camera sensor architecture for low light imaging , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[22]  Shree K. Nayar,et al.  Generalized Mosaicing: Wide Field of View Multispectral Imaging , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  James F. O'Brien,et al.  Perceptually based tone mapping for low-light conditions , 2011, SIGGRAPH 2011.

[24]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[25]  Wolfgang Heidrich,et al.  Display considerations for night and low-illumination viewing , 2009, APGV '09.

[26]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, International Journal of Computer Vision.

[27]  Donald P. Greenberg,et al.  A model of visual adaptation for realistic image synthesis , 1996, SIGGRAPH.

[28]  Peter D. Burns,et al.  Analysis Multispectral Image Capture , 1996, CIC.