Perception of object illumination depends on highlights and shadows, not shading.

Human observers are able to successfully infer direction and intensity of light from photographed scenes despite complex interactions between light, shape, and material. We investigate how well they are able to distinguish other low-level aspects of illumination, such as the diffuseness and the number of light sources. We use photographs of a teapot, an orange, and a tennis ball from the ALOI database (Geusebroek, Burghouts, & Smeulders, 2005) to create different illumination conditions, varying either in diffuseness of a single light source or in separation angle between two distinct light sources. Our observers were presented with all three objects; they indicated which object was illuminated differently from the other two. We record discrimination performance, reaction times, and eye fixations. We compare the data to a model that uses differences in image structure in same-object comparisons, and outcomes suggest that participants mostly rely on the information contained in cast shadows and highlights. The pattern of eye fixations confirms this, showing that after the first fixation, observers mostly fixate cast shadow areas. However, information in the highlights is rather salient, so it might be available from first fixation, making separate fixations are unnecessary.

[1]  Huib de Ridder,et al.  The visual light field in paintings of Museum Prinsenhof: comparing settings in empty space and on objects , 2015, Electronic Imaging.

[2]  S. Nishida,et al.  Use of image-based information in judgments of surface-reflectance properties. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[3]  Q. Zaidi,et al.  Limits of lightness identification for real objects under natural viewing conditions. , 2004, Journal of vision.

[4]  Maneesh Agrawala,et al.  The influence of shape cues on the perception of lighting direction. , 2010, Journal of vision.

[5]  Christiane B Wiebel,et al.  The speed and accuracy of material recognition in natural images , 2013, Attention, perception & psychophysics.

[6]  Pascal Mamassian,et al.  Impossible Shadows and the Shadow Correspondence Problem , 2004, Perception.

[7]  Donald P. Greenberg,et al.  Psychophysically based model of surface gloss perception , 2001, IS&T/SPIE Electronic Imaging.

[8]  A. Hurlbert Colour vision: Is colour constancy real? , 1999, Current Biology.

[9]  Phillip J. Marlow,et al.  The Perception and Misperception of Specular Surface Reflectance , 2012, Current Biology.

[10]  Sylvia C. Pont,et al.  A comparison of material and illumination discrimination performance for real rough, real smooth and computer generated smooth spheres , 2005, APGV '05.

[11]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[12]  Edward H. Adelson,et al.  The perception of shading and reflectance , 1996 .

[13]  Patrick Cavanagh,et al.  Perceiving Illumination Inconsistencies in Scenes , 2005, Perception.

[14]  E. Adelson,et al.  Image statistics for surface reflectance perception. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  Roland W Fleming,et al.  Real-world illumination and the perception of surface reflectance properties. , 2003, Journal of vision.

[16]  Richard F Murray,et al.  The human visual system's assumption that light comes from above is weak , 2011, Proceedings of the National Academy of Sciences.

[17]  J. Schirillo We infer light in space , 2013, Psychonomic bulletin & review.

[18]  Andrea J. van Doorn,et al.  Mixing material modes , 2012, Electronic Imaging.

[19]  Barton L Anderson,et al.  Visual perception of materials and surfaces , 2011, Current Biology.

[20]  Arnold W. M. Smeulders,et al.  The Amsterdam Library of Object Images , 2004, International Journal of Computer Vision.

[21]  Ignace Hooge,et al.  Scan path entropy and arrow plots: capturing scanning behavior of multiple observers , 2013, Front. Psychol..

[22]  Ron O Dror,et al.  Statistical characterization of real-world illumination. , 2004, Journal of vision.

[23]  Matteo Valsecchi,et al.  Lightness perception for matte and glossy complex shapes , 2017, Vision Research.

[24]  H. Boyaci,et al.  Testing limits on matte surface color perception in three-dimensional scenes with complex light fields , 2007, Vision Research.

[25]  S. Pont,et al.  Material — Illumination Ambiguities and the Perception of Solid Objects , 2006, Perception.

[26]  Richard F Murray,et al.  Human vision is attuned to the diffuseness of natural light. , 2014, Journal of vision.

[27]  R. Fleming Visual perception of materials and their properties , 2014, Vision Research.

[28]  G. Obein,et al.  Difference scaling of gloss: nonlinearity, binocularity, and constancy. , 2004, Journal of vision.

[29]  Alexander A. Mury,et al.  Structure of light fields in natural scenes. , 2009, Applied optics.

[30]  Matteo Toscani,et al.  Statistical correlates of perceived gloss in natural images , 2015, Vision Research.

[31]  Katsushi Ikeuchi,et al.  Illumination from Shadows , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Wendy L. Braje,et al.  Invariant Recognition of Natural Objects in the Presence of Shadows , 2000, Perception.

[33]  J. Koenderink,et al.  Visual Discrimination of Spectral Distributions , 2004, Perception.

[34]  E. Adelson,et al.  Accuracy and speed of material categorization in real-world images. , 2014, Journal of vision.

[35]  Stacey Aston,et al.  Illumination discrimination in real and simulated scenes , 2016, Journal of vision.

[36]  Katja Doerschner,et al.  Cues to an equivalent lighting model. , 2006, Journal of vision.

[37]  P. Hanrahan,et al.  On the relationship between radiance and irradiance: determining the illumination from images of a convex Lambertian object. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[38]  Roland W Fleming,et al.  Human Perception: Visual Heuristics in the Perception of Glossiness , 2012, Current Biology.

[39]  Sylvia C Pont,et al.  Highlight shapes and perception of gloss for real and photographed objects. , 2016, Journal of vision.

[40]  D. Brainard,et al.  Mechanisms of color constancy under nearly natural viewing. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[41]  Nopporn Chotikakamthorn,et al.  Light source estimation using feature points from specular highlights and cast shadows , 2016 .

[42]  Ling Xia,et al.  The visual light field in real scenes , 2014, i-Perception.

[43]  Dragan Sekulovski,et al.  The global structure of the visual light field and its relation to the physical light field. , 2016, Journal of vision.

[44]  Edward H. Adelson,et al.  Material perception: What can you see in a brief glance? , 2010 .

[45]  A. Gilchrist Lightness, brightness, and transparency , 2009 .

[46]  Robin E. Hauck,et al.  Measurements of the effect of surface slant on perceived lightness. , 2004, Journal of vision.

[47]  Roberto Casati,et al.  The Shadow Knows: A Primer on the Informational Structure of Cast Shadows , 2004, Perception.

[48]  D. Kersten,et al.  Responses to Lightness Variations in Early Human Visual Cortex , 2007, Current Biology.

[49]  Sylvia C Pont,et al.  The Visual Light Field , 2007, Perception.

[50]  Karl R Gegenfurtner,et al.  Lightness perception for surfaces moving through different illumination levels. , 2016, Journal of vision.

[51]  E. Adelson,et al.  Image statistics and the perception of surface qualities , 2007, Nature.

[52]  J. Koenderink,et al.  Light Direction from Shad(ow)ed Random Gaussian Surfaces , 2004, Perception.

[53]  J. Koenderink,et al.  Matching illumination of solid objects , 2007, Perception & psychophysics.

[54]  J. Koenderink,et al.  Illumination direction from texture shading. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[55]  Anya Hurlbert,et al.  Color and size interactions in a real 3D object similarity task. , 2004, Journal of vision.

[56]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[57]  Johan Wagemans,et al.  Awareness of the light field: the case of deformation , 2012, i-Perception.

[58]  P. Mamassian,et al.  Prior knowledge on the illumination position , 2001, Cognition.

[59]  H. Bülthoff,et al.  Does the brain know the physics of specular reflection? , 1990, Nature.

[60]  Huseyin Boyaci,et al.  Surface color perception and light field estimation in 3D scenes , 2011 .

[61]  David J. Kriegman,et al.  The Bas-Relief Ambiguity , 2004, International Journal of Computer Vision.

[62]  Fan Zhang,et al.  The influence of lighting on visual perception of material qualities , 2015, Electronic Imaging.

[63]  K. Gegenfurtner,et al.  Optimal sampling of visual information for lightness judgments , 2013, Proceedings of the National Academy of Sciences.

[64]  L. Maloney,et al.  The effect of perceived surface orientation on perceived surface albedo in binocularly viewed scenes. , 2003, Journal of vision.