The role of natural lighting diffuseness in human visual perception

The pattern of the light that falls on the retina is a conflation of real-world sources such as illumination and reflectance. Human observers often contend with the inherent ambiguity of the underlying sources by making assumptions about what real-world sources are most likely. Here we examine whether the visual system’s assumptions about illumination match the statistical regularities of the real world. We used a custom-built multidirectional photometer to capture lighting relevant to the shading of Lambertian surfaces in hundreds of real-world scenes. We quantify the diffuseness of these lighting measurements, and compare them to previous biases in human visual perception. We find that (1) natural lighting diffuseness falls over the same range as previous psychophysical estimates of the visual system’s assumptions on diffuseness, and (2) natural lighting almost always provides lighting direction cues that are strong enough to override the human visual system’s well known assumption that light tends to come from above. A consequence of these findings is that what seem to be errors in visual perception are often actually byproducts of the visual system knowing about and using reliable properties of real-world lighting when contending with ambiguous retinal images.

[1]  V S Ramachandran,et al.  Perceiving shape from shading. , 1988, Scientific American.

[2]  Paul Debevec Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 2008, SIGGRAPH Classes.

[3]  David H Brainard,et al.  Surface color perception and equivalent illumination models. , 2011, Journal of vision.

[4]  Alan Gilchrist Seeing in Black & White , 2008 .

[5]  Sharon Poggenpohl,et al.  Laws of Seeing , 2012 .

[6]  Robin E. Hauck,et al.  Measurements of the effect of surface slant on perceived lightness. , 2004, Journal of vision.

[7]  David H Brainard,et al.  The effect of photometric and geometric context on photometric and geometric lightness effects. , 2014, Journal of vision.

[8]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[9]  D Purves,et al.  An empirical explanation of brightness. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Ronen Basri,et al.  Lambertian Reflectance and Linear Subspaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Pat Hanrahan,et al.  An efficient representation for irradiance environment maps , 2001, SIGGRAPH.

[12]  Robin E. Hauck,et al.  An equivalent illuminant model for the effect of surface slant on perceived lightness. , 2004, Journal of vision.

[13]  C. Cuttle,et al.  Lighting by Design , 2003 .

[14]  Alexander A. Mury,et al.  Light field constancy within natural scenes. , 2007, Applied optics.

[15]  Alexander A. Mury,et al.  Representing the light field in finite three-dimensional spaces from sparse discrete samples. , 2009, Applied optics.

[16]  Katja Doerschner,et al.  Cues to an equivalent lighting model. , 2006, Journal of vision.

[17]  V. S. Ramachandran,et al.  Perception of shape from shading , 1988, Nature.

[18]  Zygmunt Pizlo,et al.  From : Shape Perception in Human and Computer Vision , 2017 .

[19]  Richard F. Murray Human lightness perception is guided by simple assumptions about reflectance and lighting , 2013, Electronic Imaging.

[20]  L. Maloney,et al.  The effect of perceived surface orientation on perceived surface albedo in binocularly viewed scenes. , 2003, Journal of vision.

[21]  L. Maloney,et al.  Perceived surface color in binocularly viewed scenes with two light sources differing in chromaticity. , 2004, Journal of vision.

[22]  Alexander A. Mury,et al.  Structure of light fields in natural scenes. , 2009, Applied optics.

[23]  Richard F. Murray,et al.  The Statistics of Shape, Reflectance, and Lighting in Real-World Scenes , 2013, Shape Perception in Human and Computer Vision.

[24]  Richard F Murray,et al.  Human vision is attuned to the diffuseness of natural light. , 2014, Journal of vision.

[25]  Richard F Murray,et al.  The human visual system's assumption that light comes from above is weak , 2011, Proceedings of the National Academy of Sciences.

[26]  Ron O Dror,et al.  Statistical characterization of real-world illumination. , 2004, Journal of vision.

[27]  Mark A. Georgeson,et al.  Sun and sky: Does human vision assume a mixture of point and diffuse illumination when interpreting shape-from-shading? , 2011, Vision Research.

[28]  David J. Kriegman,et al.  The Bas-Relief Ambiguity , 2004, International Journal of Computer Vision.

[29]  W. Metzger,et al.  Laws of Seeing , 2006 .