Sun and sky: Does human vision assume a mixture of point and diffuse illumination when interpreting shape-from-shading?

People readily perceive smooth luminance variations as being due to the shading produced by undulations of a 3-D surface (shape-from-shading). In doing so, the visual system must simultaneously estimate the shape of the surface and the nature of the illumination. Remarkably, shape-from-shading operates even when both these properties are unknown and neither can be estimated directly from the image. In such circumstances humans are thought to adopt a default illumination model. A widely held view is that the default illuminant is a point source located above the observer's head. However, some have argued instead that the default illuminant is a diffuse source. We now present evidence that humans may adopt a flexible illumination model that includes both diffuse and point source elements. Our model estimates a direction for the point source and then weights the contribution of this source according to a bias function. For most people the preferred illuminant direction is overhead with a strong diffuse component.

[1]  P. Cavanagh,et al.  Shape from shadows. , 1989, Journal of experimental psychology. Human perception and performance.

[2]  V. S. Ramachandran,et al.  Perception of shape from shading , 1988, Nature.

[3]  Kai von Fieandt,et al.  Das phänomenologische problem von licht und schatten , 1949 .

[4]  Joseph P. Hornak,et al.  Encyclopedia of imaging science and technology , 2002 .

[5]  M. Ernst,et al.  Experience can change the 'light-from-above' prior , 2004, Nature Neuroscience.

[6]  Eugene McSorley,et al.  The curvature of saccade trajectories is modulated by advanced knowledge of target location but is not spatially sensitive to distractor location , 2004 .

[7]  J. Koenderink,et al.  Light Direction from Shad(ow)ed Random Gaussian Surfaces , 2004, Perception.

[8]  Jan J. Koenderink,et al.  Haptic perception disambiguates visual perception of 3D shape , 2009, Experimental Brain Research.

[9]  Ron O Dror,et al.  Statistical characterization of real-world illumination. , 2004, Journal of vision.

[10]  A. James Stewart,et al.  Towards accurate recovery of shape from shading under diffuse lighting , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Michael S. Landy,et al.  Computational models of visual processing , 1991 .

[12]  J. Koenderink,et al.  Light Source Dependence in Shape from Shading , 1997, Vision Research.

[13]  Frederick A A Kingdom,et al.  Color brings relief to human vision , 2003, Nature Neuroscience.

[14]  Laurence T Maloney,et al.  Estimating changes in lighting direction in binocularly viewed three-dimensional scenes. , 2010, Journal of vision.

[15]  Christopher W. Tyler,et al.  Diffuse illumination as a default assumption for shape-from-shading in the absence of shadows , 1997, Electronic Imaging.

[16]  Michael Bosse,et al.  Calibrated, Registered Images of an Extended Urban Area , 2003, International Journal of Computer Vision.

[17]  Jan J. Koenderink,et al.  Perception of illuminance flow in the case of anisotropic rough surfaces , 2007, Perception & psychophysics.

[18]  William T. Freeman,et al.  The generic viewpoint assumption in a framework for visual perception , 1994, Nature.

[19]  A. James Stewart,et al.  Toward Accurate Recovery of Shape from Shading Under Diffuse Lighting , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  D. Pelli,et al.  Display Characterization , 1998 .

[21]  A. Pentland Shape information from shading: A theory about human perception , 1989 .

[22]  J. Koenderink,et al.  Illumination direction from texture shading. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[23]  H. Bülthoff,et al.  Depth Discrimination from Shading under Diffuse Lighting , 2000, Perception.

[24]  J. Koenderink,et al.  Perception of local shape from shading , 1993, Perception & psychophysics.

[25]  Alexander A. Mury,et al.  Structure of light fields in natural scenes. , 2009, Applied optics.

[26]  James T Todd,et al.  Perceptual biases in the interpretation of 3D shape from shading , 2004, Vision Research.

[27]  Frederick A.A. Kingdom,et al.  Perceiving light versus material , 2008, Vision Research.

[28]  Peng Sun,et al.  What is second-order vision for? Discriminating illumination versus material changes. , 2010, Journal of vision.

[29]  M. Landy,et al.  Shading Ambiguity: Reflectance and Illumination , 1991 .

[30]  David J. Kriegman,et al.  The Bas-Relief Ambiguity , 2004, International Journal of Computer Vision.

[31]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  E. Hess,et al.  Development of the chick's responses to light and shade cues of depth. , 1950, Journal of comparative and physiological psychology.

[33]  Mark A. Georgeson,et al.  Local luminance amplitude modulates the interpretation of shape-from-shading in textured surfaces , 2006, Vision Research.

[34]  Robin E. Hauck,et al.  An equivalent illuminant model for the effect of surface slant on perceived lightness. , 2004, Journal of vision.

[35]  P. Mamassian,et al.  Prior knowledge on the illumination position , 2001, Cognition.

[36]  E. Mingolla,et al.  Perception of surface curvature and direction of illumination from patterns of shading. , 1983, Journal of experimental psychology. Human perception and performance.

[37]  D. Todd,et al.  The Sun , 1870, Nature.

[38]  A. Pentland Finding the illuminant direction , 1982 .

[39]  G. Orban,et al.  Perception of Three-Dimensional Shape From Specular Highlights, Deformations of Shading, and Other Types of Visual Information , 2004, Psychological science.

[40]  Peng Sun,et al.  Two operational modes in the perception of shape from shading revealed by the effects of edge information in slant settings. , 2012, Journal of vision.

[41]  S. M. Shape-from-shading on a cloudy day , 1992 .

[42]  Sylvia C Pont,et al.  The Visual Light Field , 2007, Perception.

[43]  J. Koenderink,et al.  Irradiation direction from texture. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[44]  Vision Research , 1961, Nature.