The influence of shape cues on the perception of lighting direction.

Three scene properties determine the luminances in the image of a shaded object: the material reflectance, the illuminant position, and the object's shape. Because all three properties determine the image, one cannot solve for any one property without knowing the other two. Nevertheless, people perceive consistent 3D shape and consistent lighting in shaded images; they must therefore be making assumptions about the unknown properties. We conducted two psychophysical experiments to determine how viewers use shape information to estimate the lighting direction from shaded images. In the first experiment, we confirmed that observers use 3D shape information when estimating lighting direction. In the second experiment, we investigated how different shape cues affect lighting direction estimates. Observers can accurately determine lighting direction when a host of shape cues specify the objects. When shading is the only cue, observers always set lighting direction to be from above. We modeled the results in a Bayesian framework that included a prior distribution describing the assumed lighting direction. The estimated prior was slightly counterclockwise from above at a ∼30° slant. Our model showed that an assumption of convexity provides an accurate estimate of lighting direction when the shape is globally, but not locally, consistent with convexity.

[1]  James A. Crowell,et al.  Horizontal and vertical disparity, eye position, and stereoscopic slant perception , 1999, Vision Research.

[2]  Amitabh Varshney,et al.  Geometry-dependent lighting , 2006, IEEE Transactions on Visualization and Computer Graphics.

[3]  Mary J. Bravo,et al.  Image forensic analyses that elude the human visual system , 2010, Electronic Imaging.

[4]  J. Koenderink,et al.  Light Direction from Shad(ow)ed Random Gaussian Surfaces , 2004, Perception.

[5]  M. Ernst,et al.  Experience can change the 'light-from-above' prior , 2004, Nature Neuroscience.

[6]  Erik Reinhard,et al.  Light Source Detection in Photographs , 2009, CEIG.

[7]  M.-C. Dubois,et al.  Light from above , 2003 .

[8]  C. Harris,et al.  Identity and similarity in repetition blindness: no cross-over interaction , 2001, Cognition.

[9]  P. Mamassian,et al.  Prior knowledge on the illumination position , 2001, Cognition.

[10]  Laurence R Harris,et al.  Shape-from-Shading Depends on Visual, Gravitational, and Body-Orientation Cues , 2004, Perception.

[11]  Wendy J Adams,et al.  A common light-prior for visual search, shape, and reflectance judgments. , 2007, Journal of vision.

[12]  Pascal Mamassian,et al.  Impossible Shadows and the Shadow Correspondence Problem , 2004, Perception.

[13]  A. Pentland Finding the illuminant direction , 1982 .

[14]  Katsushi Ikeuchi,et al.  Numerical Shape from Shading and Occluding Boundaries , 1981, Artif. Intell..

[15]  Kent A. Stevens,et al.  Slant-tilt: The visual encoding of surface orientation , 1983, Biological Cybernetics.

[16]  Ronald A. Rensink,et al.  Influence of scene-based properties on visual search. , 1990, Science.

[17]  P. Perona,et al.  Where is the sun? , 1998, Nature Neuroscience.

[18]  H H Bülthoff,et al.  A Prior for Global Convexity in Local Shape-from-Shading , 2001, Perception.

[19]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[20]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[21]  Szymon Rusinkiewicz,et al.  Exaggerated shading for depicting shape and detail , 2006, ACM Trans. Graph..

[22]  Yaniv Morgenstern,et al.  Contextual lighting cues can override the light-from-above prior , 2010 .

[23]  Azriel Rosenfeld,et al.  Improved Methods of Estimating Shape from Shading Using the Light Source Coordinate System , 1985, Artif. Intell..

[24]  Patrick Cavanagh,et al.  Perceiving Illumination Inconsistencies in Scenes , 2005, Perception.

[25]  J. Koenderink,et al.  Perturbation Study of Shading in Pictures , 1996, Perception.

[26]  Pascal Mamassian,et al.  Observer biases in the 3D interpretation of line drawings , 1998, Vision Research.

[27]  Hany Farid,et al.  Exposing digital forgeries by detecting inconsistencies in lighting , 2005, MM&Sec '05.

[28]  Maneesh Agrawala,et al.  The assumed light direction for perceiving shape from shading , 2008, APGV '08.

[29]  V. Ramachandran,et al.  On the perception of shape from shading , 1988, Nature.

[30]  Sylvia C Pont,et al.  The Visual Light Field , 2007, Perception.

[31]  Greg Humphreys,et al.  A spatial data structure for fast Poisson-disk sample generation , 2006, SIGGRAPH 2006.

[32]  Dani Lischinski,et al.  Automatic Lighting Design using a Perceptual Quality Metric , 2001, Comput. Graph. Forum.

[33]  Simon Carlile,et al.  Methods for spherical data analysis and visualization , 1998, Journal of Neuroscience Methods.

[34]  Jan-Olof Eklundh,et al.  Automatic estimation of the projected light source direction , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[35]  J. Malik,et al.  Recovering Three Dimensional Shape from a Single Image of Curved Objects , 1987, IJCAI.

[36]  M. Landy,et al.  How direction of illumination affects visually perceived surface roughness. , 2006, Journal of vision.

[37]  J. Koenderink,et al.  Matching illumination of solid objects , 2007, Perception & psychophysics.

[38]  E. Catmull,et al.  Recursively generated B-spline surfaces on arbitrary topological meshes , 1978 .

[39]  Stefan Gumhold,et al.  Maximum entropy light source placement , 2002, IEEE Visualization, 2002. VIS 2002..

[40]  James T. Kajiya,et al.  The rendering equation , 1998 .