Perception of Three-Dimensional Shape From Specular Highlights, Deformations of Shading, and Other Types of Visual Information

There have been numerous computational models developed in an effort to explain how the human visual system analyzes three-dimensional (3D) surface shape from patterns of image shading, but they all share some important limitations. Models that are applicable to individual static images cannot correctly interpret regions that contain specular highlights, and those that are applicable to moving images have difficulties when a surface moves relative to its sources of illumination. Here we describe a psychophysical experiment that measured the sensitivity of human observers to small differences of 3D shape over a wide variety of conditions. The results provide clear evidence that the presence of specular highlights or the motions of a surface relative to its light source do not pose an impediment to perception, but rather, provide powerful sources of information for the perceptual analysis of 3D shape.

[1]  M. M. Taylor,et al.  PEST: Efficient Estimates on Probability Functions , 1967 .

[2]  S. Ullman,et al.  The interpretation of visual motion , 1977 .

[3]  J. Koenderink,et al.  Photometric Invariants Related to Solid Shape , 1980 .

[4]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[5]  J. Koenderink,et al.  The Shape of Smooth Objects and the Way Contours End , 1982, Perception.

[6]  J J Koenderink,et al.  What Does the Occluding Contour Tell Us about Solid Shape? , 1984, Perception.

[7]  Richard S. Weiss,et al.  Reconstruction of Surfaces from Profiles , 1987, ICCV 1987.

[8]  Hans-Hellmut Nagel,et al.  On the Estimation of Optical Flow: Relations between Different Approaches and Some New Results , 1987, Artif. Intell..

[9]  Andrew Blake,et al.  The information available to a moving observer from specularities , 1989, Image Vis. Comput..

[10]  Shape from Highlights. , 1989 .

[11]  J. Todd,et al.  Ordinal structure in the visual perception and cognition of smoothly curved surfaces. , 1989, Psychological review.

[12]  H. Bülthoff,et al.  Does the brain know the physics of specular reflection? , 1990, Nature.

[13]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[14]  A Blake,et al.  Shape from specularities: computation and psychophysics. , 1991, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[15]  J T Todd,et al.  Perception of rigid motion in depth from the optical deformations of shadows and occlusion boundaries. , 1994, Journal of experimental psychology. Human perception and performance.

[16]  J T Todd,et al.  The Visual Discrimination of Relative Surface Orientation , 1995, Perception.

[17]  A. James Stewart,et al.  Towards accurate recovery of shape from shading under diffuse lighting , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  J T Todd,et al.  The Discriminability of Local Surface Structure , 1996, Perception.

[19]  J. Todd,et al.  Effects of Texture, Illumination, and Surface Reflectance on Stereoscopic Shape Perception , 1996, Perception.

[20]  A. James Stewart,et al.  Toward Accurate Recovery of Shape from Shading Under Diffuse Lighting , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Roberto Cipolla,et al.  The visual motion of curves and surfaces , 1998, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[22]  G. Orban,et al.  Three-Dimensional Shape Coding in Inferior Temporal Cortex , 2000, Neuron.

[23]  Pietro Perona,et al.  Local Analysis for 3D Reconstruction of Specular Surfaces - Part II , 2002, ECCV.

[24]  J Farley Norman,et al.  The perception and discrimination of local 3-D surface structure from deforming and disparate boundary contours , 2002, Perception & psychophysics.

[25]  James T Todd,et al.  The visual perception of 3-D shape from multiple cues: Are observers capable of perceiving metric structure? , 2003, Perception & psychophysics.

[26]  Jitendra Malik,et al.  Computing Local Surface Orientation and Shape from Texture for Curved Surfaces , 1997, International Journal of Computer Vision.

[27]  David J. Kriegman,et al.  The Bas-Relief Ambiguity , 2004, International Journal of Computer Vision.

[28]  J. Koenderink,et al.  The singularities of the visual mapping , 1976, Biological Cybernetics.

[29]  Shree K. Nayar,et al.  A Theory of Specular Surface Geometry , 2004, International Journal of Computer Vision.

[30]  Jitendra Malik,et al.  Interpreting line drawings of curved objects , 1986, International Journal of Computer Vision.

[31]  Olivier D. Faugeras,et al.  Shape From Shading , 2006, Handbook of Mathematical Models in Computer Vision.