What do reflections tell us about the shape of a mirror?

Three-dimensional shape may be perceived from static images. Contours, shading, texture gradients, perspective and occlusion are well-studied cues to this percept. When looking at a picture of a specular object, such as a silver vase, one additional cue is potentially available: a deformed picture of the reflected environment is seen in the surface of the object and the amount and type of deformation depend on its shape. Can specular reflections be used as a visual cue for shape perception? Our experiments show that our subjects are very poor at judging the shape of mirror surfaces in absence of other visual cues. However, for a considerable subset of the stimuli, subjects are highly consistent in their (most often wrong) perception. This observation leads us to the hypothesis that our subjects rather than 'computing' a percept from each image based on geometrical considerations, may be associating a shape to each pattern in a stereotypical way, akin to pattern-matching. This behavior is reasonable since, as suggested by our ideal observer analysis, the information available from specular reflections is ambiguous when the surrounding world is (partially) unknown.

[1]  J. Koenderink,et al.  Photometric Invariants Related to Solid Shape , 1980 .

[2]  J. Todd,et al.  Perception of three-dimensional form from patterns of optical texture. , 1987, Journal of experimental psychology. Human perception and performance.

[3]  Andrea Li,et al.  Limitations on shape information provided by texture cues , 2002, Vision Research.

[4]  Jitendra Malik,et al.  Surface orientation from texture: Isotropy or homogeneity (or both)? , 1997, Vision Research.

[5]  S K Nayar,et al.  Visual appearance of matte surfaces , 1995, Science.

[6]  J. Koenderink,et al.  Surface roughness from highlight structure. , 1999, Applied optics.

[7]  D. Sheinberg,et al.  Shape from texture: ideal observers and human psychophysics , 1996 .

[8]  Andrew Blake,et al.  Geometry From Specularities , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[9]  Edward H. Adelson,et al.  How do Humans Determine Reflectance Properties under Unknown Illumination , 2001, CVPR 2001.

[10]  Andrew Blake,et al.  The information available to a moving observer from specularities , 1989, Image and Vision Computing.

[11]  J. Todd,et al.  Effects of Texture, Illumination, and Surface Reflectance on Stereoscopic Shape Perception , 1996, Perception.

[12]  Shree K. Nayar,et al.  A Theory of Specular Surface Geometry , 2004, International Journal of Computer Vision.

[13]  H. Bülthoff,et al.  Does the brain know the physics of specular reflection? , 1990, Nature.

[14]  David C. Knill,et al.  Surface orientation from texture: ideal observers, generic observers and the information content of texture cues , 1998, Vision Research.

[15]  Victoria Interrante,et al.  Conveying shape with texture: experimental investigations of texture's effects on shape categorization judgments , 2004, IEEE Transactions on Visualization and Computer Graphics.

[16]  J. Beck,et al.  Highlights and the perception of glossiness , 1981, Perception & psychophysics.

[17]  Min Chen,et al.  Recovering Local Shape of a Mirror Surface from Reflection of a Regular Grid , 2004, ECCV.