A theory of shape constancy based on perspective invariants

Shape constancy refers to the phenomenon in which the percept of the shape of a given object remains constant despite changes in the shape of the object's retinal image. The phenomenon of shape constancy is considered from historical, theoretical and empirical perspectives in this paper. First, four prior theories are discussed; specifically, (1) Helmholtzian theory, which assumes that shape constancy is achieved by taking an object's orientation into account, (2) Gestalt theory, which assumes that shape constancy involves a relationship between the perceived shape and perceived orientation of an object, (3) Gibsonian theory, which assumes that shape constancy is based on projective invariants and (4) multiple view theory, which assumes that shape constancy is achieved by memorizing a large set of different views of the object. It is shown, by an analysis of the prior literature, that none of these theories can actually explain the phenomenon of shape constancy. A new theory, which is based on new perspective invariants of a flat shape, is then proposed. The new Perspective Invariants Theory can account for all prior shape constancy experiments. New experiments, testing predictions of the Perspective Invariants Theory are then described. These experiments showed that: (1) a novel shape can be matched with its single perspective image in the absence of depth cues, (2) perceptual processing of shape is impaired when the range of possible values of tilt is wide, (3) perceptual processing of shape is not affected by the width of the range of possible values of slant. These results support predictions of Perspective Invariants Theory.

[1]  John Primrose Geometry of visual space , 1951 .

[2]  G Sperling,et al.  Kinetic depth effect and identification of shape. , 1989, Journal of experimental psychology. Human perception and performance.

[3]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[4]  Takeo Kanade,et al.  Mapping Image Properties into Shape Constraints: Skewed Symmetry, Affine-Transformable Patterns, and the Shape-from-Texture Paradigm , 1983 .

[5]  I. Rock,et al.  A case of viewer-centered object perception , 1987, Cognitive Psychology.

[6]  S. Ullman,et al.  The interpretation of visual motion , 1977 .

[7]  W. Epstein,et al.  The induction of nonveridical slant and the perception of shape. , 1962, Journal of experimental psychology.

[8]  James E. Cutting,et al.  Perception with an eye for motion , 1986 .

[9]  Alfred H. Holway,et al.  Determinants of Apparent Visual Size with Distance Variant , 1941 .

[10]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[11]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[12]  M. Braunstein Depth perception through motion , 1976 .

[13]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[14]  P. Kaiser,et al.  Perceived shape and its dependency on perceived slant. , 1967, Journal of experimental psychology.

[15]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[16]  Azriel Rosenfeld,et al.  Recognition of planar shapes from perspective images using contour-based invariants , 1992, CVGIP Image Underst..

[17]  J. Aloimonos Shape from texture , 1988, Biological cybernetics.

[18]  L. Zusne Visual perception of form , 1970 .

[19]  David A. Forsyth,et al.  Extracting projective structure from single perspective views of 3D point sets , 1993, 1993 (4th) International Conference on Computer Vision.

[20]  P. R. Bevington,et al.  Data Reduction and Error Analysis for the Physical Sciences , 1969 .

[21]  H. Leibowitz,et al.  Time and intensity as determiners of perceived shape. , 1956, Journal of experimental psychology.

[22]  C. C. Wood,et al.  Effects of graded doses of alcohol on speed-accuracy tradeoff in choice reaction time , 1976 .

[23]  Andrew P. Witkin,et al.  Recovering Surface Shape and Orientation from Texture , 1981, Artif. Intell..

[24]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[25]  J A Perrone,et al.  Visual Slant Underestimation: A General Model , 1982, Perception.

[26]  Jezekiel Ben-Arie The Probabilistic Peaking Effect of Viewed Angles and Distances with Application to 3-D Object Recognition , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  R. Thouless The general principle underlying effects attributed to the so-called phenomenal constancy tendency , 1934 .

[28]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[29]  J. L. Coolidge,et al.  A history of geometrical methods , 1947 .

[30]  Andrew Zisserman,et al.  Introduction—towards a new framework for vision , 1992 .

[31]  K. Koffka Principles Of Gestalt Psychology , 1936 .

[32]  E. Johnston Systematic distortions of shape from stereopsis , 1991, Vision Research.

[33]  G. Sperling The description and luminous calibration of cathode ray oscilloscope visual displays , 1971 .

[34]  E. Cassirer The concept of group and the theory of perception , 1944 .

[35]  J T Todd,et al.  The perception of 3-dimensional affine structure from minimal apparent motion sequences , 1990, Perception & psychophysics.

[36]  R. Shepard,et al.  Mental Images and Their Transformations , 1982 .

[37]  M. Landy,et al.  Kinetic depth effect and optic flow—I. 3D shape from Fourier motion , 1989, Vision Research.

[38]  S. Ullman Recent Computational Studies in the Interpretation of Structure from Motion , 1983 .

[39]  Katsushi Ikeuchi,et al.  Shape from Regular Patterns , 1984, Artif. Intell..

[40]  Robert H. Thouless,et al.  Phenomenal Regression to the Real Object , 1931, Nature.

[41]  J. Todd,et al.  Perception of three-dimensional form from patterns of optical texture. , 1987, Journal of experimental psychology. Human perception and performance.

[42]  S. Edelman,et al.  Orientation dependence in the recognition of familiar and novel views of three-dimensional objects , 1992, Vision Research.

[43]  Yehezkel Lamdan,et al.  Object recognition by affine invariant matching , 2011, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[44]  J. Gibson,et al.  The relation of apparent shape to apparent slant in the perception of objects. , 1955, Journal of experimental psychology.

[45]  W. Hoffman The Lie algebra of visual perception , 1966 .

[46]  Katsushi Ikeuchi,et al.  Numerical Shape from Shading and Occluding Boundaries , 1981, Artif. Intell..

[47]  H. Leibowitz,et al.  Effect of stimulus distance and age on shape constancy. , 1967, Journal of experimental psychology.

[48]  John B. Thurmond,et al.  Form identification in peripheral vision , 1970 .

[49]  J.B. Burns,et al.  View Variation of Point-Set and Line-Segment Features , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Isaac Weiss,et al.  Projective invariants of shapes , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[51]  J T Todd,et al.  The visual perception of smoothly curved surfaces from minimal apparent motion sequences , 1991, Perception & psychophysics.

[52]  The Effect of Refractive Error on Size Constancy and Shape Constancy , 1978, Perception.

[53]  E. Brunswik Representative design and probabilistic theory in a functional psychology. , 1955, Psychological review.

[54]  Alex Pentland,et al.  Local Shading Analysis , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  I. Rock,et al.  Can we imagine how objects look from other viewpoints? , 1989, Cognitive Psychology.

[56]  H WALLACH,et al.  The role of slant in the perception of shape. , 1962, The American journal of psychology.

[57]  T. Sejnowski,et al.  Neural network model of visual cortex for determining surface curvature from images of shaded surfaces , 1990, Proceedings of the Royal Society of London. B. Biological Sciences.

[58]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[59]  J. Gibson The perception of the visual world , 1951 .

[60]  S. McKee,et al.  The imprecision of stereopsis , 1990, Vision Research.

[61]  J. Perrone Slant Underestimation: A Model Based on the Size of the Viewing Aperture , 1980, Perception.

[62]  M. Bitterman,et al.  The measurement of shape-constancy. , 1951, The American journal of psychology.

[63]  James T. Todd,et al.  Ordinal structure in the visual perception and cognition of smoothly curved surfaces. , 1989 .