Foundations of spatial vision: from retinal images to perceived shapes.

Vision is based on spatial correspondences between physically different structures--in environment, retina, brain, and perception. An examination of the correspondence between environmental surfaces and their retinal images showed that this consists of 2-dimensional 2nd-order differential structure (effectively 4th-order) associated with local surface shape, suggesting that this might be a primitive form of spatial information. Next, experiments on hyperacuities for detecting relative motion and binocular disparity among separated image features showed that spatial positions are visually specified by the surrounding optical pattern rather than by retinal coordinates, minimally affected by random image perturbations produced by 3-D object motions. Retinal image space, therefore, involves 4th-order differential structure. This primitive spatial structure constitutes information about local surface shape.

[1]  J S Tittle,et al.  The visual perception of three-dimensional length. , 1996, Journal of experimental psychology. Human perception and performance.

[2]  E. Robinson.  Cybernetics, or Control and Communication in the Animal and the Machine , 1963 .

[3]  J. Lappin,et al.  Detection of visual forms in space and time , 1983, Vision Research.

[4]  Adriaan van den Bos,et al.  Resolution: a survey , 1997 .

[5]  J. Koenderink,et al.  Second-order optic flow , 1992 .

[6]  G. Johansson.  PERCEPTION OF MOTION AND CHANGING FORM: A study of visual perception from continuous transformations of a solid angle of light at the eye , 1964 .

[7]  Rich Gossweiler,et al.  Perceiving geographical slant , 1995, Psychonomic bulletin & review.

[8]  Refractor.  Vision , 2000, The Lancet.

[9]  G Westheimer,et al.  The spatial sense of the eye. Proctor lecture. , 1979, Investigative ophthalmology & visual science.

[10]  J T Todd,et al.  The perception of 3-dimensional affine structure from minimal apparent motion sequences , 1990, Perception & psychophysics.

[11]  P. O. Bishop,et al.  Spatial vision. , 1971, Annual review of psychology.

[12]  I. Ohzawa,et al.  On the neurophysiological organization of binocular vision , 1990, Vision Research.

[13]  Andrea J. van Doorn,et al.  Invariant Properties of the Motion Parallax Field due to the Movement of Rigid Bodies Relative to an Observer , 1975 .

[14]  Andrea J. van Doorn,et al.  Generic Neighborhood Operators , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[16]  M. Landy,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[17]  B Efron,et al.  Statistical Data Analysis in the Computer Age , 1991, Science.

[18]  C. Erkelens,et al.  Stability of Binocular Depth Perception with Moving Head and Eyes , 1996, Vision Research.

[19]  E. Adelson.  Perceptual organization and the judgment of brightness. , 1993, Science.

[20]  J T Todd,et al.  The visual perception of smoothly curved surfaces from minimal apparent motion sequences , 1991, Perception & psychophysics.

[21]  J S Lappin,et al.  Detection of three-dimensional structure in moving optical patterns. , 1984, Journal of experimental psychology. Human perception and performance.

[22]  J T Todd,et al.  The Discriminability of Local Surface Structure , 1996, Perception.

[23]  Jonathan Barzilai,et al.  On the foundations of measurement , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[24]  W. J. Thron,et al.  Encyclopedia of Mathematics and its Applications. , 1982 .

[25]  J T Todd,et al.  Perceptual localization of surface position. , 1997, Journal of experimental psychology. Human perception and performance.

[26]  S. McKee,et al.  Finding the common bond: Stereoacuity and the other hyperacuities , 1990, Vision Research.

[27]  A Johnston,et al.  Shape from Shading. I: Surface Curvature and Orientation , 1994, Perception.

[28]  G. Brindley.  Physiology of the Retina and the Visual Pathway , 1960 .

[29]  Michael S. Landy,et al.  Computational models of visual processing , 1991 .

[30]  S. McKee,et al.  What prior uniocular processing is necessary for stereopsis? , 1979, Investigative ophthalmology & visual science.

[31]  J. Todd,et al.  The perception of surface curvature from optical motion , 1998, Perception & psychophysics.

[32]  K Nakayama,et al.  Experiencing and perceiving visual surfaces. , 1992, Science.

[33]  J T Todd,et al.  Visual discrimination of local surface depth and orientation , 1995, Perception & psychophysics.

[34]  J. Koenderink,et al.  Photometric Invariants Related to Solid Shape , 1980 .

[35]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[36]  M. Kane.  Measurement theory. , 1980, NLN publications.

[37]  T. Papathomas.  Early vision and beyond , 1995 .

[38]  J Turner,et al.  Detection of surfaces in structure from motion. , 1995, Journal of experimental psychology. Human perception and performance.

[39]  P. R. Snoeren,et al.  EXTRACTION OF THREE-DIMENSIONAL SHAPE FROM OPTIC FLOW : A GEOMETRIC APPROACH , 1994 .

[40]  Jan J. Koenderink,et al.  Limits in perception , 1984 .

[41]  Gordon E. Legge,et al.  Stereopsis and contrast , 1989, Vision Research.

[42]  R. N. Berry.  Quantitative relations among vernier, real depth, and stereoscopic depth acuities. , 1948, Journal of experimental psychology.

[43]  Christopher W. Tyler,et al.  Binocular cross-correlation in time and space , 1978, Vision Research.

[44]  D. Regan,et al.  Necessary conditions for the perception of motion in depth. , 1986, Investigative ophthalmology & visual science.

[45]  J. Koenderink,et al.  The Shape of Smooth Objects and the Way Contours End , 1982, Perception.

[46]  Richard Hunter,et al.  A Source Book in the History of Psychology , 1967, Medical History.

[47]  G. Brindley.  The physiology of the retina and visual pathways , 1962 .

[48]  Jan J. Koenderink,et al.  Surface range and attitude probing in stereoscopically presented dynamic scenes , 1996 .

[49]  J. Lappin,et al.  The detection of coherence in moving random-dot patterns , 1976, Vision Research.

[50]  G Westheimer,et al.  Spatial frequency and light-spread descriptions of visual acuity and hyperacuity. , 1977, Journal of the Optical Society of America.

[51]  J T Todd,et al.  Stereoscopic Discrimination of Interval and Ordinal Depth Relations on Smooth Surfaces and in Empty Space , 1998, Perception.

[52]  J. M. Foley.  Binocular distance perception. , 1980, Psychological review.

[53]  J T Todd,et al.  Surface range and attitude probing in stereoscopically presented dynamic scenes. , 1996, Journal of experimental psychology. Human perception and performance.

[54]  Joseph S. Lappin,et al.  Definition and detection of binocular disparity , 1997, Vision Research.

[55]  David J. Fleet,et al.  Neural encoding of binocular disparity: Energy models, position shifts and phase shifts , 1996, Vision Research.

[56]  Andrea J. van Doorn,et al.  Illuminance texture due to surface mesostructure , 1996 .

[58]  Takeo Kanade,et al.  A sequential factorization method for recovering shape and motion from image streams , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[59]  H. Wallach,et al.  The kinetic depth effect. , 1953, Journal of experimental psychology.

[60]  J. Gibson.  The Senses Considered As Perceptual Systems , 1967 .

[61]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[62]  J F Norman,et al.  The detection of surface curvatures defined by optical motion , 1992, Perception & psychophysics.

[63]  J. Koenderink.  Optic flow , 1986, Vision Research.

[64]  Jan J. Koenderink,et al.  An internal representation for solid shape based on the topological properties of the apparent contour , 1987 .

[65]  Jan J. Koenderink,et al.  Local structure of movement parallax of the plane , 1976 .

[66]  B. Rogers,et al.  Disparity curvature and the perception of three-dimensional surfaces , 1989, Nature.

[67]  Jürgen Müller,et al.  Invariant properties of the atmospheric aerosol , 1986 .

[68]  Karen K. De Valois,et al.  Discrimination of relative spatial position , 1990, Vision Research.

[69]  R. W. Rodieck.  The First Steps in Seeing , 1998 .

[70]  B. Rogers,et al.  Anisotropies in the perception of three-dimensional surfaces. , 1983, Science.

[71]  J. Todd,et al.  Effects of Texture, Illumination, and Surface Reflectance on Stereoscopic Shape Perception , 1996, Perception.

[72]  W. Geisler.  Sequential ideal-observer analysis of visual discriminations. , 1989 .

[73]  H. Wilson.  Spatiotemporal characterization of a transient mechanism in the human visual system , 1980, Vision Research.

[74]  H Collewijn,et al.  Binocular eye movements and the perception of depth. , 1990, Reviews of oculomotor research.

[75]  K. Nakayama,et al.  Toward a general theory of stereopsis: binocular matching, occluding contours, and fusion. , 1994, Psychological review.

[76]  A. Readhead.  Radio astronomy by very-long baseline interferometry. , 1982 .

[77]  A Johnston,et al.  Shape from Shading. II. Geodesic Bisection and Alignment , 1994, Perception.

[78]  R. Hetherington.  The Perception of the Visual World , 1952 .

[79]  Jaap Van Brakel,et al.  Foundations of measurement , 1983 .

[80]  E. Reed.  The Ecological Approach to Visual Perception , 1989 .

[81]  Joseph S. Lappin,et al.  Spatial primitives for seeing three-dimensional shape from motion , 1995 .

[82]  Jan J. Koenderink,et al.  Solid shape , 1990 .

[83]  S. Klein,et al.  Hyperacuity thresholds of 1 sec: theoretical predictions and empirical validation. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[84]  S. McKee,et al.  Steroscopic acuity for moving retinal images. , 1978, Journal of the Optical Society of America.

[85]  H. Smallman,et al.  Size-disparity correlation in stereopsis at contrast threshold. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[86]  Eileen Kowler.  Eye movements and their role in visual and cognitive processes. , 1990, Reviews of oculomotor research.

[87]  Norbert Wiener,et al.  The human use of human beings - cybernetics and society , 1988 .