The analysis of stereopsis.

Our eyes capture different 2-D images of the objects around us and our brain uses these images to recover a description of the 3-D structure of the environ­ ment. Stereopsis is the process responsible for this reconstruction of the depth dimension in our visual world. Since Wheatstone invented the stereoscope in 1 838, the processes underlying primate stereo vision have been intensively studied, first with psychophysical techniques, and more recently in terms of the underlying physiological mechanisms in the visual cortex. During the last few years, the computational aspects of the problem of stereo vision have received increased attention. As with so many other visual tasks that humans perform easily and effortlessly, the development of automatic systems of stereoscopic vision, which would yield immediate and important applications, has proven surprisingly difficult. It is now clear that the problem of stereopsis is not only a problem in the area of psychophysics and physiology, but also a complex problem in information processing. Because of its knowledge-free, low-level character, the solution of the stereopsis problem may thus uncover some fundamental principles that apply equally well to artificial and natural vision systems. This somewhat new perspective is reflected in the organization of this paper. We first review the computational problems posed by stereopsis and describe briefly the main theories and models that have been proposed in the context of human and computer vision. The structure of these algorithms and their

[1]  L. Riggs,et al.  Eye Movements Recorded During Convergence and Divergence , 1960 .

[2]  B. Julesz Binocular depth perception of computer-generated patterns , 1960 .

[3]  G WESTHEIMER,et al.  Independence of conjugate and disjunctive eye movements , 1961, The Journal of physiology.

[4]  G. Westheimer,et al.  Disjunctive eye movements , 1961, The Journal of physiology.

[5]  D. Mitchell Retinal disparity and diplopia. , 1966, Vision research.

[6]  B Julesz,et al.  Stereopsis Based on Vernier Acuity Cues Alone , 1967, Science.

[7]  C. Blakemore,et al.  The neural mechanism of binocular depth discrimination , 1967, The Journal of physiology.

[8]  B. Julesz,et al.  Extension of Panum's fusional area in binocularly stabilized vision. , 1967, Journal of the Optical Society of America.

[9]  G Westheimer,et al.  The sensory stimulus for disjunctive eye movements. , 1969, Vision research.

[10]  D. Fender,et al.  The interplay of drifts and flicks in binocular fixation. , 1969, Vision research.

[11]  E. W. Bough Stereoscopic Vision in the Macaque Monkey: a Behavioural Demonstration , 1970, Nature.

[12]  G. Sperling Binocular Vision: A Physical and a Neural Theory , 1970 .

[13]  D. Hubel,et al.  Stereoscopic Vision in Macaque Monkey: Cells sensitive to Binocular Depth in Area 18 of the Macaque Monkey Cortex , 1970, Nature.

[14]  W. Richards,et al.  Anomalous stereoscopic depth perception. , 1971, Journal of the Optical Society of America.

[15]  B. Julesz Foundations of Cyclopean Perception , 1971 .

[16]  P. O. Bishop,et al.  Binocular interaction fields of single units in the cat striate cortex , 1971, The Journal of physiology.

[17]  P. O. Bishop,et al.  Spatial vision. , 1971, Annual review of psychology.

[18]  R. A. Smith,et al.  Disparity processing of spatial frequencies in man , 1972, The Journal of physiology.

[19]  J. Pokorny Foundations of Cyclopean Perception , 1972 .

[20]  R Jones,et al.  Vergence eye movements to pairs of disparity stimuli with shape selection cues. , 1972, Vision research.

[21]  C. Tyler Stereoscopic Vision: Cortical Limitations and a Disparity Scaling Effect , 1973, Science.

[22]  J Ross,et al.  Short-term memory in stereopsis. , 1974, Vision research.

[23]  C. WILLIAM TYLER,et al.  Depth perception in disparity gratings , 1974, Nature.

[24]  MICHAEL MORGAN,et al.  Stereoillusion based on visual persistence , 1975, Nature.

[25]  W. Uttal,et al.  Parameters of tachistoscopic stereopsis , 1975, Vision Research.

[26]  J I Nelson,et al.  Globality and stereoscopic fusion in binocular vision. , 1975, Journal of theoretical biology.

[27]  B. Julesz,et al.  Independent Spatial-Frequency-Tuned Channels in Binocular Fusion and Rivalry , 1975 .

[28]  R. F. Sarmiento The stereoacuity of macaque monkey , 1975, Vision Research.

[29]  C. Tyler Spatial organization of binocular disparity sensitivity , 1975, Vision Research.

[30]  Parvati Dev,et al.  Perception of Depth Surfaces in Random-Dot Stereograms: A Neural Model , 1975, Int. J. Man Mach. Stud..

[31]  D. Whitteridge,et al.  Binocular visual mechanisms in cortical areas I and II of the sheep. , 1976, The Journal of physiology.

[32]  P. Schiller,et al.  Quantitative studies of single-cell properties in monkey striate cortex. II. Orientation specificity and ocular dominance. , 1976, Journal of neurophysiology.

[33]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[34]  D Marr,et al.  Early processing of visual information. , 1976, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[35]  M. Morgan Pulfrich Effect and the Filling in of Apparent Motion , 1976, Perception.

[36]  J. Pettigrew,et al.  Neurons selective for orientation and binocular disparity in the visual Wulst of the barn owl (Tyto alba). , 1976, Science.

[37]  Stereomovement from Interocular Delay in Dynamic Visual Noise: A Random Spatial Disparity Hypothesis , 1977, American journal of optometry and physiological optics.

[38]  Tyler Cw Stereomovement from interocular delay in dynamic visual noise: a random spatial disparity hypothesis. , 1977 .

[39]  G. Poggio,et al.  Binocular interaction and depth sensitivity in striate and prestriate cortex of behaving rhesus monkey. , 1977, Journal of neurophysiology.

[40]  R S Harwerth,et al.  Viewing Time and Stereoscopic Threshold with Random‐Dot Stereograms , 1977, American journal of optometry and physiological optics.

[41]  J. Mayhew,et al.  Global Processes in Stereopsis: Some Comments on Ramachandran and Nelson (1976) , 1977, Perception.

[42]  J. Nelson,et al.  The plasticity of correspondence: after-effects, illusions and horopter shifts in depth perception. , 1977, Journal of theoretical biology.

[43]  Christopher W. Tyler,et al.  Spatial Limitations Of Human Stereoscopic Vision , 1977, Optics & Photonics.

[44]  B. Logan Information in the zero crossings of bandpass signals , 1977, The Bell System Technical Journal.

[45]  J. Mayhew,et al.  Stereopsis Masking in Humans is Not Orientationally Tuned , 1978, Perception.

[46]  J. J. KULIKOWSKI,et al.  Limit of single vision in stereopsis depends on contour sharpness , 1978, Nature.

[47]  G. Westheimer Vertical disparity detection: is there an induced size effect? , 1978, Investigative ophthalmology & visual science.

[48]  Bela Julesz,et al.  Global Stereopsis: Cooperative Phenomena in Stereoscopic Depth Perception , 1978 .

[49]  J. Mayhew,et al.  Contrast Summation Effects and Stereopsis , 1978, Perception.

[50]  S. McKee,et al.  Steroscopic acuity for moving retinal images. , 1978, Journal of the Optical Society of America.

[51]  J. Mayhew,et al.  Contrast Sensitivity Function for Stereopsis , 1978, Perception.

[52]  H. B. Barlow,et al.  Reconstructing the visual image in space and time , 1979, Nature.

[53]  R. Blake,et al.  Stereopsis by harmonic analysis , 1979, Vision Research.

[54]  O J Braddick,et al.  Binocular single vision and perceptual processing , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[55]  R. Schumer,et al.  Independent stereoscopic channels for different extents of spatial pooling , 1979, Vision Research.

[56]  D. Burr Acuity for apparent vernier offset , 1979, Vision Research.

[57]  J. E. W. MAYHEW,et al.  Texture contours can facilitate stereopsis by initiating vergence eye movements , 1979, Nature.

[58]  G F Poggio,et al.  Depth sensitivity of binocular cortical neurons of behaving monkeys , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[59]  D Marr,et al.  A computational theory of human stereo vision. , 1979, Proceedings of the Royal Society of London. Series B, Biological sciences.

[60]  David C. Burr,et al.  How does binocular delay give information about depth? , 1979, Vision Research.

[61]  J. Bergen,et al.  A four mechanism model for threshold spatial vision , 1979, Vision Research.

[62]  J. Mayhew,et al.  Convergent disparity discriminations in narrow-band-filtered random-dot stereograms , 1979, Vision Research.

[63]  S. Dumais,et al.  Stereopsis in human infants. , 1980, Science.

[64]  Donald Bernard Gennery,et al.  Modelling the environment of an exploring vehicle by means of stereo vision , 1980 .

[65]  J. Krol,et al.  The Double-Nail Illusion: Experiments on Binocular Vision with Nails, Needles, and Pins , 1980, Perception.

[66]  S P McKee,et al.  Stereogram design for testing local stereopsis. , 1980, Investigative ophthalmology & visual science.

[67]  Tomaso Poggio,et al.  Some Comments on a Recent Theory of Stereopsis , 1980 .

[68]  S. McKee,et al.  Stereoscopic acuity with defocused and spatially filtered retinal images , 1980 .

[69]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[70]  Hans P. Moravec Obstacle avoidance and navigation in the real world by a seeing robot rover , 1980 .

[71]  J P Frisby,et al.  The Computation of Binocular Edges , 1980, Perception.

[72]  J. M. Foley Binocular distance perception. , 1980, Psychological review.

[73]  D. Marr,et al.  An Information Processing Approach to Understanding the Visual Cortex , 1980 .

[74]  T. O. Binford,et al.  Geometric Constraints In Stereo Vision , 1980, Optics & Photonics.

[75]  B. Julesz,et al.  Modifications of the Classical Notion of Panum's Fusional Area , 1980, Perception.

[76]  B. Julesz,et al.  A disparity gradient limit for binocular fusion. , 1980, Science.

[77]  R. Held,et al.  Stereoacuity of human infants. , 1980, Proceedings of the National Academy of Sciences of the United States of America.

[78]  J. Mayhew,et al.  Vergence Eye Movements Made in Response to Spatial-Frequency-Filtered Random-Dot Stereograms , 1981, Perception.

[79]  Thomas O. Binford,et al.  Depth from Edge and Intensity Based Stereo , 1981, IJCAI.

[80]  G. Brink,et al.  Diplopia thresholds and the initiation of vergence eye-movements , 1981, Vision Research.

[81]  D. Teller The development of visual acuity in human and monkey infants , 1981, Trends in Neurosciences.

[82]  G. Poggio,et al.  Mechanisms of static and dynamic stereopsis in foveal cortex of the rhesus monkey , 1981, The Journal of physiology.

[83]  John E. W. Mayhew,et al.  Psychophysical and Computational Studies Towards a Theory of Human Stereopsis , 1981, Artif. Intell..

[84]  A. Duwaer Binocular single vision : psychophysical studies on underlying sensory and motor processes , 1981 .

[85]  Christopher W. Tyler,et al.  Spatio-temporal properties of Panum's fusional area , 1981, Vision Research.

[86]  B. Julesz,et al.  Early visual perception. , 1981, Annual review of psychology.

[87]  Eric L. W. Grimson,et al.  From Images to Surfaces: A Computational Study of the Human Early Visual System , 1981 .

[88]  G. Baumgartner,et al.  Development of stereopsis and cortical binocularity in human infants: electrophysiological evidence. , 1981, Science.

[89]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[90]  D. Ferster A comparison of binocular depth mechanisms in areas 17 and 18 of the cat visual cortex , 1981, The Journal of physiology.

[91]  J. E. W. Mayhew,et al.  A computational model of binocular depth perception , 1982, Nature.

[92]  R. Held,et al.  Stereoacuity development for crossed and uncrossed disparities in human infants , 1982, Vision Research.

[93]  G. van den Brink,et al.  Detection of vertical disparities , 1982, Vision Research.

[94]  H. K. Nishihara,et al.  Hidden cues in random-line stereograms , 1982, Nature.

[95]  Michael Kass,et al.  A Computational Framework for the Visual Correspondence Problem , 1983, IJCAI.

[96]  B. Gillam,et al.  The induced effect, vertical disparity, and stereoscopic theory , 1983, Perception & psychophysics.

[97]  Thomas S. Huang,et al.  Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.