Toward a general theory of stereopsis: binocular matching, occluding contours, and fusion.

Models of stereopsis have focused on developing strategies for identifying common features in the 2 half-images so that disparity may be computed. This emphasis ignores the unpairable features that arise at occluding contours (half-occlusions). Most models treat half-occlusions as noise or outliers that are interpreted after disparity processing is completed. A series of experiments reveal that occlusion relationships are sensed during the earliest stages of binocular processing. The authors hypothesize the existence of receptive field structures that sense the local structure of stereoscopic occlusion relationships to account for these findings. Finally, a simple theoretical framework is presented in which fusion, stereopsis, and occlusion are unified. This theory explains the co-occurrence of stereopsis and diplopia and how half-occlusions escape the suppression characteristic of binocular rivalry.

[1]  C. Wheatstone XVIII. Contributions to the physiology of vision. —Part the first. On some remarkable, and hitherto unobserved, phenomena of binocular vision , 1962, Philosophical Transactions of the Royal Society of London.

[2]  D. Brewster XXIV.—On the Law of Visible Position in Single and Binocular Vision, and on the representation of Solid Figures by the union of dissimilar Plane Pictures on the Retina , 1844, Transactions of the Royal Society of Edinburgh.

[3]  J. Balfour Transactions of the Royal Society of Edinburgh , 1870, Nature.

[4]  B. Julesz Binocular depth perception of computer-generated patterns , 1960 .

[5]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[6]  George S. Harker,et al.  Some observations and measurements of the Panum phenomenon , 1967 .

[7]  R. Lawson,et al.  Stereopsis and anomalous contour. , 1967, Vision research.

[8]  B. Julesz,et al.  Extension of Panum's fusional area in binocularly stabilized vision. , 1967, Journal of the Optical Society of America.

[9]  G. Sperling Binocular Vision: A Physical and a Neural Theory , 1970 .

[10]  W. Richards,et al.  Anomalous stereoscopic depth perception. , 1971, Journal of the Optical Society of America.

[11]  B. Julesz Foundations of Cyclopean Perception , 1971 .

[12]  J I Nelson,et al.  Globality and stereoscopic fusion in binocular vision. , 1975, Journal of theoretical biology.

[13]  Parvati Dev,et al.  Perception of Depth Surfaces in Random-Dot Stereograms: A Neural Model , 1975, Int. J. Man Mach. Stud..

[14]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[15]  G. Poggio,et al.  Binocular interaction and depth sensitivity in striate and prestriate cortex of behaving rhesus monkey. , 1977, Journal of neurophysiology.

[16]  J. J. KULIKOWSKI,et al.  Limit of single vision in stereopsis depends on contour sharpness , 1978, Nature.

[17]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[18]  Ilya Prigogine,et al.  From Being To Becoming , 1980 .

[19]  J. Mayhew,et al.  Vergence Eye Movements Made in Response to Spatial-Frequency-Filtered Random-Dot Stereograms , 1981, Perception.

[20]  B Julesz,et al.  Eye movements and neural remapping during fusion of misaligned random-dot stereograms. , 1983, Journal of the Optical Society of America.

[21]  C. Schor,et al.  Disparity range for local stereopsis as a function of luminance spatial frequency , 1983, Vision Research.

[22]  T. Poggio,et al.  The analysis of stereopsis. , 1984, Annual review of neuroscience.

[23]  H. K. Nishihara,et al.  Practical Real-Time Imaging Stereo Matcher , 1984 .

[24]  S. Grossberg,et al.  Neural dynamics of form perception: boundary completion, illusory figures, and neon color spreading. , 1985 .

[25]  J P Frisby,et al.  PMF: A Stereo Correspondence Algorithm Using a Disparity Gradient Limit , 1985, Perception.

[26]  H. Ono,et al.  Resolving discrepant results of the Wheatstone Experiment , 1985, Psychological research.

[27]  Ennio Mingolla,et al.  Neural dynamics of perceptual grouping: Textures, boundaries, and emergent segmentations , 1985 .

[28]  P. Cavanagh,et al.  Subjective contours capture stereopsis , 1985, Nature.

[29]  David R. Badcock,et al.  A comparison of stereo and vernier acuity within spatial channels as a function of distance from fixation , 1985, Vision Research.

[30]  A. Gruen ADAPTIVE LEAST SQUARES CORRELATION: A POWERFUL IMAGE MATCHING TECHNIQUE , 1985 .

[31]  R. Watt,et al.  A theory of the primitive spatial code in human vision , 1985, Vision Research.

[32]  Thomas P. Piantanida,et al.  Stereo hysteresis revisited , 1986, Vision Research.

[33]  G Westheimer,et al.  Panum’s phenomenon and the confluence of signals from the two eyes in stereoscopy , 1986, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[34]  D H Fender,et al.  Hysteresis in human binocular fusion: temporalward and nasalward ranges. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[35]  S Grossberg,et al.  Cortical dynamics of three-dimensional form, color, and brightness perception: II. Binocular theory , 1988, Perception & psychophysics.

[36]  H H Bülthoff,et al.  Integration of depth modules: stereo and shading. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[37]  B Gillam,et al.  The Role of Monocular Regions in Stereoscopic Displays , 1988, Perception.

[38]  Casper J. Erkelens,et al.  Fusional limits for a large random-dot stereogram , 1988, Vision Research.

[39]  S. Levay,et al.  Ocular dominance and disparity coding in cat visual cortex , 1988, Visual Neuroscience.

[40]  R Blake,et al.  Mislocalization of diplopic images. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[41]  R. Blake,et al.  How Contrast Affects Stereoacuity , 1988, Perception.

[42]  L. Spillmann,et al.  Visual Perception: The Neurophysiological Foundations , 1989 .

[43]  R. Blake A Neural Theory of Binocular Rivalry , 1989 .

[44]  K Nakayama,et al.  Stereoscopic Depth: Its Relation to Image Segmentation, Grouping, and the Recognition of Occluded Objects , 1989, Perception.

[45]  Gordon E. Legge,et al.  Stereopsis and contrast , 1989, Vision Research.

[46]  Shinsuke Shimojo,et al.  Da vinci stereopsis: Depth and subjective occluding contours from unpaired image points , 1990, Vision Research.

[47]  S. McKee,et al.  The imprecision of stereopsis , 1990, Vision Research.

[48]  J. Frisby,et al.  12 – THE PERCEPTION OF STEREODEPTH AND STEREOMOTION: Cortical Mechanisms , 1990 .

[49]  K. Nakayama,et al.  Real world occlusion constraints and binocular rivalry , 1990, Vision Research.

[50]  H. Wilson,et al.  Coarse spatial scales constrain the range of binocular fusion on fine scales. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[51]  Lawrence K. Cormack,et al.  Depth attraction and repulsion in random dot stereograms , 1991, Vision Research.

[52]  Heinrich H. Bülthoff,et al.  Stereo Integration, Mean Field Theory and Psychophysics , 1991 .

[53]  R. Blake,et al.  Spatial frequency tuning of human stereopsis , 1991, Vision Research.

[54]  Jitendra Malik,et al.  Determining Three-Dimensional Shape from Orientation and Spatial Frequency Disparities , 1991, ECCV.

[55]  David Mumford,et al.  A Bayesian treatment of the stereo correspondence problem using half-occluded regions , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[56]  H. Ono,et al.  Occlusion as a depth cue in the Wheatstone-Panum limiting case , 1992, Perception & psychophysics.

[57]  B L Anderson,et al.  Hysteresis, cooperativity, and depth averaging in dynamic random-dot stereograms , 1992, Perception & psychophysics.

[58]  Jitendra Malik,et al.  Computational framework for determining stereo correspondence from a set of linear spatial filters , 1992, Image Vis. Comput..

[59]  L K Cormack,et al.  Disparity-tuned channels of the human visual system , 1993, Visual Neuroscience.

[60]  Barton L. Anderson,et al.  The role of partial occlusion in stereopsis , 1994, Nature.

[61]  Takeo Kanade,et al.  A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment , 1994, IEEE Trans. Pattern Anal. Mach. Intell..