Influence of eye position on stereo matching

In animals with binocular depth vision, or stereopsis, the visual fields of the two eyes overlap, shrinking the overall field of view. Eye movements increase the field of view, but they also complicate the first stage of stereopsis: the search for corresponding images on the two retinas. If the eyes were stationary in the head, corresponding images would always lie on retina-fixed bands called epipolar lines. Because the eyes rotate, the epipolar lines move on the retinas. Therefore, the stereoptic system has a choice: it may monitor eye position to keep track of the epipolar lines, or it may give up on tracking epipolar lines and instead search for matches over retina-fixed regions, but in that case the search regions must be 2-D patches, large enough to encompass all possible locations of the epipolar lines in all usual eye positions. We use a new type of random-dot stereogram to show that human stereopsis uses large, retina-fixed search zones. We show that the brain somewhat reduces the size of these search zones by rotating the eyes about their lines of sight in a way that reduces the motion of the epipolar lines. These findings show the link between sensory and motor processes: by considering eye motion we can understand why the brain searches for matching images over 2-D retinal regions rather than along epipolar lines; and by considering retinal correspondence we appreciate why the eyes rotate as they do about their lines of sight.

[1]  D. Zee,et al.  Rotation of Listing's plane with convergence: independence from eye position. , 2000, Investigative ophthalmology & visual science.

[2]  D. Whitteridge.  Movements of the eyes R. H. S. Carpenter, Pion Ltd, London (1977), 420 pp., $27.00 , 1979, Neuroscience.

[3]  F. A. Miles.  Binocular Vision and Stereopsis by Ian P. Howard and Brian J. Rogers, Oxford University Press, 1995. £90.00 (736 pages) ISBN 0 19 508476 4. , 1996, Trends in Neurosciences.

[4]  T. Vilis,et al.  Rotation of Listing's plane during vergence , 1992, Vision Research.

[5]  J P Frisby,et al.  PMF: A Stereo Correspondence Algorithm Using a Disparity Gradient Limit , 1985, Perception.

[6]  A. V. van den Berg,et al.  Binocular eye orientation during fixations: Listing's law extended to include eye vergence. , 1993, Vision research.

[7]  J. E. W. Mayhew,et al.  A computational model of binocular depth perception , 1982, Nature.

[8]  K. Hepp,et al.  Theoretical explanations of Listing's law and their implication for binocular vision , 1995, Vision Research.

[9]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[10]  Z. Kapoula,et al.  Listing’s plane rotation with convergence: role of disparity, accommodation, and depth perception , 1999, Experimental Brain Research.

[11]  J. Douglas Crawford,et al.  The motor side of depth vision , 2001, Nature.

[12]  H. Wilson,et al.  Neural models of stereoscopic vision , 1991, Trends in Neurosciences.

[13]  A. V. D. Berg,et al.  Binocular eye orientation during fixations: Listing's law extended to include eye vergence , 1993, Vision Research.

[14]  Douglas Tweed,et al.  PII: S0042-6989(97)00002-3 , 2003 .