The pursuit theory of motion parallax

Although motion parallax is closely associated with observer head movement, the underlying neural mechanism appears to rely on a pursuit-like eye movement signal to disambiguate perceived depth sign from the ambiguous retinal motion information [Naji, J. J., & Freeman, T. C. A. (2004). Perceiving depth order during pursuit eye movement. Vision Research, 44, 3025-3034; Nawrot, M. (2003). Eye movements provide the extra-retinal signal required for the perception of depth from motion parallax. Vision Research, 43, 1553-1562]. Here, we outline the evidence for a pursuit signal in motion parallax and propose a simple neural network model for how the pursuit theory of motion parallax might function within the visual system. The first experiment demonstrates the crucial role that an extra-retinal pursuit signal plays in the unambiguous perception of depth from motion parallax. The second experiment demonstrates that identical head movements can generate opposite depth percepts, and even ambiguous percepts, when the pursuit signal is altered. The pursuit theory of motion parallax provides a parsimonious explanation for all of these observations.

[1]  Masao Ohmi,et al.  The Effect of Central and Peripheral Field Stimulation on the Rise Time and Gain of Human Optokinetic Nystagmus , 2005, Perception.

[2]  M Nawrot,et al.  A neural network model of kinetic depth , 1991, Visual Neuroscience.

[3]  M. Braunstein,et al.  The observer-relative velocity field as the basis for effective motion parallax. , 1988, Journal of experimental psychology. Human perception and performance.

[4]  G. B. Wetherill,et al.  SEQUENTIAL ESTIMATION OF POINTS ON A PSYCHOMETRIC FUNCTION. , 1965, The British journal of mathematical and statistical psychology.

[5]  Hiroshi Ono,et al.  Depth and Motion in Historical Descriptions of Motion Parallax , 2005, Perception.

[6]  Mark Nawrot,et al.  Depth from motion parallax scales with eye movement gain. , 2003, Journal of vision.

[7]  Hiroyasu Ujike,et al.  Depth thresholds of motion parallax as a function of head movement velocity , 2001, Vision Research.

[8]  Hiroyasu Ujike,et al.  Motion Parallax Driven by Head Movements: Conditions for Visual Stability, Perceived Depth, and Perceived Concomitant Motion , 2005, Perception.

[9]  F A Miles,et al.  Ocular Compensation for Self‐Motion. Visual Mechanisms , 1992, Annals of the New York Academy of Sciences.

[10]  H. Komatsu,et al.  Relation of cortical areas MT and MST to pursuit eye movements. III. Interaction with full-field visual stimulation. , 1988, Journal of neurophysiology.

[11]  F. A. Miles,et al.  Short-latency ocular following responses of monkey. I. Dependence on temporospatial properties of visual input. , 1986, Journal of neurophysiology.

[12]  Charles Wheatstone,et al.  I. The Bakerian Lecture.— Contributions to the physiology of vision.— Part the second. On some remarkable, and hitherto unobserved, phenomena of binocular vision (continued) , 1852, Philosophical Transactions of the Royal Society of London.

[13]  J. Demer,et al.  Optokinetic asynunetry in esotropia. , 1988, Journal of pediatric ophthalmology and strabismus.

[14]  Chad Stockert,et al.  Elevated motion parallax thresholds are related to eye movement anomalies in strabismus , 2004 .

[15]  Mark Nawrot,et al.  Extra-retinal signals in motion parallax: Support from eye movement asymmetries in strabismus , 2005 .

[16]  Charles Wheatstone,et al.  Contributions to the Physiology of Vision. , 1837 .

[17]  Jenny J. Naji,et al.  Perceiving depth order during pursuit eye movement , 2004, Vision Research.

[18]  R. Andersen,et al.  Integration of motion and stereopsis in middle temporal cortical area of macaques , 1995, Nature.

[19]  F A Miles,et al.  The neural processing of 3‐D visual information: evidence from eye movements , 1998, The European journal of neuroscience.

[20]  S. Shimojo,et al.  Surface Discontinuity is Critical in a Moving Observer's Perception of Objects’ Depth Order and Relative Motion from Retinal Image Motion , 1998, Perception.

[21]  H. Ono,et al.  Apparent Depth with Motion Aftereffect and Head Movement , 1994, Perception.

[22]  W C Gogel,et al.  Eye Fixation and Attention as Modifiers of Perceived Distance , 1977, Perceptual and motor skills.

[23]  B Rogers,et al.  Motion Parallax as an Independent Cue for Depth Perception , 1979, Perception.

[24]  F. Plum Handbook of Physiology. , 1960 .

[25]  H. Komatsu,et al.  Relation of cortical areas MT and MST to pursuit eye movements. I. Localization and visual properties of neurons. , 1988, Journal of neurophysiology.

[26]  W A Hershberger,et al.  Motion-parallax cues in one-dimensional polar and parallel projections: differential velocity and acceleration/displacement change. , 1974, Journal of experimental psychology.

[27]  Jane H Sumnall,et al.  Optokinetic potential and the perception of head-centred speed , 2003, Vision Research.

[28]  C. Busettini,et al.  Human ocular responses to translation of the observer and of the scene: dependence on viewing distance , 2004, Experimental Brain Research.

[29]  Masao Ohmi,et al.  The efficiency of the central and peripheral retina in driving human optokinetic nystagmus , 1984, Vision Research.

[30]  H. Komatsu,et al.  Disparity sensitivity of neurons in monkey extrastriate area MST , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  Mark Nawrot,et al.  Eye movements provide the extra-retinal signal required for the perception of depth from motion parallax , 2003, Vision Research.

[32]  Mark Nawrot,et al.  Disruption of Eye Movements by Ethanol Intoxication Affects Perception of Depth From Motion Parallax , 2004, Psychological science.

[33]  T. Mergner,et al.  Combined action of smooth pursuit eye movements, optokinetic reflex and vestibulo-ocular reflex in macaque monkey during transient stimulation , 2003, Neuroscience Letters.

[34]  Mark Nawrot,et al.  Abnormal depth perception from motion parallax in amblyopic observers , 1999, Vision Research.

[35]  R. Andersen,et al.  Encoding of three-dimensional structure-from-motion by primate area MT neurons , 1998, Nature.

[36]  J. Gibson,et al.  Motion parallax as a determinant of perceived depth. , 1959, Journal of experimental psychology.

[37]  R. Krauzlis Recasting the smooth pursuit eye movement system. , 2004, Journal of neurophysiology.

[38]  J. Farber,et al.  Optical motions as information for unsigned depth. , 1979, Journal of experimental psychology. Human perception and performance.

[39]  J. Outerbridge,et al.  Optokinetic nystagmus during selective retinal stimulation , 1975, Experimental Brain Research.

[40]  Kenji Kawano,et al.  Ocular tracking: behavior and neurophysiology , 1999, Current Opinion in Neurobiology.

[41]  Dora E Angelaki,et al.  Eyes on target: what neurons must do for the vestibuloocular reflex during linear motion. , 2004, Journal of neurophysiology.

[42]  M Eizenman,et al.  Cortical binocularity and monocular optokinetic asymmetry in early-onset esotropia. , 1998, Investigative ophthalmology & visual science.

[43]  U D Upadhyay,et al.  MST responses to pursuit across optic flow with motion parallax. , 2000, Journal of neurophysiology.

[44]  H. Ono,et al.  Monocular stereopsis with and without head movement. , 1990, Perception & psychophysics.

[45]  B J Rogers,et al.  Visual and nonvisual information disambiguate surfaces specified by motion parallax , 1992, Perception & psychophysics.

[46]  L. Wilkins Handbook of Physiology , 1960, Neurology.

[47]  E. J. Morris,et al.  Different responses to small visual errors during initiation and maintenance of smooth-pursuit eye movements in monkeys. , 1987, Journal of neurophysiology.

[48]  W. Epstein,et al.  EXAMINATION OF GIBSON'S PSYCHOPHYSICAL HYPOTHESIS. , 1964, Psychological bulletin.

[49]  M. Braunstein,et al.  Velocity gradients and relative depth perception , 1981, Perception & psychophysics.

[50]  F. A. Miles,et al.  Visual Motion and Its Role in the Stabilization of Gaze , 1992 .

[51]  C. Wheatstone XVIII. Contributions to the physiology of vision. —Part the first. On some remarkable, and hitherto unobserved, phenomena of binocular vision , 1962, Philosophical Transactions of the Royal Society of London.

[52]  N. Wade A natural history of vision , 1998 .

[53]  H. Leibowitz,et al.  A revised analysis of the role of efference in motion perception. , 1985, Perception.

[54]  Charles Wheatstone On some remarkable and hitherto unobserved phenomena of binocular vision. , 1962 .

[55]  Miles Fa,et al.  The sensing of rotational and translational optic flow by the primate optokinetic system. , 1993 .

[56]  R. Hetherington The Perception of the Visual World , 1952 .

[57]  H. Komatsu,et al.  Relation of cortical areas MT and MST to pursuit eye movements. II. Differentiation of retinal from extraretinal inputs. , 1988, Journal of neurophysiology.