Integration time for the perception of depth from motion parallax

The perception of depth from relative motion is believed to be a slow process that "builds-up" over a period of observation. However, in the case of motion parallax, the potential accuracy of the depth estimate suffers as the observer translates during the viewing period. Our recent quantitative model for the perception of depth from motion parallax proposes that relative object depth (d) can be determined from retinal image motion (dθ/dt), pursuit eye movement (dα/dt), and fixation distance (f) by the formula: d/f≈dθ/dα. Given the model's dynamics, it is important to know the integration time required by the visual system to recover dα and dθ, and then estimate d. Knowing the minimum integration time reveals the incumbent error in this process. A depth-phase discrimination task was used to determine the time necessary to perceive depth-sign from motion parallax. Observers remained stationary and viewed a briefly translating random-dot motion parallax stimulus. Stimulus duration varied between trials. Fixation on the translating stimulus was monitored and enforced with an eye-tracker. The study found that relative depth discrimination can be performed with presentations as brief as 16.6 ms, with only two stimulus frames providing both retinal image motion and the stimulus window motion for pursuit (mean range=16.6-33.2 ms). This was found for conditions in which, prior to stimulus presentation, the eye was engaged in ongoing pursuit or the eye was stationary. A large high-contrast masking stimulus disrupted depth-discrimination for stimulus presentations less than 70-75 ms in both pursuit and stationary conditions. This interval might be linked to ocular-following response eye-movement latencies. We conclude that neural mechanisms serving depth from motion parallax generate a depth estimate much more quickly than previously believed. We propose that additional sluggishness might be due to the visual system's attempt to determine the maximum dθ/dα ratio for a selection of points on a complicated stimulus.

[1]  Gregory C. DeAngelis,et al.  A neural representation of depth from motion parallax in macaque visual cortex , 2008, Nature.

[2]  Ellen C. Hildreth,et al.  The perceptual buildup of three-dimensional structure from motion , 1989, Perception & psychophysics.

[3]  Yiannis Aloimonos,et al.  On the Geometry of Visual Correspondence , 1997, International Journal of Computer Vision.

[4]  D A Gordon,et al.  Static and dynamic visul fields in human space perception. , 1965, Journal of the Optical Society of America.

[5]  Jenny J. Naji,et al.  Perceiving depth order during pursuit eye movement , 2004, Vision Research.

[6]  T.C.A. Freeman,et al.  Unequal retinal and extra-retinal motion signals produce different perceived slants of moving surfaces , 2000, Vision Research.

[7]  J. Aloimonos,et al.  On the kinetic depth effect , 1989, Biological Cybernetics.

[8]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[9]  Gin McCollum,et al.  Motion parallax contribution to perception of self-motion and depth , 2008, Biological Cybernetics.

[10]  W F Bischof,et al.  Motion and metacontrast with simultaneous onset of stimuli. , 1995, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  D. Eby.  The spatial and temporal characteristics of perceiving 3-D structure from motion , 1992, Perception & psychophysics.

[12]  R. Krauzlis.  The Control of Voluntary Eye Movements: New Perspectives , 2005, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[13]  Lindsey Joyce,et al.  The pursuit theory of motion parallax , 2006, Vision Research.

[14]  R. Andersen,et al.  A Computational Framework for Determining Stereo Correspondence from a Set of Linear Spatial Filters Perception of Three-dimensional Structure from Motion Review , 2022 .

[15]  Eileen Kowler.  Eye movements: The past 25years , 2011, Vision Research.

[16]  L. Colgin,et al.  Society for Neuroscience , 2005, Nature.

[17]  K. Nakayama,et al.  Optical Velocity Patterns, Velocity-Sensitive Neurons, and Space Perception: A Hypothesis , 1974, Perception.

[18]  J. Perrone,et al.  A model of self-motion estimation within primate extrastriate visual cortex , 1994, Vision Research.

[19]  G R Barnes,et al.  Evidence for a link between the extra-retinal component of random-onset pursuit and the anticipatory pursuit of predictable object motion. , 2008, Journal of neurophysiology.

[20]  G. R. Barnes,et al.  The remembered pursuit task: evidence for segregation of timing and velocity storage in predictive oculomotor control , 1999, Experimental Brain Research.

[21]  F. Bremmer,et al.  Perception of self-motion from visual flow , 1999, Trends in Cognitive Sciences.

[22]  C Caudek,et al.  Perceiving surface slant from deformation of optic flow. , 1999, Journal of experimental psychology. Human perception and performance.

[23]  Mark Nawrot,et al.  MT Neurons Combine Visual Motion with a Smooth Eye Movement Signal to Code Depth-Sign from Motion Parallax , 2009, Neuron.

[24]  M. Goldberg,et al.  Neuronal Activity in the Lateral Intraparietal Area and Spatial Attention , 2003, Science.

[25]  F A Miles,et al.  Effects of stationary textured backgrounds on the initiation of pursuit eye movements in monkeys. , 1992, Journal of neurophysiology.

[26]  Richard J. Krauzlis,et al.  Spatial allocation of attention during smooth pursuit eye movements , 2009, Vision Research.

[27]  S. Lisberger,et al.  Attention and target selection for smooth pursuit eye movements , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[28]  G. B. Wetherill,et al.  SEQUENTIAL ESTIMATION OF POINTS ON A PSYCHOMETRIC FUNCTION. , 1965, The British journal of mathematical and statistical psychology.

[29]  S G Lisberger,et al.  Neuronal responses in visual areas MT and MST during smooth pursuit target selection. , 1997, Journal of neurophysiology.

[30]  Mark Nawrot,et al.  The motion/pursuit law for visual depth perception from motion parallax , 2009, Vision Research.

[31]  Mark Nawrot,et al.  Visual depth from motion parallax and eye pursuit , 2011, Journal of Mathematical Biology.

[32]  R. Krauzlis.  Recasting the smooth pursuit eye movement system. , 2004, Journal of neurophysiology.

[33]  Chad Stockert,et al.  Motion parallax in movies: Background motion, eye movement signals, and depth , 2010 .

[34]  Iain D Gilchrist,et al.  Oculomotor capture by transient events: a comparison of abrupt onsets, offsets, motion, and flicker. , 2008, Journal of vision.

[35]  Hiroyasu Ujike,et al.  Motion Parallax Driven by Head Movements: Conditions for Visual Stability, Perceived Depth, and Perceived Concomitant Motion , 2005, Perception.

[36]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[37]  D. E. Irwin,et al.  Our Eyes do Not Always Go Where we Want Them to Go: Capture of the Eyes by New Objects , 1998 .

[38]  Mark Nawrot,et al.  Eye movements provide the extra-retinal signal required for the perception of depth from motion parallax , 2003, Vision Research.

[39]  Mark Nawrot,et al.  In Pursuit of Perspective: Does Vertical Perspective Disambiguate Depth from Motion Parallax? , 2013, Perception.

[40]  J. Koenderink,et al.  Facts on optic flow , 1987, Biological Cybernetics.

[41]  F A Miles,et al.  The neural processing of 3‐D visual information: evidence from eye movements , 1998, The European journal of neuroscience.

[42]  E. L. Keller,et al.  Smooth-pursuit initiation in the presence of a textured background in monkey , 1986, Vision Research.

[43]  Stefan Treue,et al.  Human perception of structure from motion , 1991, Vision Research.

[44]  Elizabeth Nawrot,et al.  The role of eye movements in depth from motion parallax during infancy. , 2013, Journal of vision.

[45]  Arnulf Remole,et al.  VISUAL MASKING: AN INTEGRATIVE APPROACH , 1985 .

[46]  Andrea J. van Doorn,et al.  Invariant Properties of the Motion Parallax Field due to the Movement of Rigid Bodies Relative to an Observer , 1975 .