A neurally plausible model of the dynamics of motion integration in smooth eye pursuit based on recursive Bayesian estimation

In this study, we describe a model of motion integration in smooth eye pursuit based on a recursive Bayesian estimation process, which displays a dynamic behaviour qualitatively similar to the dynamics of the motion integration process observed experimentally, both psychophysically in humans and monkeys, and physiologically in monkeys. By formulating the model as an approximate version of a Kalman filter algorithm, we have been able to show that it can be put into a neurally plausible, distributed recurrent form which coarsely corresponds to the recurrent circuitry of visual cortical areas V1 and MT. The model thus provides further support for the notion that the motion integration process is based on a form of Bayesian estimation, as has been suggested by many psychophysical studies, and moreover suggests that the observed dynamic properties of this process are the result of the recursive nature of the motion estimation.

[1]  Yves Burnod,et al.  Bayesian inference in populations of cortical neurons: a model of motion integration and segmentation in area MT , 1999, Biological Cybernetics.

[2]  John H. R. Maunsell,et al.  The middle temporal visual area in the macaque: Myeloarchitecture, connections, functional properties and topographic organization , 1981, The Journal of comparative neurology.

[3]  R. Shapley,et al.  Visual spatial characterization of macaque V1 neurons. , 2001, Journal of neurophysiology.

[4]  L. Bowns.  Evidence for a Feature Tracking Explanation of Why Type II Plaids Move in the Vector Sum Direction at Short Durations , 1996, Vision Research.

[5]  L. Stone,et al.  From following edges to pursuing objects. , 2002, Journal of neurophysiology.

[6]  Heiko Neumann,et al.  Disambiguating Visual Motion Through Contextual Feedback Modulation , 2004, Neural Computation.

[7]  Guillaume S Masson,et al.  Object motion computation for the initiation of smooth pursuit eye movements in humans. , 2005, Journal of neurophysiology.

[8]  U. Ilg,et al.  Initiation of smooth-pursuit eye movements to first-order and second-order motion stimuli , 2000, Experimental Brain Research.

[9]  Guillaume S. Masson,et al.  Dynamics of distributed 1D and 2D motion representations for short-latency ocular following , 2008, Vision Research.

[10]  John H. R. Maunsell,et al.  The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  Eero P. Simoncelli,et al.  How MT cells analyze the motion of visual patterns , 2006, Nature Neuroscience.

[12]  Christopher C. Pack,et al.  The role of terminators and occlusion cues in motion integration and segmentation: a neural network model , 1999, Vision Research.

[13]  Rajesh P. N. Rao.  Bayesian Computation in Recurrent Neural Circuits , 2004, Neural Computation.

[14]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[15]  Stephen Grossberg,et al.  Neural dynamics of motion integration and segmentation within and across apertures , 2001, Vision Research.

[16]  Edward H. Adelson,et al.  Probability distributions of optical flow , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[18]  Christopher Bowd,et al.  Direction discrimination of cyclopean (stereoscopic) and luminance motion , 1997, Vision Research.

[19]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[20]  Harry S. Orbach,et al.  Computing feature motion without feature detectors: A model for terminator motion without end-stopped cells 1 This research was first reported at the Annual Meeting of the Association for Research in Vision and Ophthalmology, May 1997. 1 , 1999, Vision Research.

[21]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[22]  David J. Heeger,et al.  Model of visual motion sensing , 1994 .

[23]  R. Born,et al.  Segregation of Object and Background Motion in Visual Area MT Effects of Microstimulation on Eye Movements , 2000, Neuron.

[24]  S. Zeki,et al.  The Organization of Connections between Areas V5 and V1 in Macaque Monkey Visual Cortex , 1989, The European journal of neuroscience.

[25]  H. Komatsu,et al.  Relation of cortical areas MT and MST to pursuit eye movements. I. Localization and visual properties of neurons. , 1988, Journal of neurophysiology.

[26]  J. Movshon,et al.  Dynamics of motion signaling by neurons in macaque area MT , 2005, Nature Neuroscience.

[27]  J. B. Mulligan,et al.  Effect of contrast on the perceived direction of a moving plaid , 1990, Vision Research.

[28]  R. Shapley,et al.  “On the Visually Perceived Direction of Motion” by Hans Wallach: 60 Years Later , 1996 .

[29]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[30]  P. Wenderoth,et al.  The effect of interactions between one-dimensional component gratings on two-dimensional motion perception , 1993, Vision Research.

[31]  M. Shiffrar,et al.  Different motion sensitive units are involved in recovering the direction of moving lines , 1993, Vision Research.

[32]  Stefan Schaal,et al.  A model of smooth pursuit in primates based on learning the target dynamics , 2005, Neural Networks.

[33]  P. Thompson,et al.  Human speed perception is contrast dependent , 1992, Vision Research.

[34]  A. Leventhal,et al.  Signal timing across the macaque visual system. , 1998, Journal of neurophysiology.

[35]  Hans Wallach.  Über visuell wahrgenommene Bewegungsrichtung , 1935 .

[36]  H. Wilson,et al.  Moving two-dimensional patterns can capture the perceived directions of lower or higher spatial frequency gratings , 1992, Vision Research.

[37]  Claude L. Fennema,et al.  Velocity determination in scenes containing several moving objects , 1979 .

[38]  K. Rockland,et al.  Feedback connections from area MT of the squirrel monkey to areas V1 and V2 , 2000, The Journal of comparative neurology.

[39]  U. Polat,et al.  Collinear stimuli regulate visual responses depending on cell's contrast threshold , 1998, Nature.

[40]  H. Wilson,et al.  A psychophysically motivated model for two-dimensional motion perception , 1992, Visual Neuroscience.

[41]  P Girard,et al.  Feedback connections act on the early part of the responses in monkey visual cortex. , 2001, Journal of neurophysiology.

[42]  Christopher C. Pack,et al.  Integration of motion cues for the initiation of smooth pursuit eye movements. , 2002, Progress in brain research.

[43]  R. Shapley,et al.  Contrast's effect on spatial summation by macaque V1 neurons , 1999, Nature Neuroscience.

[44]  Pascal Mamassian,et al.  Bayesian modeling of dynamic motion integration , 2007, Journal of Physiology-Paris.

[45]  H. Komatsu,et al.  Modulation of pursuit eye movements by stimulation of cortical areas MT and MST. , 1989, Journal of neurophysiology.

[46]  Eric Castet,et al.  Parallel Motion Processing for the Initiation of Short-Latency Ocular Following in Humans , 2002, The Journal of Neuroscience.

[47]  Christopher C. Pack,et al.  Integration of Contour and Terminator Signals in Visual Area MT of Alert Macaque , 2004, The Journal of Neuroscience.

[48]  G. Orban,et al.  Response latencies of visual cells in macaque areas V1, V2 and V5 , 1989, Brain Research.

[49]  Eero P. Simoncelli,et al.  A model of neuronal responses in visual area MT , 1998, Vision Research.

[50]  Margaret S Livingstone,et al.  Two-Dimensional Substructure of MT Receptive Fields , 2001, Neuron.

[51]  W T Newsome,et al.  How Is a Sensory Map Read Out? Effects of Microstimulation in Visual Area MT on Saccades and Smooth Pursuit Eye Movements , 1997, The Journal of Neuroscience.

[52]  S. Lisberger,et al.  Properties of visual inputs that initiate horizontal smooth pursuit eye movements in monkeys , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[53]  Christopher Bowd,et al.  The cyclopean (stereoscopic) barber pole illusion , 1998, Vision Research.

[54]  Stefan Schaal,et al.  A Model of Smooth Pursuit based on Learning of the Target Dynamics Using Only Retinal Signals , 2001 .

[55]  Carlos R. Ponce,et al.  Temporal evolution of 2-dimensional direction signals used to guide eye movements. , 2005, Journal of neurophysiology.

[56]  E. Adelson,et al.  The analysis of moving visual patterns , 1985 .

[57]  E. Castet,et al.  Temporal dynamics of motion integration for the initiation of tracking eye movements at ultra-short latencies , 2000, Visual Neuroscience.

[58]  Margaret S Livingstone,et al.  End-Stopping and the Aperture Problem Two-Dimensional Motion Signals in Macaque V1 , 2003, Neuron.

[59]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[60]  Christopher C. Pack,et al.  Temporal dynamics of a neural solution to the aperture problem in visual area MT of macaque brain , 2001, Nature.

[61]  Eero P. Simoncelli.  Local analysis of visual motion , 2003 .