Biological model of motion integration and segmentation based on form cues

Active vision is an essential part of every biological organism possessing an eye system: posture, eye movements, visual research, ... All require a motion percept to operate. At the basis of active vision lays the ability to calculate movements of objects in the scene, at least on a sufficient level to react correctly. In this report we present a model of motion integration and segmentation in the first visual cortex areas. Specifically we modeled the first two cortex areas involved in motion processing in the primate: V1 and MT. To be able to process motion correctly a visual system also need to deal with form information. We investigate how form cues coming from the ventral pathway can be used by the V1/MT dorsal pathway to solve some perception problems. By using a recurrent dynamical system between the V1 and MT layers we are able to find out psychophysical results such as motion integration and center-surround effects due to the feedback connections, or end-of-line and 2D features detectors thanks to the shunting inhibition. We propose to modulate this system by a form information coming from the ventral stream and are thus able to explain asymmetric center-surround effects as well as motion segmentation and segregation between extrinsic and intrinsic junctions.

[1]  R. Shapley,et al.  Visual spatial characterization of macaque V1 neurons. , 2001, Journal of neurophysiology.

[2]  Christopher C. Pack,et al.  Integration of Contour and Terminator Signals in Visual Area MT of Alert Macaque , 2004, The Journal of Neuroscience.

[3]  Guillaume S Masson,et al.  Spatial scale of motion segmentation from speed cues , 2001, Vision Research.

[4]  Heiko Neumann,et al.  Disambiguating Visual Motion by Form-Motion Interaction—a Computational Model , 2007, International Journal of Computer Vision.

[5]  Pierre Bayerl,et al.  A model of visual motion perception , 2006 .

[6]  J. Bullier,et al.  Reaching beyond the classical receptive field of V1 neurons: horizontal or feedback axons? , 2003, Journal of Physiology-Paris.

[7]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[8]  P A Salin,et al.  Response selectivity of neurons in area MT of the macaque monkey during reversible inactivation of area V1. , 1992, Journal of neurophysiology.

[9]  C. Koch,et al.  The analysis of visual motion: from computational theory to neuronal mechanisms. , 1986, Annual review of neuroscience.

[10]  E. Callaway,et al.  The Parvocellular LGN Provides a Robust Disynaptic Input to the Visual Motion Area MT , 2006, Neuron.

[11]  C. Gross,et al.  Afferent basis of visual response properties in area MT of the macaque. I. Effects of striate cortex removal , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  Randolph Blake,et al.  Perceptual consequences of centre–surround antagonism in visual motion processing , 2003, Nature.

[13]  G. Orban,et al.  The spatial distribution of the antagonistic surround of MT/V5 neurons. , 1997, Cerebral cortex.

[14]  R A Andersen,et al.  The response of area MT and V1 neurons to transparent motion , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[15]  Shmuel Peleg,et al.  A Three-Frame Algorithm for Estimating Two-Component Image Motion , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Christopher C. Pack,et al.  Contrast dependence of suppressive influences in cortical area MT of alert macaque. , 2005, Journal of neurophysiology.

[17]  E. Adelson,et al.  Slow and Smooth: A Bayesian theory for the combination of local motion signals in human vision , 1998 .

[18]  T. Albright,et al.  Adaptive Surround Modulation in Cortical Area MT , 2007, Neuron.

[19]  G. DeAngelis,et al.  Organization of Disparity-Selective Neurons in Macaque Area MT , 1999, The Journal of Neuroscience.

[20]  Paul Sajda,et al.  Integration of form and motion within a generative model of visual cortex , 2004, Neural Networks.

[21]  Yair Weiss.  Bayesian motion estimation and segmentation , 1998 .

[22]  Anthony J. Movshon,et al.  Visual Response Properties of Striate Cortical Neurons Projecting to Area MT in Macaque Monkeys , 1996, The Journal of Neuroscience.

[23]  Nava Rubin,et al.  The dynamics of bi-stable alternation in ambiguous motion displays: a fresh look at plaids , 2003, Vision Research.

[24]  Sergei Gepshtein,et al.  Stability and change in perception: spatial organization in temporal context , 2004, Experimental Brain Research.

[25]  R. Frostig,et al.  Cortical point-spread function and long-range lateral interactions revealed by real-time optical imaging of macaque monkey primary visual cortex , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[26]  Colin Blakemore,et al.  Pattern motion is present in V1 of awake but not anaesthetized monkeys , 2004, The European journal of neuroscience.

[27]  Terrence J. Sejnowski,et al.  Filter Selection Model for Generating Visual Motion Signals , 1992, NIPS.

[28]  Eero P. Simoncelli,et al.  A model of neuronal responses in visual area MT , 1998, Vision Research.

[29]  O. Braddick,et al.  Brain Areas Sensitive to Coherent Visual Motion , 2001, Perception.

[30]  G. Orban,et al.  Spatial heterogeneity of inhibitory surrounds in the middle temporal visual area. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[31]  A. Sillito,et al.  Always returning: feedback and sensory processing in visual cortex and thalamus , 2006, Trends in Neurosciences.

[32]  R. Andersen,et al.  Encoding of three-dimensional structure-from-motion by primate area MT neurons , 1998, Nature.

[33]  K. Nakayama,et al.  Occlusion and the solution to the aperture problem for motion , 1989, Vision Research.

[34]  L. Stone,et al.  Speed tuning of motion segmentation and discrimination , 1999, Vision Research.

[35]  J. B. Levitt,et al.  Circuits for Local and Global Signal Integration in Primary Visual Cortex , 2002, The Journal of Neuroscience.

[36]  Chris J. Tinsley,et al.  The nature of V1 neural responses to 2D moving patterns depends on receptive-field structure in the marmoset monkey. , 2003, Journal of neurophysiology.

[37]  Hans Wallach.  Über visuell wahrgenommene Bewegungsrichtung , 1935 .

[38]  K. Rockland,et al.  Feedback connections from area MT of the squirrel monkey to areas V1 and V2 , 2000, The Journal of comparative neurology.

[39]  C. Koch,et al.  A framework for consciousness , 2003, Nature Neuroscience.

[40]  Terrence J. Sejnowski,et al.  Filter selection model for motion segmentation and velocity integration , 1994 .

[41]  E. Castet,et al.  Temporal dynamics of motion integration for the initiation of tracking eye movements at ultra-short latencies , 2000, Visual Neuroscience.