Interactions of motion and form in visual cortex – A neural model

In this work, we present a neural model simulating parts of the motion and the form pathway of the visual cortex. It is shown how the visual features motion, disparity, and form that are represented in a distributed way in areas V1, V2, and MT mutually interact at several levels. Thus, their information is shared without the need of explicit neural representation for each combination of features. In particular, we address the issue of 2D extrinsic motion cues generated at occlusions that have to be treated differently than 2D intrinsic motion features of the same object. We suggest that here information of the form channel, namely the indication of a junction, is necessary to achieve a correct percept in the motion pathway. Furthermore, we investigated the question of how a percept of either pattern or component motion is generated in a scenario of moving bars that only differs in the presence or absence of occlusions, like in the chopstick and the barberpole display. We propose different roles for various kinds of MT cells that are involved in the interactions with the form pathway, simulating purely integrative cells tuned to motion and to motion and stereo, but also contrast cells responding strongly when motion in the surround is in the opposite direction. The model simulations reproduce psychophysical and neurophysiological results of the chopstick as well as of the barberpole illusion. The temporal course of the dominant motion percept generated by the iterative interplay between motion and form pathway is in line with data of ocular following responses in primates and humans.

[1]  A. Basbaum,et al.  The senses : a comprehensive reference , 2008 .

[2]  H. Neumann,et al.  Object Segmentation from Motion Discontinuities and Temporal Occlusions–A Biologically Inspired Model , 2008, PloS one.

[3]  Aya Takemura,et al.  A Cortically Mediated Visual Stabilization Mechanism with Ultrashort Latency in Primates , 1997 .

[4]  J Gautrais,et al.  Rate coding versus temporal order coding: a theoretical approach. , 1998, Bio Systems.

[5]  Neumann Heiko Area MT pattern motion selectivity by integrating 1D and 2D motion features from V1 - a neural model , 2009 .

[6]  Christopher C. Pack,et al.  Cortical Mechanisms for the Integration of Visual Motion , 2008 .

[7]  Eero P. Simoncelli,et al.  How MT cells analyze the motion of visual patterns , 2006, Nature Neuroscience.

[8]  Christopher C. Pack,et al.  The role of terminators and occlusion cues in motion integration and segmentation: a neural network model , 1999, Vision Research.

[9]  H. Neumann,et al.  Extraction of Surface-Related Features in a Recurrent Model of V1-V2 Interactions , 2009, PloS one.

[10]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[11]  R A Andersen,et al.  Transparent motion perception as detection of unbalanced motion signals. III. Modeling , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  S. Grossberg The complementary brain: unifying brain dynamics and modularity , 2000, Trends in Cognitive Sciences.

[13]  Eero P. Simoncelli,et al.  A model of neuronal responses in visual area MT , 1998, Vision Research.

[14]  Heiko Neumann,et al.  A model of neural mechanisms in monocular transparent motion perception , 2010, Journal of Physiology-Paris.

[15]  L. Stone,et al.  From following edges to pursuing objects. , 2002, Journal of neurophysiology.

[16]  Heiko Neumann,et al.  Disambiguating Visual Motion Through Contextual Feedback Modulation , 2004, Neural Computation.

[17]  Reinhard Eckhorn,et al.  Feature Linking via Synchronization among Distributed Assemblies: Simulations of Results from Cat Visual Cortex , 1990, Neural Computation.

[18]  Christopher C. Pack,et al.  Temporal dynamics of a neural solution to the aperture problem in visual area MT of macaque brain , 2001, Nature.

[19]  Pierre Kornprobst,et al.  Biological model of motion integration and segmentation based on form cues , 2007 .

[20]  Pierre Kornprobst,et al.  Motion integration modulated by form information , 2008 .

[21]  Eric Castet,et al.  Parallel Motion Processing for the Initiation of Short-Latency Ocular Following in Humans , 2002, The Journal of Neuroscience.

[22]  A. Thielscher,et al.  Neural mechanisms of cortico–cortical interaction in texture boundary detection: a modeling approach , 2003, Neuroscience.

[23]  Christopher C. Pack,et al.  Integration of Contour and Terminator Signals in Visual Area MT of Alert Macaque , 2004, The Journal of Neuroscience.

[24]  Terrence J. Sejnowski,et al.  Filter selection model for motion segmentation and velocity integration , 1994 .

[25]  L B Winter The influence of duration of sensitization of anaphylaxis in the guinea‐pig , 1945, The Journal of physiology.

[26]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[27]  S. Grossberg,et al.  Laminar cortical dynamics of visual form and motion interactions during coherent object motion perception. , 2007, Spatial vision.

[28]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[29]  Hans Wallach Über visuell wahrgenommene Bewegungsrichtung , 1935 .

[30]  Heiko Neumann,et al.  Globally consistent depth sorting of overlapping 2D surfaces in a model using local recurrent interactions , 2008, Biological Cybernetics.

[31]  J. van Santen,et al.  Elaborated Reichardt detectors. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[32]  EckhornR.,et al.  Feature linking via synchronization among distributed assemblies , 1990 .

[33]  Leslie G. Ungerleider,et al.  Object vision and spatial vision: two cortical pathways , 1983, Trends in Neurosciences.

[34]  S. Yamane,et al.  Neural activity in cortical area MST of alert monkey during ocular following responses. , 1994, Journal of neurophysiology.

[35]  T. Troscianko,et al.  AI and the eye , 1990 .

[36]  R. Born,et al.  Integrating motion and depth via parallel pathways , 2008, Nature Neuroscience.

[37]  Christopher C. Pack,et al.  Integration of motion cues for the initiation of smooth pursuit eye movements. , 2002, Progress in brain research.

[38]  K. Nakayama,et al.  Occlusion and the solution to the aperture problem for motion , 1989, Vision Research.

[39]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[40]  Ennio Mingolla,et al.  Monocular occlusion cues alter the influence of terminator motion in the barber pole phenomenon , 1998, Vision Research.

[41]  Heiko Neumann,et al.  Disambiguating Visual Motion by Form-Motion Interaction—a Computational Model , 2007, International Journal of Computer Vision.