Recurrent network dynamics reconciles visual motion segmentation and integration

In sensory systems, a range of computational rules are presumed to be implemented by neuronal subpopulations with different tuning functions. For instance, in primate cortical area MT, different classes of direction-selective cells have been identified and related either to motion integration, segmentation or transparency. Still, how such different tuning properties are constructed is unclear. The dominant theoretical viewpoint based on a linear-nonlinear feed-forward cascade does not account for their complex temporal dynamics and their versatility when facing different input statistics. Here, we demonstrate that a recurrent network model of visual motion processing can reconcile these different properties. Using a ring network, we show how excitatory and inhibitory interactions can implement different computational rules such as vector averaging, winner-take-all or superposition. The model also captures ordered temporal transitions between these behaviors. In particular, depending on the inhibition regime the network can switch from motion integration to segmentation, thus being able to compute either a single pattern motion or to superpose multiple inputs as in motion transparency. We thus demonstrate that recurrent architectures can adaptively give rise to different cortical computational regimes depending upon the input statistics, from sensory flow integration to segmentation.

[1]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Gustavo Deco,et al.  Multi-stable perception balances stability and sensitivity , 2013, Front. Comput. Neurosci..

[3]  R. Shapley,et al.  Dynamics of Orientation Selectivity in the Primary Visual Cortex and the Importance of Cortical Inhibition , 2003, Neuron.

[4]  J. Rauschecker,et al.  Perceptual Organization of Tone Sequences in the Auditory Cortex of Awake Macaques , 2005, Neuron.

[5]  H. Wilson,et al.  A psychophysically motivated model for two-dimensional motion perception , 1992, Visual Neuroscience.

[6]  J. Movshon,et al.  Dynamics of motion signaling by neurons in macaque area MT , 2005, Nature Neuroscience.

[7]  Shin'ya Nishida,et al.  Advancement of motion psychophysics: review 2001-2010. , 2011, Journal of vision.

[8]  Xin Huang,et al.  Distributed and Dynamic Neural Encoding of Multiple Motion Directions of Transparently Moving Stimuli in Cortical Area MT , 2015, The Journal of Neuroscience.

[9]  Hugh R. Wilson,et al.  Perceived direction of moving two-dimensional patterns depends on duration, contrast and eccentricity , 1992, Vision Research.

[10]  Richard J Krauzlis,et al.  Spatial integration by MT pattern neurons: a closer look at pattern-to-component effects and the role of speed tuning. , 2008, Journal of vision.

[11]  Ning Qian,et al.  The organization of global motion and transparency , 2001 .

[12]  R. Sekuler,et al.  Mutual repulsion between moving visual targets. , 1979, Science.

[13]  Yuanye Ma,et al.  Aging affects the neural representation of speed in Macaque area MT. , 2009, Cerebral cortex.

[14]  P. Bressloff Spatiotemporal dynamics of continuum neural fields , 2012 .

[15]  Bart Krekelberg,et al.  Adaptation without Plasticity. , 2016, Cell reports.

[16]  H. Rodman,et al.  Single-unit analysis of pattern-motion selective properties in the middle temporal visual area (MT) , 2004, Experimental Brain Research.

[17]  Bard Ermentrout,et al.  Pattern Formation in a Network of Excitatory and Inhibitory Cells with Adaptation , 2004, SIAM J. Appl. Dyn. Syst..

[18]  Christopher C. Pack,et al.  Temporal dynamics of a neural solution to the aperture problem in visual area MT of macaque brain , 2001, Nature.

[19]  Heiko Neumann,et al.  A Model of Motion Transparency Processing with Local Center-Surround Interactions and Feedback , 2011, Neural Computation.

[20]  J. Movshon,et al.  Dynamics of Macaque MT Cell Responses to Grating Triplets , 2012, The Journal of Neuroscience.

[21]  Kenneth D Miller,et al.  Canonical computations of cerebral cortex , 2016, Current Opinion in Neurobiology.

[22]  Eero P. Simoncelli,et al.  How MT cells analyze the motion of visual patterns , 2006, Nature Neuroscience.

[23]  M. Scanziani,et al.  Equalizing Excitation-Inhibition Ratios across Visual Cortical Neurons , 2014, Nature.

[24]  J. A. Kuznecov Elements of applied bifurcation theory , 1998 .

[25]  Olivier D. Faugeras,et al.  Bifurcation study of a neural field competition model with an application to perceptual switching in motion integration , 2013, Journal of Computational Neuroscience.

[26]  John Rinzel,et al.  Noise and adaptation in multistable perception: noise drives when to switch, adaptation determines percept choice. , 2014, Journal of vision.

[27]  Alexander Grunewald,et al.  Orthogonal motion after-effect illusion predicted by a model of cortical motion processing , 1996, Nature.

[28]  H. Wilson,et al.  Perceived direction of moving two-dimensional patterns , 1990, Vision Research.

[29]  C. Koch,et al.  Methods in Neuronal Modeling: From Ions to Networks , 1998 .

[30]  G H Recanzone,et al.  Shift in smooth pursuit initiation and MT and MST neuronal activity under different stimulus conditions. , 1999, Journal of neurophysiology.

[31]  Selina S. Solomon,et al.  Integration and segregation of multiple motion signals by neurons in area MT of primate. , 2014, Journal of neurophysiology.

[32]  O Braddick,et al.  Local and Global Representations of Velocity: Transparency, Opponency, and Global Direction Perception , 1997, Perception.

[33]  K. Fujii,et al.  Visualization for the analysis of fluid motion , 2005, J. Vis..

[34]  J. Touboul Mean-field equations for stochastic firing-rate neural fields with delays: Derivation and noise-induced transitions , 2012 .

[35]  Eero P. Simoncelli,et al.  A model of neuronal responses in visual area MT , 1998, Vision Research.

[36]  Ruye Wang,et al.  A Network Model of Motion Processing in Area MT of Primates , 1997, Journal of Computational Neuroscience.

[37]  Stefan Treue,et al.  Seeing multiple directions of motion—physiology and psychophysics , 2000, Nature Neuroscience.

[38]  D. Newport,et al.  Transient natural convection in a conducting enclosure heated from above , 2013, J. Vis..

[39]  P. Kornprobst,et al.  Modelling the dynamics of motion integration with a new luminance-gated diffusion mechanism , 2010, Vision Research.

[40]  J. Movshon,et al.  Temporal and spatial limits of pattern motion sensitivity in macaque MT neurons. , 2015, Journal of neurophysiology.

[41]  O. Braddick Segmentation versus integration in visual motion processing , 1993, Trends in Neurosciences.

[42]  Adam Kohn,et al.  Adaptation Disrupts Motion Integration in the Primate Dorsal Stream , 2014, Neuron.

[43]  Stephen Grossberg,et al.  Neural dynamics of motion integration and segmentation within and across apertures , 2001, Vision Research.

[44]  V. Jayaraman,et al.  Ring attractor dynamics in the Drosophila central brain , 2017, Science.

[45]  J. Rinzel,et al.  Noise-induced alternations in an attractor network model of perceptual bistability. , 2007, Journal of neurophysiology.

[46]  Daniel Pressnitzer,et al.  The initial phase of auditory and visual scene analysis , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[47]  R A Andersen,et al.  Transparent motion perception as detection of unbalanced motion signals. III. Modeling , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  Jeroen Joukes,et al.  Motion detection based on recurrent network dynamics , 2014, Frontiers in Systems Neuroscience.

[49]  H. Sompolinsky,et al.  13 Modeling Feature Selectivity in Local Cortical Circuits , 2022 .

[50]  O. Faugeras,et al.  The relative contribution of noise and adaptation to competition during tri-stable motion perception. , 2016, Journal of vision.

[51]  J Anthony Movshon,et al.  Properties of pattern and component direction-selective cells in area MT of the macaque. , 2016, Journal of neurophysiology.

[52]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[53]  Christopher C. Pack,et al.  Responses of MT neurons to type II plaid stimuli , 2010 .

[54]  Nicholas J. Priebe,et al.  Tuning for Spatiotemporal Frequency and Speed in Directionally Selective Neurons of Macaque Striate Cortex , 2006, The Journal of Neuroscience.

[55]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[56]  Thomas D. Albright,et al.  Neural correlates of perceptual motion coherence , 1992, Nature.

[57]  Gustavo Deco,et al.  Stimulus-dependent variability and noise correlations in cortical MT neurons , 2013, Proceedings of the National Academy of Sciences.

[58]  E. Adelson,et al.  The analysis of moving visual patterns , 1985 .

[59]  Olivier D. Faugeras,et al.  Bifurcation analysis applied to a model of motion integration with a multistable stimulus , 2012, Journal of Computational Neuroscience.

[60]  Frances S. Chance,et al.  Complex cells as cortically amplified simple cells , 1999, Nature Neuroscience.