Competitive Dynamics in MSTd: A Mechanism for Robust Heading Perception Based on Optic Flow

Human heading perception based on optic flow is not only accurate, it is also remarkably robust and stable. These qualities are especially apparent when observers move through environments containing other moving objects, which introduce optic flow that is inconsistent with observer self-motion and therefore uninformative about heading direction. Moving objects may also occupy large portions of the visual field and occlude regions of the background optic flow that are most informative about heading perception. The fact that heading perception is biased by no more than a few degrees under such conditions attests to the robustness of the visual system and warrants further investigation. The aim of the present study was to investigate whether recurrent, competitive dynamics among MSTd neurons that serve to reduce uncertainty about heading over time offer a plausible mechanism for capturing the robustness of human heading perception. Simulations of existing heading models that do not contain competitive dynamics yield heading estimates that are far more erratic and unstable than human judgments. We present a dynamical model of primate visual areas V1, MT, and MSTd based on that of Layton, Mingolla, and Browning that is similar to the other models, except that the model includes recurrent interactions among model MSTd neurons. Competitive dynamics stabilize the model’s heading estimate over time, even when a moving object crosses the future path. Soft winner-take-all dynamics enhance units that code a heading direction consistent with the time history and suppress responses to transient changes to the optic flow field. Our findings support recurrent competitive temporal dynamics as a crucial mechanism underlying the robustness and stability of perception of heading.

[1]  JAMES A. CROWELL,et al.  Testing the Perrone and Stone (1994) Model of Heading Estimation , 1997, Vision Research.

[2]  Constance S. Royden,et al.  Computing heading in the presence of moving objects: a model that uses motion-opponent operators , 2002, Vision Research.

[3]  Heiko Neumann,et al.  A Model of Motion Transparency Processing with Local Center-Surround Interactions and Feedback , 2011, Neural Computation.

[4]  Oliver W. Layton,et al.  Recurrent competition explains temporal effects of attention in MSTd , 2012, Front. Comput. Neurosci..

[5]  S. Grossberg.  Intracellular mechanisms of adaptation and self-regulation in self-organizing networks: the role of chemical transducers. , 1980, Bulletin of mathematical biology.

[6]  Jerome Carriot,et al.  Multimodal Integration of Self-Motion Cues in the Vestibular System: Active versus Passive Translations , 2013, The Journal of Neuroscience.

[7]  Paul R. MacNeilage,et al.  Systematic Biases in Human Heading Estimation , 2013, PloS one.

[8]  Constance S. Royden,et al.  Human heading judgments in the presence of moving objects , 1996, Perception & psychophysics.

[9]  Christopher C. Pack,et al.  Dynamic properties of neurons in cortical area MT in alert and anaesthetized macaque monkeys , 2001, Nature.

[10]  Eero P. Simoncelli,et al.  How MT cells analyze the motion of visual patterns , 2006, Nature Neuroscience.

[11]  Oliver W. Layton,et al.  A motion pooling model of visually guided navigation explains human behavior in the presence of independently moving objects. , 2012, Journal of vision.

[12]  Heiko Neumann,et al.  A Bio-Inspired, Motion-Based Analysis of Crowd Behavior Attributes Relevance to Motion Transparency, Velocity Gradients, and Motion Patterns , 2012, PloS one.

[13]  W Reichardt,et al.  Autocorrelation, a principle for evaluation of sensory information by the central nervous system , 1961 .

[14]  Stephen Grossberg,et al.  A neural model of how the brain computes heading from optic flow in realistic scenes , 2009, Cognitive Psychology.

[15]  M. Banks,et al.  Perceiving heading with different retinal regions and types of optic flow , 1993, Perception & psychophysics.

[16]  A. Verri,et al.  First-order analysis of optical flow in monkey brain. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[17]  W. Reichardt,et al.  Autocorrelation, a principle for the evaluation of sensory information by the central nervous system , 1961 .

[18]  T J Sejnowski,et al.  A Model for Encoding Multiple Object Motions and Self-Motion in Area MST of Primate Visual Cortex , 1998, The Journal of Neuroscience.

[19]  Andreas Burkhalter,et al.  Microcircuitry of forward and feedback connections within rat visual cortex , 1996, The Journal of comparative neurology.

[20]  Kechen Zhang,et al.  Emergence of Position-Independent Detectors of Sense of Rotation and Dilation with Hebbian Learning: An Analysis , 1999, Neural Computation.

[21]  Brett R Fajen,et al.  The temporal dynamics of heading perception in the presence of moving objects. , 2016, Journal of neurophysiology.

[22]  Nicholas B. Turk-Browne,et al.  When past is present: Substitutions of long-term memory for sensory evidence in perceptual judgments , 2016, Journal of vision.

[23]  C. Duffy,et al.  Heading representation in MST: sensory interactions and population encoding. , 2003, Journal of neurophysiology.

[24]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[25]  Heiko Neumann,et al.  Modeling heading and path perception from optic flow in the case of independently moving objects , 2013, Front. Behav. Neurosci..

[26]  Gregory C. DeAngelis,et al.  Vestibular Facilitation of Optic Flow Parsing , 2010, PloS one.

[27]  R. Born.  Center-surround interactions in the middle temporal visual area of the owl monkey. , 2000, Journal of neurophysiology.

[28]  G. DeAngelis,et al.  Representation of Vestibular and Visual Cues to Self-Motion in Ventral Intraparietal Cortex , 2011, The Journal of Neuroscience.

[29]  G. Orban,et al.  Responses of macaque STS neurons to optic flow components: a comparison of areas MT and MST. , 1994, Journal of neurophysiology.

[30]  J. Bullier,et al.  The role of feedback connections in shaping the responses of visual cortical neurons. , 2001, Progress in brain research.

[31]  Dora E Angelaki,et al.  Multisensory Integration of Visual and Vestibular Signals Improves Heading Discrimination in the Presence of a Moving Object , 2015, The Journal of Neuroscience.

[32]  E. Callaway.  Local circuits in primary visual cortex of the macaque monkey. , 1998, Annual review of neuroscience.

[33]  Dora E Angelaki,et al.  Visual and Nonvisual Contributions to Three-Dimensional Heading Selectivity in the Medial Superior Temporal Area , 2006, The Journal of Neuroscience.

[34]  Christopher C. Pack,et al.  Hierarchical processing of complex motion along the primate dorsal visual pathway , 2012, Proceedings of the National Academy of Sciences.

[35]  P. Schiller,et al.  Functional specificity of lateral geniculate nucleus laminae of the rhesus monkey. , 1978, Journal of neurophysiology.

[36]  M. Graziano,et al.  Tuning of MST neurons to spiral motions , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[37]  G. DeAngelis,et al.  Neural correlates of multisensory cue integration in macaque MSTd , 2008, Nature Neuroscience.

[38]  Heiko Neumann,et al.  Disambiguating Visual Motion Through Contextual Feedback Modulation , 2004, Neural Computation.

[39]  Mazyar Fallah,et al.  Response latencies of neurons in visual areas MT and MST of monkeys with striate cortex lesions , 2003, Neuropsychologia.

[40]  W H Warren,et al.  Perceiving Heading in the Presence of Moving Objects , 1995, Perception.

[41]  S. Grossberg,et al.  Neural dynamics of motion processing and speed discrimination , 1998, Vision Research.

[42]  Constance S. Royden,et al.  Mathematical analysis of motion-opponent mechanisms used in the determination of heading and depth. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[43]  Niraj S. Desai,et al.  Activity-dependent scaling of quantal amplitude in neocortical neurons , 1998, Nature.

[44]  Brett R Fajen,et al.  Sources of bias in the perception of heading in the presence of moving objects: Object-based and border-based discrepancies. , 2016, Journal of vision.

[45]  John H. R. Maunsell,et al.  Functions of the ON and OFF channels of the visual system , 1986, Nature.

[46]  Stephen Grossberg,et al.  Cortical dynamics of navigation and steering in natural scenes: Motion-based object segmentation, heading, and obstacle avoidance , 2009, Neural Networks.

[47]  Charles J. Duffy,et al.  Cortical Neurons Encoding Path and Place: Where You Go Is Where You Are , 2002, Science.

[48]  Simon K. Rushton,et al.  Heading recovery from optic flow: comparing performance of humans and computational models , 2013, Front. Behav. Neurosci..

[49]  K. Hoffmann,et al.  Optic Flow Processing in Monkey STS: A Theoretical and Experimental Approach , 1996, The Journal of Neuroscience.

[50]  J. M. Hupé,et al.  Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons , 1998, Nature.

[51]  Nicholas G. Hatsopoulos,et al.  Visual navigation with a neural network , 1991, Neural Networks.

[52]  Heiko Neumann,et al.  A Bio-Inspired, Computational Model Suggests Velocity Gradients of Optic Flow Locally Encode Ordinal Depth at Surface Borders and Globally They Encode Self-Motion , 2013, Neural Computation.

[53]  R. Wurtz,et al.  Response of monkey MST neurons to optic flow stimuli with shifted centers of motion , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[54]  J A Perrone,et al.  Emulating the Visual Receptive-Field Properties of MST Neurons with a Template Model of Heading Estimation , 1998, The Journal of Neuroscience.

[55]  James J. DiCarlo,et al.  How Does the Brain Solve Visual Object Recognition? , 2012, Neuron.

[56]  M. Srinivasan.  Honey bees as a model for vision, perception, and cognition. , 2010, Annual review of entomology.

[57]  R. Wurtz,et al.  Sensitivity of MST neurons to optic flow stimuli. I. A continuum of response selectivity to large-field stimuli. , 1991, Journal of neurophysiology.

[58]  Bevil R. Conway,et al.  Spatiotemporal Structure of Nonlinear Subunits in Macaque Visual Cortex , 2006, The Journal of Neuroscience.

[59]  A. V. van den Berg,et al.  Heading detection using motion templates and eye velocity gain fields , 1998, Vision Research.

[60]  D. Saucier,et al.  Enriched childhood experiences moderate age-related motor and cognitive decline , 2012, Front. Behav. Neurosci..

[61]  Diederick C Niehorster,et al.  A Bayesian model for estimating observer translation and rotation from optic flow and extra-retinal input. , 2010, Journal of vision.

[62]  James A. Crowell,et al.  Ideal observer for heading judgments , 1996, Vision Research.

[63]  L. Abbott,et al.  Synaptic Depression and Cortical Gain Control , 1997, Science.

[64]  M. Livingstone,et al.  Mechanisms of Direction Selectivity in Macaque V1 , 1998, Neuron.

[65]  R. Born,et al.  Segregation of global and local motion processing in primate middle temporal visual area , 1993, Nature.

[66]  R. Hetherington.  The Perception of the Visual World , 1952 .

[67]  W. Warren,et al.  The role of central and peripheral vision in perceiving the direction of self-motion , 1992, Perception & psychophysics.

[68]  J. Bullier,et al.  Visual latencies in areas V1 and V2 of the macaque monkey , 1995, Visual Neuroscience.

[69]  Yong Gu,et al.  Decoding of MSTd Population Activity Accounts for Variations in the Precision of Heading Perception , 2010, Neuron.

[70]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[71]  Yong Gu,et al.  Causal Links between Dorsal Medial Superior Temporal Area Neurons and Multisensory Heading Perception , 2012, The Journal of Neuroscience.

[72]  Kenneth H. Britten,et al.  Mechanisms of self-motion perception. , 2008, Annual review of neuroscience.

[73]  T. Wiesel,et al.  Patterns of synaptic input to layer 4 of cat striate cortex , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[74]  W. Warren,et al.  Perception of translational heading from optical flow. , 1988, Journal of experimental psychology. Human perception and performance.

[75]  Stephen Grossberg,et al.  Neural dynamics of motion grouping: from aperture ambiguity to object speed and direction , 1997 .

[76]  J A Perrone,et al.  Model for the computation of self-motion in biological systems. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[77]  Stephen Grossberg,et al.  A Self-Organizing Neural Network Architecture for Navigation Using Optic Flow , 1998, Neural Computation.

[78]  Dileep George,et al.  Towards a Mathematical Theory of Cortical Micro-circuits , 2009, PLoS Comput. Biol..

[79]  J H Rieger,et al.  Processing differential image motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[80]  Oliver W. Layton,et al.  A Unified Model of Heading and Path Perception in Primate MSTd , 2014, PLoS Comput. Biol..

[81]  G. DeAngelis,et al.  Multimodal Coding of Three-Dimensional Rotation and Translation in Area MSTd: Comparison of Visual and Vestibular Selectivity , 2007, The Journal of Neuroscience.

[82]  S. Grossberg.  Contour Enhancement , Short Term Memory , and Constancies in Reverberating Neural Networks , 1973 .

[83]  K. Rockland,et al.  Feedback connections from area MT of the squirrel monkey to areas V1 and V2 , 2000, The Journal of comparative neurology.

[84]  S. Grossberg,et al.  Contrast-sensitive perceptual grouping and object-based attention in the laminar circuits of primary visual cortex , 2000, Vision Research.

[85]  Timothy Barnes,et al.  Representation of motion onset and offset in an augmented Barlow-Levick model of motion detection , 2012, Journal of Computational Neuroscience.

[86]  M. Carandini,et al.  Normalization as a canonical neural computation , 2011, Nature Reviews Neuroscience.

[87]  O. Braddick.  Segmentation versus integration in visual motion processing , 1993, Trends in Neurosciences.

[88]  S Grossberg,et al.  Some nonlinear networks capable of learning a spatial pattern of arbitrary complexity. , 1968, Proceedings of the National Academy of Sciences of the United States of America.

[89]  Stephen Grossberg,et al.  A neural model of visually guided steering, obstacle avoidance, and route selection. , 2009, Journal of experimental psychology. Human perception and performance.

[90]  J. Perrone,et al.  A model of self-motion estimation within primate extrastriate visual cortex , 1994, Vision Research.

[91]  Kathleen E. Cullen,et al.  The vestibular system: multimodal integration and encoding of self-motion for motor control , 2012, Trends in Neurosciences.

[92]  R. Born,et al.  Specificity of Projections from Wide-Field and Local Motion-Processing Regions within the Middle Temporal Visual Area of the Owl Monkey , 2000, The Journal of Neuroscience.

[93]  E. Callaway,et al.  Contributions of individual layer 2–5 spiny neurons to local circuits in macaque primary visual cortex , 1996, Visual Neuroscience.

[94]  Guy A Orban,et al.  Higher order visual processing in macaque extrastriate cortex. , 2008, Physiological reviews.

[95]  Gregory C. DeAngelis,et al.  A Comparison of Vestibular Spatiotemporal Tuning in Macaque Parietoinsular Vestibular Cortex, Ventral Intraparietal Area, and Medial Superior Temporal Area , 2011, The Journal of Neuroscience.

[96]  David J Logan,et al.  Cerebral Cortex doi:10.1093/cercor/bhj082 Cerebral Cortex Advance Access published December 7, 2005 Cortical Area MSTd Combines Visual Cues , 2022 .

[97]  Markus Lappe,et al.  A Neural Network for the Processing of Optic Flow from Ego-Motion in Man and Higher Mammals , 1993, Neural Computation.

[98]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[99]  Ellen C. Hildreth,et al.  Recovering heading for visually-guided navigation , 1992, Vision Research.

[100]  D. Heeger.  Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.