Neuronal Correlations in MT and MST Impair Population Decoding of Opposite Directions of Random Dot Motion

Abstract The study of neuronal responses to random-dot motion patterns has provided some of the most valuable insights into how the activity of neurons is related to perception. In the opposite directions of motion paradigm, the motion signal strength is decreased by manipulating the coherence of random dot patterns to examine how well the activity of single neurons represents the direction of motion. To extend this paradigm to populations of neurons, studies have used modelling based on data from pairs of neurons, but several important questions require further investigation with larger neuronal datasets. We recorded neuronal populations in the middle temporal (MT) and medial superior temporal (MST) areas of anaesthetized marmosets with electrode arrays, while varying the coherence of random dot patterns in two opposite directions of motion (left and right). Using the spike rates of simultaneously recorded neurons, we decoded the direction of motion at each level of coherence with linear classifiers. We found that the presence of correlations had a detrimental effect to decoding performance, but that learning the correlation structure produced better decoding performance compared to decoders that ignored the correlation structure. We also found that reducing motion coherence increased neuronal correlations, but decoders did not need to be optimized for each coherence level. Finally, we showed that decoder weights depend of left-right selectivity at 100% coherence, rather than the preferred direction. These results have implications for understanding how the information encoded by populations of neurons is affected by correlations in spiking activity.

[1]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[2]  W. Newsome,et al.  Neuronal and psychophysical sensitivity to motion signals in extrastriate area MST of the macaque monkey , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  Chris Tailby,et al.  Visual motion integration by neurons in the middle temporal area of a New World monkey, the marmoset , 2011, The Journal of physiology.

[4]  Alexander S. Ecker,et al.  The Effect of Noise Correlations in Populations of Diversely Tuned Neurons , 2011, The Journal of Neuroscience.

[5]  Eero P. Simoncelli,et al.  Partitioning neuronal variability , 2014, Nature Neuroscience.

[6]  Michael Petrides,et al.  The marmoset brain in stereotaxic coordinates , 2012 .

[7]  J. Maunsell,et al.  Attention improves performance primarily by reducing interneuronal correlations , 2009, Nature Neuroscience.

[8]  Hsin-Hao Yu,et al.  A simple method for creating wide-field visual stimulus for electrophysiology: mapping and analyzing receptive fields using a hemispheric display. , 2010, Journal of vision.

[9]  Maureen A. Hagan,et al.  Sensitivity of neurons in the middle temporal area of marmoset monkeys to random dot motion. , 2017, Journal of neurophysiology.

[10]  T. Albright Direction and orientation selectivity of neurons in visual area MT of the macaque. , 1984, Journal of neurophysiology.

[11]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[12]  W. Newsome,et al.  Estimates of the Contribution of Single Neurons to Perception Depend on Timescale and Noise Correlation , 2009, The Journal of Neuroscience.

[13]  Keiji Tanaka,et al.  Integration of direction signals of image motion in the superior temporal sulcus of the macaque monkey , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  A. Georgopoulos,et al.  Neural activity in prefrontal cortex during copying geometrical shapes , 2003, Experimental brain research.

[15]  K. H. Britten,et al.  Neuronal correlates of a perceptual decision , 1989, Nature.

[16]  Elise G. Rowe,et al.  Rapid Adaptation Induces Persistent Biases in Population Codes for Visual Motion , 2016, The Journal of Neuroscience.

[17]  Maureen A. Hagan,et al.  Auditory motion does not modulate spiking activity in the middle temporal and medial superior temporal visual areas , 2018, The European journal of neuroscience.

[18]  D C Van Essen,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. , 1983, Journal of neurophysiology.

[19]  Aaron R. Seitz,et al.  What a difference a parameter makes: A psychophysical comparison of random dot motion algorithms , 2009, Vision Research.

[20]  Leo L. Lui,et al.  Structure and function of the middle temporal visual area (MT) in the marmoset: Comparisons with the macaque monkey , 2015, Neuroscience Research.

[21]  Alexander S. Ecker,et al.  State Dependence of Noise Correlations in Macaque Primary Visual Cortex , 2014, Neuron.

[22]  M. A. Smith,et al.  Spatial and Temporal Scales of Neuronal Correlation in Primary Visual Cortex , 2008, The Journal of Neuroscience.

[23]  Maoz Shamir,et al.  Emerging principles of population coding: in search for the neural code , 2014, Current Opinion in Neurobiology.

[24]  Maxwell H. Turner,et al.  Direction-Selective Circuits Shape Noise to Ensure a Precise Population Code , 2016, Neuron.

[25]  M. Cohen,et al.  Measuring and interpreting neuronal correlations , 2011, Nature Neuroscience.

[26]  H. Sompolinsky,et al.  Population coding in neuronal systems with correlated noise. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  W. Bair,et al.  Correlated Firing in Macaque Visual Area MT: Time Scales and Relationship to Behavior , 2001, The Journal of Neuroscience.

[28]  J. Movshon,et al.  The analysis of visual motion: a comparison of neuronal and psychophysical performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  K. H. Britten,et al.  Responses of neurons in macaque MT to stochastic motion signals , 1993, Visual Neuroscience.

[30]  Alexander S. Ecker,et al.  Reassessing optimal neural population codes with neurometric functions , 2011, Proceedings of the National Academy of Sciences.

[31]  G. Orban,et al.  Practising orientation identification improves orientation coding in V1 neurons , 2001, Nature.

[32]  J. Movshon,et al.  The statistical reliability of signals in single neurons in cat and monkey visual cortex , 1983, Vision Research.

[33]  Marcello G P Rosa,et al.  Preparation for the in vivo recording of neuronal responses in the visual cortex of anaesthetised marmosets (Callithrix jacchus). , 2003, Brain research. Brain research protocols.

[34]  Apostolos P. Georgopoulos,et al.  Neural activity in prefrontal cortex during copying geometrical shapes , 2003, Experimental Brain Research.

[35]  Alexandre Pouget,et al.  Origin of information-limiting noise correlations , 2015, Proceedings of the National Academy of Sciences.

[36]  C. Law,et al.  Reinforcement learning can account for associative and perceptual learning on a visual decision task , 2009, Nature Neuroscience.

[37]  Anne E. Urai,et al.  Sensory integration dynamics in a hierarchical network explains choice probabilities in cortical area MT , 2015, Nature Communications.

[38]  C. Law,et al.  Neural correlates of perceptual learning in a sensory-motor, but not a sensory, cortical area , 2008, Nature Neuroscience.

[39]  J. Maunsell,et al.  The Effect of Perceptual Learning on Neuronal Responses in Monkey Visual Area V4 , 2004, The Journal of Neuroscience.

[40]  F. Gallyas Silver staining of myelin by means of physical development. , 1979, Neurological research.

[41]  G. Orban,et al.  Learning to See the Difference Specifically Alters the Most Informative V4 Neurons , 2006, The Journal of Neuroscience.

[42]  R. Wurtz,et al.  Sensitivity of MST neurons to optic flow stimuli. I. A continuum of response selectivity to large-field stimuli. , 1991, Journal of neurophysiology.

[43]  J. Maunsell,et al.  Using Neuronal Populations to Study the Mechanisms Underlying Spatial and Feature Attention , 2011, Neuron.

[44]  Jaime de la Rocha,et al.  Supplementary Information for the article ‘ Correlation between neural spike trains increases with firing rate ’ , 2007 .

[45]  Joel Zylberberg Untuned But Not Irrelevant: A Role For Untuned Neurons In Sensory Information Coding , 2017 .

[46]  A. Pouget,et al.  Correlations and Neuronal Population Information. , 2016, Annual review of neuroscience.

[47]  J. Movshon,et al.  A computational analysis of the relationship between neuronal and behavioral responses to visual motion , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  Douglas A Ruff,et al.  Attention Increases Spike Count Correlations between Visual Cortical Areas , 2016, The Journal of Neuroscience.

[49]  Bijan Pesaran,et al.  Temporal structure in neuronal activity during working memory in macaque parietal cortex , 2000, Nature Neuroscience.

[50]  A. Pouget,et al.  Perceptual learning as improved probabilistic inference in early sensory areas , 2011, Nature Neuroscience.

[51]  A. Pouget,et al.  Information-limiting correlations , 2014, Nature Neuroscience.

[52]  G. Elston,et al.  Visuotopic organisation and neuronal response selectivity for direction of motion in visual areas of the caudal temporal lobe of the marmoset monkey (Callithrix jacchus): Middle temporal area, middle temporal crescent, and surrounding cortex , 1998, The Journal of comparative neurology.

[53]  Wallace Wang Using , 2019, Pro iPhone Development with Swift 5.

[54]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[55]  Rava Azeredo da Silveira,et al.  Structures of Neural Correlation and How They Favor Coding , 2016, Neuron.

[56]  M. Rosa,et al.  A distinct anatomical network of cortical areas for analysis of motion in far peripheral vision , 2006, The European journal of neuroscience.

[57]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[58]  K. Tanaka,et al.  Analysis of local and wide-field movements in the superior temporal visual areas of the macaque monkey , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[59]  Hsin-Hao Yu,et al.  Correlated Variability in the Neurons With the Strongest Tuning Improves Direction Coding , 2019, Cerebral cortex.

[60]  Xin Huang,et al.  Noise correlations in cortical area MT and their potential impact on trial-by-trial variation in the direction and speed of smooth-pursuit eye movements. , 2009, Journal of neurophysiology.

[61]  M. Carandini,et al.  The Nature of Shared Cortical Variability , 2015, Neuron.

[62]  Haim Sompolinsky,et al.  Implications of Neuronal Diversity on Population Coding , 2006, Neural Computation.

[63]  W. Newsome,et al.  Context-Dependent Changes in Functional Circuitry in Visual Area MT , 2008, Neuron.

[64]  Ehsan Arabzadeh,et al.  Population Decoding in Rat Barrel Cortex: Optimizing the Linear Readout of Correlated Population Responses , 2014, PLoS Comput. Biol..

[65]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque MT , 1996, Visual Neuroscience.

[66]  Adam J. Sachs,et al.  Correlated variability modifies working memory fidelity in primate prefrontal neuronal ensembles , 2017, Proceedings of the National Academy of Sciences.

[67]  R. Shapley,et al.  Orientation Selectivity in Macaque V1: Diversity and Laminar Dependence , 2002, The Journal of Neuroscience.

[68]  Arnulf B. A. Graf,et al.  Decoding the activity of neuronal populations in macaque primary visual cortex , 2011, Nature Neuroscience.

[69]  Jude F. Mitchell,et al.  Spatial Attention Decorrelates Intrinsic Activity Fluctuations in Macaque Area V4 , 2009, Neuron.

[70]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[71]  John W Morley,et al.  Local and Global Correlations between Neurons in the Middle Temporal Area of Primate Visual Cortex. , 2015, Cerebral cortex.

[72]  S. Zeki Functional organization of a visual area in the posterior bank of the superior temporal sulcus of the rhesus monkey , 1974, The Journal of physiology.