Noise-Correlation Is Modulated by Reward Expectation in the Primary Motor Cortex Bilaterally During Manual and Observational Tasks in Primates

Reward modulation is represented in the motor cortex (M1) and could be used to implement more accurate decoding models to improve brain computer interfaces (BCIs) (Zhao et al. 2018). Analyzing trial-to-trial noise-correlations between neural units in the presence of rewarding (R) and non-rewarding (NR) stimuli adds to our understanding of cortical network dynamics. We utilized Pearson’s correlation coefficient to measure shared variability between simultaneously recorded units (32 – 112) and found significantly higher noise-correlation and positive correlation between the populations’ signal- and noise-correlation during NR trials as compared to R trials. This pattern is evident in data from two non-human primates (NHPs) during single-target center out reaching tasks, both manual and action observation versions. We conducted mean matched noise-correlation analysis in order to decouple known interactions between event triggered firing rate changes and neural correlations. Isolated reward discriminatory units demonstrated stronger correlational changes than units unresponsive to reward firing rate modulation, however the qualitative response was similar, indicating correlational changes within the network as a whole can serve as another information channel to be exploited by BCIs that track the underlying cortical state, such as reward expectation, or attentional modulation. Reward expectation and attention in return can be utilized with reinforcement learning towards autonomous BCI updating.

[1]  Valentin Dragoi,et al.  Efficient coding in heterogeneous neuronal populations , 2008, Proceedings of the National Academy of Sciences.

[2]  Joseph Thachil Francis,et al.  Neuroplasticity of the Sensorimotor Cortex during Learning , 2011, Neural plasticity.

[3]  Douglas A Ruff,et al.  Global Cognitive Factors Modulate Correlated Response Variability between V4 Neurons , 2014, The Journal of Neuroscience.

[4]  Konrad Paul Kording,et al.  Premotor and Motor Cortices Encode Reward , 2016, PloS one.

[5]  Yoon Woo Byun,et al.  Cortical neurons multiplex reward-related signals along with sensory and motor information , 2017, Proceedings of the National Academy of Sciences.

[6]  John P. Hessburg,et al.  Reward Modulates Local Field Potentials, Spiking Activity and Spike-Field Coherence in the Primary Motor Cortex , 2018 .

[7]  J. Movshon,et al.  The statistical reliability of signals in single neurons in cat and monkey visual cortex , 1983, Vision Research.

[8]  Dennis C. Tkach,et al.  Congruent Activity during Action and Action Observation in Motor Cortex , 2007, The Journal of Neuroscience.

[9]  William W. Lytton,et al.  Cortical Spiking Network Interfaced with Virtual Musculoskeletal Arm and Robotic Arm , 2015, Front. Neurorobot..

[10]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[11]  M. Cohen,et al.  Relating normalization to neuronal populations across cortical areas. , 2016, Journal of neurophysiology.

[12]  Nicholas A. Steinmetz,et al.  Diverse coupling of neurons to populations in sensory cortex , 2015, Nature.

[13]  M. Cohen,et al.  Measuring and interpreting neuronal correlations , 2011, Nature Neuroscience.

[14]  Sheila Nirenberg,et al.  Decoding neuronal spike trains: How important are correlations? , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[15]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[16]  K. Molina-Luna,et al.  Dopamine in Motor Cortex Is Necessary for Skill Learning and Synaptic Plasticity , 2009, PloS one.

[17]  Matthew T. Kaufman,et al.  Neural population dynamics during reaching , 2012, Nature.

[18]  Alexander Thiele,et al.  Attention-Induced Variance and Noise Correlation Reduction in Macaque V1 Is Mediated by NMDA Receptors , 2013, Neuron.

[19]  Saori C. Tanaka,et al.  Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops , 2004, Nature Neuroscience.

[20]  Nicolas Fourcaud-Trocmé,et al.  Correlation-induced Synchronization of Oscillations in Olfactory Bulb Neurons , 2022 .

[21]  R A Andersen,et al.  Supplementary motor area encodes reward expectancy in eye-movement tasks. , 2005, Journal of neurophysiology.

[22]  Riichi Kajiwara,et al.  Voltage-Sensitive Dye Imaging of Primary Motor Cortex Activity Produced by Ventral Tegmental Area Stimulation , 2014, The Journal of Neuroscience.

[23]  John S. Choi,et al.  Motor Cortex Encodes A Temporal Difference Reinforcement Learning Process , 2018, bioRxiv.

[24]  Yong Gu,et al.  Perceptual Learning Reduces Interneuronal Correlations in Macaque Visual Cortex , 2011, Neuron.

[25]  Charles J. Wilson,et al.  Active decorrelation in the basal ganglia , 2013, Neuroscience.

[26]  Andrew M. Clark,et al.  Stimulus onset quenches neural variability: a widespread cortical phenomenon , 2010, Nature Neuroscience.

[27]  J. Maunsell,et al.  Attention improves performance primarily by reducing interneuronal correlations , 2009, Nature Neuroscience.

[28]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[29]  Timothy Q. Gentner,et al.  Associative Learning Enhances Population Coding by Inverting Interneuronal Correlation Patterns , 2013, Neuron.

[30]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[31]  Mark F Bear,et al.  Reward timing in the primary visual cortex. , 2006, Science.

[32]  Junmo An,et al.  Reward Expectation Modulates Local Field Potentials, Spiking Activity and Spike-Field Coherence in the Primary Motor Cortex , 2019, eNeuro.

[33]  W. Bair,et al.  Correlated Firing in Macaque Visual Area MT: Time Scales and Relationship to Behavior , 2001, The Journal of Neuroscience.

[34]  W. Newsome,et al.  Context-Dependent Changes in Functional Circuitry in Visual Area MT , 2008, Neuron.

[35]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[36]  Yao Zhao,et al.  Paradigm Shift in Sensorimotor Control Research and Brain Machine Interface Control: The Influence of Context on Sensorimotor Representations , 2017, bioRxiv.

[37]  Barry J. Richmond,et al.  Differential Encoding of Factors Influencing Predicted Reward Value in Monkey Rostral Anterior Cingulate Cortex , 2012, PloS one.

[38]  John Hertz,et al.  Cross-Correlations in High-Conductance States of a Model Cortical Network , 2010, Neural Computation.

[39]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[40]  Jaime de la Rocha,et al.  Supplementary Information for the article ‘ Correlation between neural spike trains increases with firing rate ’ , 2007 .

[41]  A. Aertsen,et al.  Dynamics of neuronal interactions in monkey cortex in relation to behavioural events , 1995, Nature.

[42]  N. Urban,et al.  Intrinsic biophysical diversity decorrelates neuronal firing while increasing information content , 2010, Nature Neuroscience.

[43]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[44]  Cheng Ly,et al.  When do correlations increase with firing rates in recurrent networks? , 2016, PLoS Comput. Biol..

[45]  Joseph T. Francis,et al.  Toward an Autonomous Brain Machine Interface: Integrating Sensorimotor Reward Modulation and Reinforcement Learning , 2015, The Journal of Neuroscience.

[46]  Mohammad Bataineh,et al.  Classifier Performance in Primary Somatosensory Cortex Towards Implementation of a Reinforcement Learning Based Brain Machine Interface , 2016, 2016 32nd Southern Biomedical Engineering Conference (SBEC).

[47]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[48]  Jude F. Mitchell,et al.  Spatial Attention Decorrelates Intrinsic Activity Fluctuations in Macaque Area V4 , 2009, Neuron.

[49]  Matthias M. Müller,et al.  The time course of cortical facilitation during cued shifts of spatial attention , 1998, Nature Neuroscience.

[50]  R. Romo,et al.  Correlated Neuronal Discharges that Increase Coding Efficiency during Perceptual Discrimination , 2003, Neuron.

[51]  Valentin Dragoi,et al.  Correlated Variability in Laminar Cortical Circuits , 2012, Neuron.

[52]  Karel Svoboda,et al.  Learning-related fine-scale specificity imaged in motor cortex circuits of behaving mice , 2010, Nature.

[53]  Juliana Dushanova,et al.  Neurons in primary motor cortex engaged during action observation , 2010, The European journal of neuroscience.

[54]  John P. Hessburg,et al.  Normalization by Valence and Motivational Intensity in the Primary Sensorimotor Cortices (PMd, M1 and S1) , 2019, bioRxiv.

[55]  R. Reid,et al.  Specificity of monosynaptic connections from thalamus to visual cortex , 1995, Nature.

[56]  Joonyeol Lee,et al.  A Normalization Model of Attentional Modulation of Single Unit Responses , 2009, PloS one.

[57]  Valentin Dragoi,et al.  Negative Correlations in Visual Cortical Networks. , 2016, Cerebral cortex.

[58]  P. Glimcher,et al.  Reward Value-Based Gain Control: Divisive Normalization in Parietal Cortex , 2011, The Journal of Neuroscience.

[59]  M. A. Smith,et al.  Stimulus Dependence of Neuronal Correlation in Primary Visual Cortex of the Macaque , 2005, The Journal of Neuroscience.

[60]  Joseph T. Francis,et al.  Reward value is encoded in primary somatosensory cortex and can be decoded from neural activity during performance of a psychophysical task , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[61]  Joonyeol Lee,et al.  Attentional Modulation of MT Neurons with Single or Multiple Stimuli in Their Receptive Fields , 2010, The Journal of Neuroscience.

[62]  Jude F. Mitchell,et al.  Differential Attention-Dependent Response Modulation across Cell Classes in Macaque Visual Area V4 , 2007, Neuron.

[63]  Peyman Golshani,et al.  Temporal correlations among functionally specialized striatal neural ensembles in reward-conditioned mice. , 2016, Journal of neurophysiology.

[64]  Daeyeol Lee,et al.  Effects of noise correlations on information encoding and decoding. , 2006, Journal of neurophysiology.

[65]  Joseph T. Francis,et al.  Near Perfect Neural Critic from Motor Cortical Activity Toward an Autonomously Updating Brain Machine Interface , 2018, bioRxiv.

[66]  R. Andersen,et al.  Cognitive Control Signals for Neural Prosthetics , 2004, Science.

[67]  John S. Choi,et al.  Motor Cortex Encodes A Value Function Consistent With Reinforcement Learning , 2018 .

[68]  Adam Kohn,et al.  Laminar dependence of neuronal correlations in visual cortex. , 2013, Journal of neurophysiology.