Flexible Sensorimotor Computations through Rapid Reconfiguration of Cortical Dynamics

Neural mechanisms that support flexible sensorimotor computations are not well understood. In a dynamical system whose state is determined by interactions among neurons, computations can be rapidly reconfigured by controlling the system's inputs and initial conditions. To investigate whether the brain employs such control mechanisms, we recorded from the dorsomedial frontal cortex of monkeys trained to measure and produce time intervals in two sensorimotor contexts. The geometry of neural trajectories during the production epoch was consistent with a mechanism wherein the measured interval and sensorimotor context exerted control over cortical dynamics by adjusting the system's initial condition and input, respectively. These adjustments, in turn, set the speed at which activity evolved in the production epoch, allowing the animal to flexibly produce different time intervals. These results provide evidence that the language of dynamical systems can be used to parsimoniously link brain activity to sensorimotor computations.

[1]  M. Miyazaki,et al.  Testing Bayesian models of human coincidence timing. , 2005, Journal of neurophysiology.

[2]  N. Parga,et al.  Dynamic Control of Response Criterion in Premotor Cortex during Perceptual Detection under Temporal Uncertainty , 2015, Neuron.

[3]  Matthew T. Kaufman,et al.  Cortical Preparatory Activity: Representation of Movement or First Cog in a Dynamical Machine? , 2010, Neuron.

[4]  J. Gibbon,et al.  Scalar expectancy theory and peak-interval timing in humans. , 1998, Journal of experimental psychology. Animal behavior processes.

[5]  廣瀬雄一,et al.  Neuroscience , 2019, Workplace Attachments.

[6]  L. Abbott,et al.  Eigenvalue spectra of random matrices for neural networks. , 2006, Physical review letters.

[7]  Min Whan Jung,et al.  Neural Correlates of Interval Timing in Rodent Prefrontal Cortex , 2013, The Journal of Neuroscience.

[8]  Kenneth D Harris,et al.  Spike sorting for large, dense electrode arrays , 2015, Nature Neuroscience.

[9]  James M Murray,et al.  Learning multiple variable-speed sequences in striatum via cortical tutoring , 2017, eLife.

[10]  P. Montague,et al.  Ready…Go: Amplitude of the fMRI Signal Encodes Expectation of Cue Arrival Time , 2009, PLoS biology.

[11]  Richard Ragot,et al.  Relationship between CNV and timing of an upcoming event , 2005, Neuroscience Letters.

[12]  Dean V. Buonomano,et al.  ROBUST TIMING AND MOTOR PATTERNS BY TAMING CHAOS IN RECURRENT NEURAL NETWORKS , 2012, Nature Neuroscience.

[13]  Byron M. Yu,et al.  Single-Trial Neural Correlates of Arm Movement Preparation , 2011, Neuron.

[14]  Hajime Mushiake,et al.  Deciphering Elapsed Time and Predicting Action Timing from Neuronal Population Signals , 2011, Front. Comput. Neurosci..

[15]  S. Scott Optimal feedback control and the neural basis of volitional motor control , 2004, Nature Reviews Neuroscience.

[16]  Jun Kunimatsu,et al.  Alteration of the timing of self‐initiated but not reactive saccades by electrical stimulation in the supplementary eye field , 2012, The European journal of neuroscience.

[17]  K. C. Anderson,et al.  Single neurons in prefrontal cortex encode abstract rules , 2001, Nature.

[18]  O. Hikosaka,et al.  Switching from automatic to controlled action by monkey medial frontal cortex , 2007, Nature Neuroscience.

[19]  Zengcai V. Guo,et al.  Maintenance of persistent activity in a frontal thalamocortical loop , 2017, Nature.

[20]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[21]  J. Tanji,et al.  The role of premotor cortex and the supplementary motor area in the temporal control of movement in man. , 1993, Brain : a journal of neurology.

[22]  N. Sigala,et al.  Dynamic Coding for Cognitive Control in Prefrontal Cortex , 2013, Neuron.

[23]  J. Tanji,et al.  Neuronal activities in the primate motor fields of the agranular frontal cortex preceding visually triggered and self-paced movement , 2004, Experimental Brain Research.

[24]  K. Shenoy,et al.  A Central Source of Movement Variability , 2006, Neuron.

[25]  F. Vidal,et al.  Functional Anatomy of the Attentional Modulation of Time Estimation , 2004, Science.

[26]  Franck Vidal,et al.  The supplementary motor area in motor and perceptual time processing: fMRI studies , 2006, Cognitive Processing.

[27]  Ralf D. Wimmer,et al.  Thalamic amplification of cortical connectivity sustains attentional control , 2017, Nature.

[28]  M M Merzenich,et al.  Temporal information transformed into a spatial code by a neural network with realistic properties , 1995, Science.

[29]  J. Kleim,et al.  Functional reorganization of the rat motor cortex following motor skill learning. , 1998, Journal of neurophysiology.

[30]  Jun Tanji,et al.  Prefrontal cortical cells projecting to the supplementary eye field and presupplementary motor area in the monkey , 2005, Neuroscience Research.

[31]  松坂 義哉,et al.  Changing directions of forthcoming arm movements : neuronal activity in the presupplementary and supplementary motor area of monkey cerebral cortex , 1996 .

[32]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[33]  Hansjörg Scherberger,et al.  Neural Population Dynamics during Reaching Are Better Explained by a Dynamical System than Representational Tuning , 2016, PLoS Comput. Biol..

[34]  Naoshige Uchida,et al.  Demixed principal component analysis of neural population data , 2014, eLife.

[35]  W. Schultz,et al.  Neuronal activity preceding self-initiated or externally timed arm movements in area 6 of monkey cortex , 2004, Experimental Brain Research.

[36]  J. Andrew Pruszynski,et al.  Primary motor cortex underlies multi-joint integration for fast feedback control , 2011, Nature.

[37]  Mark Laubach,et al.  Frontiers in Integrative Neuroscience Integrative Neuroscience , 2022 .

[38]  Xiao-Jing Wang,et al.  Internal Representation of Task Rules by Recurrent Dynamics: The Importance of the Diversity of Neural Responses , 2010, Front. Comput. Neurosci..

[39]  Shogo Ohmae,et al.  Neuronal activity related to anticipated and elapsed time in macaque supplementary eye field , 2008, Experimental Brain Research.

[40]  Zachary F Mainen,et al.  Neural antecedents of self-initiated actions in secondary motor cortex , 2014, Nature Neuroscience.

[41]  Carlos Garcia,et al.  A simple procedure for the comparison of covariance matrices , 2012, BMC Evolutionary Biology.

[42]  Stephen J. Heinen,et al.  A mechanism for decision rule discrimination by supplementary eye field neurons , 2014, Experimental Brain Research.

[43]  J. Tanji,et al.  Interval time coding by neurons in the presupplementary and supplementary motor areas , 2009, Nature Neuroscience.

[44]  Matthew T. Kaufman,et al.  The Largest Response Component in the Motor Cortex Reflects Movement Timing but Not Movement Type , 2016, eNeuro.

[45]  Y. Dan,et al.  Representation of interval timing by temporally scalable firing patterns in rat prefrontal cortex , 2013, Proceedings of the National Academy of Sciences.

[46]  M. Sahani,et al.  Cortical control of arm movements: a dynamical systems perspective. , 2013, Annual review of neuroscience.

[47]  Masaki Tanaka,et al.  Smooth Pursuit Eye Movements , 2018 .

[48]  M. Jung,et al.  Inactivation of Medial Prefrontal Cortex Impairs Time Interval Discrimination in Rats , 2009, Front. Behav. Neurosci..

[49]  E. Fetz Movement control: Are movement parameters recognizably coded in the activity of single neurons? , 1992 .

[50]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[51]  W. Gan,et al.  Sleep promotes branch-specific formation of dendritic spines after learning , 2014, Science.

[52]  U. Karmarkar,et al.  Timing in the Absence of Clocks: Encoding Time in Neural Network States , 2007, Neuron.

[53]  J. Tanji,et al.  A motor area rostral to the supplementary motor area (presupplementary motor area) in the monkey: neuronal activity during a learned motor task. , 1992, Journal of neurophysiology.

[54]  J. Tanji,et al.  Contrasting neuronal activity in the supplementary and frontal eye fields during temporal organization of multiple saccades. , 2003, Journal of neurophysiology.

[55]  M. Schlag-Rey,et al.  Evidence for a supplementary eye field. , 1987, Journal of neurophysiology.

[56]  Hansjörg Scherberger,et al.  Predicting Reaction Time from the Neural State Space of the Premotor and Parietal Grasping Network , 2015, The Journal of Neuroscience.

[57]  J. Kaas,et al.  Supplementary eye field as defined by intracortical microstimulation: Connections in macaques , 1990, The Journal of comparative neurology.

[58]  Matteo Carandini,et al.  Kilosort: realtime spike-sorting for extracellular electrophysiology with hundreds of channels , 2016, bioRxiv.

[59]  M. Brass,et al.  The role of the frontal cortex in task preparation. , 2002, Cerebral cortex.

[60]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[61]  Wolfram Schultz,et al.  Role of primate basal ganglia and frontal cortex in the internal generation of movements , 2004, Experimental Brain Research.

[62]  Shun-Nan Yang,et al.  Contrasting the roles of the supplementary and frontal eye fields in ocular decision making. , 2014, Journal of neurophysiology.

[63]  Chethan Pandarinath,et al.  LFADS - Latent Factor Analysis via Dynamical Systems , 2016, ArXiv.

[64]  Christian K. Machens,et al.  Behavioral / Systems / Cognitive Functional , But Not Anatomical , Separation of “ What ” and “ When ” in Prefrontal Cortex , 2009 .

[65]  Michael N. Shadlen,et al.  A Neural Mechanism for Sensing and Reproducing a Time Interval , 2015, Current Biology.

[66]  P. Strick,et al.  Supplementary Motor Area and Presupplementary Motor Area: Targets of Basal Ganglia and Cerebellar Output , 2007, The Journal of Neuroscience.

[67]  W. Gerstner,et al.  Optimal Control of Transient Dynamics in Balanced Networks Supports Generation of Complex Movements , 2014, Neuron.

[68]  Luigi Acerbi,et al.  Internal Representations of Temporal Statistics and Feedback Calibrate Motor-Sensory Interval Timing , 2012, PLoS Comput. Biol..

[69]  Hugo Merchant,et al.  Interval Tuning in the Primate Medial Premotor Cortex as a General Timing Mechanism , 2013, The Journal of Neuroscience.

[70]  Guangyu R. Yang,et al.  Training Excitatory-Inhibitory Recurrent Neural Networks for Cognitive Tasks: A Simple and Flexible Framework , 2016, PLoS Comput. Biol..

[71]  M. Nicolelis,et al.  Interval timing and the encoding of signal duration by ensembles of cortical and striatal neurons. , 2003, Behavioral neuroscience.

[72]  J Tanji,et al.  Role for cells in the presupplementary motor area in updating motor plans. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[73]  Michael N. Shadlen,et al.  Temporal context calibrates interval timing , 2010, Nature Neuroscience.

[74]  K. Harris,et al.  Cortical state and attention , 2011, Nature Reviews Neuroscience.

[75]  P J Webros BACKPROPAGATION THROUGH TIME: WHAT IT DOES AND HOW TO DO IT , 1990 .

[76]  Christopher D. Harvey,et al.  Recurrent Network Models of Sequence Generation and Memory , 2016, Neuron.

[77]  J Schlag,et al.  Primate supplementary eye field. II. Comparative aspects of connections with the thalamus, corpus striatum, and related forebrain nuclei , 1991, The Journal of comparative neurology.

[78]  Mehrdad Jazayeri,et al.  Late Bayesian inference in sensorimotor behavior , 2017, bioRxiv.

[79]  David J. Freedman,et al.  Computing by Robust Transience: How the Fronto-Parietal Network Performs Sequential, Category-Based Decisions , 2017, Neuron.

[80]  P. Goldman-Rakic,et al.  Prefrontal connections of medial motor areas in the rhesus monkey , 1993, The Journal of comparative neurology.

[81]  Stephen M. Rao,et al.  The evolution of brain activation during temporal processing , 2001, Nature Neuroscience.

[82]  Gilles Laurent,et al.  Transient Dynamics for Neural Processing , 2008, Science.

[83]  S. Wise,et al.  Premotor and supplementary motor cortex in rhesus monkeys: neuronal activity during externally- and internally-instructed motor tasks , 2004, Experimental Brain Research.

[84]  P. Cisek,et al.  Deliberation and Commitment in the Premotor and Primary Motor Cortex during Dynamic Decision Making , 2014, Neuron.

[85]  W. Schultz,et al.  Role of primate basal ganglia and frontal cortex in the internal generation of movements , 2004, Experimental Brain Research.

[86]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[87]  M. Carandini,et al.  Vision and Locomotion Shape the Interactions between Neuron Types in Mouse Visual Cortex , 2016, Neuron.

[88]  M. Hallett,et al.  Modulation of muscle responses evoked by transcranial magnetic stimulation during the acquisition of new fine motor skills. , 1995, Journal of neurophysiology.

[89]  W. Maass,et al.  State-dependent computations: spatiotemporal processing in cortical networks , 2009, Nature Reviews Neuroscience.

[90]  Jay A. Hennig,et al.  Signal Multiplexing and Single-Neuron Computations in Lateral Intraparietal Area During Decision-Making , 2013, The Journal of Neuroscience.

[91]  Hugo Merchant,et al.  Measuring time with different neural chronometers during a synchronization-continuation task , 2011, Proceedings of the National Academy of Sciences.

[92]  J. Assad,et al.  A cognitive signal for the proactive timing of action in macaque LIP , 2006, Nature Neuroscience.

[93]  J. B. Preston,et al.  Interconnections between the prefrontal cortex and the premotor areas in the frontal lobe , 1994, The Journal of comparative neurology.

[94]  Matthew T. Kaufman,et al.  A neural network that finds a naturalistic solution for the production of muscle activity , 2015, Nature Neuroscience.

[95]  Cyrille Rossant,et al.  Spike sorting for large, dense electrode arrays , 2015 .

[96]  Dirk Bucher,et al.  Neuromodulation of neurons and synapses , 2014, Current Opinion in Neurobiology.

[97]  Jun Tanji,et al.  Distribution of eye- and arm-movement-related neuronal activity in the SEF and in the SMA and Pre-SMA of monkeys. , 2002, Journal of neurophysiology.

[98]  John P. Cunningham,et al.  Tensor Analysis Reveals Distinct Population Structure that Parallels the Different Computational Roles of Areas M1 and V1 , 2016, PLoS Comput. Biol..

[99]  Matthew T. Kaufman,et al.  Neural population dynamics during reaching , 2012, Nature.

[100]  Devika Narain,et al.  Flexible timing by temporal scaling of cortical responses , 2017, Nature Neuroscience.

[101]  Willie F. Tobin,et al.  Rapid formation and selective stabilization of synapses for enduring motor memories , 2009, Nature.