Stability of motor cortex network states during learning-associated neural reorganizations.

A substantial reorganization of neural activity and neuron-to-movement relationship in motor cortical circuits accompanies the emergence of reproducible movement patterns during motor learning. Little is known about how this tempest of neural activity restructuring impacts the stability of network states in recurrent cortical circuits. To investigate this issue, we reanalyzed data in which we recorded for 14 days via population calcium imaging the activity of the same neural populations of pyramidal neurons in layer 2/3 and layer 5 of forelimb motor and pre-motor cortex in mice during the daily learning of a lever-press task. We found that motor cortex network states remained stable with respect to the critical network state during the extensive reorganization of both neural population activity and its relation to lever movement throughout learning. Specifically, layer 2/3 cortical circuits unceasingly displayed robust evidence for operating at the critical network state, a regime that maximizes information capacity and transmission, and provides a balance between network robustness and flexibility. In contrast, layer 5 circuits operated away from the critical network state for all 14 days of recording and learning. In conclusion, this result indicates that the wide-ranging malleability of synapses, neurons, and neural connectivity during learning operates within the constraint of a stable and layer-specific network state regarding dynamic criticality, and suggests that different cortical layers operate under distinct constraints because of their specialized goals.

[1]  M. Porter,et al.  Critical Truths About Power Laws , 2012, Science.

[2]  Stassinopoulos,et al.  Democratic reinforcement: A principle for brain function. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[3]  F. Helmchen,et al.  Reorganization of cortical population activity imaged throughout long-term sensory deprivation , 2012, Nature Neuroscience.

[4]  Joseph Lee,et al.  Relationship of critical dynamics, functional connectivity, and states of consciousness in large-scale human brain networks , 2019, NeuroImage.

[5]  Yahya Karimipanah,et al.  Criticality predicts maximum irregularity in recurrent networks of excitatory nodes , 2017, PloS one.

[6]  Robert D Flint,et al.  Long-Term Stability of Motor Cortical Activity: Implications for Brain Machine Interfaces and Optimal Feedback Control , 2016, The Journal of Neuroscience.

[7]  M. Merzenich,et al.  Use-dependent alterations of movement representations in primary motor cortex of adult squirrel monkeys , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  M. Nicolelis,et al.  Differential Corticostriatal Plasticity during Fast and Slow Motor Skill Learning in Mice , 2004, Current Biology.

[9]  Byron M. Yu,et al.  Learning by neural reassociation , 2018, Nature Neuroscience.

[10]  A. P. Georgopoulos,et al.  Movement parameters and neural activity in motor cortex and area 5. , 1994, Cerebral cortex.

[11]  K. Linkenkaer-Hansen,et al.  Avalanche dynamics of human brain oscillations: Relation to critical branching processes and temporal correlations , 2008, Human brain mapping.

[12]  Jeremy D. Cohen,et al.  Skilled motor learning does not enhance long-term depression in the motor cortex in vivo. , 2005, Journal of neurophysiology.

[13]  Woodrow L. Shew,et al.  Adaptation towards scale-free dynamics improves cortical stimulus discrimination at the cost of reduced detection , 2017, PLoS Comput. Biol..

[14]  R. J. van Beers,et al.  The role of execution noise in movement variability. , 2004, Journal of neurophysiology.

[15]  Jochen Triesch,et al.  Spike avalanches in vivo suggest a driven, slightly subcritical brain state , 2014, Front. Syst. Neurosci..

[16]  Albert-László Barabási,et al.  Control Principles of Complex Networks , 2015, ArXiv.

[17]  Viola Priesemann,et al.  Neuronal Avalanches Differ from Wakefulness to Deep Sleep – Evidence from Intracranial Depth Recordings in Humans , 2013, PLoS Comput. Biol..

[18]  K. Shenoy,et al.  Temporal complexity and heterogeneity of single-neuron activity in premotor and motor cortex. , 2007, Journal of neurophysiology.

[19]  M. Nicolelis,et al.  Spike Avalanches Exhibit Universal Dynamics across the Sleep-Wake Cycle , 2010, PloS one.

[20]  Mahmood S. Hoseini,et al.  Coherent and intermittent ensemble oscillations emerge from networks of irregular spiking neurons. , 2016, Journal of neurophysiology.

[21]  Elly Nedivi,et al.  Inhibitory Synapses Are Repeatedly Assembled and Removed at Persistent Sites In Vivo , 2016, Neuron.

[22]  Robert Leech,et al.  The characteristic patterns of neuronal avalanches in mice under anesthesia and at rest: An investigation using constrained artificial neural networks , 2018, PloS one.

[23]  Jochen Triesch,et al.  Criticality meets learning: Criticality signatures in a self-organizing recurrent neural network , 2017, PloS one.

[24]  L. Paninski,et al.  Spatiotemporal tuning of motor cortical neurons for hand position and velocity. , 2004, Journal of neurophysiology.

[25]  Gustavo Deco,et al.  Spontaneous cortical activity is transiently poised close to criticality , 2017, PLoS Comput. Biol..

[26]  J. Donoghue,et al.  Plasticity and primary motor cortex. , 2000, Annual review of neuroscience.

[27]  C. Mehring,et al.  Inference of hand movements from local field potentials in monkey motor cortex , 2003, Nature Neuroscience.

[28]  Oren Shriki,et al.  Near-Critical Dynamics in Stimulus-Evoked Activity of the Human Brain and Its Relation to Spontaneous Resting-State Activity , 2015, The Journal of Neuroscience.

[29]  R. Yuste,et al.  Neocortical activity is stimulus- and scale-invariant , 2017, PLoS ONE.

[30]  J F Mejias,et al.  Optimal heterogeneity for coding in spiking neural networks. , 2012, Physical review letters.

[31]  Matthias Bethge,et al.  Benchmarking Spike Rate Inference in Population Calcium Imaging , 2016, Neuron.

[32]  Haim Sompolinsky,et al.  Chaotic Balanced State in a Model of Cortical Circuits , 1998, Neural Computation.

[33]  Takaki Komiyama,et al.  Subtype-specific plasticity of inhibitory circuits in motor cortex during motor learning , 2015, Nature Neuroscience.

[34]  T. Komiyama,et al.  Transformation of Cortex-wide Emergent Properties during Motor Learning , 2017, Neuron.

[35]  Selmaan N. Chettih,et al.  Dynamic Reorganization of Neuronal Activity Patterns in Parietal Cortex , 2017, Cell.

[36]  A. Hobolth,et al.  A general framework for moment-based analysis of genetic data , 2019, Journal of Mathematical Biology.

[37]  Taro Kiritani,et al.  Sublayer-specific microcircuits of corticospinal and corticostriatal neurons in motor cortex , 2010, Nature Neuroscience.

[38]  Ralf Wessel,et al.  Cortical Circuit Dynamics Are Homeostatically Tuned to Criticality In Vivo , 2019, Neuron.

[39]  Woodrow L. Shew,et al.  Predicting criticality and dynamic range in complex networks: effects of topology. , 2010, Physical review letters.

[40]  Woodrow L. Shew,et al.  Neuronal Avalanches Imply Maximum Dynamic Range in Cortical Networks at Criticality , 2009, The Journal of Neuroscience.

[41]  Woodrow L. Shew,et al.  State-dependent intrinsic predictability of cortical network dynamics , 2015, PLoS Comput. Biol..

[42]  Claudia Clopath,et al.  Variance and invariance of neuronal long-term representations , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[43]  Yoshikazu Isomura,et al.  Two distinct layer-specific dynamics of cortical ensembles during learning of a motor task , 2014, Nature Neuroscience.

[44]  Steven Laureys,et al.  Large-scale signatures of unconsciousness are consistent with a departure from critical dynamics , 2015, Journal of The Royal Society Interface.

[45]  Simon X. Chen,et al.  Emergence of reproducible spatiotemporal activity during motor learning , 2014, Nature.

[46]  Mikhail A Lebedev,et al.  Stable Ensemble Performance with Single-neuron Variability during Reaching Movements in Primates , 2022 .

[47]  M. Rioult-Pedotti,et al.  Transient Spine Expansion and Learning-Induced Plasticity in Layer 1 Primary Motor Cortex , 2008, The Journal of Neuroscience.

[48]  S. Kauffman,et al.  Robustness and evolvability in genetic regulatory networks. , 2007, Journal of theoretical biology.

[49]  J. M. Herrmann,et al.  Phase transitions towards criticality in a neural system with adaptive interactions. , 2009, Physical review letters.

[50]  Mark E. J. Newman,et al.  Power-Law Distributions in Empirical Data , 2007, SIAM Rev..

[51]  Johannes Zierenberg,et al.  Homeostatic plasticity and external input shape neural network dynamics , 2018, bioRxiv.

[52]  Takaki Komiyama,et al.  Learning in the Rodent Motor Cortex. , 2017, Annual review of neuroscience.

[53]  Lacey J. Kitch,et al.  Long-term dynamics of CA1 hippocampal place codes , 2013, Nature Neuroscience.

[54]  E. Bizzi,et al.  Motor Learning with Unstable Neural Representations , 2007, Neuron.

[55]  Golomb,et al.  Dynamics of globally coupled inhibitory neurons with heterogeneity. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[56]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[57]  Massimo Scanziani,et al.  Reorganization of Recurrent Layer 5 Corticospinal Networks Following Adult Motor Training , 2019, The Journal of Neuroscience.

[58]  John M. Beggs,et al.  Being Critical of Criticality in the Brain , 2012, Front. Physio..

[59]  G. Shepherd,et al.  Motor cortex microcircuits , 2013, Front. Neural Circuits.

[60]  M. A. Muñoz Colloquium: Criticality and dynamical scaling in living systems , 2017, Reviews of Modern Physics.

[61]  A B Schwartz,et al.  Motor cortical representation of speed and direction during reaching. , 1999, Journal of neurophysiology.

[62]  Rafael Yuste,et al.  Fast nonnegative deconvolution for spike train inference from population calcium imaging. , 2009, Journal of neurophysiology.

[63]  Willie F. Tobin,et al.  Rapid formation and selective stabilization of synapses for enduring motor memories , 2009, Nature.

[64]  K. Harris,et al.  Cortical state and attention , 2011, Nature Reviews Neuroscience.

[65]  Jens Wilting,et al.  Inferring collective dynamical states from widely unobserved systems , 2016, Nature Communications.

[66]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[67]  Woodrow L. Shew,et al.  Adaptation to sensory input tunes visual cortex to criticality , 2015, Nature Physics.

[68]  D. Plenz,et al.  Stability of neuronal avalanches and long-range temporal correlations during the first year of life in human infants , 2020, Brain Structure and Function.

[69]  Anna R. Chambers,et al.  A stable brain from unstable components: Emerging concepts and implications for neural computation , 2017, Neuroscience.

[70]  Andreas Klaus,et al.  Irregular spiking of pyramidal neurons organizes as scale-invariant neuronal avalanches in the awake state , 2015, eLife.

[71]  Pico Caroni,et al.  Parvalbumin-expressing basket-cell network plasticity induced by experience regulates adult learning , 2013, Nature.

[72]  John M Beggs,et al.  Critical branching captures activity in living neural networks and maximizes the number of metastable States. , 2005, Physical review letters.

[73]  Xiao-Jing Wang,et al.  Task representations in neural networks trained to perform many cognitive tasks , 2019, Nature Neuroscience.

[74]  Andreas Schulze-Bonhage,et al.  Prediction of arm movement trajectories from ECoG-recordings in humans , 2008, Journal of Neuroscience Methods.

[75]  Nils Bertschinger,et al.  Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks , 2004, Neural Computation.

[76]  Takaki Komiyama,et al.  Reorganization of corticospinal output during motor learning , 2017, Nature Neuroscience.

[77]  Amiram Grinvald,et al.  Critical dynamics, anesthesia and information integration: Lessons from multi-scale criticality analysis of voltage imaging data , 2018, NeuroImage.

[78]  Gary C. Sing,et al.  Primitives for Motor Adaptation Reflect Correlated Neural Tuning to Position and Velocity , 2009, Neuron.

[79]  D. Plenz,et al.  Neuronal avalanches organize as nested theta- and beta/gamma-oscillations during development of cortical layer 2/3 , 2008, Proceedings of the National Academy of Sciences.

[80]  Luc Berthouze,et al.  Identification of Criticality in Neuronal Avalanches: II. A Theoretical and Empirical Investigation of the Driven Case , 2013, Journal of mathematical neuroscience.

[81]  S. Leibler,et al.  Robustness in simple biochemical networks , 1997, Nature.

[82]  Viola Priesemann,et al.  Control of criticality and computation in spiking neuromorphic networks with plasticity , 2020, Nature Communications.

[83]  Nicholas Bennett,et al.  Analysis of Power Laws, Shape Collapses, and Neural Complexity: New Techniques and MATLAB Support via the NCC Toolbox , 2016, Front. Physiol..

[84]  Woodrow L. Shew,et al.  Information Capacity and Transmission Are Maximized in Balanced Cortical Networks with Neuronal Avalanches , 2010, The Journal of Neuroscience.

[85]  Karel Svoboda,et al.  Learning-related fine-scale specificity imaged in motor cortex circuits of behaving mice , 2010, Nature.

[86]  Woodrow L. Shew,et al.  Inhibition causes ceaseless dynamics in networks of excitable nodes. , 2013, Physical review letters.

[87]  James K. Johnson,et al.  Single-Cell Membrane Potential Fluctuations Evince Network Scale-Freeness and Quasicriticality , 2019, The Journal of Neuroscience.

[88]  J. Sethna,et al.  Crackling noise , 2001, Nature.

[89]  Jaume Casademunt,et al.  Noise focusing and the emergence of coherent activity in neuronal cultures , 2013, Nature Physics.

[90]  K. Linkenkaer-Hansen,et al.  Critical-State Dynamics of Avalanches and Oscillations Jointly Emerge from Balanced Excitation/Inhibition in Neuronal Networks , 2012, The Journal of Neuroscience.

[91]  W. Gan,et al.  Stably maintained dendritic spines are associated with lifelong memories , 2009, Nature.

[92]  Woodrow L. Shew,et al.  Induced cortical oscillations in turtle cortex are coherent at the mesoscale of population activity, but not at the microscale of the membrane potential of neurons. , 2017, Journal of neurophysiology.

[93]  J. Donoghue,et al.  Learning-induced LTP in neocortex. , 2000, Science.

[94]  A. Aertsen,et al.  Predominance of Movement Speed Over Direction in Neuronal Population Signals of Motor Cortex: Intracranial EEG Data and A Simple Explanatory Model , 2016, Cerebral cortex.

[95]  Andreas Klaus,et al.  The Interplay between Long- and Short-Range Temporal Correlations Shapes Cortex Dynamics across Vigilance States , 2017, The Journal of Neuroscience.

[96]  W. Singer,et al.  Neuronal avalanches in spontaneous activity in vivo. , 2010, Journal of neurophysiology.

[97]  E. Bizzi,et al.  Neuronal Correlates of Motor Performance and Motor Learning in the Primary Motor Cortex of Monkeys Adapting to an External Force Field , 2001, Neuron.

[98]  Mark J. Schnitzer,et al.  Impermanence of dendritic spines in live adult CA1 hippocampus , 2015, Nature.

[99]  A B Schwartz,et al.  Direct cortical representation of drawing. , 1994, Science.

[100]  J. M. Herrmann,et al.  Dynamical synapses causing self-organized criticality in neural networks , 2007, 0712.1003.

[101]  J. Hopfield,et al.  Earthquake cycles and neural reverberations: Collective oscillations in systems with pulse-coupled threshold elements. , 1995, Physical review letters.

[102]  John M Beggs,et al.  The criticality hypothesis: how local cortical networks might optimize information processing , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[103]  Woodrow L. Shew,et al.  The Functional Benefits of Criticality in the Cortex , 2013, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[104]  John M. Beggs,et al.  Universal critical dynamics in high resolution neuronal avalanche data. , 2012, Physical review letters.

[105]  J. Simon Wiegert,et al.  Multiple dynamic representations in the motor cortex during sensorimotor learning , 2012, Nature.

[106]  Brice Bathellier,et al.  A multiplicative reinforcement learning model capturing learning dynamics and interindividual variability in mice , 2013, Proceedings of the National Academy of Sciences.

[107]  Jianing Yu,et al.  Top-down laminar organization of the excitatory network in motor cortex , 2008, Nature Neuroscience.

[108]  Woodrow L. Shew,et al.  Cascades and Cognitive State: Focused Attention Incurs Subcritical Dynamics , 2015, The Journal of Neuroscience.

[109]  F. Mussa-Ivaldi,et al.  Do neurons in the motor cortex encode movement direction? An alternative hypothesis , 1988, Neuroscience Letters.

[110]  S. Scarpetta,et al.  Hysteresis, neural avalanches, and critical behavior near a first-order transition of a spiking neural network. , 2018, Physical review. E.

[111]  J. Wilting,et al.  25 years of criticality in neuroscience — established results, open controversies, novel concepts , 2019, Current Opinion in Neurobiology.

[112]  Shan Yu,et al.  Maintained avalanche dynamics during task-induced changes of neuronal activity in nonhuman primates , 2017, eLife.

[113]  K. Linkenkaer-Hansen Scaling and Criticality in Large-Scale Neuronal Activity , 2003 .

[114]  Ju Lu,et al.  REPETITIVE MOTOR LEARNING INDUCES COORDINATED FORMATION OF CLUSTERED DENDRITIC SPINES IN VIVO , 2012, Nature.

[115]  Misha Tsodyks,et al.  The Emergence of Up and Down States in Cortical Networks , 2006, PLoS Comput. Biol..

[116]  Carson C. Chow,et al.  Synchronization and Oscillatory Dynamics in Heterogeneous, Mutually Inhibited Neurons , 1998, Journal of Computational Neuroscience.

[117]  Yogesh Virkar,et al.  Power-law distributions in binned empirical data , 2012, 1208.3524.

[118]  Valentin Dragoi,et al.  Efficient coding in heterogeneous neuronal populations , 2008, Proceedings of the National Academy of Sciences.

[119]  D. Plenz,et al.  Spontaneous cortical activity in awake monkeys composed of neuronal avalanches , 2009, Proceedings of the National Academy of Sciences.

[120]  Kimberlyn A Bailey,et al.  Decline of long-range temporal correlations in the human brain during sustained wakefulness , 2017, Scientific Reports.

[121]  Pedro V. Carelli,et al.  Criticality between cortical states , 2018, bioRxiv.