Dynamical systems, attractors, and neural circuits

Biology is the study of dynamical systems. Yet most of us working in biology have limited pedagogical training in the theory of dynamical systems, an unfortunate historical fact that can be remedied for future generations of life scientists. In my particular field of systems neuroscience, neural circuits are rife with nonlinearities at all levels of description, rendering simple methodologies and our own intuition unreliable. Therefore, our ideas are likely to be wrong unless informed by good models. These models should be based on the mathematical theories of dynamical systems since functioning neurons are dynamic—they change their membrane potential and firing rates with time. Thus, selecting the appropriate type of dynamical system upon which to base a model is an important first step in the modeling process. This step all too easily goes awry, in part because there are many frameworks to choose from, in part because the sparsely sampled data can be consistent with a variety of dynamical processes, and in part because each modeler has a preferred modeling approach that is difficult to move away from. This brief review summarizes some of the main dynamical paradigms that can arise in neural circuits, with comments on what they can achieve computationally and what signatures might reveal their presence within empirical data. I provide examples of different dynamical systems using simple circuits of two or three cells, emphasizing that any one connectivity pattern is compatible with multiple, diverse functions.

[1]  Chris Eliasmith,et al.  A Controlled Attractor Network Model of Path Integration in the Rat , 2005, Journal of Computational Neuroscience.

[2]  G. Tononi,et al.  Cortical Development, Electroencephalogram Rhythms, and the Sleep/Wake Cycle , 2015, Biological Psychiatry.

[3]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[4]  Ichiro Tsuda,et al.  Chaotic itinerancy and its roles in cognitive neurodynamics , 2015, Current Opinion in Neurobiology.

[5]  M. Shadlen,et al.  Neural Activity in Macaque Parietal Cortex Reflects Temporal Integration of Visual Motion Signals during Perceptual Decision Making , 2005, The Journal of Neuroscience.

[6]  Xiao-Jing Wang,et al.  Internal Representation of Task Rules by Recurrent Dynamics: The Importance of the Diversity of Neural Responses , 2010, Front. Comput. Neurosci..

[7]  Y. Arshavsky,et al.  Winnerless competition between sensory neurons generates chaos: A possible mechanism for molluscan hunting behavior. , 2002, Chaos.

[8]  S. Yoshizawa,et al.  An Active Pulse Transmission Line Simulating Nerve Axon , 1962, Proceedings of the IRE.

[9]  S. Hughes,et al.  The slow (<1 Hz) rhythm of non-REM sleep: a dialogue between three cardinal oscillators , 2010, Nature Neuroscience.

[10]  C. van Vreeswijk,et al.  What Is the Neural Code , 2006 .

[11]  Paul Miller,et al.  Stimulus number, duration and intensity encoding in randomly connected attractor networks with synaptic depression , 2013, Front. Comput. Neurosci..

[12]  Eric J Friedman,et al.  Hierarchical networks, power laws, and neuronal avalanches. , 2013, Chaos.

[13]  H. Berger Über das Elektrenkephalogramm des Menschen , 1938, Archiv für Psychiatrie und Nervenkrankheiten.

[14]  H. J. Herrmann,et al.  Brain modularity controls the critical behavior of spontaneous activity , 2014, Scientific Reports.

[15]  Peter Dayan,et al.  A Hierarchical Model of Binocular Rivalry , 1998, Neural Computation.

[16]  J. Hupé,et al.  Temporal Dynamics of Auditory and Visual Bistability Reveal Common Principles of Perceptual Organization , 2006, Current Biology.

[17]  Y. Miyashita Neuronal correlate of visual associative long-term memory in the primate temporal cortex , 1988, Nature.

[18]  Jonathan W. Pillow,et al.  Single-trial spike trains in parietal cortex reveal discrete steps during decision-making , 2015, Science.

[19]  G. Deco,et al.  Ongoing Cortical Activity at Rest: Criticality, Multistability, and Ghost Attractors , 2012, The Journal of Neuroscience.

[20]  T Poston,et al.  Nonlinear modeling of multistable perception. , 1978, Behavioral science.

[21]  S. Raghavachari,et al.  Gating of Human Theta Oscillations by a Working Memory Task , 2001, The Journal of Neuroscience.

[22]  A. Pouget,et al.  Efficient computation and cue integration with noisy population codes , 2001, Nature Neuroscience.

[23]  H. Sebastian Seung,et al.  The Autapse: A Simple Illustration of Short-Term Analog Memory Storage by Tuned Synaptic Feedback , 2004, Journal of Computational Neuroscience.

[24]  E. Miller,et al.  Task-Dependent Changes in Short-Term Memory in the Prefrontal Cortex , 2010, The Journal of Neuroscience.

[25]  Xiao-Jing Wang Neurophysiological and computational principles of cortical rhythms in cognition. , 2010, Physiological reviews.

[26]  E. Marder,et al.  Principles of rhythmic motor pattern generation. , 1996, Physiological reviews.

[27]  Gustavo Deco,et al.  Deterministic analysis of stochastic bifurcations in multi-stable neurodynamical systems , 2007, Biological Cybernetics.

[28]  B. McNaughton,et al.  Paradoxical Effects of External Modulation of Inhibitory Interneurons , 1997, The Journal of Neuroscience.

[29]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[30]  Xiao-Song Yang,et al.  Complex dynamics in simple Hopfield neural networks. , 2006, Chaos.

[31]  Paul Miller,et al.  Power-law neuronal fluctuations in a recurrent network model of parametric working memory. , 2006, Journal of neurophysiology.

[32]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[33]  John J. Hopfield,et al.  Understanding Emergent Dynamics: Using a Collective Activity Coordinate of a Neural Network to Recognize Time-Varying Patterns , 2015, Neural Computation.

[34]  R. Desimone,et al.  Modulation of Oscillatory Neuronal Synchronization by Selective Visual Attention , 2001, Science.

[35]  H S Seung,et al.  How the brain keeps the eyes still. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[36]  Daniel D. Lee,et al.  Stability of the Memory of Eye Position in a Recurrent Network of Conductance-Based Model Neurons , 2000, Neuron.

[37]  J. Lisman,et al.  The Theta-Gamma Neural Code , 2013, Neuron.

[38]  N. Brunel Persistent activity and the single-cell frequency–current curve in a cortical network model , 2000, Network.

[39]  Haim Sompolinsky,et al.  Chaotic Balanced State in a Model of Cortical Circuits , 1998, Neural Computation.

[40]  Dean V. Buonomano,et al.  Neural Network Model of the Cerebellum: Temporal Discrimination and the Timing of Motor Responses , 1999, Neural Computation.

[41]  V. Zhigulin,et al.  On the origin of reproducible sequential activity in neural circuits. , 2004, Chaos.

[42]  X. Wang,et al.  Synaptic Basis of Cortical Persistent Activity: the Importance of NMDA Receptors to Working Memory , 1999, The Journal of Neuroscience.

[43]  G. Buzsáki,et al.  Neuronal Oscillations in Cortical Networks , 2004, Science.

[44]  R. Romo,et al.  Neuronal correlates of parametric working memory in the prefrontal cortex , 1999, Nature.

[45]  Angus Chadwick,et al.  Independent theta phase coding accounts for CA1 population sequences and enables flexible remapping , 2014, bioRxiv.

[46]  K. Zhang,et al.  Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[47]  A. Gorea,et al.  Perceptual bistability with counterphase gratings , 1984, Vision Research.

[48]  John M Beggs,et al.  The criticality hypothesis: how local cortical networks might optimize information processing , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[49]  John M. Beggs,et al.  Universal critical dynamics in high resolution neuronal avalanche data. , 2012, Physical review letters.

[50]  A. Koulakov,et al.  Model for a robust neural integrator , 2002, Nature Neuroscience.

[51]  Sommers,et al.  Chaos in random neural networks. , 1988, Physical review letters.

[52]  Thomas C. Toppino,et al.  Time for a change: What dominance durations reveal about adaptation effects in the perception of a bi-stable reversible figure , 2014, Attention, Perception, & Psychophysics.

[53]  P. Miller,et al.  Stochastic Transitions between Neural States in Taste Processing and Decision-Making , 2010, The Journal of Neuroscience.

[54]  R. FitzHugh Impulses and Physiological States in Theoretical Models of Nerve Membrane. , 1961, Biophysical journal.

[55]  Xiao-Jing Wang,et al.  The importance of mixed selectivity in complex cognitive tasks , 2013, Nature.

[56]  Paul Miller,et al.  Accuracy and response-time distributions for decision-making: linear perfect integrators versus nonlinear attractor-based neural circuits , 2013, Journal of Computational Neuroscience.

[57]  S Grossberg,et al.  Some nonlinear networks capable of learning a spatial pattern of arbitrary complexity. , 1968, Proceedings of the National Academy of Sciences of the United States of America.

[58]  A. Pérez-Villalba Rhythms of the Brain, G. Buzsáki. Oxford University Press, Madison Avenue, New York (2006), Price: GB £42.00, p. 448, ISBN: 0-19-530106-4 , 2008 .

[59]  P. Goldman-Rakic,et al.  Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. , 2000, Cerebral cortex.

[60]  Alfredo Fontanini,et al.  7 to 12 Hz activity in rat gustatory cortex reflects disengagement from a fluid self-administration task. , 2005, Journal of neurophysiology.

[61]  R. Quinn,et al.  Designing responsive pattern generators: stable heteroclinic channel cycles for modeling and control , 2015, Bioinspiration & biomimetics.

[62]  Peter E. Latham,et al.  Computing and Stability in Cortical Networks , 2004, Neural Computation.

[63]  D. Buonomano,et al.  Complexity without chaos: Plasticity within random recurrent networks generates robust timing and motor control , 2012, 1210.2104.

[64]  Pablo Balenzuela,et al.  Criticality in Large-Scale Brain fMRI Dynamics Unveiled by a Novel Point Process Analysis , 2012, Front. Physio..

[65]  D. Knill,et al.  Bayesian sampling in visual perception , 2011, Proceedings of the National Academy of Sciences.

[66]  Ramón Huerta,et al.  Dynamics of sequential decision making. , 2006, Physical review letters.

[67]  Kenneth D. Miller,et al.  Analysis of the Stabilized Supralinear Network , 2012, Neural Computation.

[68]  Christian Bick,et al.  Dynamical origin of the effective storage capacity in the brain's working memory. , 2009, Physical review letters.

[69]  J. Hupé,et al.  Bistability for audiovisual stimuli: Perceptual decision is modality specific. , 2008, Journal of vision.

[70]  Naftali Tishby,et al.  Hidden Markov modelling of simultaneously recorded cells in the associative cortex of behaving monkeys , 1997 .

[71]  J. Lisman,et al.  Position reconstruction from an ensemble of hippocampal place cells: contribution of theta phase coding. , 2000, Journal of neurophysiology.

[72]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[73]  Christopher D. Harvey,et al.  Recurrent Network Models of Sequence Generation and Memory , 2016, Neuron.

[74]  Ramón Huerta,et al.  Reproducible sequence generation in random neural ensembles. , 2004, Physical review letters.

[75]  Walter J Freeman,et al.  Mechanism and significance of global coherence in scalp EEG , 2015, Current Opinion in Neurobiology.

[76]  Izhar Bar-Gad,et al.  Quantifying Spike Train Oscillations: Biases, Distortions and Solutions , 2015, PLoS Comput. Biol..

[77]  L. Abbott,et al.  From fixed points to chaos: Three models of delayed discrimination , 2013, Progress in Neurobiology.

[78]  Andrew M. Clark,et al.  Stimulus onset quenches neural variability: a widespread cortical phenomenon , 2010, Nature Neuroscience.

[79]  Nils Bertschinger,et al.  Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks , 2004, Neural Computation.

[80]  Alessandro Treves,et al.  Stable and Rapid Recurrent Processing in Realistic Autoassociative Memories , 1998, Neural Computation.

[81]  Dean V. Buonomano,et al.  ROBUST TIMING AND MOTOR PATTERNS BY TAMING CHAOS IN RECURRENT NEURAL NETWORKS , 2012, Nature Neuroscience.

[82]  E. Seidemann,et al.  Simultaneously recorded single units in the frontal cortex go through sequences of discrete and stable states in monkeys performing a delayed localization task , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[83]  Daniel B. Rubin,et al.  The Stabilized Supralinear Network: A Unifying Circuit Motif Underlying Multi-Input Integration in Sensory Cortex , 2015, Neuron.

[84]  A Treves,et al.  Associative memory neural network with low temporal spiking rates. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[85]  M. Tsodyks,et al.  Synaptic Theory of Working Memory , 2008, Science.

[86]  R. Romo,et al.  A recurrent network model of somatosensory parametric working memory in the prefrontal cortex. , 2003, Cerebral cortex.

[87]  H. Seung,et al.  Anatomy and discharge properties of pre-motor neurons in the goldfish medulla that have eye-position signals during fixations. , 2000, Journal of neurophysiology.

[88]  John M. Beggs,et al.  Being Critical of Criticality in the Brain , 2012, Front. Physio..

[89]  Sompolinsky,et al.  Willshaw model: Associative memory with sparse coding and low firing rates. , 1990, Physical review. A, Atomic, molecular, and optical physics.

[90]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[91]  J. Lisman The theta/gamma discrete phase code occuring during the hippocampal phase precession may be a more general brain coding scheme , 2005, Hippocampus.

[92]  Treves,et al.  Graded-response neurons and information encodings in autoassociative memories. , 1990, Physical review. A, Atomic, molecular, and optical physics.

[93]  H. Sompolinsky,et al.  Transition to chaos in random neuronal networks , 2015, 1508.06486.

[94]  L. F. Abbott,et al.  Generating Coherent Patterns of Activity from Chaotic Neural Networks , 2009, Neuron.

[95]  H. Barlow Vision: A computational investigation into the human representation and processing of visual information: David Marr. San Francisco: W. H. Freeman, 1982. pp. xvi + 397 , 1983 .

[96]  Paul Miller,et al.  Natural stimuli evoke dynamic sequences of states in sensory cortical ensembles , 2007, Proceedings of the National Academy of Sciences.

[97]  Changsong Zhou,et al.  Sustained Activity in Hierarchical Modular Neural Networks: Self-Organized Criticality and Oscillations , 2010, Front. Comput. Neurosci..

[98]  G. Buzsáki Hippocampal sharp wave‐ripple: A cognitive biomarker for episodic memory and planning , 2015, Hippocampus.

[99]  Carlos D. Brody,et al.  Design of Continuous Attractor Networks with Monotonic Tuning Using a Symmetry Principle , 2008, Neural Computation.

[100]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[101]  Michael J. Berry,et al.  Thermodynamics and signatures of criticality in a network of neurons , 2015, Proceedings of the National Academy of Sciences.

[102]  J. Rinzel,et al.  Noise-induced alternations in an attractor network model of perceptual bistability. , 2007, Journal of neurophysiology.

[103]  Naftali Tishby,et al.  Cortical activity flips among quasi-stationary states. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[104]  G. Buzsáki,et al.  Mechanisms of gamma oscillations. , 2012, Annual review of neuroscience.

[105]  P. Miller,et al.  The Behavioral Relevance of Cortical Neural Ensemble Responses Emerges Suddenly , 2016, The Journal of Neuroscience.

[106]  H Sompolinsky,et al.  Dynamics of random neural networks with bistable units. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[107]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[108]  Ramón Huerta,et al.  Transient Cognitive Dynamics, Metastability, and Decision Making , 2008, PLoS Comput. Biol..

[109]  Xiao-Jing Wang,et al.  Angular Path Integration by Moving “Hill of Activity”: A Spiking Neuron Model without Recurrent Excitation of the Head-Direction System , 2005, The Journal of Neuroscience.

[110]  Peter E. Latham,et al.  Optimal computation with attractor networks , 2003, Journal of Physiology-Paris.

[111]  M M Merzenich,et al.  Temporal information transformed into a spatial code by a neural network with realistic properties , 1995, Science.

[112]  L. Abbott,et al.  Stimulus-dependent suppression of chaos in recurrent neural networks. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.