Distributed Dynamical Computation in Neural Circuits with Propagating Coherent Activity Patterns

Activity in neural circuits is spatiotemporally organized. Its spatial organization consists of multiple, localized coherent patterns, or patchy clusters. These patterns propagate across the circuits over time. This type of collective behavior has ubiquitously been observed, both in spontaneous activity and evoked responses; its function, however, has remained unclear. We construct a spatially extended, spiking neural circuit that generates emergent spatiotemporal activity patterns, thereby capturing some of the complexities of the patterns observed empirically. We elucidate what kind of fundamental function these patterns can serve by showing how they process information. As self-sustained objects, localized coherent patterns can signal information by propagating across the neural circuit. Computational operations occur when these emergent patterns interact, or collide with each other. The ongoing behaviors of these patterns naturally embody both distributed, parallel computation and cascaded logical operations. Such distributed computations enable the system to work in an inherently flexible and efficient way. Our work leads us to propose that propagating coherent activity patterns are the underlying primitives with which neural circuits carry out distributed dynamical computation.

[1]  Kenneth Showalter,et al.  Control of waves, patterns and turbulence in chemical systems , 2006 .

[2]  J. Bouchaud,et al.  Anomalous diffusion in disordered media: Statistical mechanisms, models and physical applications , 1990 .

[3]  N. Hatsopoulos,et al.  Propagating waves mediate information transfer in the motor cortex , 2006, Nature Neuroscience.

[4]  E. Halgren,et al.  Dynamic Statistical Parametric Mapping Combining fMRI and MEG for High-Resolution Imaging of Cortical Activity , 2000, Neuron.

[5]  K. Linkenkaer-Hansen,et al.  Long-Range Temporal Correlations and Scaling Behavior in Human Brain Oscillations , 2001, The Journal of Neuroscience.

[6]  Anthony J. G. Hey,et al.  Feynman Lectures on Computation , 1996 .

[7]  Stephen Coombes,et al.  Waves, bumps, and patterns in neural field theories , 2005, Biological Cybernetics.

[8]  Alwyn C. Scott,et al.  Nonlinear Science: Emergence and Dynamics of Coherent Structures , 1999 .

[9]  Y. Kivshar,et al.  Introduction: Nonlinear localized modes. , 2003, Chaos.

[10]  Robert A. Frazor,et al.  Standing Waves and Traveling Waves Distinguish Two Circuits in Visual Cortex , 2007, Neuron.

[11]  B. Ermentrout Neural networks as spatio-temporal pattern-forming systems , 1998 .

[12]  Karl J. Friston,et al.  The Dynamic Brain: From Spiking Neurons to Neural Masses and Cortical Fields , 2008, PLoS Comput. Biol..

[13]  C. Leeuwen,et al.  Scale-invariant fluctuations of the dynamical synchronization in human brain electrical activity , 2003, Neuroscience Letters.

[14]  P. Adorján,et al.  Axonal topography of cortical basket cells in relation to orientation, direction, and ocular dominance maps , 2001, The Journal of comparative neurology.

[15]  T. Gelder,et al.  Mind as Motion: Explorations in the Dynamics of Cognition , 1995 .

[16]  A. Opstal Dynamic Patterns: The Self-Organization of Brain and Behavior , 1995 .

[17]  D. Senseman,et al.  High-speed VSD imaging of visually evoked cortical waves: decomposition into intra- and intercortical wave motions. , 2002, Journal of neurophysiology.

[18]  D. Kleinfeld,et al.  Distributed representation of vibrissa movement in the upper layers of somatosensory cortex revealed with voltage‐sensitive dyes , 1996, The Journal of comparative neurology.

[19]  Boris S. Gutkin,et al.  Multiple Bumps in a Neuronal Model of Working Memory , 2002, SIAM J. Appl. Math..

[20]  Zenon W. Pylyshyn,et al.  Computation and Cognition: Toward a Foundation for Cognitive Science , 1984 .

[21]  M. Newman Power laws, Pareto distributions and Zipf's law , 2005 .

[22]  G. Shepherd The Synaptic Organization of the Brain , 1979 .

[23]  M. Weliky,et al.  Small modulation of ongoing cortical dynamics by sensory input during natural vision , 2004, Nature.

[24]  F. Haiss,et al.  Spatiotemporal Dynamics of Cortical Sensorimotor Integration in Behaving Mice , 2007, Neuron.

[25]  A. Grinvald,et al.  Imaging Spatiotemporal Dynamics of Surround Inhibition in the Barrels Somatosensory Cortex , 2003, The Journal of Neuroscience.

[26]  I. Fried,et al.  Coupling Between Neuronal Firing, Field Potentials, and fMRI in Human Auditory Cortex , 2005, Science.

[27]  N. Margolus Physics-like models of computation☆ , 1984 .

[28]  P. Roland,et al.  Cortical feedback depolarization waves: A mechanism of top-down influence on early visual areas , 2006, Proceedings of the National Academy of Sciences.

[29]  Lee M. Miller,et al.  Measuring temporal dynamics of functional networks using phase spectrum of fMRI data , 2005, NeuroImage.

[30]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[31]  Usher,et al.  Dynamic pattern formation leads to 1/f noise in neural populations. , 1995, Physical review letters.

[32]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[33]  S. Grillner,et al.  Microcircuits : the interface between neurons and global brain function , 2006 .

[34]  Robert W. Keyes,et al.  Physics of digital devices , 1989 .

[35]  W. Freeman,et al.  Analysis of spatial patterns of phase in neocortical gamma EEGs in rabbit. , 2000, Journal of neurophysiology.

[36]  Justin L. Vincent,et al.  Intrinsic functional architecture in the anaesthetized monkey brain , 2007, Nature.

[37]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[38]  Pulin Gong,et al.  Dynamically maintained spike timing sequences in networks of pulse-coupled oscillators with delays. , 2007, Physical review letters.

[39]  T. Toffoli,et al.  Conservative logic , 2002, Collision-Based Computing.

[40]  周建和,et al.  Anomalous Diffusion in Disordered Media , 2000 .

[41]  D. Rumelhart Parallel Distributed Processing Volume 1: Foundations , 1987 .

[42]  Reinhard Eckhorn,et al.  A multi-channel correlation method detects traveling γ-waves in monkey visual cortex , 2003, Journal of Neuroscience Methods.

[43]  Jian-Young Wu,et al.  Compression and Reflection of Visually Evoked Cortical Waves , 2007, Neuron.

[44]  M. Breakspear,et al.  Bistability and Non-Gaussian Fluctuations in Spontaneous Cortical Activity , 2009, The Journal of Neuroscience.

[45]  Feng Qi Han,et al.  Reverberation of Recent Visual Experience in Spontaneous Cortical Waves , 2008, Neuron.

[46]  A Grinvald,et al.  Coherent spatiotemporal patterns of ongoing activity revealed by real-time optical imaging coupled with single-unit recording in the cat visual cortex. , 1995, Journal of neurophysiology.

[47]  Reinhard Eckhorn,et al.  A multi-channel correlation method detects traveling gamma-waves in monkey visual cortex. , 2003, Journal of neuroscience methods.

[48]  K. D. Singh,et al.  Magnetic field tomography of coherent thalamocortical 40-Hz oscillations in humans. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[49]  Maurizio Corbetta,et al.  The human brain is intrinsically organized into dynamic, anticorrelated functional networks. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[50]  W. Precht The synaptic organization of the brain G.M. Shepherd, Oxford University Press (1975). 364 pp., £3.80 (paperback) , 1976, Neuroscience.

[51]  D. Kleinfeld,et al.  Visual stimuli induce waves of electrical activity in turtle cortex. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[52]  Aaditya V. Rangan,et al.  Modeling the spatiotemporal cortical activity associated with the line-motion illusion in primary visual cortex. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[53]  Evgueniy V. Lubenov,et al.  Hippocampal theta oscillations are travelling waves , 2009, Nature.

[54]  A. Grinvald,et al.  Spontaneously emerging cortical representations of visual attributes , 2003, Nature.

[55]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[56]  Stephanie Forrest,et al.  Emergent computation: self-organizing, collective, and cooperative phenomena in natural and artificial computing networks , 1990 .

[57]  Y. Lam,et al.  Odors Elicit Three Different Oscillations in the Turtle Olfactory Bulb , 2000, The Journal of Neuroscience.

[58]  L. C. Katz,et al.  Spatiotemporal patterns of excitation and inhibition evoked by the horizontal network in layer 2/3 of ferret visual cortex. , 2003, Journal of neurophysiology.

[59]  S. Havlin,et al.  Diffusion and Reactions in Fractals and Disordered Systems , 2000 .

[60]  D. Kleinfeld,et al.  Traveling Electrical Waves in Cortex Insights from Phase Dynamics and Speculation on a Computational Role , 2001, Neuron.

[61]  Aaditya V. Rangan,et al.  Architectural and synaptic mechanisms underlying coherent spontaneous activity in V1. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[62]  Walter J. Freeman,et al.  A Neurobiological Theory of Meaning in Perception. , 2022 .

[63]  Ad Aertsen,et al.  Stable propagation of synchronous spiking in cortical neural networks , 1999, Nature.

[64]  E. Callaway Local circuits in primary visual cortex of the macaque monkey. , 1998, Annual review of neuroscience.

[66]  M. Cross,et al.  Pattern formation outside of equilibrium , 1993 .

[67]  Walter J. Freeman,et al.  A neurobiological theory of meaning in perception , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[68]  Philipp Slusallek,et al.  Introduction to real-time ray tracing , 2005, SIGGRAPH Courses.

[69]  J A Kelso,et al.  Spatiotemporal pattern formation in neural systems with heterogeneous connection topologies. , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.