Neural Assembly Computing

Spiking neurons can realize several computational operations when firing cooperatively. This is a prevalent notion, although the mechanisms are not yet understood. A way by which neural assemblies compute is proposed in this paper. It is shown how neural coalitions represent things (and world states), memorize them, and control their hierarchical relations in order to perform algorithms. It is described how neural groups perform statistic logic functions as they form assemblies. Neural coalitions can reverberate, becoming bistable loops. Such bistable neural assemblies become short- or long-term memories that represent the event that triggers them. In addition, assemblies can branch and dismantle other neural groups generating new events that trigger other coalitions. Hence, such capabilities and the interaction among assemblies allow neural networks to create and control hierarchical cascades of causal activities, giving rise to parallel algorithms. Computing and algorithms are used here as in a nonstandard computation approach. In this sense, neural assembly computing (NAC) can be seen as a new class of spiking neural network machines. NAC can explain the following points: 1) how neuron groups represent things and states; 2) how they retain binary states in memories that do not require any plasticity mechanism; and 3) how branching, disbanding, and interaction among assemblies may result in algorithms and behavioral responses. Simulations were carried out and the results are in agreement with the hypothesis presented. A MATLAB code is available as a supplementary material.

[1]  J. Milton,et al.  Multistability in recurrent neural loops arising from delay. , 2000, Journal of neurophysiology.

[2]  José Roberto Castilho Piqueira,et al.  Computing with phase locked loops: choosing gains and delays , 2003, IEEE Trans. Neural Networks.

[3]  Vivien A. Casagrande,et al.  Biophysics of Computation: Information Processing in Single Neurons , 1999 .

[4]  Xiao-Jing Wang Synaptic reverberation underlying mnemonic persistent activity , 2001, Trends in Neurosciences.

[5]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[6]  DeLiang Wang,et al.  Emergent synchrony in locally coupled neural oscillators , 1995, IEEE Trans. Neural Networks.

[7]  Richard Hans Robert Hahnloser,et al.  An ultra-sparse code underliesthe generation of neural sequences in a songbird , 2002, Nature.

[8]  José Roberto Castilho Piqueira,et al.  Global and partial synchronism in phase-locked loop networks , 2003, IEEE Trans. Neural Networks.

[9]  G. Buzsáki,et al.  Neuronal Oscillations in Cortical Networks , 2004, Science.

[10]  Asif A Ghazanfar,et al.  Hebb's Dream: The Resurgence of Cell Assemblies , 1997, Neuron.

[11]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[12]  G. Laurent,et al.  Odour encoding by temporal sequences of firing in oscillating neural assemblies , 1996, Nature.

[13]  W. Singer,et al.  Modulation of Neuronal Interactions Through Neuronal Synchronization , 2007, Science.

[14]  S. Nelson,et al.  Homeostatic plasticity in the developing nervous system , 2004, Nature Reviews Neuroscience.

[15]  M. W. Schwartz,et al.  Central nervous system control of food intake and body weight , 2006, Nature.

[16]  György Buzsáki,et al.  Neural Syntax: Cell Assemblies, Synapsembles, and Readers , 2010, Neuron.

[17]  A. Aertsen,et al.  Neuronal assemblies , 1989, IEEE Transactions on Biomedical Engineering.

[18]  G. Edelman,et al.  Spike-timing dynamics of neuronal groups. , 2004, Cerebral cortex.

[19]  T. Sejnowski,et al.  Correlated neuronal activity and the flow of neural information , 2001, Nature Reviews Neuroscience.

[20]  Qian Gao,et al.  Neurobiology of feeding and energy expenditure. , 2007, Annual review of neuroscience.

[21]  A. Compte Computational and in vitro studies of persistent activity: Edging towards cellular and synaptic mechanisms of working memory , 2006, Neuroscience.

[22]  E. Marder,et al.  Invertebrate Central Pattern Generation Moves along , 2005, Current Biology.

[23]  Chris I. De Zeeuw,et al.  Time windows and reverberating loops: a reverse-engineering approach to cerebellar function , 2008, The Cerebellum.

[24]  Damian J. Wallace,et al.  Chasing the cell assembly , 2010, Current Opinion in Neurobiology.

[25]  J. Martinerie,et al.  The brainweb: Phase synchronization and large-scale integration , 2001, Nature Reviews Neuroscience.

[26]  Hélène Paugam-Moisy,et al.  Algorithms for Structural and Dynamical Polychronous Groups Detection , 2009, ICANN.

[27]  João Eduardo Kögler,et al.  Bistable memory and binary counters in spiking neural network , 2011, 2011 IEEE Symposium on Foundations of Computational Intelligence (FOCI).

[28]  W. Singer,et al.  Dynamic predictions: Oscillations and synchrony in top–down processing , 2001, Nature Reviews Neuroscience.

[29]  Nicolas Brunel,et al.  Can Attractor Network Models Account for the Statistics of Firing During Persistent Activity in Prefrontal Cortex? , 2008, Front. Neurosci..

[30]  Moshe Abeles,et al.  Synfire chains , 2009, Scholarpedia.

[31]  Gilles Laurent,et al.  Olfactory network dynamics and the coding of multidimensional signals , 2002, Nature Reviews Neuroscience.

[32]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[33]  Kevin L. Briggman,et al.  Multifunctional pattern-generating circuits. , 2008, Annual review of neuroscience.

[34]  C. Curtis,et al.  Persistent activity in the prefrontal cortex during working memory , 2003, Trends in Cognitive Sciences.

[35]  M Abeles,et al.  Spatio-temporal firing patterns in the frontal cortex of behaving monkeys , 1996, Journal of Physiology-Paris.

[36]  E. Bienenstock A model of neocortex , 1995 .

[37]  G. Buzsáki Large-scale recording of neuronal ensembles , 2004, Nature Neuroscience.

[38]  H. Swadlow Efferent neurons and suspected interneurons in motor cortex of the awake rabbit: axonal properties, sensory receptive fields, and subthreshold synaptic inputs. , 1994, Journal of neurophysiology.

[39]  A. Pérez-Villalba Rhythms of the Brain, G. Buzsáki. Oxford University Press, Madison Avenue, New York (2006), Price: GB £42.00, p. 448, ISBN: 0-19-530106-4 , 2008 .

[40]  Yuji Ikegaya,et al.  Synfire Chains and Cortical Songs: Temporal Modules of Cortical Activity , 2004, Science.

[41]  Samy Bengio,et al.  Delay learning and polychronization for reservoir computing , 2008, Neurocomputing.

[42]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[43]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[44]  D. Amit The Hebbian paradigm reintegrated: Local reverberations as internal representations , 1995, Behavioral and Brain Sciences.

[45]  José Roberto Castilho Piqueira,et al.  Multiple synchronous states in static delay-free mutually connected PLL networks , 2010, Signal Process..

[46]  E. Marder Motor pattern generation , 2000, Current Opinion in Neurobiology.

[47]  Sten Grillner,et al.  Biological Pattern Generation: The Cellular and Computational Logic of Networks in Motion , 2006, Neuron.

[48]  Anders Lansner,et al.  Bistable, Irregular Firing and Population Oscillations in a Modular Attractor Memory Network , 2010, PLoS Comput. Biol..

[49]  Frank C. Hoppensteadt,et al.  Synaptic organizations and dynamical properties of weakly connected neural oscillators , 1996, Biological Cybernetics.

[50]  Frank C. Hoppensteadt,et al.  Polychronous Wavefront Computations , 2009, Int. J. Bifurc. Chaos.

[51]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[52]  M. Nicolelis,et al.  Sensorimotor encoding by synchronous neural ensemble activity at multiple levels of the somatosensory system. , 1995, Science.

[53]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[54]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[55]  Tino Gramß Non-standard Computation - Molecular Computation, Cellular Automata, Evolutionary Algorithms, Quantum Computers , 2005, Non-standard Computation.

[56]  Sander M. Bohte,et al.  Computing with Spiking Neuron Networks , 2012, Handbook of Natural Computing.

[57]  S. Thorpe,et al.  Spike times make sense , 2005, Trends in Neurosciences.

[58]  Bruno Cessac,et al.  Overview of facts and issues about neural coding by spikes , 2010, Journal of Physiology-Paris.

[59]  Wolfgang Maass,et al.  Networks of Spiking Neurons: The Third Generation of Neural Network Models , 1996, Electron. Colloquium Comput. Complex..

[60]  J J Hopfield,et al.  What is a moment? Transient synchrony as a collective mechanism for spatiotemporal integration. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[61]  Adriano B. L. Tort,et al.  Neuronal Assembly Detection and Cell Membership Specification by Principal Component Analysis , 2011, PloS one.