Why Neurons Have Thousands of Synapses, a Theory of Sequence Memory in Neocortex

Pyramidal neurons represent the majority of excitatory neurons in the neocortex. Each pyramidal neuron receives input from thousands of excitatory synapses that are segregated onto dendritic branches. The dendrites themselves are segregated into apical, basal, and proximal integration zones, which have different properties. It is a mystery how pyramidal neurons integrate the input from thousands of synapses, what role the different dendrites play in this integration, and what kind of network behavior this enables in cortical tissue. It has been previously proposed that non-linear properties of dendrites enable cortical neurons to recognize multiple independent patterns. In this paper we extend this idea in multiple ways. First we show that a neuron with several thousand synapses segregated on active dendrites can recognize hundreds of independent patterns of cellular activity even in the presence of large amounts of noise and pattern variation. We then propose a neuron model where patterns detected on proximal dendrites lead to action potentials, defining the classic receptive field of the neuron, and patterns detected on basal and apical dendrites act as predictions by slightly depolarizing the neuron without generating an action potential. By this mechanism, a neuron can predict its activation in hundreds of independent contexts. We then present a network model based on neurons with these properties that learns time-based sequences. The network relies on fast local inhibition to preferentially activate neurons that are slightly depolarized. Through simulation we show that the network scales well and operates robustly over a wide range of parameters as long as the network uses a sparse distributed code of cellular activations. We contrast the properties of the new network model with several other neural network models to illustrate the relative capabilities of each. We conclude that pyramidal neurons with thousands of synapses, active dendrites, and multiple integration zones create a robust and powerful sequence memory. Given the prevalence and similarity of excitatory neurons throughout the neocortex and the importance of sequence memory in inference and behavior, we propose that this form of sequence memory may be a universal property of neocortical tissue.

[1]  J. Schiller,et al.  NMDA spikes in basal dendrites of cortical pyramidal neurons , 2000, Nature.

[2]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[3]  Nace L. Golding,et al.  Dendritic Calcium Spike Initiation and Repolarization Are Controlled by Distinct Potassium Channel Subtypes in CA1 Pyramidal Neurons , 1999, The Journal of Neuroscience.

[4]  Bartlett W. Mel,et al.  Computational subunits in thin dendrites of pyramidal cells , 2004, Nature Neuroscience.

[5]  M. Zeldin,et al.  Content and Context , 2011 .

[6]  Pentti Kanerva,et al.  Sparse Distributed Memory , 1988 .

[7]  Victor A. F. Lamme,et al.  Feedforward, horizontal, and feedback processing in the visual cortex , 1998, Current Opinion in Neurobiology.

[8]  L. Pinneo On noise in the nervous system. , 1966, Psychological review.

[9]  K. Svoboda,et al.  The subcellular organization of neocortical excitatory connections , 2009, Nature.

[10]  C. Gray,et al.  Heterogeneity in the responses of adjacent neurons to natural stimuli in cat striate cortex. , 2007, Journal of neurophysiology.

[11]  Subutai Ahmad,et al.  Properties of Sparse Distributed Representations and their Application to Hierarchical Temporal Memory , 2015, ArXiv.

[12]  K. Lashley The problem of serial order in behavior , 1951 .

[13]  Subutai Ahmad,et al.  Porting HTM Models to the Heidelberg Neuromorphic Computing Platform , 2015, ArXiv.

[14]  Rajesh P. N. Rao,et al.  Predictive Sequence Learning in Recurrent Neocortical Circuits , 1999, NIPS.

[15]  Wen-Liang L Zhou,et al.  The decade of the dendritic NMDA spike , 2010, Journal of neuroscience research.

[16]  W. Gan,et al.  Branch-specific dendritic Ca2+ spikes cause persistent synaptic plasticity , 2015, Nature.

[17]  Matthew E Larkum,et al.  Synaptic clustering by dendritic signalling mechanisms , 2008, Current Opinion in Neurobiology.

[18]  Yitzhak Schiller,et al.  NMDA receptor-mediated dendritic spikes and coincident signal amplification , 2001, Current Opinion in Neurobiology.

[19]  G. Knott,et al.  Formation of Dendritic Spines with GABAergic Synapses Induced by Whisker Stimulation in Adult Mice , 2002, Neuron.

[20]  H. Sompolinsky,et al.  The tempotron: a neuron that learns spike timing–based decisions , 2006, Nature Neuroscience.

[21]  Bartlett W. Mel,et al.  Cortical rewiring and information storage , 2004, Nature.

[22]  Subutai Ahmad,et al.  How do neurons operate on sparse distributed representations? A mathematical theory of sparsity, neurons and active dendrites , 2016, ArXiv.

[23]  Haim Sompolinsky,et al.  Learning Precisely Timed Spikes , 2014, Neuron.

[24]  Michael Schmitt,et al.  Learning Temporally Encoded Patterns in Networks of Spiking Neurons , 2004, Neural Processing Letters.

[25]  Wolfgang Maass,et al.  Branch-Specific Plasticity Enables Self-Organization of Nonlinear Computation in Single Neurons , 2011, The Journal of Neuroscience.

[26]  J. Schiller,et al.  Active properties of neocortical pyramidal neuron dendrites. , 2013, Annual review of neuroscience.

[27]  A. Faisal,et al.  Noise in the nervous system , 2008, Nature Reviews Neuroscience.

[28]  Riedel,et al.  Temporal sequences and chaos in neural nets. , 1988, Physical review. A, General physics.

[29]  Jackie Schiller,et al.  Spatiotemporally graded NMDA spike/plateau potentials in basal dendrites of neocortical pyramidal neurons. , 2008, Journal of neurophysiology.

[30]  Thomas M. Cover,et al.  Geometrical and Statistical Properties of Systems of Linear Inequalities with Applications in Pattern Recognition , 1965, IEEE Trans. Electron. Comput..

[31]  Bruno A Olshausen,et al.  Sparse coding of sensory inputs , 2004, Current Opinion in Neurobiology.

[32]  Wolfgang Maass,et al.  Networks of Spiking Neurons: The Third Generation of Neural Network Models , 1996, Electron. Colloquium Comput. Complex..

[33]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[34]  Richard Kempter,et al.  Memory Capacity for Sequences in a Recurrent Network with Biological Constraints , 2006, Neural Computation.

[35]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[36]  Y Watanabe,et al.  Properties of Horizontal and Vertical Inputs to Pyramidal Cells in the Superficial Layers of the Cat Visual Cortex , 2000, The Journal of Neuroscience.

[37]  J. Gallant,et al.  Natural Stimulation of the Nonclassical Receptive Field Increases Information Transmission Efficiency in V1 , 2002, The Journal of Neuroscience.

[38]  K. Martin,et al.  Functional Heterogeneity in Neighboring Neurons of Cat Primary Visual Cortex in Response to Both Artificial and Natural Stimuli , 2013, The Journal of Neuroscience.

[39]  A. Thomson,et al.  Interlaminar connections in the neocortex. , 2003, Cerebral cortex.

[40]  M. Larkum A cellular mechanism for cortical associations: an organizing principle for the cerebral cortex , 2013, Trends in Neurosciences.

[41]  David Haussler,et al.  Probably Approximately Correct Learning , 2010, Encyclopedia of Machine Learning.

[42]  Sophie Denève,et al.  Bayesian Spiking Neurons II: Learning , 2008, Neural Computation.

[43]  Martin P Meyer,et al.  In vivo imaging of synapse formation on a growing dendritic arbor , 2004, Nature Neuroscience.

[44]  Kanter,et al.  Temporal association in asymmetric neural networks. , 1986, Physical review letters.

[45]  Yann LeCun,et al.  Measuring the VC-Dimension of a Learning Machine , 1994, Neural Computation.

[46]  J. Hawkins,et al.  On Intelligence , 2004 .

[47]  Eugene W. Myers,et al.  Thalamocortical input onto layer 5 pyramidal neurons measured using quantitative large-scale array tomography , 2013, Front. Neural Circuits.

[48]  B. Sakmann,et al.  A new cellular mechanism for coupling inputs arriving at different cortical layers , 1999, Nature.

[49]  Marc Joliot,et al.  Content and context in temporal thalamocortical binding , 1994 .

[50]  Judit K. Makara,et al.  Compartmentalized dendritic plasticity and input feature storage in neurons , 2008, Nature.

[51]  L. Rabiner,et al.  An introduction to hidden Markov models , 1986, IEEE ASSP Magazine.

[52]  K. Svoboda,et al.  Long-term in vivo imaging of experience-dependent synaptic plasticity in adult cortex , 2002, Nature.

[53]  K. Svoboda,et al.  Experience-dependent structural synaptic plasticity in the mammalian brain , 2009, Nature Reviews Neuroscience.

[54]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[55]  David Haussler,et al.  Quantifying Inductive Bias: AI Learning Algorithms and Valiant's Learning Framework , 1988, Artif. Intell..

[56]  Yuwei Cui,et al.  Continuous Online Sequence Learning with an Unsupervised Neural Network Model , 2015, Neural Computation.

[57]  A. Polsky,et al.  Synaptic Integration in Tuft Dendrites of Layer 5 Pyramidal Neurons: A New Unifying Principle , 2009, Science.

[58]  N. Spruston Pyramidal neurons: dendritic structure and synaptic integration , 2008, Nature Reviews Neuroscience.

[59]  M. Häusser,et al.  Dendritic coincidence detection of EPSPs and action potentials , 2001, Nature Neuroscience.

[60]  Sven Jahnke,et al.  A Unified Dynamic Model for Learning, Replay, and Sharp-Wave/Ripples , 2015, The Journal of Neuroscience.

[61]  W. Singer,et al.  Distributed Fading Memory for Stimulus Properties in the Primary Visual Cortex , 2009, PLoS biology.

[62]  T. Freund,et al.  Total number and distribution of inhibitory and excitatory synapses on hippocampal CA1 pyramidal cells , 2001, Neuroscience.

[63]  Alexander H. Waibel,et al.  Modular Construction of Time-Delay Neural Networks for Speech Recognition , 1989, Neural Computation.

[64]  Peter Jonas,et al.  Fast-spiking, parvalbumin+ GABAergic interneurons: From cellular design to microcircuit function , 2014, Science.

[65]  Hojjat Adeli,et al.  Spiking Neural Networks , 2009, Int. J. Neural Syst..

[66]  Bartlett W. Mel,et al.  Pyramidal Neuron as Two-Layer Neural Network , 2003, Neuron.

[67]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .