Dendritic error backpropagation in deep cortical microcircuits

Animal behaviour depends on learning to associate sensory stimuli with the desired motor command. Understanding how the brain orchestrates the necessary synaptic modifications across different brain areas has remained a longstanding puzzle. Here, we introduce a multi-area neuronal network model in which synaptic plasticity continuously adapts the network towards a global desired output. In this model synaptic learning is driven by a local dendritic prediction error that arises from a failure to predict the top-down input given the bottom-up activities. Such errors occur at apical dendrites of pyramidal neurons where both long-range excitatory feedback and local inhibitory predictions are integrated. When local inhibition fails to match excitatory feedback an error occurs which triggers plasticity at bottom-up synapses at basal dendrites of the same pyramidal neurons. We demonstrate the learning capabilities of the model in a number of tasks and show that it approximates the classical error backpropagation algorithm. Finally, complementing this cortical circuit with a disinhibitory mechanism enables attention-like stimulus denoising and generation. Our framework makes several experimental predictions on the function of dendritic integration and cortical microcircuits, is consistent with recent observations of cross-area learning, and suggests a biological implementation of deep learning.

[1]  Ha Hong,et al.  Performance-optimized hierarchical models predict neural responses in higher visual cortex , 2014, Proceedings of the National Academy of Sciences.

[2]  R. Froemke Plasticity of cortical excitatory-inhibitory balance. , 2015, Annual review of neuroscience.

[3]  Randall C. O'Reilly,et al.  Biologically Plausible Error-Driven Learning Using Local Activation Differences: The Generalized Recirculation Algorithm , 1996, Neural Computation.

[4]  Claudia Clopath,et al.  Modeling somatic and dendritic spike mediated plasticity at the single neuron and network level , 2017, Nature Communications.

[5]  Walter Senn,et al.  Spatio-Temporal Credit Assignment in Neuronal Population Learning , 2011, PLoS Comput. Biol..

[6]  Stephen Grossberg,et al.  Competitive Learning: From Interactive Activation to Adaptive Resonance , 1987, Cogn. Sci..

[7]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[8]  Pierre Priouret,et al.  Adaptive Algorithms and Stochastic Approximations , 1990, Applications of Mathematics.

[9]  Takaki Komiyama,et al.  Learning enhances the relative impact of top-down processing in the visual cortex , 2015, Nature Neuroscience.

[10]  Yoshua Bengio,et al.  How Auto-Encoders Could Provide Credit Assignment in Deep Networks via Target Propagation , 2014, ArXiv.

[11]  W. Senn,et al.  Learning by the Dendritic Prediction of Somatic Spiking , 2014, Neuron.

[12]  Colin J. Akerman,et al.  Random synaptic feedback weights support error backpropagation for deep learning , 2016, Nature Communications.

[13]  J. Simon Wiegert,et al.  Multiple dynamic representations in the motor cortex during sensorimotor learning , 2012, Nature.

[14]  N. Spruston Pyramidal neurons: dendritic structure and synaptic integration , 2008, Nature Reviews Neuroscience.

[15]  Alexander Attinger,et al.  Visuomotor Coupling Shapes the Functional Development of Mouse Visual Cortex , 2017, Cell.

[16]  W. Gerstner,et al.  Connectivity reflects coding: a model of voltage-based STDP with homeostasis , 2010, Nature Neuroscience.

[17]  Nando de Freitas,et al.  Cortical microcircuits as gated-recurrent neural networks , 2017, NIPS.

[18]  Thomas K. Berger,et al.  Frequency‐dependent disynaptic inhibition in the pyramidal network: a ubiquitous pathway in the developing rat neocortex , 2009, The Journal of physiology.

[19]  Konrad P. Kording,et al.  Towards an integration of deep learning and neuroscience , 2016, bioRxiv.

[20]  Caspar M. Schwiedrzik,et al.  High-Level Prediction Signals in a Low-Level Area of the Macaque Face-Processing Hierarchy , 2017, Neuron.

[21]  Thomas K. Berger,et al.  Brief Bursts Self-Inhibit and Correlate the Pyramidal Network , 2010, PLoS biology.

[22]  Rafal Bogacz,et al.  An Approximation of the Error Backpropagation Algorithm in a Predictive Coding Network with Local Hebbian Synaptic Plasticity , 2017, Neural Computation.

[23]  Xiaohui Xie,et al.  Equivalence of Backpropagation and Contrastive Hebbian Learning in a Layered Network , 2003, Neural Computation.

[24]  Wulfram Gerstner,et al.  Integrating Hebbian and homeostatic plasticity: the current state of the field and future research directions , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[25]  Yoshua Bengio,et al.  Difference Target Propagation , 2014, ECML/PKDD.

[26]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[27]  Nikolaus Kriegeskorte,et al.  Deep Supervised, but Not Unsupervised, Models May Explain IT Cortical Representation , 2014, PLoS Comput. Biol..

[28]  Georg B. Keller,et al.  Learning Enhances Sensory and Multiple Non-sensory Representations in Primary Visual Cortex , 2015, Neuron.

[29]  Yann LeCun,et al.  A theoretical framework for back-propagation , 1988 .

[30]  Wolfgang Maass,et al.  Bayesian Computation Emerges in Generic Cortical Microcircuits through Spike-Timing-Dependent Plasticity , 2013, PLoS Comput. Biol..

[31]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[32]  Andreas Lüthi,et al.  Disinhibition, a Circuit Mechanism for Associative Learning and Memory , 2015, Neuron.

[33]  W. Senn,et al.  Dendritic encoding of sensory stimuli controlled by deep cortical interneurons , 2009, Nature.

[34]  Henning Sprekeler,et al.  Inhibitory Plasticity Balances Excitation and Inhibition in Sensory Pathways and Memory Networks , 2011, Science.

[35]  Konrad P. Körding,et al.  Toward an Integration of Deep Learning and Neuroscience , 2016, bioRxiv.

[36]  Christoph E. Schreiner,et al.  Developmental sensory experience balances cortical excitation and inhibition , 2010, Nature.

[37]  Yotam Luz,et al.  Balancing Feed-Forward Excitation and Inhibition via Hebbian Inhibitory Synaptic Plasticity , 2012, PLoS Comput. Biol..

[38]  Alison L. Barth,et al.  Somatostatin-expressing neurons in cortical networks , 2016, Nature Reviews Neuroscience.

[39]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[40]  Karl J. Friston,et al.  A theory of cortical responses , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[41]  K. Svoboda,et al.  The subcellular organization of neocortical excitatory connections , 2009, Nature.

[42]  S. Manita,et al.  A Top-Down Cortical Circuit for Accurate Sensory Perception , 2015, Neuron.

[43]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[44]  Geoffrey E. Hinton,et al.  Learning Representations by Recirculation , 1987, NIPS.

[45]  Pieter R. Roelfsema,et al.  Attention-Gated Reinforcement Learning of Internal Representations for Classification , 2005, Neural Computation.

[46]  Francis Crick,et al.  The recent excitement about neural networks , 1989, Nature.

[47]  M. Larkum A cellular mechanism for cortical associations: an organizing principle for the cerebral cortex , 2013, Trends in Neurosciences.

[48]  L. Cauller,et al.  The neural basis of the behaviorally relevant N1 component of the somatosensory-evoked potential in SI cortex of awake monkeys: evidence that backward cortical projections signal conscious touch sensation , 2004, Experimental Brain Research.

[49]  M. Larkum,et al.  Active cortical dendrites modulate perception , 2016, Science.

[50]  H. Markram,et al.  Disynaptic Inhibition between Neocortical Pyramidal Cells Mediated by Martinotti Cells , 2007, Neuron.

[51]  Yoshua Bengio,et al.  Equilibrium Propagation: Bridging the Gap between Energy-Based Models and Backpropagation , 2016, Front. Comput. Neurosci..

[52]  Joshua I. Sanders,et al.  Cortical interneurons that specialize in disinhibitory control , 2013, Nature.

[53]  Timothée Masquelier,et al.  Unsupervised Learning of Visual Features through Spike Timing Dependent Plasticity , 2007, PLoS Comput. Biol..

[54]  J. DiCarlo,et al.  Using goal-driven deep learning models to understand sensory cortex , 2016, Nature Neuroscience.

[55]  Y. Dan,et al.  Long-range and local circuits for top-down modulation of visual cortex processing , 2014, Science.