Sleep-like slow oscillations improve visual classification through synaptic homeostasis and memory association in a thalamo-cortical model

The occurrence of sleep passed through the evolutionary sieve and is widespread in animal species. Sleep is known to be beneficial to cognitive and mnemonic tasks, while chronic sleep deprivation is detrimental. Despite the importance of the phenomenon, a complete understanding of its functions and underlying mechanisms is still lacking. In this paper, we show interesting effects of deep-sleep-like slow oscillation activity on a simplified thalamo-cortical model which is trained to encode, retrieve and classify images of handwritten digits. During slow oscillations, spike-timing-dependent-plasticity (STDP) produces a differential homeostatic process. It is characterized by both a specific unsupervised enhancement of connections among groups of neurons associated to instances of the same class (digit) and a simultaneous down-regulation of stronger synapses created by the training. This hierarchical organization of post-sleep internal representations favours higher performances in retrieval and classification tasks. The mechanism is based on the interaction between top-down cortico-thalamic predictions and bottom-up thalamo-cortical projections during deep-sleep-like slow oscillations. Indeed, when learned patterns are replayed during sleep, cortico-thalamo-cortical connections favour the activation of other neurons coding for similar thalamic inputs, promoting their association. Such mechanism hints at possible applications to artificial learning systems.

[1]  Giulio Tononi,et al.  Ultrastructural evidence for synaptic scaling across the wake/sleep cycle , 2017, Science.

[2]  M. Steriade,et al.  Network modulation of a slow intrinsic oscillation of cat thalamocortical neurons implicated in sleep delta waves: cortically induced synchronization and brainstem cholinergic suppression , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  Maurizio Mattia,et al.  Diverse population-bursting modes of adapting spiking neurons. , 2007, Physical review letters.

[4]  K. Harris,et al.  Sleep and the single neuron: the role of global slow oscillations in individual cell rest , 2013, Nature Reviews Neuroscience.

[5]  Yoshua Bengio,et al.  Dendritic error backpropagation in deep cortical microcircuits , 2017, ArXiv.

[6]  M. Larkum A cellular mechanism for cortical associations: an organizing principle for the cerebral cortex , 2013, Trends in Neurosciences.

[7]  Wilten Nicola,et al.  Supervised learning in spiking neural networks with FORCE training , 2016, Nature Communications.

[8]  J. Hobson,et al.  The cognitive neuroscience of sleep: neuronal systems, consciousness and learning , 2002, Nature Reviews Neuroscience.

[9]  Marcello Massimini,et al.  Shaping the Default Activity Pattern of the Cortical Network , 2017, Neuron.

[10]  O. Paulsen,et al.  Activity-Dependent Downscaling of Subthreshold Synaptic Inputs during Slow-Wave-Sleep-like Activity In Vivo , 2018, Neuron.

[11]  Alexander Peyser,et al.  Nest 2.12.0 , 2017 .

[12]  M. Bazhenov,et al.  Synaptic Mechanisms of Memory Consolidation during Sleep Slow Oscillations , 2016, The Journal of Neuroscience.

[13]  Alain Destexhe,et al.  Self-sustained Asynchronous Irregular States and Up–down States in Thalamic, Cortical and Thalamocortical Networks of Nonlinear Integrate-and-fire Neurons , 2022 .

[14]  M. Mattia,et al.  Slow wave activity as the default mode of the cerebral cortex. , 2014, Archives italiennes de biologie.

[15]  D. Contreras,et al.  Cellular basis of EEG slow rhythms: a study of dynamic corticothalamic relationships , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  L. Frank,et al.  Awake Hippocampal Sharp-Wave Ripples Support Spatial Memory , 2012, Science.

[17]  Matthew Cook,et al.  Unsupervised learning of digit recognition using spike-timing-dependent plasticity , 2015, Front. Comput. Neurosci..

[18]  William D S Killgore,et al.  Effects of sleep deprivation on cognition. , 2010, Progress in brain research.

[19]  Maria V. Sanchez-Vives,et al.  Slow Waves in Cortical Slices: How Spontaneous Activity is Shaped by Laminar Structure , 2019, Cerebral cortex.

[20]  J. L. Kenemans,et al.  The effects of sleep loss on task performance and the electroencephalogram in young and elderly subjects , 1997, Biological Psychology.

[21]  Xiao-Jing Wang,et al.  The importance of mixed selectivity in complex cognitive tasks , 2013, Nature.

[22]  Haim Sompolinsky,et al.  Learning Input Correlations through Nonlinear Temporally Asymmetric Hebbian Plasticity , 2003, The Journal of Neuroscience.

[23]  G. Tononi,et al.  Sleep and the Price of Plasticity: From Synaptic and Cellular Homeostasis to Memory Consolidation and Integration , 2014, Neuron.

[24]  Giulia De Bonis,et al.  Gaussian and Exponential Lateral Connectivity on Distributed Spiking Neural Network Simulation , 2018, 2018 26th Euromicro International Conference on Parallel, Distributed and Network-based Processing (PDP).

[25]  Daniel Levenstein,et al.  Network Homeostasis and State Dynamics of Neocortical Sleep , 2016, Neuron.

[26]  C. Koch,et al.  Consciousness: here, there and everywhere? , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[27]  Matteo Grasso,et al.  Sleep and Dreaming in the Predictive Processing Framework , 2017 .

[28]  Claudia Clopath,et al.  Sparse synaptic connectivity is required for decorrelation and pattern separation in feedforward networks , 2017, Nature Communications.

[29]  R. Stickgold,et al.  Sleep, memory, and plasticity. , 2006, Annual review of psychology.

[30]  Maxim Bazhenov,et al.  Differential roles of sleep spindles and sleep slow oscillations in memory consolidation , 2017, bioRxiv.