Sleep and the extraction of hidden regularities: A systematic review and the importance of temporal rules.

As part of its role in memory consolidation, sleep has been repeatedly identified as critical for the extraction of regularities from wake experiences. However, many null results have been published as well, with no clear consensus emerging regarding the conditions that yield this sleep effect. Here, we systematically review the role of sleep in the extraction of hidden regularities, specifically those involving associative relations embedded in newly learned information. We found that the specific behavioral task used in a study had far more impact on whether a sleep effect was discovered than either the category of the cognitive processes targeted, or the particular experimental design employed. One emerging pattern, however, was that the explicit detection of hidden rules is more likely to happen when the rules are of a temporal nature (i.e., event A at time t predicts a later event B) than when they are non-temporal. We discuss this temporal rule sensitivity in reference to the compressed memory replay occurring in the hippocampus during slow-wave-sleep, and compare this effect to what happens when the extraction of regularities depends on prior knowledge and relies on structures other than the hippocampus.

[1]  J. Born,et al.  Increasing Explicit Sequence Knowledge by Odor Cueing during Sleep in Men but not Women , 2016, Front. Behav. Neurosci..

[2]  G. Tononi,et al.  Sleep function and synaptic homeostasis. , 2006, Sleep medicine reviews.

[3]  Avi J. H. Chanales,et al.  The role of sleep in forming a memory representation of a two‐dimensional space , 2013, Hippocampus.

[4]  Gianluca Ficca,et al.  Caveats on psychological models of sleep and memory: a compass in an overgrown scenario. , 2013, Sleep medicine reviews.

[5]  Padraic Monaghan,et al.  Sleep-Driven Computations in Speech Processing , 2017, PloS one.

[6]  K. Janacsek,et al.  The Consolidation of Implicit Sequence Memory in Obstructive Sleep Apnea , 2014, PloS one.

[7]  Denise M Werchan,et al.  Sleep confers a benefit for retention of statistical language learning in 6.5month old infants , 2017, Brain and Language.

[8]  G. Buzsáki.  Two-stage model of memory trace formation: A role for “noisy” brain states , 1989, Neuroscience.

[9]  Richard B. Ivry,et al.  Sleep-Dependent Consolidation of Contextual Learning , 2006, Current Biology.

[10]  Andrew P Yonelinas,et al.  Familiarity is related to conceptual implicit memory: An examination of individual differences , 2012, Psychonomic bulletin & review.

[11]  P. Lewis,et al.  Cued Reactivation of Motor Learning during Sleep Leads to Overnight Changes in Functional Brain Activity and Connectivity , 2016, PLoS biology.

[12]  J. Born,et al.  The reciprocal relation between sleep and memory in infancy: Memory‐dependent adjustment of sleep spindles and spindle‐dependent improvement of memories , 2018, Developmental science.

[13]  Eric W. Gobel,et al.  Cued Memory Reactivation During Sleep Influences Skill Learning , 2012, Nature Neuroscience.

[14]  Rebecca Frost,et al.  Sleep Underpins the Plasticity of Language Production , 2014, Psychological science.

[15]  P. Lewis,et al.  Cued Memory Reactivation During SWS Abolishes the Beneficial Effect of Sleep on Abstraction , 2017, Sleep.

[16]  Jan Born,et al.  Implicit Learning–Explicit Knowing: A Role for Sleep in Memory System Interaction , 2006, Journal of Cognitive Neuroscience.

[17]  Padraic Monaghan,et al.  Sleep on it, but only if it is difficult: Effects of sleep on problem solving , 2013, Memory & cognition.

[18]  Christian Büchel,et al.  The sleeping child outplays the adult's capacity to convert implicit into explicit knowledge , 2013, Nature Neuroscience.

[19]  Ole Jensen,et al.  Sleep Promotes the Extraction of Grammatical Rules , 2013, PloS one.

[20]  I. Wilhelm,et al.  System consolidation of memory during sleep , 2011, Psychological Research.

[21]  E. Wamsley,et al.  The impact of sleep on novel concept learning , 2017, Neurobiology of Learning and Memory.

[22]  D. Cai,et al.  REM, not incubation, improves creativity by priming associative networks , 2009, Proceedings of the National Academy of Sciences.

[23]  L. Sebastiani,et al.  Sleep does not facilitate insight in older adults , 2017, Neurobiology of Learning and Memory.

[24]  Angela D. Friederici,et al.  Generalization of word meanings during infant sleep , 2015, Nature Communications.

[25]  R. Stickgold,et al.  Cognitive flexibility across the sleep-wake cycle: REM-sleep enhancement of anagram problem solving. , 2002, Brain research. Cognitive brain research.

[26]  J. Born,et al.  About sleep's role in memory. , 2013, Physiological reviews.

[27]  J. Born,et al.  Sleep inspires insight , 2004, Nature.

[28]  M. Wilson,et al.  Coordinated memory replay in the visual cortex and hippocampus during sleep , 2007, Nature Neuroscience.

[29]  Jan Born,et al.  Sleep Strengthens Predictive Sequence Coding , 2018, The Journal of Neuroscience.

[30]  G. Tononi,et al.  Sleep-Dependent Synaptic Down-Selection (I): Modeling the Benefits of Sleep on Memory Consolidation and Integration , 2013, Front. Neurol..

[31]  J. Born,et al.  Sleep Supports the Slow Abstraction of Gist from Visual Perceptual Memories , 2017, Scientific Reports.

[32]  Robert Stickgold,et al.  Sleep Spindle Activity is Associated with the Integration of New Memories and Existing Knowledge , 2010, The Journal of Neuroscience.

[33]  Amory H. Danek,et al.  Sleep Does Not Promote Solving Classical Insight Problems and Magic Tricks , 2018, Front. Hum. Neurosci..

[34]  R. Stickgold,et al.  REM sleep enhancement of probabilistic classification learning is sensitive to subsequent interference , 2015, Neurobiology of Learning and Memory.

[35]  R. Verleger,et al.  Sleep Spindles in the Right Hemisphere Support Awareness of Regularities and Reflect Pre-Sleep Activations , 2017, Sleep.

[36]  Daphna Shohamy,et al.  Sleep enhances category learning. , 2009, Learning & memory.

[37]  E. Robertson.  The Serial Reaction Time Task: Implicit Motor Skill Learning? , 2007, The Journal of Neuroscience.

[38]  Jessica D. Payne,et al.  The role of sleep in false memory formation , 2009, Neurobiology of Learning and Memory.

[39]  H. Nusbaum,et al.  Reduced false memory after sleep. , 2009, Learning & memory.

[40]  M. Gluck,et al.  Computational models of the hippocampal region: linking incremental learning and episodic memory , 2003, Trends in Cognitive Sciences.

[41]  William B. Levy,et al.  Temporal Sequence Compression by an Integrate-and-Fire Model of Hippocampal Area CA3 , 2004, Journal of Computational Neuroscience.

[42]  Genevieve Albouy,et al.  Sleeping on the motor engram: The multifaceted nature of sleep-related motor memory consolidation , 2017, Neuroscience & Biobehavioral Reviews.

[43]  Elizabeth A. McDevitt,et al.  Sleep Benefits Memory for Semantic Category Structure While Preserving Exemplar-Specific Information , 2017, bioRxiv.

[44]  P. Lewis,et al.  Cued Memory Reactivation during Slow-Wave Sleep Promotes Explicit Knowledge of a Motor Sequence , 2014, The Journal of Neuroscience.

[45]  Steven Laureys,et al.  Learned material content and acquisition level modulate cerebral reactivation during posttraining rapid-eye-movements sleep , 2003, NeuroImage.

[46]  Itamar Lerner,et al.  Individual Differences in Slow-Wave-Sleep Predict Acquisition of Full Cognitive Maps , 2018, Front. Hum. Neurosci..

[47]  J. Born,et al.  Sleep enhances false memories depending on general memory performance , 2010, Behavioural Brain Research.

[48]  Christophe Phillips,et al.  Implicit Oculomotor Sequence Learning in Humans: Time Course of Offline Processing , 2022 .

[49]  Sunbin Song,et al.  Practice and sleep form different aspects of skill , 2014, Nature Communications.

[50]  Stefan Fischer,et al.  Developmental Differences in Sleep's Role for Implicit Off-line Learning: Comparing Children with Adults , 2007, Journal of Cognitive Neuroscience.

[51]  H. Lau,et al.  Relational Memory: A Daytime Nap Facilitates the Abstraction of General Concepts , 2011, PloS one.

[52]  M. Gaskell,et al.  No effect of targeted memory reactivation during slow‐wave sleep on emotional recognition memory , 2018, Journal of sleep research.

[53]  Itamar Lerner.  Sleep is For the Brain , 2017 .

[54]  Rebecca L. Gómez,et al.  Generalizing memories over time: Sleep and reinforcement facilitate transitive inference , 2013, Neurobiology of Learning and Memory.

[55]  U. Wagner,et al.  Differential Associations of Early- and Late-Night Sleep with Functional Brain States Promoting Insight to Abstract Task Regularity , 2010, PloS one.

[56]  Michael J. Frank,et al.  Transitivity, flexibility, conjunctive representations, and the hippocampus. II. A computational analysis , 2003, Hippocampus.

[57]  J. Ashe,et al.  Time of day accounts for overnight improvement in sequence learning. , 2007, Learning & memory.

[58]  M. Tucker,et al.  Daytime napping: Effects on human direct associative and relational memory , 2010, Neurobiology of Learning and Memory.

[59]  R. Spencer,et al.  Age-related changes in consolidation of perceptual and muscle-based learning of motor skills , 2013, Front. Aging Neurosci..

[60]  M. Kohler,et al.  Complex associative memory processing and sleep: A systematic review and meta-analysis of behavioural evidence and underlying EEG mechanisms , 2014, Neuroscience & Biobehavioral Reviews.

[61]  Monika Schönauer,et al.  Strengthening Procedural Memories by Reactivation in Sleep , 2014, Journal of Cognitive Neuroscience.

[62]  F. Louzada,et al.  After Being Challenged by a Video Game Problem, Sleep Increases the Chance to Solve It , 2014, PloS one.

[63]  J. Hobson,et al.  Sleep-Induced Changes in Associative Memory , 1999, Journal of Cognitive Neuroscience.

[64]  R. Verleger,et al.  Labile sleep promotes awareness of abstract knowledge in a serial reaction time task , 2015, Front. Psychol..

[65]  Juliana Yordanova,et al.  Increased Alpha (8–12 Hz) Activity during Slow Wave Sleep as a Marker for the Transition from Implicit Knowledge to Explicit Insight , 2012, Journal of Cognitive Neuroscience.

[66]  Á. Pascual-Leone,et al.  Awareness Modifies the Skill-Learning Benefits of Sleep , 2004, Current Biology.

[67]  M. Gareth Gaskell,et al.  Does Sleep Improve Your Grammar? Preferential Consolidation of Arbitrary Components of New Linguistic Knowledge , 2016, PloS one.

[68]  P. Lewis,et al.  Overnight consolidation aids the transfer of statistical knowledge from the medial temporal lobe to the striatum. , 2013, Cerebral cortex.

[69]  S. Gais,et al.  Incubation, not sleep, aids problem-solving , 2018, Sleep.

[70]  M. Gluck,et al.  The influence of sleep on emotional and cognitive processing is primarily trait- (but not state-) dependent , 2016, Neurobiology of Learning and Memory.

[71]  Michael Van Elzakker,et al.  Transitivity, flexibility, conjunctive representations, and the hippocampus. I. An empirical analysis , 2003, Hippocampus.

[72]  Sunbin Song,et al.  Sleep Does Not Benefit Probabilistic Motor Sequence Learning , 2007, The Journal of Neuroscience.

[73]  Jessica D. Payne,et al.  Human relational memory requires time and sleep , 2007, Proceedings of the National Academy of Sciences.

[74]  Rutvik H. Desai,et al.  The neurobiology of semantic memory , 2011, Trends in Cognitive Sciences.

[75]  R. Stickgold,et al.  Overnight alchemy: sleep-dependent memory evolution , 2010, Nature Reviews Neuroscience.

[76]  Penelope A. Lewis,et al.  Sleep-dependent consolidation of statistical learning , 2011, Neuropsychologia.

[77]  J. Born,et al.  Effects of Early and Late Nocturnal Sleep on Declarative and Procedural Memory , 1997, Journal of Cognitive Neuroscience.

[78]  B. McNaughton,et al.  Reactivation of hippocampal ensemble memories during sleep. , 1994, Science.

[79]  Jan Born,et al.  Sleep and awareness about presence of regularity speed the transition from implicit to explicit knowledge , 2011, Biological Psychology.

[80]  L. Talamini,et al.  Generalization from episodic memories across time: A route for semantic knowledge acquisition , 2014, Cortex.

[81]  R. Gómez,et al.  Words to Sleep On: Naps Facilitate Verb Generalization in Habitually and Nonhabitually Napping Preschoolers. , 2017, Child development.

[82]  A. Głodek,et al.  Ill-Defined Problem Solving Does Not Benefit From Daytime Napping , 2020, Frontiers in Psychology.

[83]  P. Lewis,et al.  Overlapping memory replay during sleep builds cognitive schemata , 2011, Trends in Cognitive Sciences.

[84]  The Sleeping Infant Brain Anticipates Development , 2017, Current Biology.

[85]  J. Payne,et al.  The differential effects of emotional salience on direct associative and relational memory during a nap , 2016, Cognitive, Affective, & Behavioral Neuroscience.

[86]  Rebecca L. Gómez,et al.  Naps Promote Abstraction in Language-Learning Infants , 2006, Psychological science.

[87]  Natalie B. Bryant,et al.  Transcranial Current Stimulation During Sleep Facilitates Insight into Temporal Rules, but does not Consolidate Memories of Individual Sequential Experiences , 2019, Scientific Reports.

[88]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[89]  Richard B Ivry,et al.  Age-related decline of sleep-dependent consolidation. , 2007, Learning & memory.

[90]  Paul J. Reber,et al.  Sleep facilitates learning a new linguistic rule , 2014, Neuropsychologia.

[91]  T. Bitan,et al.  Prior Knowledge Predicts Early Consolidation in Second Language Learning , 2019, Front. Psychol..

[92]  C. Degueldre,et al.  Are Spatial Memories Strengthened in the Human Hippocampus during Slow Wave Sleep? , 2004, Neuron.

[93]  Ágnes Lukács,et al.  Sleep-independent off-line enhancement and time of the day effects in three forms of skill learning , 2016, Cognitive Processing.

[94]  Karolina Janacsek,et al.  Sleep has no critical role in implicit motor sequence learning in young and old adults , 2010, Experimental Brain Research.

[95]  M. Gluck,et al.  Hippocampal mediation of stimulus representation: A computational theory , 1993, Hippocampus.

[96]  U. Wagner,et al.  Covert Reorganization of Implicit Task Representations by Slow Wave Sleep , 2009, PloS one.

[97]  Penelope A. Lewis,et al.  Time- but not sleep-dependent consolidation promotes the emergence of cross-modal conceptual representations , 2014, Neuropsychologia.

[98]  P. Lewis,et al.  Schema-conformant memories are preferentially consolidated during REM sleep , 2015, Neurobiology of Learning and Memory.

[99]  Brian D. Glass,et al.  EFFECTS OF SLEEP DEPRIVATION ON LEARNING SYSTEMS The Effects of Sleep Deprivation on Dissociable Prototype Learning Systems , 2011 .

[100]  I. Wilhelm,et al.  Children's initial sleep-associated changes in motor skill are unrelated to long-term skill levels. , 2017, Developmental science.

[101]  Rebecca M C Spencer,et al.  Sleep‐dependent modulation of affectively guided decision‐making , 2012, Journal of sleep research.

[102]  J. Born,et al.  Shifting from implicit to explicit knowledge: different roles of early- and late-night sleep. , 2008, Learning & memory.

[103]  William B. Levy,et al.  When logic fails: Implicit transitive inference in humans , 2005, Memory & cognition.

[104]  Denise M Werchan,et al.  Wakefulness (not sleep) promotes generalization of word learning in 2.5-year-old children. , 2014, Child development.

[105]  A. Hupbach,et al.  Nap-dependent learning in infants. , 2009, Developmental science.

[106]  Axel Cleeremans,et al.  Experience-dependent changes in cerebral activation during human REM sleep , 2000, Nature Neuroscience.

[107]  K. Paller,et al.  Sleep-based memory processing facilitates grammatical generalization: Evidence from targeted memory reactivation , 2017, Brain and Language.

[108]  R. Verleger,et al.  Awareness of Knowledge or Awareness of Processing? Implications for Sleep-Related Memory Consolidation , 2009, Front. Hum. Neurosci..

[109]  Karolina Janacsek,et al.  The differential consolidation of perceptual and motor learning in skill acquisition , 2013, Cortex.

[110]  C. Stark,et al.  Pattern separation in the hippocampus , 2011, Trends in Neurosciences.

[111]  Á. Pascual-Leone,et al.  Off-Line Learning and the Primary Motor Cortex , 2005, The Journal of Neuroscience.

[112]  J. Born,et al.  Skill Memory Escaping from Distraction by Sleep—Evidence from Dual-Task Performance , 2012, PloS one.

[113]  Brian D. Glass,et al.  The effects of sleep deprivation on information-integration categorization performance. , 2009, Sleep.

[114]  Penelope A. Lewis,et al.  Cross-modal transfer of statistical information benefits from sleep , 2016, Cortex.