Building phonetic categories: an argument for the role of sleep

The current review provides specific predictions for the role of sleep-mediated memory consolidation in the formation of new speech sound representations. Specifically, this discussion will highlight selected literature on the different ideas concerning category representation in speech, followed by a broad overview of memory consolidation and how it relates to human behavior, as relevant to speech/perceptual learning. In combining behavioral and physiological accounts from animal models with insights from the human consolidation literature on auditory skill/word learning, we are in the early stages of understanding how the transfer of experiential information between brain structures during sleep manifests in changes to online perception. Arriving at the conclusion that this process is crucial in perceptual learning and the formation of novel categories, further speculation yields the adjacent claim that the habitual disruption in this process leads to impoverished quality in the representation of speech sounds.

[1]  R. Tuchman,et al.  Epilepsy and epileptiform EEG: association with autism and language disorders. , 2000, Mental retardation and developmental disabilities research reviews.

[2]  T. Bliss,et al.  Long‐lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path , 1973, The Journal of physiology.

[3]  M. Ullman,et al.  Specific Language Impairment is not Specific to Language: the Procedural Deficit Hypothesis , 2005, Cortex.

[4]  D. Pisoni,et al.  Speech perception without traditional speech cues. , 1981, Science.

[5]  J. McQueen,et al.  The specificity of perceptual learning in speech processing , 2005, Perception & psychophysics.

[6]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[7]  Carlyle Smith,et al.  Sleep states and learning: A review of the animal literature , 1985, Neuroscience & Biobehavioral Reviews.

[8]  W. Marslen-Wilson Functional parallelism in spoken word-recognition , 1987, Cognition.

[9]  Carlyle T. Smith,et al.  Sleep states and memory processes , 1995, Behavioural Brain Research.

[10]  A. Anastasi Individual differences. , 2020, Annual review of psychology.

[11]  H. Nusbaum Talker Normalization: Phonetic Constancy as a Cognitive Process , 2011 .

[12]  J. Hobson,et al.  Visual Discrimination Task Improvement: A Multi-Step Process Occurring During Sleep , 2000, Journal of Cognitive Neuroscience.

[13]  S. Shinnar,et al.  Landau-Kleffner syndrome, electrical status epilepticus in slow wave sleep, and language regression in children. , 2004, Mental retardation and developmental disabilities research reviews.

[14]  J. Pierrehumbert Phonetic Diversity, Statistical Learning, and Acquisition of Phonology , 2003, Language and speech.

[15]  M. Gaskell,et al.  Lexical competition and the acquisition of novel words , 2003, Cognition.

[16]  S. Harnad Categorical Perception: The Groundwork of Cognition , 1990 .

[17]  R. Aslin,et al.  Statistical phonetic learning in infants: facilitation and feature generalization. , 2008, Developmental science.

[18]  Joel L. Davis,et al.  An Introduction to Neural and Electronic Networks , 1995 .

[19]  Matthew H. Davis,et al.  Learning and Consolidation of Novel Spoken Words , 2009, Journal of Cognitive Neuroscience.

[20]  James L. McClelland,et al.  The TRACE model of speech perception , 1986, Cognitive Psychology.

[21]  R. Näätänen,et al.  Psychobiology: Speech sounds learned by sleeping newborns , 2002, Nature.

[22]  W. Whitehouse ‘Sleep EEG and developmental dysphasia’ , 1999, Developmental medicine and child neurology.

[23]  J. Born,et al.  Odor Cues During Slow-Wave Sleep Prompt Declarative Memory Consolidation , 2007, Science.

[24]  Rebecca L. Gómez,et al.  Naps Promote Abstraction in Language-Learning Infants , 2006, Psychological science.

[25]  B. McNaughton,et al.  Reactivation of hippocampal ensemble memories during sleep. , 1994, Science.

[26]  Robert J. Zatorre,et al.  Individual differences in the acquisition of second language phonology , 2009, Brain and Language.

[27]  M. L. Lambon Ralph,et al.  The Role of Sleep Spindles and Slow-Wave Activity in Integrating New Information in Semantic Memory , 2013, The Journal of Neuroscience.

[28]  Matthew H. Davis,et al.  A complementary systems account of word learning: neural and behavioural evidence , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[29]  S. Goldinger Echoes of echoes? An episodic theory of lexical access. , 1998, Psychological review.

[30]  A. Karni,et al.  Dependence on REM sleep of overnight improvement of a perceptual skill. , 1994, Science.

[31]  M. Shishuku [Visual discrimination]. , 1974, Kokubyo Gakkai zasshi. The Journal of the Stomatological Society, Japan.

[32]  Robert Stickgold,et al.  Sleep Spindle Activity is Associated with the Integration of New Memories and Existing Knowledge , 2010, The Journal of Neuroscience.

[33]  Robert L. Goldstone The role of similarity in categorization: providing a groundwork , 1994, Cognition.

[34]  Perla b. Ephrussi Experimentelle Beiträge zur Lehre vom Gedächtnis , 1904 .

[35]  A. Basbaum,et al.  The senses : a comprehensive reference , 2008 .

[36]  Naomi H. Feldman,et al.  The influence of categories on perception: explaining the perceptual magnet effect as optimal statistical inference. , 2009, Psychological review.

[37]  K. Nation,et al.  Individual differences in contextual facilitation: evidence from dyslexia and poor reading comprehension. , 1998, Child development.

[38]  C. Smith Sleep states and memory processes in humans: procedural versus declarative memory systems. , 2001, Sleep medicine reviews.

[39]  H. Nusbaum,et al.  Sleep restores loss of generalized but not rote learning of synthetic speech , 2013, Cognition.

[40]  M. Gareth Gaskell,et al.  A Day in the Life of a Spoken Word , 2004 .

[41]  A. Samuel,et al.  Perceptual learning for speech: Is there a return to normal? , 2005, Cognitive Psychology.

[42]  C. Bramham,et al.  BDNF function in adult synaptic plasticity: The synaptic consolidation hypothesis , 2005, Progress in Neurobiology.

[43]  K. Stevens,et al.  Linguistic experience alters phonetic perception in infants by 6 months of age. , 1992, Science.

[44]  Y. Tohkura,et al.  A perceptual interference account of acquisition difficulties for non-native phonemes , 2003, Cognition.

[45]  Carlyle Smith,et al.  Paradoxical sleep deprivation applied two days after end of training retards learning , 1988, Physiology & Behavior.

[46]  B. McNaughton,et al.  Replay of Neuronal Firing Sequences in Rat Hippocampus During Sleep Following Spatial Experience , 1996, Science.

[47]  David E. Rumelhart,et al.  Brain style computation: learning and generalization , 1990 .

[48]  J. McQueen,et al.  Perceptual learning in speech: stability over time. , 2006, The Journal of the Acoustical Society of America.

[49]  M. Gareth Gaskell,et al.  Overnight lexical consolidation revealed by speech segmentation , 2012, Cognition.

[50]  Matthew P Walker,et al.  The role of sleep in directed forgetting and remembering of human memories. , 2011, Cerebral cortex.

[51]  R. Stickgold Sleep-dependent memory consolidation , 2005, Nature.

[52]  Mark S. Seidenberg,et al.  Phonology and syntax in specific language impairment: Evidence from a connectionist model , 2003, Brain and Language.

[53]  T. Bliss,et al.  A synaptic model of memory: long-term potentiation in the hippocampus , 1993, Nature.

[54]  Gottfried Schlaug,et al.  The influence of sleep on auditory learning: a behavioral study , 2004, Neuroreport.

[55]  M. Nissen,et al.  Attentional requirements of learning: Evidence from performance measures , 1987, Cognitive Psychology.

[56]  R. O’Reilly,et al.  Conjunctive representations in learning and memory: principles of cortical and hippocampal function. , 2001, Psychological review.

[57]  R. Stickgold,et al.  Dissociable stages of human memory consolidation and reconsolidation , 2003, Nature.

[58]  B. C. Griffith,et al.  The discrimination of speech sounds within and across phoneme boundaries. , 1957, Journal of experimental psychology.

[59]  E. Tulving How many memory systems are there , 1985 .

[60]  Elizabeth A. Strand Uncovering the Role of Gender Stereotypes in Speech Perception , 1999 .

[61]  Satrajit S. Ghosh,et al.  Representation of sound categories in auditory cortical maps. , 2004, Journal of speech, language, and hearing research : JSLHR.

[62]  Y. Dudai The neurobiology of consolidations, or, how stable is the engram? , 2004, Annual review of psychology.

[63]  P. Kuhl Human adults and human infants show a “perceptual magnet effect” for the prototypes of speech categories, monkeys do not , 1991, Perception & psychophysics.

[64]  S. Goldinger,et al.  Priming Lexical Neighbors of Spoken Words: Effects of Competition and Inhibition. , 1989, Journal of memory and language.

[65]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[66]  H. Nusbaum,et al.  Consolidation during sleep of perceptual learning of spoken language , 2003, Nature.

[67]  R. Stickgold,et al.  Practice with Sleep Makes Perfect Sleep-Dependent Motor Skill Learning , 2002, Neuron.

[68]  J. Born,et al.  Motor Memory Consolidation in Sleep Shapes More Effective Neuronal Representations , 2005, The Journal of Neuroscience.

[69]  Penelope A. Lewis,et al.  Sleep and environmental context: interactive effects for memory , 2011, Experimental Brain Research.

[70]  D. Pisoni,et al.  Some observations on representations and representational specificity in speech perception and spoken word recognition , 2005 .

[71]  Alexander L. Francis,et al.  Effects of training on attention to acoustic cues , 2000, Perception & psychophysics.

[72]  D. Pisoni,et al.  Recognizing Spoken Words: The Neighborhood Activation Model , 1998, Ear and hearing.

[73]  H. Nusbaum,et al.  Acoustic differences, listener expectations, and the perceptual accommodation of talker variability. , 2007, Journal of experimental psychology. Human perception and performance.

[74]  J. Doyon Skill learning. , 1997, International review of neurobiology.

[75]  T. Bliss Long-lasting potentiation of synaptic transmission , 2005 .

[76]  R. Stickgold,et al.  Posttraining Sleep Enhances Automaticity in Perceptual Discrimination , 2004, Journal of Cognitive Neuroscience.

[77]  J. McQueen,et al.  Perceptual learning in speech: Stability over time (L) , 2006 .

[78]  P Iverson,et al.  Mapping the perceptual magnet effect for speech using signal detection theory and multidimensional scaling. , 1995, The Journal of the Acoustical Society of America.

[79]  Jakke Tamminen,et al.  Short Article: Newly Learned Spoken Words Show Long-Term Lexical Competition Effects , 2008, Quarterly journal of experimental psychology.

[80]  B. McNaughton,et al.  Hippocampal synaptic enhancement and information storage within a distributed memory system , 1987, Trends in Neurosciences.

[81]  A. Samuel,et al.  Perceptual learning for speech , 2009, Attention, perception & psychophysics.

[82]  M. Wilson,et al.  Coordinated memory replay in the visual cortex and hippocampus during sleep , 2007, Nature Neuroscience.

[83]  C. Billard,et al.  Study of unilateral hemisphere performance in children with developmental dysphasia , 1995, Neuropsychologia.

[84]  J. Born,et al.  The contribution of sleep to hippocampus-dependent memory consolidation , 2007, Trends in Cognitive Sciences.

[85]  R. Diehl,et al.  Speech Perception , 2004, Annual review of psychology.

[86]  J. Born,et al.  About sleep's role in memory. , 2013, Physiological reviews.

[87]  R. Stickgold,et al.  Sleep-Dependent Learning and Memory Consolidation , 2004, Neuron.

[88]  J. Born,et al.  The memory function of sleep , 2010, Nature Reviews Neuroscience.

[89]  A. Kamhi,et al.  Specific language impairment. , 2013, Handbook of clinical neurology.

[90]  P. Lewis,et al.  Overnight consolidation aids the transfer of statistical knowledge from the medial temporal lobe to the striatum. , 2013, Cerebral cortex.

[91]  R. Gómez,et al.  Learning, memory, and sleep in children , 2011 .

[92]  Jessica Maye,et al.  Infant sensitivity to distributional information can affect phonetic discrimination , 2002, Cognition.

[93]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[94]  Noam Chomsky,et al.  The Sound Pattern of English , 1968 .

[95]  E. Bizzi,et al.  Consolidation in human motor memory , 1996, Nature.

[96]  P. Maquet,et al.  Neural correlates of perceptual learning: A functional MRI study of visual texture discrimination , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[97]  B. Tonge,et al.  An investigation into sleep characteristics of children with autism and Asperger’s Disorder , 1998, Journal of paediatrics and child health.

[98]  P Achermann,et al.  Sleep and rest facilitate auditory learning , 2004, Neuroscience.

[99]  D. Pisoni,et al.  Talker-specific learning in speech perception , 1998, Perception & psychophysics.

[100]  Alexander L. Francis,et al.  Selective attention and the acquisition of new phonetic categories. , 2002, Journal of experimental psychology. Human perception and performance.

[101]  M. Merzenich,et al.  Dichotomy and perceptual distortions in absolute pitch ability , 2007, Proceedings of the National Academy of Sciences.

[102]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[103]  Joanne L. Miller,et al.  Listener sensitivity to individual talker differences in voice-onset-time. , 2004, The Journal of the Acoustical Society of America.

[104]  R. Vertes,et al.  Memory Consolidation in Sleep Dream or Reality , 2004, Neuron.

[105]  Robert L. Goldstone Effects of Categorization on Color Perception , 1995 .

[106]  A. Hupbach,et al.  Nap-dependent learning in infants. , 2009, Developmental science.

[107]  L. Squire Memory and the hippocampus: a synthesis from findings with rats, monkeys, and humans. , 1992, Psychological review.

[108]  C. Smith,et al.  Increases in number of REMS and REM density in humans following an intensive learning period. , 1991, Sleep.

[109]  C. Marescaux,et al.  Landau–Kleffner syndrome: sleep EEG characteristics at onset , 2000, Clinical Neurophysiology.

[110]  D. Margoliash,et al.  Sleep and Memory Consolidation in Audition , 2008 .

[111]  R. Nosofsky Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[112]  D. Pisoni,et al.  Speech Perception as a Talker-Contingent Process , 1993, Psychological science.

[113]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .

[114]  J. Hobson,et al.  Visual discrimination learning requires sleep after training , 2000, Nature Neuroscience.

[115]  C. Best The emergence of native-language phonological influences in infants: A perceptual assimilation model. , 1994 .

[116]  Daniel Margoliash,et al.  Sleep-Dependent Consolidation of Auditory Discrimination Learning in Adult Starlings , 2010, The Journal of Neuroscience.

[117]  Liat Kishon-Rabin,et al.  A latent consolidation phase in auditory identification learning: time in the awake state is sufficient. , 2005, Learning & memory.

[118]  R. Passingham The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[119]  Emily B. Myers,et al.  Category labels induce boundary-dependent perceptual warping in learned speech categories , 2013, Second language research.

[120]  M. Gaskell,et al.  Sleep-Associated Changes in the Mental Representation of Spoken Words , 2007, Psychological science.