The contribution of early language exposure to the cortical tracking of speech

Despite the relevance of the cortical tracking of speech for the development of speech perception skills, no study to date has explored whether and how it is shaped by language experience and exposure. In this study we expand the current theories of cortex-speech tracking by showing that the cortical tracking of speech in unbalanced bilingual children is modulated by language exposure. We recorded electroencephalography in 35 Basque-Spanish bilingual children (6 y.o.) with a markedly unbalanced bilingual profile (>70 % exposure to Basque; <30 % to Spanish) while they listened to continuous speech in each of their languages. We assessed their cortical tracking of speech at the acoustic temporal (speech envelope), lexical (lexical frequency), and semantic (sentence-level semantic distance) levels. Phase alignment between the speech envelope and the EEG activity (speech-brain coherence) in the delta frequency band (0.5 – 1.5 Hz) was significant and similar in both languages. Interestingly, mTRF modeling showed that the cortical encoding of the speech envelope in the language with the least exposure was the most robust. Moreover, mTRF modeling showed that children had a more sensitive cortical tracking of semantic information in their most experienced language. Lastly, only for the language with dominant exposure, the cortex-speech tracking of the envelope was linked to the phonological abilities, while their cortical tracking of lexico-semantic information predicted their vocabulary knowledge. Our findings inform the developmental theories by showing that the cortical tracking of acoustic temporal and lexico-semantic speech features depends on the accumulated experience within a language during the early years of language acquisition.

[1]  O. Scharenborg,et al.  Neural representations of non-native speech reflect proficiency and interference from native language knowledge , 2023, bioRxiv.

[2]  N. Turk-Browne,et al.  Neural signatures of second language proficiency in narrative processing , 2022, bioRxiv.

[3]  D. Burnham,et al.  Language specificity in cortical tracking of speech rhythm at the mora, syllable, and foot levels , 2022, Scientific Reports.

[4]  K. Nation,et al.  Book Language and Its Implications for Children’s Language, Literacy, and Development , 2022, Current Directions in Psychological Science.

[5]  J. Wouters,et al.  Development of Atypical Reading at Ages 5 to 9 Years and Processing of Speech Envelope Modulations in the Brain , 2022, Frontiers in Computational Neuroscience.

[6]  C. van den Boomen,et al.  Neural Tracking in Infancy Predicts Language Development in Children With and Without Family History of Autism , 2022, Neurobiology of Language.

[7]  Lars Meyer,et al.  Natural infant-directed speech facilitates neural tracking of prosody , 2021, NeuroImage.

[8]  R. Aslin,et al.  Towards a model of language neurobiology in early development , 2021, Brain and Language.

[9]  Aaron R. Nidiffer,et al.  Linear Modeling of Neurophysiological Responses to Speech and Other Continuous Stimuli: Methodological Considerations for Applied Research , 2021, Frontiers in Neuroscience.

[10]  M. Bourguignon,et al.  Right-hemisphere coherence to speech at pre-reading stages predicts reading performance one year later , 2021, Journal of Cognitive Psychology.

[11]  S. ten Oever,et al.  An oscillating computational model can track pseudo-rhythmic speech by using linguistic predictions , 2021, eLife.

[12]  Ellen F. Lau,et al.  Parallel processing in speech perception with local and global representations of linguistic context , 2021, bioRxiv.

[13]  Nicola Molinaro,et al.  One Way or Another: Cortical Language Areas Flexibly Adapt Processing Strategies to Perceptual And Contextual Properties of Speech. , 2021, Cerebral cortex.

[14]  M. Carreiras,et al.  Language Proficiency Entails Tuning Cortical Activity to Second Language Speech. , 2021, Cerebral cortex.

[15]  N. Weisz,et al.  Neural speech tracking shifts from the syllabic to the modulation rate of speech as intelligibility decreases , 2021, bioRxiv.

[16]  Nicola Molinaro,et al.  Speech-brain phase coupling is enhanced in low contextual semantic predictability conditions , 2021, Neuropsychologia.

[17]  B. Chandrasekaran,et al.  Neural tracking of the speech envelope is differentially modulated by attention and language experience , 2020, Brain and Language.

[18]  U. Goswami,et al.  Delta- and theta-band cortical tracking and phase-amplitude coupling to sung speech by infants , 2020, NeuroImage.

[19]  Antje S. Meyer,et al.  Linguistic Structure and Meaning Organize Neural Oscillations into a Content-Specific Hierarchy , 2020, The Journal of Neuroscience.

[20]  Aapo Hyvärinen,et al.  Brain activity reflects the predictability of word sequences in listened continuous speech , 2020, NeuroImage.

[21]  Z. Emami,et al.  EEG Phase Synchronization during Semantic Unification Relates to Individual Differences in Children's Vocabulary Skill. , 2020, Developmental science.

[22]  Edmund C. Lalor,et al.  Dissociable electrophysiological measures of natural language processing reveal differences in speech comprehension strategy in healthy ageing , 2020, Scientific Reports.

[23]  U. Goswami,et al.  Infant‐directed speech to infants at risk for dyslexia: A novel cross‐dyad design , 2020, Infancy.

[24]  M. Bourguignon,et al.  Development of neural oscillatory activity in response to speech in children from 4 to 6 years old , 2020, Developmental science.

[25]  Jacqueline Leybaert,et al.  Cortical tracking of speech in noise accounts for reading strategies in children , 2020, bioRxiv.

[26]  S. Peperkamp,et al.  Dual language input and the impact of language separation on early lexical development. , 2020, Infancy : the official journal of the International Society on Infant Studies.

[27]  Sylvain Baillet,et al.  Two Distinct Neural Timescales for Predictive Speech Processing , 2019, Neuron.

[28]  C. Kayser,et al.  Neural Entrainment and Attentional Selection in the Listening Brain , 2019, Trends in Cognitive Sciences.

[29]  Edmund C Lalor,et al.  Semantic Context Enhances the Early Auditory Encoding of Natural Speech , 2019, The Journal of Neuroscience.

[30]  U. Goswami,et al.  Sensitivity to amplitude envelope rise time in infancy and vocabulary development at 3 years: A significant relationship. , 2019, Developmental science.

[31]  Anne Hauswald,et al.  Degradation levels of continuous speech affect neural speech tracking and alpha power differently , 2019, bioRxiv.

[32]  Perla B. Gámez,et al.  Dual Language and English-Only Learners' Expressive and Receptive Language Skills and Exposure to Peers' Language. , 2019, Child development.

[33]  Mathieu Bourguignon,et al.  Comparing the potential of MEG and EEG to uncover brain tracking of speech temporal envelope , 2019, NeuroImage.

[34]  Nicola Molinaro,et al.  Delta(but not theta)‐band cortical entrainment involves speech‐specific processing , 2018, The European journal of neuroscience.

[35]  Andrea E. Martin,et al.  A Compositional Neural Architecture for Language , 2020, Journal of Cognitive Neuroscience.

[36]  Denis Burnham,et al.  Atypical cortical entrainment to speech in the right hemisphere underpins phonemic deficits in dyslexia , 2018, NeuroImage.

[37]  Lars Meyer,et al.  Synchronization of Electrophysiological Responses with Speech Benefits Syntactic Information Processing , 2018, Journal of Cognitive Neuroscience.

[38]  Erik Edwards,et al.  A Spatial Map of Onset and Sustained Responses to Speech in the Human Superior Temporal Gyrus , 2018, Current Biology.

[39]  Usha Goswami,et al.  A Neural Basis for Phonological Awareness? An Oscillatory Temporal-Sampling Perspective , 2018 .

[40]  J. Wouters,et al.  Do prereaders' auditory processing and speech perception predict later literacy? , 2017, Research in developmental disabilities.

[41]  Edmund C. Lalor,et al.  Electrophysiological Correlates of Semantic Dissimilarity Reflect the Comprehension of Natural, Narrative Speech , 2017, Current Biology.

[42]  Christian Brodbeck,et al.  Neural source dynamics of brain responses to continuous stimuli: Speech processing from acoustics to comprehension , 2017, NeuroImage.

[43]  Andrea E Martin,et al.  A mechanism for the cortical computation of hierarchical linguistic structure , 2017, PLoS biology.

[44]  Matthijs Douze,et al.  FastText.zip: Compressing text classification models , 2016, ArXiv.

[45]  Edmund C. Lalor,et al.  The Multivariate Temporal Response Function (mTRF) Toolbox: A MATLAB Toolbox for Relating Neural Signals to Continuous Stimuli , 2016, Front. Hum. Neurosci..

[46]  U. Goswami,et al.  Difficulties in auditory organization as a cause of reading backwardness? An auditory neuroscience perspective , 2016, Developmental science.

[47]  Usha Goswami,et al.  Neural encoding of the speech envelope by children with developmental dyslexia , 2016, Brain and Language.

[48]  Lars Meyer,et al.  Linguistic Bias Modulates Interpretation of Speech via Neural Delta-Band Oscillations , 2016, Cerebral cortex.

[49]  Manuel Carreiras,et al.  Out‐of‐synchrony speech entrainment in developmental dyslexia , 2016, Human brain mapping.

[50]  Thomas L. Griffiths,et al.  Supplementary Information for Natural Speech Reveals the Semantic Maps That Tile Human Cerebral Cortex , 2022 .

[51]  J. Paradis,et al.  Chinese L1 children's English L2 verb morphology over time: individual variation in long-term outcomes , 2016, Journal of Child Language.

[52]  Judit Gervain,et al.  Plasticity in early language acquisition: the effects of prenatal and early childhood experience , 2015, Current Opinion in Neurobiology.

[53]  Angela D. Friederici,et al.  The ontogeny of the cortical language network , 2016, Nature Reviews Neuroscience.

[54]  Régine Kolinsky,et al.  Illiterate to literate: behavioural and cerebral changes induced by reading acquisition , 2015, Nature Reviews Neuroscience.

[55]  Itziar Laka,et al.  EHME: a New Word Database for Research in Basque Language , 2014, The Spanish Journal of Psychology.

[56]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[57]  U. Goswami,et al.  Assessment of rhythmic entrainment at multiple timescales in dyslexia: Evidence for disruption to syllable timing , 2014, Hearing Research.

[58]  David Poeppel,et al.  Acoustic landmarks drive delta–theta oscillations to enable speech comprehension by facilitating perceptual parsing , 2014, NeuroImage.

[59]  Marc Brysbaert,et al.  Subtlex-UK: A New and Improved Word Frequency Database for British English , 2014, Quarterly journal of experimental psychology.

[60]  A. Friederici,et al.  Neural Correlates of the Development of Speech Perception and Comprehension , 2013 .

[61]  P. Schyns,et al.  Speech Rhythms and Multiplexed Oscillatory Sensory Coding in the Human Brain , 2013, PLoS biology.

[62]  Usha Goswami,et al.  Neural entrainment to rhythmic speech in children with developmental dyslexia , 2013, Front. Hum. Neurosci..

[63]  Claudia Männel,et al.  The role of pause as a prosodic boundary marker: Language ERP studies in German 3- and 6-year-olds , 2013, Developmental Cognitive Neuroscience.

[64]  U. Goswami,et al.  Speech rhythm and temporal structure: Converging perspectives? , 2013 .

[65]  Anne Fernald,et al.  Relative language exposure, processing efficiency and vocabulary in Spanish–English bilingual toddlers* , 2013, Bilingualism: Language and Cognition.

[66]  A. Duchon,et al.  EsPal: One-stop shopping for Spanish word properties , 2013, Behavior research methods.

[67]  Joachim Gross,et al.  Phase-Locked Responses to Speech in Human Auditory Cortex are Enhanced During Comprehension , 2012, Cerebral cortex.

[68]  David Poeppel,et al.  Cortical oscillations and speech processing: emerging computational principles and operations , 2012, Nature Neuroscience.

[69]  E. Thordardottir The relationship between bilingual exposure and vocabulary development , 2011 .

[70]  Tim Fosker,et al.  Language-universal Sensory Deficits in Developmental Dyslexia: English, Spanish, and Chinese , 2011, Journal of Cognitive Neuroscience.

[71]  U. Goswami A temporal sampling framework for developmental dyslexia , 2011, Trends in Cognitive Sciences.

[72]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[73]  Anne Cutler,et al.  Prosodic Structure in Early Word Segmentation: ERP Evidence From Dutch Ten-Month-Olds. , 2009, Infancy : the official journal of the International Society on Infant Studies.

[74]  Nivja H. Jong,et al.  Praat script to detect syllable nuclei and measure speech rate automatically , 2009, Behavior research methods.

[75]  Anne Fernald,et al.  Does input influence uptake? Links between maternal talk, processing speed and vocabulary size in Spanish-learning children. , 2008, Developmental science.

[76]  G. Karmos,et al.  Entrainment of Neuronal Oscillations as a Mechanism of Attentional Selection , 2008, Science.

[77]  Jyotsna Vaid,et al.  Bilingual language lateralization: A meta-analytic tale of two hemispheres , 2007, Neuropsychologia.

[78]  J. Wouters,et al.  Auditory processing, speech perception and phonological ability in pre-school children at high-risk for dyslexia: A longitudinal study of the auditory temporal processing theory , 2007, Neuropsychologia.

[79]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[80]  D. Poeppel,et al.  Phase Patterns of Neuronal Responses Reliably Discriminate Speech in Human Auditory Cortex , 2007, Neuron.

[81]  D. Oller,et al.  Profile effects in early bilingual language and literacy , 2007, Applied Psycholinguistics.

[82]  Jyotsna Vaid,et al.  Laterality and language experience , 2006, Laterality.

[83]  E. Thordardottir,et al.  Bilingual assessment: Can overall proficiency be estimated from separate measurement of two languages? , 2006 .

[84]  P. Kuhl Early language acquisition: cracking the speech code , 2004, Nature Reviews Neuroscience.

[85]  José Ignacio Hualde,et al.  A grammar of Basque , 2003 .

[86]  C. Norbury,et al.  Phonological processing, language, and literacy: a comparison of children with mild-to-moderate sensorineural hearing loss and those with specific language impairment. , 2001, Journal of child psychology and psychiatry, and allied disciplines.

[87]  D. Oller,et al.  The relation of input factors to lexical learning by bilingual infants , 1997, Applied Psycholinguistics.

[88]  S Nittrouer,et al.  The relation between speech perception and phonemic awareness: evidence from low-SES children and children with chronic OM. , 1996, Journal of speech and hearing research.

[89]  U. Goswami,et al.  Phonological Skills and Learning to Read , 1993, Annals of the New York Academy of Sciences.

[90]  P. Bertelson,et al.  Does awareness of speech as a sequence of phones arise spontaneously? , 1979, Cognition.

[91]  J. Paradis,et al.  Bilingual children's long-term outcomes in English as a second language: language environment factors shape individual differences in catching up with monolinguals. , 2017, Developmental science.

[92]  M. Ezeizabarrena,et al.  Early coda production in bilingual Spanish and Basque , 2015 .

[93]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[94]  J. Simon,et al.  Neural coding of continuous speech in auditory cortex during monaural and dichotic listening. , 2012, Journal of neurophysiology.

[95]  Jeff MacSwan,et al.  Minority Language Survival: Input Factors Influencing the Acquisition of Welsh. , 2005 .

[96]  S. Nittrouer,et al.  The role of early language experience in the development of speech perception and phonological processing abilities: evidence from 5-year-olds with histories of otitis media with effusion and low socioeconomic status. , 2005, Journal of communication disorders.

[97]  Maria Teresa Guasti,et al.  Language acquisition : the growth of grammar , 2002 .

[98]  S. Nittrouer,et al.  The Role of Early Language Experience in the Development of Speech Perception and Language Processing Abilities in Children with Hearing Loss. , 2001 .

[99]  A M Amjad,et al.  A framework for the analysis of mixed time series/point process data--theory and application to the study of physiological tremor, single motor unit discharges and electromyograms. , 1995, Progress in biophysics and molecular biology.

[100]  Ingvar Lundberg,et al.  Effects of an Extensive Program for Stimulating Phonological Awareness in Preschool Children. , 1988 .