Neural envelope tracking as a measure of speech understanding in cochlear implant users

The speech envelope is essential for speech understanding and can be reconstructed from the electroencephalogram (EEG) recorded while listening to running speech. This so-called neural envelope tracking has been shown to relate to speech understanding in normal hearing listeners, but has barely been investigated in persons wearing cochlear implants (CI). We investigated the relation between speech understanding and neural envelope tracking in CI users. EEG was recorded in 8 CI users while they listened to a story. Speech understanding was varied by changing the intensity of the presented speech. The speech envelope was reconstructed from the EEG using a linear decoder and then correlated with the envelope of the speech stimulus as a measure of neural envelope tracking which was compared to actual speech understanding. This study showed that neural envelope tracking increased with increasing speech understanding in every participant. Furthermore behaviorally measured speech understanding was correlated with participant specific neural envelope tracking results indicating the potential of neural envelope tracking as an objective measure of speech understanding in CI users. This could enable objective and automatic fitting of CIs and pave the way towards closed-loop CIs that adjust continuously and automatically to individual CI users.

[1]  D. Poeppel,et al.  Cortical Tracking of Hierarchical Linguistic Structures in Connected Speech , 2015, Nature Neuroscience.

[2]  T. Picton,et al.  Human Cortical Responses to the Speech Envelope , 2008, Ear and hearing.

[3]  Ben Somers,et al.  Neural tracking of the speech envelope in cochlear implant users , 2018, bioRxiv.

[4]  Mitsunori Mizumachi,et al.  WHAT IS SPEECH INTELLIGIBILITY? , 2017 .

[5]  Thomas Lunner,et al.  Neural tracking of attended versus ignored speech is differentially affected by hearing loss. , 2017, Journal of neurophysiology.

[6]  Gilles Faÿ,et al.  Características inmunológicas claves en la fisiopatología de la sepsis. Infectio , 2009 .

[7]  Jonathan Z. Simon,et al.  Robust cortical entrainment to the speech envelope relies on the spectro-temporal fine structure , 2014, NeuroImage.

[8]  Jan Wouters,et al.  Sound Coding in Cochlear Implants: From electric pulses to hearing , 2015, IEEE Signal Processing Magazine.

[9]  Nicola Molinaro,et al.  Delta(but not theta)‐band cortical entrainment involves speech‐specific processing , 2018, The European journal of neuroscience.

[10]  Robert V. Shannon,et al.  Effect of Stimulation Rate on Cochlear Implant Users’ Phoneme, Word and Sentence Recognition in Quiet and in Noise , 2010, Audiology and Neurotology.

[11]  Ben Somers,et al.  Neural tracking of the speech envelope in cochlear implant users. , 2019, Journal of neural engineering.

[12]  Jonathan Z. Simon,et al.  Adaptive Temporal Encoding Leads to a Background-Insensitive Cortical Representation of Speech , 2013, The Journal of Neuroscience.

[13]  Alexander Bertrand,et al.  A generic EEG artifact removal algorithm based on the multi-channel Wiener filter , 2018, Journal of neural engineering.

[14]  Philipos C. Loizou,et al.  Mimicking the human ear , 1998, IEEE Signal Process. Mag..

[15]  Jan Wouters,et al.  Speech Intelligibility Predicted from Neural Entrainment of the Speech Envelope , 2018, bioRxiv.

[16]  Jan Wouters,et al.  APEX 3: a multi-purpose test platform for auditory psychophysical experiments , 2008, Journal of Neuroscience Methods.

[17]  John J. Foxe,et al.  Resolving precise temporal processing properties of the auditory system using continuous stimuli. , 2009, Journal of neurophysiology.

[18]  J. Simon,et al.  Neural coding of continuous speech in auditory cortex during monaural and dichotic listening. , 2012, Journal of neurophysiology.

[19]  J. Simon,et al.  Emergence of neural encoding of auditory objects while listening to competing speakers , 2012, Proceedings of the National Academy of Sciences.

[20]  Edmund C. Lalor,et al.  Causal cortical dynamics of a predictive enhancement of speech intelligibility , 2018, NeuroImage.

[21]  Barak A. Pearlmutter,et al.  The VESPA: A method for the rapid estimation of a visual evoked potential , 2006, NeuroImage.

[22]  M. Dorman,et al.  The effect of parametric variations of cochlear implant processors on speech understanding. , 2000, The Journal of the Acoustical Society of America.

[23]  Astrid van Wieringen,et al.  LIST and LINT: Sentences and numbers for quantifying speech understanding in severely impaired listeners for Flanders and the Netherlands , 2008, International journal of audiology.

[24]  Lars Meyer,et al.  Linguistic Bias Modulates Interpretation of Speech via Neural Delta-Band Oscillations , 2016, Cerebral cortex.

[25]  R V Shannon,et al.  Speech Recognition with Primarily Temporal Cues , 1995, Science.

[26]  Jan Wouters,et al.  Electrically Evoked Auditory Steady State Responses in Cochlear Implant Users , 2010, Journal of the Association for Research in Otolaryngology.

[27]  D. Poeppel,et al.  Phase Patterns of Neuronal Responses Reliably Discriminate Speech in Human Auditory Cortex , 2007, Neuron.