Target Speaker Detection with Concealed EEG Around the Ear

Target speaker identification is essential for speech enhancement algorithms in assistive devices aimed toward helping the hearing impaired. Several recent studies have reported that target speaker identification is possible through electroencephalography (EEG) recordings. If the EEG system could be reduced to acceptable size while retaining the signal quality, hearing aids could benefit from the integration with concealed EEG. To compare the performance of a multichannel around-the-ear EEG system with high-density cap EEG recordings an envelope tracking algorithm was applied in a competitive speaker paradigm. The data from 20 normal hearing listeners were concurrently collected from the traditional state-of-the-art laboratory wired EEG system and a wireless mobile EEG system with two bilaterally-placed around-the-ear electrode arrays (cEEGrids). The results show that the cEEGrid ear-EEG technology captured neural signals that allowed the identification of the attended speaker above chance-level, with 69.3% accuracy, while cap-EEG signals resulted in the accuracy of 84.8%. Further analyses investigated the influence of ear-EEG signal quality and revealed that the envelope tracking procedure was unaffected by variability in channel impedances. We conclude that the quality of concealed ear-EEG recordings as acquired with the cEEGrid array has potential to be used in the brain-computer interface steering of hearing aids.

[1]  Steven van de Par,et al.  Speech enhancement for multimicrophone binaural hearing aids aiming to preserve the spatial auditory scene , 2016, EURASIP J. Adv. Signal Process..

[2]  Martin G Bleichner,et al.  Exploring miniaturized EEG electrodes for brain-computer interfaces. An EEG you do not see? , 2015, Physiological reports.

[3]  Barbara Shinn-Cunningham,et al.  The perceptual consequences of binaural hearing , 2006, International journal of audiology.

[4]  N. Mesgarani,et al.  Selective cortical representation of attended speaker in multi-talker speech perception , 2012, Nature.

[5]  Alessandro Presacco,et al.  Robust decoding of selective auditory attention from MEG in a competing-speaker environment via state-space modeling , 2016, NeuroImage.

[6]  S. Shamma,et al.  Temporal coherence and attention in auditory scene analysis , 2011, Trends in Neurosciences.

[7]  S. Debener,et al.  Unobtrusive ambulatory EEG using a smartphone and flexible printed electrodes around the ear , 2015, Scientific Reports.

[8]  E. C. Cmm,et al.  on the Recognition of Speech, with , 2008 .

[9]  Gabriel Curio,et al.  Miniaturized electroencephalographic scalp electrode for optimal wearing comfort , 2010, Clinical Neurophysiology.

[10]  P M Zurek,et al.  Evaluation of an adaptive beamforming method for hearing aids. , 1992, The Journal of the Acoustical Society of America.

[11]  Michael J. Crosse,et al.  Congruent Visual Speech Enhances Cortical Entrainment to Continuous Auditory Speech in Noise-Free Conditions , 2015, The Journal of Neuroscience.

[12]  David Poeppel,et al.  The Tracking of Speech Envelope in the Human Cortex , 2013, PloS one.

[13]  David Poeppel,et al.  Acoustic landmarks drive delta–theta oscillations to enable speech comprehension by facilitating perceptual parsing , 2014, NeuroImage.

[14]  D. Poeppel,et al.  Mechanisms Underlying Selective Neuronal Tracking of Attended Speech at a “Cocktail Party” , 2013, Neuron.

[15]  Riitta Hari,et al.  Left Superior Temporal Gyrus Is Coupled to Attended Speech in a Cocktail-Party Auditory Scene , 2016, The Journal of Neuroscience.

[16]  Maarten De Vos,et al.  P300 speller BCI with a mobile EEG system: comparison to a traditional amplifier , 2014, Journal of neural engineering.

[17]  S. Debener,et al.  How about taking a low-cost, small, and wireless EEG for a walk? , 2012, Psychophysiology.

[18]  Maarten De Vos,et al.  Decoding the attended speech stream with multi-channel EEG: implications for online, daily-life applications , 2015, Journal of neural engineering.

[19]  Volker Hohmann,et al.  Database of Multichannel In-Ear and Behind-the-Ear Head-Related and Binaural Room Impulse Responses , 2009, EURASIP J. Adv. Signal Process..

[20]  T. Picton,et al.  Human Cortical Responses to the Speech Envelope , 2008, Ear and hearing.

[21]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[22]  David Poeppel,et al.  Cortical oscillations and speech processing: emerging computational principles and operations , 2012, Nature Neuroscience.

[23]  M. De Vos,et al.  P376: Wireless EEG with individual channel positions facilitates efficient motor imagery training , 2014, Clinical Neurophysiology.

[24]  John J. Foxe,et al.  At what time is the cocktail party? A late locus of selective attention to natural speech , 2012, The European journal of neuroscience.

[25]  Barbara Shinn-Cunningham,et al.  Individual differences in attentional modulation of cortical responses correlate with selective attention performance , 2014, Hearing Research.

[26]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[27]  S. Debener,et al.  Towards a truly mobile auditory brain-computer interface: exploring the P300 to take away. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[28]  J. Simon,et al.  Cortical entrainment to continuous speech: functional roles and interpretations , 2014, Front. Hum. Neurosci..

[29]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[30]  J. Simon,et al.  Emergence of neural encoding of auditory objects while listening to competing speakers , 2012, Proceedings of the National Academy of Sciences.

[31]  G. Kidd,et al.  The effect of spatial separation on informational masking of speech in normal-hearing and hearing-impaired listeners. , 2005, The Journal of the Acoustical Society of America.

[32]  John J. Foxe,et al.  Attentional Selection in a Cocktail Party Environment Can Be Decoded from Single-Trial EEG. , 2015, Cerebral cortex.

[33]  B. Shinn-Cunningham,et al.  Selective Attention in Normal and Impaired Hearing , 2008, Trends in amplification.

[34]  Brian C J Moore,et al.  Properties of auditory stream formation , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[35]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[36]  Brian N. Pasley,et al.  Reconstructing Speech from Human Auditory Cortex , 2012, PLoS biology.

[37]  Maarten De Vos,et al.  Wireless EEG with individualized channel layout enables efficient motor imagery training , 2015, Clinical Neurophysiology.

[38]  G Hickok,et al.  Role of anterior temporal cortex in auditory sentence comprehension: an fMRI study , 2001, Neuroreport.

[39]  Volker Hohmann,et al.  Binaural cue preservation for hearing aids using multi-channel wiener filter with instantaneous ITF preservation , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[40]  Virginia Best,et al.  Object continuity enhances selective auditory attention , 2008, Proceedings of the National Academy of Sciences.

[41]  Christopher K. Kovach,et al.  Temporal Envelope of Time-Compressed Speech Represented in the Human Auditory Cortex , 2009, The Journal of Neuroscience.