Different spatio‐temporal electroencephalography features drive the successful decoding of binaural and monaural cues for sound localization

The human ability to localize sound is essential for monitoring our environment and helps us to analyse complex auditory scenes. Although the acoustic cues mediating sound localization have been established, it remains unknown how these cues are represented in human cortex. In particular, it is still a point of contention whether binaural and monaural cues are processed by the same or distinct cortical networks. In this study, participants listened to a sequence of auditory stimuli from different spatial locations while we recorded their neural activity using electroencephalography (EEG). The stimuli were presented over a loudspeaker array, which allowed us to deliver realistic, free‐field stimuli in both the horizontal and vertical planes. Using a multivariate classification approach, we showed that it is possible to decode sound source location from scalp‐recorded EEG. Robust and consistent decoding was shown for stimuli that provide binaural cues (i.e. Left vs. Right stimuli). Decoding location when only monaural cues were available (i.e. Front vs. Rear and elevational stimuli) was successful for a subset of subjects and showed less consistency. Notably, the spatio‐temporal pattern of EEG features that facilitated decoding differed based on the availability of binaural and monaural cues. In particular, we identified neural processing of binaural cues at around 120 ms post‐stimulus and found that monaural cues are processed later between 150 and 200 ms. Furthermore, different spatial activation patterns emerged for binaural and monaural cue processing. These spatio‐temporal dissimilarities suggest the involvement of separate cortical mechanisms in monaural and binaural acoustic cue processing.

[1]  J. Blauert Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[2]  D. M. Green,et al.  Sound localization by human listeners. , 1991, Annual review of psychology.

[3]  J. C. Middlebrooks,et al.  Sensitivity to sound-source elevation in nontonotopic auditory cortex. , 1998, Journal of neurophysiology.

[4]  Paavo Alku,et al.  Sound localization in the human brain: neuromagnetic observations , 2000, Neuroreport.

[5]  G H Recanzone,et al.  Correlation between the activity of single auditory cortical neurons and sound-localization behavior in the macaque monkey. , 2000, Journal of neurophysiology.

[6]  J. Rauschecker,et al.  Mechanisms and streams for processing of "what" and "where" in auditory cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[7]  N Birbaumer,et al.  Simultaneous bilateral mismatch response to right‐ but not leftward sound lateralization , 2000, Neuroreport.

[8]  Robert J. Zatorre,et al.  Spatial Localization after Excision of Human Auditory Cortex , 2001, The Journal of Neuroscience.

[9]  J. Rauschecker,et al.  Perception of Sound-Source Motion by the Human Brain , 2002, Neuron.

[10]  E. Macaluso,et al.  A Common Cortical Substrate Activated by Horizontal and Vertical Sound Movement in the Human Brain , 2002, Current Biology.

[11]  Riitta Hari,et al.  Human cortical representation of virtual auditory space: differences between sound azimuth and elevation , 2002, The European journal of neuroscience.

[12]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[13]  Ruth Y Litovsky,et al.  The benefit of binaural hearing in a cocktail party: effect of location and type of interferer. , 2004, The Journal of the Acoustical Society of America.

[14]  Claude Alain,et al.  Assessing the auditory dual-pathway model in humans , 2004, NeuroImage.

[15]  K. Palomäki,et al.  Spatial processing in human auditory cortex: the effects of 3D, ITD, and ILD stimulation techniques. , 2005, Brain research. Cognitive brain research.

[16]  G L Romani,et al.  Human brain activation during passive listening to sounds from different locations: An fMRI and MEG study , 2005, Human brain mapping.

[17]  Katrin Krumbholz,et al.  Hierarchical processing of sound location and motion in the human brainstem and planum temporale , 2005, The European journal of neuroscience.

[18]  B. Shinn-Cunningham,et al.  Task-modulated “what” and “where” pathways in human auditory cortex , 2006, Proceedings of the National Academy of Sciences.

[19]  Katrin Krumbholz,et al.  Cortical response to auditory motion suggests an asymmetry in the reliance on inter-hemispheric connections between the left and right auditory cortices. , 2007, Journal of neurophysiology.

[20]  E. C. Cmm,et al.  on the Recognition of Speech, with , 2008 .

[21]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[22]  Lucas Spierer,et al.  Hemispheric competence for auditory spatial representation. , 2009, Brain : a journal of neurology.

[23]  J. Lewald,et al.  Shared cortical systems for processing of horizontal and vertical sound motion. , 2010, Journal of neurophysiology.

[24]  B. Grothe,et al.  Mechanisms of sound localization in mammals. , 2010, Physiological reviews.

[25]  Michael J. Hautus,et al.  Processing of binaural spatial information in human auditory cortex: Neuromagnetic responses to interaural timing and level differences , 2010, Neuropsychologia.

[26]  A. Mognon,et al.  ADJUST: An automatic EEG artifact detector based on the joint use of spatial and temporal features. , 2011, Psychophysiology.

[27]  Jörg Lewald,et al.  When and Where of Auditory Spatial Processing in Cortex: A Novel Approach Using Electrotomography , 2011, PloS one.

[28]  Michael S. Pratte,et al.  Decoding patterns of human brain activity. , 2012, Annual review of psychology.

[29]  W. Singer,et al.  Auditory motion direction encoding in auditory cortex and high‐level visual cortex , 2012, Human brain mapping.

[30]  Pádraig T. Kitterick,et al.  Evidence for Opponent Process Analysis of Sound Source Location in Humans , 2013, Journal of the Association for Research in Otolaryngology.

[31]  K. Krumbholz,et al.  Are Interaural Time and Level Differences Represented by Independent or Integrated Codes in the Human Auditory Cortex? , 2013, Journal of the Association for Research in Otolaryngology.

[32]  Stefan Haufe,et al.  On the interpretation of weight vectors of linear models in multivariate neuroimaging , 2014, NeuroImage.

[33]  Iiro P. Jääskeläinen,et al.  Psychophysics and neuronal bases of sound localization in humans , 2014, Hearing Research.

[34]  John J. Foxe,et al.  Attentional Selection in a Cocktail Party Environment Can Be Decoded from Single-Trial EEG. , 2015, Cerebral cortex.

[35]  Alessandro Altoè,et al.  Integrated processing of spatial cues in human auditory cortex , 2015, Hearing Research.

[36]  Karim Jerbi,et al.  Exceeding chance level by chance: The caveat of theoretical chance levels in brain signal classification and statistical assessment of decoding accuracy , 2015, Journal of Neuroscience Methods.