The encoding of auditory objects in auditory cortex: insights from magnetoencephalography.

Auditory objects, like their visual counterparts, are perceptually defined constructs, but nevertheless must arise from underlying neural circuitry. Using magnetoencephalography (MEG) recordings of the neural responses of human subjects listening to complex auditory scenes, we review studies that demonstrate that auditory objects are indeed neurally represented in auditory cortex. The studies use neural responses obtained from different experiments in which subjects selectively listen to one of two competing auditory streams embedded in a variety of auditory scenes. The auditory streams overlap spatially and often spectrally. In particular, the studies demonstrate that selective attentional gain does not act globally on the entire auditory scene, but rather acts differentially on the separate auditory streams. This stream-based attentional gain is then used as a tool to individually analyze the different neural representations of the competing auditory streams. The neural representation of the attended stream, located in posterior auditory cortex, dominates the neural responses. Critically, when the intensities of the attended and background streams are separately varied over a wide intensity range, the neural representation of the attended speech adapts only to the intensity of that speaker, irrespective of the intensity of the background speaker. This demonstrates object-level intensity gain control in addition to the above object-level selective attentional gain. Overall, these results indicate that concurrently streaming auditory objects, even if spectrally overlapping and not resolvable at the auditory periphery, are individually neurally encoded in auditory cortex, as separate objects.

[1]  Adrian K. C. Lee,et al.  Using neuroimaging to understand the cortical mechanisms of auditory selective attention , 2014, Hearing Research.

[2]  David Poeppel,et al.  The analysis of speech in different temporal integration windows: cerebral lateralization as 'asymmetric sampling in time' , 2003, Speech Commun..

[3]  Jonathan Z. Simon,et al.  Abstract Journal of Neuroscience Methods 165 (2007) 297–305 Denoising based on time-shift PCA , 2007 .

[4]  S. Shamma,et al.  Interaction between Attention and Bottom-Up Saliency Mediates the Representation of Foreground and Background in an Auditory Scene , 2009, PLoS biology.

[5]  David Poeppel,et al.  Auditory M50 and M100 responses to broadband noise: functional implications , 2004, Neuroreport.

[6]  Yale E. Cohen amp Andersen,et al.  Multimodal spatial representations in the primate parietal lobe , 2004 .

[7]  Jonathan Z. Simon,et al.  Robust cortical entrainment to the speech envelope relies on the spectro-temporal fine structure , 2014, NeuroImage.

[8]  C. Plack Oxford Handbook of Auditory Science: Hearing , 2010 .

[9]  Bernd Lütkenhöner,et al.  High-Precision Neuromagnetic Study of the Functional Organization of the Human Auditory Cortex , 1998, Audiology and Neurotology.

[10]  Y. Cohen,et al.  Neural Correlates of Auditory Cognition , 2013, Springer Handbook of Auditory Research.

[11]  Yadong Wang,et al.  Significance tests for MEG response detection , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..

[12]  J. Simon,et al.  Neural coding of continuous speech in auditory cortex during monaural and dichotic listening. , 2012, Journal of neurophysiology.

[13]  E. C. Cherry Some Experiments on the Recognition of Speech, with One and with Two Ears , 1953 .

[14]  Melissa K. Gregg,et al.  Attention, Awareness, and the Perception of Auditory Scenes , 2011, Front. Psychology.

[15]  M. Ericson,et al.  Informational and energetic masking effects in the perception of multiple simultaneous talkers. , 2001, The Journal of the Acoustical Society of America.

[16]  I. Winkler,et al.  Object representation in the human auditory system , 2006, The European journal of neuroscience.

[17]  B. Shinn-Cunningham,et al.  Task-modulated “what” and “where” pathways in human auditory cortex , 2006, Proceedings of the National Academy of Sciences.

[18]  B. Shinn-Cunningham Object-based auditory and visual attention , 2008, Trends in Cognitive Sciences.

[19]  I. Winkler,et al.  Recording Event-Related Brain Potentials: Application to Study Auditory Perception , 2012 .

[20]  Jonathan Z. Simon,et al.  Fully complex magnetoencephalography , 2005, Journal of Neuroscience Methods.

[21]  D. Poeppel,et al.  Mechanisms Underlying Selective Neuronal Tracking of Attended Speech at a “Cocktail Party” , 2013, Neuron.

[22]  M. Kubovy,et al.  Auditory and visual objects , 2001, Cognition.

[23]  Alain de Cheveigné,et al.  Sensor noise suppression , 2008, Journal of Neuroscience Methods.

[24]  Jonathan Z. Simon,et al.  Denoising based on spatial filtering , 2008, Journal of Neuroscience Methods.

[25]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[26]  Barbara G. Shinn-Cunningham,et al.  Auditory Selective Attention Reveals Preparatory Activity in Different Cortical Regions for Selection Based on Source Location and Source Pitch , 2012, Front. Neurosci..

[27]  Ruth Y Litovsky,et al.  The benefit of binaural hearing in a cocktail party: effect of location and type of interferer. , 2004, The Journal of the Acoustical Society of America.

[28]  T. Griffiths,et al.  What is an auditory object? , 2004, Nature Reviews Neuroscience.

[29]  Albert S. Bregman,et al.  The Auditory Scene. (Book Reviews: Auditory Scene Analysis. The Perceptual Organization of Sound.) , 1990 .

[30]  Jonathan Z. Simon,et al.  Adaptive Temporal Encoding Leads to a Background-Insensitive Cortical Representation of Speech , 2013, The Journal of Neuroscience.

[31]  J. Simon,et al.  Emergence of neural encoding of auditory objects while listening to competing speakers , 2012, Proceedings of the National Academy of Sciences.

[32]  C Alain,et al.  Selectively attending to auditory objects. , 2000, Frontiers in bioscience : a journal and virtual library.

[33]  Mounya Elhilali,et al.  Competing Streams at the Cocktail Party: Exploring the Mechanisms of Attention and Temporal Integration , 2010, The Journal of Neuroscience.

[34]  S. David,et al.  Estimating sparse spectro-temporal receptive fields with natural stimuli , 2007, Network.

[35]  Simon Haykin,et al.  The Cocktail Party Problem , 2005, Neural Computation.

[36]  S. Shamma,et al.  Temporal coherence and attention in auditory scene analysis , 2011, Trends in Neurosciences.

[37]  J. Simon,et al.  MEG Adaptive Noise Suppression using Fast LMS , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..