The Encoding of Sound Source Elevation in the Human Auditory Cortex

Spatial hearing is a crucial capacity of the auditory system. While the encoding of horizontal sound direction has been extensively studied, very little is known about the representation of vertical sound direction in the auditory cortex. Using high-resolution fMRI, we measured voxelwise sound elevation tuning curves in human auditory cortex and show that sound elevation is represented by broad tuning functions preferring lower elevations as well as secondary narrow tuning functions preferring individual elevation directions. We changed the ear shape of participants (male and female) with silicone molds for several days. This manipulation reduced or abolished the ability to discriminate sound elevation and flattened cortical tuning curves. Tuning curves recovered their original shape as participants adapted to the modified ears and regained elevation perception over time. These findings suggest that the elevation tuning observed in low-level auditory cortex did not arise from the physical features of the stimuli but is contingent on experience with spectral cues and covaries with the change in perception. One explanation for this observation may be that the tuning in low-level auditory cortex underlies the subjective perception of sound elevation. SIGNIFICANCE STATEMENT This study addresses two fundamental questions about the brain representation of sensory stimuli: how the vertical spatial axis of auditory space is represented in the auditory cortex and whether low-level sensory cortex represents physical stimulus features or subjective perceptual attributes. Using high-resolution fMRI, we show that vertical sound direction is represented by broad tuning functions preferring lower elevations as well as secondary narrow tuning functions preferring individual elevation directions. In addition, we demonstrate that the shape of these tuning functions is contingent on experience with spectral cues and covaries with the change in perception, which may indicate that the tuning functions in low-level auditory cortex underlie the perceived elevation of a sound source.

[1]  Marc O Ernst,et al.  Natural auditory scene statistics shapes human spatial hearing , 2014, Proceedings of the National Academy of Sciences.

[2]  F. Asano,et al.  Role of spectral cues in median plane localization. , 1990, The Journal of the Acoustical Society of America.

[3]  J R Lackner,et al.  Changes in auditory localization during body tilt. , 1974, Acta oto-laryngologica.

[4]  I. Fried,et al.  Coupling between Neuronal Firing Rate, Gamma LFP, and BOLD fMRI Is Related to Interneuronal Correlations , 2007, Current Biology.

[5]  Teemu Rinne,et al.  Functional Maps of Human Auditory Cortex: Effects of Acoustic Features and Attention , 2009, PloS one.

[6]  Alan C. Evans,et al.  A general statistical analysis for fMRI data , 2000, NeuroImage.

[7]  M. W. Altshuler,et al.  Effect of Body Tilt on Auditory Localization , 1971, Perceptual and motor skills.

[8]  P. Alku,et al.  A Population Rate Code of Auditory Space in the Human Cortex , 2009, PloS one.

[9]  J. Blauert Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[10]  E. Formisano,et al.  Auditory Cortex Encodes the Perceptual Interpretation of Ambiguous Sound , 2011, The Journal of Neuroscience.

[11]  M. Schönwiesner,et al.  Representation of interaural temporal information from left and right auditory space in the human planum temporale and inferior parietal lobe. , 2005, Cerebral cortex.

[12]  Arne D. Ekstrom,et al.  How and when the fMRI BOLD signal relates to underlying neural activity: The danger in dissociation , 2010, Brain Research Reviews.

[13]  Joyce Vliegen,et al.  Dynamic Sound Localization during Rapid Eye-Head Gaze Shifts , 2004, The Journal of Neuroscience.

[14]  A. V. van Opstal,et al.  Relearning Sound Localization with a New Ear , 2005, The Journal of Neuroscience.

[15]  Ramani Duraiswami,et al.  Extracting the frequencies of the pinna spectral notches in measured head related impulse responses. , 2004, The Journal of the Acoustical Society of America.

[16]  N. Lesica,et al.  The Neural Representation of Interaural Time Differences in Gerbils Is Transformed from Midbrain to Cortex , 2014, The Journal of Neuroscience.

[17]  D D Dirks,et al.  The effect of spatially separated sound sources on speech intelligibility. , 1969, Journal of speech and hearing research.

[18]  Noël Staeren,et al.  Sound Categories Are Represented as Distributed Patterns in the Human Auditory Cortex , 2009, Current Biology.

[19]  S. Carlile The plastic ear and perceptual relearning in auditory spatial perception , 2014, Front. Neurosci..

[20]  E D Young,et al.  Neural organization and responses to complex stimuli in the dorsal cochlear nucleus. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[21]  V R Algazi,et al.  Elevation localization and head-related transfer function analysis at low frequencies. , 2001, The Journal of the Acoustical Society of America.

[22]  Riitta Hari,et al.  Human cortical representation of virtual auditory space: differences between sound azimuth and elevation , 2002, The European journal of neuroscience.

[23]  Nobuo Suga,et al.  Corticofugal modulation of the midbrain frequency map in the bat auditory system , 1998, Nature Neuroscience.

[24]  T. Imig,et al.  Directionality derived from pinna-cue spectral notches in cat dorsal cochlear nucleus. , 2000, Journal of neurophysiology.

[25]  Simon Carlile,et al.  The nature and distribution of errors in sound localization by human listeners , 1997, Hearing Research.

[26]  Victoria M Bajo,et al.  The descending corticocollicular pathway mediates learning-induced auditory plasticity , 2010, Nature Neuroscience.

[27]  Jörg Lewald,et al.  Processing of sound location in human cortex , 2008, The European journal of neuroscience.

[28]  A. J. King,et al.  Role of auditory cortex in sound localization in the midsagittal plane. , 2007, Journal of neurophysiology.

[29]  A. King,et al.  Encoding of virtual acoustic space stimuli by neurons in ferret primary auditory cortex. , 2005, Journal of neurophysiology.

[30]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[31]  Robert A. Butler,et al.  Asymmetric performances in binaural localization of sound in space , 1994, Neuropsychologia.

[32]  J. C. Middlebrooks,et al.  Two-dimensional sound localization by human listeners. , 1990, The Journal of the Acoustical Society of America.

[33]  Paul M. Hofman,et al.  Relearning sound localization with new ears , 1998, Nature Neuroscience.

[34]  D. Schwarz,et al.  Plasticity in human directional hearing. , 1995, The Journal of otolaryngology.

[35]  J. C. Middlebrooks,et al.  Sensitivity to sound-source elevation in nontonotopic auditory cortex. , 1998, Journal of neurophysiology.

[36]  N. Logothetis,et al.  Neurophysiology of the BOLD fMRI Signal in Awake Monkeys , 2008, Current Biology.

[37]  G H Recanzone,et al.  Spatial processing in the auditory cortex of the macaque monkey. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[38]  K. A. Davis,et al.  Auditory Processing of Spectral Cues for Sound Localization in the Inferior Colliculus , 2003, Journal of the Association for Research in Otolaryngology.

[39]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[40]  E. Macaluso,et al.  A Common Cortical Substrate Activated by Horizontal and Vertical Sound Movement in the Human Brain , 2002, Current Biology.

[41]  G. Christopher Stecker,et al.  Tuning to Binaural Cues in Human Auditory Cortex , 2016, Journal of the Association for Research in Otolaryngology.

[42]  G. Recanzone,et al.  Effects of stimulus azimuth and intensity on the single-neuron activity in the auditory cortex of the alert macaque monkey. , 2006, Journal of neurophysiology.

[43]  Simon Carlile,et al.  Accommodating to new ears: the effects of sensory and sensory-motor feedback. , 2014, The Journal of the Acoustical Society of America.

[44]  G. Recanzone Rapidly induced auditory plasticity: the ventriloquism aftereffect. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[45]  Jochen Kaiser,et al.  Processing of Auditory Location Changes after Horizontal Head Rotation , 2009, The Journal of Neuroscience.

[46]  Xiaolin Hu,et al.  Neural representation of three-dimensional acoustic space in the human temporal lobe , 2015, Front. Hum. Neurosci..

[47]  Q. Summerfield Book Review: Auditory Scene Analysis: The Perceptual Organization of Sound , 1992 .

[48]  P. Alku,et al.  Asymmetrical representation of auditory space in human cortex , 2010, Brain Research.

[49]  F L Wightman,et al.  Headphone simulation of free-field listening. II: Psychophysical validation. , 1989, The Journal of the Acoustical Society of America.

[50]  C. Angelborg Distribution of Macromolecular Tracer Particles (Thorotrast(R)) in the Cochlea. An Electron Microscopic Study in Guinea Pig: Part I. The organ of Corti, the basilar membrane and the tympanic covering layer. , 1974, Acta oto-laryngologica.

[51]  DeLiang Wang,et al.  Speech segregation based on sound localization , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[52]  P. Morosan,et al.  Probabilistic Mapping and Volume Measurement of Human Primary Auditory Cortex , 2001, NeuroImage.

[53]  Katrin Krumbholz,et al.  Evidence for opponent-channel coding of interaural time differences in human auditory cortex. , 2010, Journal of neurophysiology.

[54]  Marc Schönwiesner,et al.  Adaptation to shifted interaural time differences changes encoding of sound location in human auditory cortex , 2015, NeuroImage.

[55]  Simon Carlile,et al.  Relearning Auditory Spectral Cues for Locations Inside and Outside the Visual Field , 2014, Journal of the Association for Research in Otolaryngology.

[56]  K. Palomäki,et al.  Spatial processing in human auditory cortex: the effects of 3D, ITD, and ILD stimulation techniques. , 2005, Brain research. Cognitive brain research.

[57]  Nobuo Suga,et al.  Plasticity and Corticofugal Modulation for Hearing in Adult Animals , 2002, Neuron.

[58]  B. Scharf,et al.  Auditory attention: the psychoacoustical approach , 1998 .

[59]  John F. Brugge,et al.  Simulation of free-field sound sources and its application to studies of cortical mechanisms of sound localization in the cat , 1994, Hearing Research.

[60]  Talia Shrem,et al.  Spatial Localization of Auditory Stimuli in Human Auditory Cortex is Based on Both Head-Independent and Head-Centered Coordinate Systems , 2012, The Journal of Neuroscience.

[61]  I. Fried,et al.  Coupling Between Neuronal Firing, Field Potentials, and fMRI in Human Auditory Cortex , 2005, Science.

[62]  G H Recanzone,et al.  Correlation between the activity of single auditory cortical neurons and sound-localization behavior in the macaque monkey. , 2000, Journal of neurophysiology.

[63]  P M Hofman,et al.  Spectro-temporal factors in two-dimensional human sound localization. , 1998, The Journal of the Acoustical Society of America.

[64]  J. C. Middlebrooks,et al.  Spatial Stream Segregation by Auditory Cortical Neurons , 2013, The Journal of Neuroscience.

[65]  K. Krumbholz,et al.  Are Interaural Time and Level Differences Represented by Independent or Integrated Codes in the Human Auditory Cortex? , 2013, Journal of the Association for Research in Otolaryngology.

[66]  H H Goossens,et al.  Influence of head position on the spatial representation of acoustic targets. , 1999, Journal of neurophysiology.

[67]  Gaëtan Parseihian,et al.  Rapid head-related transfer function adaptation using a virtual auditory environment. , 2012, The Journal of the Acoustical Society of America.

[68]  Gregory H. Wakefield,et al.  Introduction to Head-Related Transfer Functions (HRTFs): Representations of HRTFs in Time, Frequency, and Space , 2001 .

[69]  E. Langendijk,et al.  Contribution of spectral cues to human sound localization. , 1999, The Journal of the Acoustical Society of America.

[70]  Timothy D Griffiths,et al.  Mapping Pitch Representation in Neural Ensembles with fMRI , 2012, The Journal of Neuroscience.

[71]  J. C. Middlebrooks,et al.  Location Coding by Opponent Neural Populations in the Auditory Cortex , 2005, PLoS biology.

[72]  D. Broadbent The role of auditory localization in attention and memory span. , 1954, Journal of experimental psychology.

[73]  Karl J. Friston,et al.  A unified statistical approach for determining significant signals in images of cerebral activation , 1996, Human brain mapping.

[74]  David McAlpine,et al.  Optimal neural population coding of an auditory spatial cue , 2004, Nature.

[75]  M. W. Altshuler,et al.  Effect of Body Tilt on Auditory Lateralization , 1971, Perceptual and motor skills.

[76]  Katrin Krumbholz,et al.  Parcellation of Human and Monkey Core Auditory Cortex with fMRI Pattern Classification and Objective Detection of Tonotopic Gradient Reversals , 2014, Cerebral cortex.

[77]  J. C. Middlebrooks,et al.  Individual differences in external-ear transfer functions reduced by scaling in frequency. , 1999, The Journal of the Acoustical Society of America.

[78]  Jennifer M Groh,et al.  A Rate Code for Sound Azimuth in Monkey Auditory Cortex: Implications for Human Neuroimaging Studies , 2008, The Journal of Neuroscience.

[79]  W Owen Brimijoin,et al.  Egocentric and allocentric representations in auditory cortex , 2017, bioRxiv.

[80]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[81]  Colin Humphries,et al.  Tonotopic organization of human auditory cortex , 2010, NeuroImage.

[82]  Alan C. Evans,et al.  A General Statistical Analysis for fMRI Data , 2000, NeuroImage.

[83]  A John Van Opstal,et al.  The influence of duration and level on human sound localization. , 2004, The Journal of the Acoustical Society of America.

[84]  Marc Schönwiesner,et al.  Fast and persistent adaptation to new spectral cues for sound localization suggests a many-to-one mapping mechanism. , 2016, The Journal of the Acoustical Society of America.

[85]  R. Bowtell,et al.  “sparse” temporal sampling in auditory fMRI , 1999, Human brain mapping.