Neural correlates of sound externalization

When we listen to sounds through headphones without utilizing special transforms, sound sources seem to be located inside our heads. The sound sources are said to be lateralized to one side or the other to varying degree. This internal lateralization is different than sound source localization in the natural environment in which the sound is localized distal to the head. We used fMRI to investigate difference in neural responses between lateralization and localization. Individualized binaural recordings were used as externalized auditory stimuli and stereo recordings were used as internalized auditory stimuli. Brain activity was measured while 14 participants performed an active auditory localization task and while 12 participants performed a stimulus type identification task. Irrespective of the task condition, we observed enhanced activity in the bilateral posterior temporal gyri (pSTG) for the externalized stimuli relative to the internalized stimuli. Region of interest analysis indicated that both left and right pSTG were more sensitive to sound sources in contra- than ipsilateral hemifields. Moreover, greater back than front activity was also found in the left pSTG. Compared to impoverished spatial auditory stimuli, realistic spatial auditory stimuli enhance neural responses in the pSTG. This may be why we could observe contralateral hemifield preference in bilateral pSTG that many previous studies have failed to observe. Overall, the results indicate the importance of using ecologically valid stimuli for investigating neural processes in human cortex.

[1]  Jörg Lewald,et al.  Effects of natural versus artificial spatial cues on electrophysiological correlates of auditory motion , 2010, Hearing Research.

[2]  M. Schönwiesner,et al.  Hemispheric asymmetry for auditory processing in the human auditory brain stem, thalamus, and cortex. , 2006, Cerebral cortex.

[3]  G L Romani,et al.  Human brain activation during passive listening to sounds from different locations: An fMRI and MEG study , 2005, Human brain mapping.

[4]  N. Birbaumer,et al.  Right-Hemisphere Dominance for the Processing of Sound-Source Lateralization , 2000, The Journal of Neuroscience.

[5]  J. Haxby,et al.  Parallel Visual Motion Processing Streams for Manipulable Objects and Human Movements , 2002, Neuron.

[6]  D H Mershon,et al.  Absolute and Relative Cues for the Auditory Perception of Egocentric Distance , 1979, Perception.

[7]  J. Lewald,et al.  Shared cortical systems for processing of horizontal and vertical sound motion. , 2010, Journal of neurophysiology.

[8]  B. Argall,et al.  Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus , 2004, Neuron.

[9]  G. Recanzone.  Rapidly induced auditory plasticity: the ventriloquism aftereffect. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[10]  E. Macaluso,et al.  A Common Cortical Substrate Activated by Horizontal and Vertical Sound Movement in the Human Brain , 2002, Current Biology.

[11]  P. Alku,et al.  Asymmetrical representation of auditory space in human cortex , 2010, Brain Research.

[12]  Hans-Jochen Heinze,et al.  A movement-sensitive area in auditory cortex , 1999, Nature.

[13]  Romain Brette,et al.  Spike-Timing-Based Computation in Sound Localization , 2010, PLoS Comput. Biol..

[14]  T. Griffiths,et al.  The planum temporale as a computational hub , 2002, Trends in Neurosciences.

[15]  P. Alku,et al.  A Population Rate Code of Auditory Space in the Human Cortex , 2009, PloS one.

[16]  John G. Neuhoff,et al.  Neural Processing of Auditory Looming in the Human Brain , 2002, Current Biology.

[17]  Heinrich Hertz,et al.  On the differences between localization and lateralization. , 1974, The Journal of the Acoustical Society of America.

[18]  Jeffrey R Binder,et al.  Human brain regions involved in recognizing environmental sounds. , 2004, Cerebral cortex.

[19]  J. Rauschecker,et al.  Perception of Sound-Source Motion by the Human Brain , 2002, Neuron.

[20]  R. Zatorre,et al.  Where is 'where' in the human auditory cortex? , 2002, Nature Neuroscience.

[21]  N F Suvorov,et al.  Role of the caudate nucleus in performance of the conditioned reactions connected with sound localization. , 1988, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[22]  Robert T. Knight,et al.  Cerebral Responses to Change in Spatial Location of Unattended Sounds , 2007, Neuron.

[23]  Barbara G Shinn-Cunningham,et al.  Localizing nearby sound sources in a classroom: binaural room impulse responses. , 2005, The Journal of the Acoustical Society of America.

[24]  Katrin Krumbholz,et al.  Hierarchical processing of sound location and motion in the human brainstem and planum temporale , 2005, The European journal of neuroscience.

[25]  Ian P. Howard,et al.  Auditory Distance Perception , 2012 .

[26]  J. Fell,et al.  Lateralized auditory spatial perception and the contralaterality of cortical processing as studied with functional magnetic resonance imaging and magnetoencephalography , 1999, Human brain mapping.

[27]  D Pralong,et al.  The role of individualized headphone calibration for the generation of high fidelity virtual auditory space. , 1996, The Journal of the Acoustical Society of America.

[28]  K. Palomäki,et al.  Spatial processing in human auditory cortex: the effects of 3D, ITD, and ILD stimulation techniques. , 2005, Brain research. Cognitive brain research.

[29]  W M Hartmann,et al.  On the externalization of sound images. , 1996, The Journal of the Acoustical Society of America.

[30]  Michael Erb,et al.  Processing of auditory spatial cues in human cortex: An fMRI study , 2006, Neuropsychologia.

[31]  Jennifer M Groh,et al.  A Rate Code for Sound Azimuth in Monkey Auditory Cortex: Implications for Human Neuroimaging Studies , 2008, The Journal of Neuroscience.

[32]  Takashi Hanakawa,et al.  Song and speech: Brain regions involved with perception and covert production , 2006, NeuroImage.

[33]  Andrew J King,et al.  Adaptive Reweighting of Auditory Localization Cues in Response to Chronic Unilateral Earplugging in Humans , 2010, The Journal of Neuroscience.

[34]  Tammo Houtgast,et al.  Auditory distance perception in rooms , 1999, Nature.

[35]  J. Rauschecker,et al.  Modality-specific frontal and parietal areas for auditory and visual spatial localization in humans , 1999, Nature Neuroscience.

[36]  Cathy J. Price,et al.  A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading , 2012, NeuroImage.

[37]  Robert A. Butler,et al.  Asymmetric performances in binaural localization of sound in space , 1994, Neuropsychologia.

[38]  E. Macaluso,et al.  High Binaural Coherence Determines Successful Sound Localization and Increased Activity in Posterior Auditory Areas , 2005, Neuron.

[39]  F L Wightman,et al.  Headphone simulation of free-field listening. II: Psychophysical validation. , 1989, The Journal of the Acoustical Society of America.

[40]  Jochen Kaiser,et al.  Processing of location and pattern changes of natural sounds in the human auditory cortex , 2007, NeuroImage.