“What” and “Where” in Auditory Sensory Processing: A High-Density Electrical Mapping Study of Distinct Neural Processes Underlying Sound Object Recognition and Sound Localization

Functionally distinct dorsal and ventral auditory pathways for sound localization (WHERE) and sound object recognition (WHAT) have been described in non-human primates. A handful of studies have explored differential processing within these streams in humans, with highly inconsistent findings. Stimuli employed have included simple tones, noise bursts, and speech sounds, with simulated left–right spatial manipulations, and in some cases participants were not required to actively discriminate the stimuli. Our contention is that these paradigms were not well suited to dissociating processing within the two streams. Our aim here was to determine how early in processing we could find evidence for dissociable pathways using better titrated WHAT and WHERE task conditions. The use of more compelling tasks should allow us to amplify differential processing within the dorsal and ventral pathways. We employed high-density electrical mapping using a relatively large and environmentally realistic stimulus set (seven animal calls) delivered from seven free-field spatial locations; with stimulus configuration identical across the “WHERE” and “WHAT” tasks. Topographic analysis revealed distinct dorsal and ventral auditory processing networks during the WHERE and WHAT tasks with the earliest point of divergence seen during the N1 component of the auditory evoked response, beginning at approximately 100 ms. While this difference occurred during the N1 timeframe, it was not a simple modulation of N1 amplitude as it displayed a wholly different topographic distribution to that of the N1. Global dissimilarity measures using topographic modulation analysis confirmed that this difference between tasks was driven by a shift in the underlying generator configuration. Minimum-norm source reconstruction revealed distinct activations that corresponded well with activity within putative dorsal and ventral auditory structures.

[1]  Antti Korvenoja,et al.  Differences between auditory evoked responses recorded during spatial and nonspatial working memory tasks , 2003, NeuroImage.

[2]  A. Fallgatter,et al.  Three-dimensional tomography of event-related potentials during response inhibition: evidence for phasic frontal lobe activation. , 1998, Electroencephalography and clinical neurophysiology.

[3]  Hannu J. Aronen,et al.  Evidence for Dissociation of Spatial and Nonspatial Auditory Information Processing , 2001, NeuroImage.

[4]  M. McCourt.  Performance consistency of normal observers in forced-choice tachistoscopic visual line bisection , 2001, Neuropsychologia.

[5]  C. Schroeder,et al.  A spatiotemporal profile of visual system activation revealed by current source density analysis in the awake macaque. , 1998, Cerebral cortex.

[6]  Leslie G. Ungerleider,et al.  Equivalence of parieto-preoccipital subareas for visuospatial ability in monkeys , 1982, Behavioural Brain Research.

[7]  Nancy Kanwisher,et al.  fMRI evidence for objects as the units of attentional selection , 1999, Nature.

[8]  R. Zatorre,et al.  Where is 'where' in the human auditory cortex? , 2002, Nature Neuroscience.

[9]  R. Näätänen,et al.  The mismatch negativity (MMN) in basic research of central auditory processing: A review , 2007, Clinical Neurophysiology.

[10]  G. B. Wetherill,et al.  SEQUENTIAL ESTIMATION OF POINTS ON A PSYCHOMETRIC FUNCTION. , 1965, The British journal of mathematical and statistical psychology.

[11]  R. Ilmoniemi,et al.  Interpreting magnetic fields of the brain: minimum norm estimates , 2006, Medical and Biological Engineering and Computing.

[12]  Dietrich Lehmann,et al.  Spatial analysis of evoked potentials in man—a review , 1984, Progress in Neurobiology.

[13]  P. Hazemann,et al.  Handbook of Electroencephalography and Clinical Neurophysiology , 1975 .

[14]  K. Zilles,et al.  The Neural Basis of Vertical and Horizontal Line Bisection Judgments: An fMRI Study of Normal Volunteers , 2001, NeuroImage.

[15]  G. V. Simpson,et al.  Flow of activation from V1 to frontal cortex in humans , 2001, Experimental Brain Research.

[16]  Jon H. Kaas,et al.  'What' and 'where' processing in auditory cortex , 1999, Nature Neuroscience.

[17]  John J. Foxe,et al.  Preattentively grouped tones do not elicit MMN with respect to each other. , 2006, Psychophysiology.

[18]  Stephanie Clarke,et al.  Automatic and intrinsic auditory "what" and "where" processing in humans revealed by electrical neuroimaging. , 2006, Cerebral cortex.

[19]  Richard J. Davidson,et al.  Effects of electrode density and electrolyte spreading in dense array electroencephalographic recording , 2004, Clinical Neurophysiology.

[20]  Jonathan Hutchinson,et al.  What? When? And How? , 1890, The Hospital.

[21]  M. Mishkin,et al.  Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex , 1999, Nature Neuroscience.

[22]  Lucas Spierer,et al.  Getting in touch: Segregated somatosensory what and where pathways in humans revealed by electrical neuroimaging , 2007, NeuroImage.

[23]  Péter Szigetvári,et al.  What and When? , 2019, Inauguration and Liturgical Kingship in the Long Twelfth Century.

[24]  D. Lehmann,et al.  Reference-free identification of components of checkerboard-evoked multichannel potential fields. , 1980, Electroencephalography and clinical neurophysiology.

[25]  L. M. Ward,et al.  Early phase of spatial mismatch negativity is localized to a posterior “where” auditory pathway , 2005, Experimental Brain Research.

[26]  J. Polich,et al.  Attention, probability, and task demands as determinants of P300 latency from auditory stimuli. , 1986, Electroencephalography and clinical neurophysiology.

[27]  Theodore H. Schwartz,et al.  Staying within the lines: the formation of visuospatial boundaries influences multisensory feature integration , 2010, The European journal of neuroscience.

[28]  J. Rauschecker,et al.  Mechanisms and streams for processing of "what" and "where" in auditory cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Wolfgang Grodd,et al.  Discrimination of temporal information at the cerebellum: functional magnetic resonance imaging of nonverbal auditory memory , 2004, NeuroImage.

[30]  M. Mesulam.  Attentional networks, confusional states, and neglect syndromes. , 2000 .

[31]  R. Burkard.  Human Auditory Evoked Potentials , 2010 .

[32]  Claude Alain,et al.  Assessing the auditory dual-pathway model in humans , 2004, NeuroImage.

[33]  John J. Foxe,et al.  Hemispheric asymmetry and callosal integration of visuospatial attention in schizophrenia: A tachistoscopic line bisection study , 2008, Schizophrenia Research.

[34]  S. Hillyard,et al.  Endogenous brain potentials associated with selective auditory attention. , 1980, Electroencephalography and clinical neurophysiology.

[35]  R. Rafal,et al.  Shifting visual attention between objects and locations: evidence from normal and parietal lesion subjects. , 1994, Journal of experimental psychology. General.

[36]  M. Mishkin,et al.  Functional Mapping of the Primate Auditory System , 2003, Science.

[37]  Erich Schröger,et al.  Auditory distraction by duration and location deviants: a behavioral and event-related potential study. , 2003, Brain research. Cognitive brain research.

[38]  John J. Foxe,et al.  Auditory processing in schizophrenia during the middle latency period (10-50 ms): high-density electrical mapping and source analysis reveal subcortical antecedents to early cortical deficits. , 2007, Journal of psychiatry & neuroscience : JPN.

[39]  B. Shinn-Cunningham,et al.  Task-modulated “what” and “where” pathways in human auditory cortex , 2006, Proceedings of the National Academy of Sciences.

[40]  M. Corballis,et al.  Sound lateralization in subjects with callosotomy, callosal agenesis, or hemispherectomy. , 2005, Brain research. Cognitive brain research.

[41]  John J. Foxe,et al.  Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. , 2002, Brain research. Cognitive brain research.

[42]  M. Fabiani,et al.  Naming norms for brief environmental sounds: effects of age and dementia. , 1996, Psychophysiology.

[43]  H. Ackermann,et al.  Who is telling what from where? A functional magnetic resonance imaging study , 2007, Neuroreport.

[44]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[45]  J.C. Mosher,et al.  Recursive MUSIC: A framework for EEG and MEG source localization , 1998, IEEE Transactions on Biomedical Engineering.

[46]  John J. Foxe,et al.  Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study. , 2004, Cerebral cortex.

[47]  Daniel C. Javitt,et al.  Right hemisphere control of visuospatial attention: line-bisection judgments evaluated with high-density electrical mapping and source analysis☆ , 2003, NeuroImage.

[48]  Stephanie Clarke,et al.  Auditory Neglect: What and Where in Auditory Space , 2004, Cortex.

[49]  Perrine Ruby,et al.  Odd Sound Processing in the Sleeping Brain , 2008, Journal of Cognitive Neuroscience.

[50]  D. Lehmann,et al.  Principles of spatial analysis , 1987 .

[51]  J. Rauschecker,et al.  A PET study of human auditory spatial processing , 1999, Neuroscience Letters.

[52]  John J. Foxe,et al.  The Spatiotemporal Dynamics of Illusory Contour Processing: Combined High-Density Electrical Mapping, Source Analysis, and Functional Magnetic Resonance Imaging , 2002, The Journal of Neuroscience.

[53]  S. Hillyard,et al.  Human auditory evoked potentials. I. Evaluation of components. , 1974, Electroencephalography and clinical neurophysiology.

[54]  R. Zatorre,et al.  ‘What’, ‘where’ and ‘how’ in auditory cortex , 2000, Nature Neuroscience.

[55]  B. de Gelder,et al.  Mismatch negativity predicts recovery from the vegetative state , 2007, Clinical Neurophysiology.

[56]  Jean-Philippe Thiran,et al.  What and Where in human audition: selective deficits following focal hemispheric lesions , 2002, Experimental Brain Research.

[57]  John J. Foxe,et al.  Dual mechanisms for the cross-sensory spread of attention: how much do learned associations matter? , 2010, Cerebral cortex.

[58]  K. Reinikainen,et al.  Mismatch negativity to change in spatial location of an auditory stimulus. , 1989, Electroencephalography and clinical neurophysiology.

[59]  Joseph B. Sala,et al.  Dissociable functional cortical topographies for working memory maintenance of voice identity and location. , 2004, Cerebral cortex.

[60]  R. Meuli,et al.  Auditory agnosia and auditory spatial deficits following left hemispheric lesions: evidence for distinct processing pathways , 2000, Neuropsychologia.

[61]  J. Rauschecker,et al.  Functional Specialization in Rhesus Monkey Auditory Cortex , 2001, Science.

[62]  Robert A. Butler,et al.  Asymmetric performances in binaural localization of sound in space , 1994, Neuropsychologia.

[63]  Dominique Morlet,et al.  Mismatch Negativity and N100 in Comatose Patients , 2000, Audiology and Neurotology.

[64]  M. Farah,et al.  Parietal lobe mechanisms of spatial attention: Modality-specific or supramodal? , 1989, Neuropsychologia.

[65]  Paavo Alku,et al.  Neuromagnetic recordings reveal the temporal dynamics of auditory spatial processing in the human cortex , 2006, Neuroscience Letters.

[66]  John J. Foxe,et al.  Object‐based attention is multisensory: co‐activation of an object's representations in ignored sensory modalities , 2007, The European journal of neuroscience.

[67]  Riaz A Khan,et al.  SOURCE LOCALIZATION OF BRAIN ELECTRICAL ACTIVITY VIA TIME-FREQUENCY LINEARLY CONSTRAINED MINIMUM VARIANCE METHOD , 2005 .

[68]  W. Ritter,et al.  Storage of information in transient auditory memory. , 1996, Brain research. Cognitive brain research.

[69]  Barak A. Pearlmutter,et al.  Dissecting the cellular contributions to early visual sensory processing deficits in schizophrenia using the VESPA evoked response , 2008, Schizophrenia Research.

[70]  Steven A. Hillyard,et al.  The Role of Spatial Attention in the Selection of Real and Illusory Objects , 2007, The Journal of Neuroscience.

[71]  D. Linden.  The P300: Where in the Brain Is It Produced and What Does It Tell Us? , 2005, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[72]  A. Leventhal,et al.  Signal timing across the macaque visual system. , 1998, Journal of neurophysiology.

[73]  C. Grady,et al.  “What” and “where” in the human auditory system , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[74]  John J. Foxe,et al.  The neural circuitry of pre-attentive auditory change-detection: an fMRI study of pitch and duration mismatch negativity generators. , 2005, Cerebral cortex.

[75]  John J. Foxe,et al.  Don't think of a white bear: An fMRI investigation of the effects of sequential instructional sets on cortical activity in a task‐switching paradigm , 2004, Human brain mapping.