Non-auditory processing in the central auditory pathway

Multisensory responses have been observed throughout the central auditory pathway, yet the origin, function and perceptual consequences of cross-modal integration remain unresolved. Recent studies have applied modern neuroanatomical and functional perturbation techniques to dissect the circuits that might enable multisensory information to sculpt the processing of sound. These highlight in particular the role that subcortical pathways might play relaying multisensory information to and between sensory cortical fields. We also examine the consequences of integrating non-auditory information into auditory processing, identifying key areas where this may be critical for successful listening and potential roles for visual information in augmenting auditory scene analysis, and for non-auditory information in facilitating coordinate frame transformations.

[1]  Brian H Scott,et al.  Thalamic connections of the core auditory cortex and rostral supratemporal plane in the macaque monkey , 2017, The Journal of comparative neurology.

[2]  P. A. Young,et al.  Cortical projections to the inferior colliculus of the cat , 1976, Experimental Neurology.

[3]  Johannes C. Dahmen,et al.  Subcortical circuits mediate communication between primary sensory cortical areas in mice , 2020, Nature Communications.

[4]  Michael M. Halassa,et al.  Prefrontal Cortex Regulates Sensory Filtering through a Basal Ganglia-to-Thalamus Pathway , 2019, Neuron.

[5]  Matthew I Banks,et al.  Descending projections from extrastriate visual cortex modulate responses of cells in primary auditory cortex. , 2011, Cerebral cortex.

[6]  Kathleen S Rockland,et al.  Multisensory convergence in calcarine visual areas in macaque monkey. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[7]  N. Logothetis,et al.  Visual modulation of neurons in auditory cortex. , 2008, Cerebral cortex.

[8]  T. Hackett,et al.  Multisensory convergence in auditory cortex, I. Cortical connections of the caudal superior temporal plane in macaque monkeys , 2007, The Journal of comparative neurology.

[9]  C. Schroeder,et al.  Neuronal Oscillations and Multisensory Interaction in Primary Auditory Cortex , 2007, Neuron.

[10]  Ed X. Wu,et al.  Optogenetic auditory fMRI reveals the effects of visual cortical inputs on auditory midbrain response , 2018, Scientific Reports.

[11]  A. Bregman.  Auditory Scene Analysis , 2008 .

[12]  E D Young,et al.  Proprioceptive Information from the Pinna Provides Somatosensory Input to Cat Dorsal Cochlear Nucleus , 2001, The Journal of Neuroscience.

[13]  David A. Bulkin,et al.  Distribution of eye position information in the monkey inferior colliculus. , 2012, Journal of neurophysiology.

[14]  M. Alex Meredith,et al.  Crossmodal projections from somatosensory area SIV to the auditory field of the anterior ectosylvian sulcus (FAES) in Cat: further evidence for subthreshold forms of multisensory processing , 2006, Experimental Brain Research.

[15]  P. Barone,et al.  Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey , 2005, The European journal of neuroscience.

[16]  Istvan Ulbert,et al.  Projection from visual areas V2 and prostriata to caudal auditory cortex in the monkey. , 2010, Cerebral cortex.

[17]  Piotr Majka,et al.  Unidirectional monosynaptic connections from auditory areas to the primary visual cortex in the marmoset monkey , 2018, Brain Structure and Function.

[18]  Aditya Gilra,et al.  Thalamic regulation of switching between cortical representations enables cognitive flexibility , 2018, Nature Neuroscience.

[19]  Ankoor S. Shah,et al.  Auditory Cortical Neurons Respond to Somatosensory Stimulation , 2003, The Journal of Neuroscience.

[20]  J. Coleman,et al.  Sources of projections to subdivisions of the inferior colliculus in the rat , 1987, The Journal of comparative neurology.

[21]  J. Kaas,et al.  Thalamocortical connections of the parabelt auditory cortex in macaque monkeys , 1998, The Journal of comparative neurology.

[22]  R U Muller,et al.  Head-direction cells recorded from the postsubiculum in freely moving rats. I. Description and quantitative analysis , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  Adrian K. C. Lee,et al.  Integration of Visual Information in Auditory Cortex Promotes Auditory Scene Analysis through Multisensory Binding , 2017, Neuron.

[24]  Istvan Ulbert,et al.  Sources of Somatosensory Input to the Caudal Belt Areas of Auditory Cortex , 2007, Perception.

[25]  Stephen G. Lomber,et al.  Auditory cortex projections target the peripheral field representation of primary visual cortex , 2008, Experimental Brain Research.

[26]  Matthew T. Kaufman,et al.  A category-free neural population supports evolving demands during decision-making , 2014, Nature Neuroscience.

[27]  Joost X. Maier,et al.  Multisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex , 2005 .

[28]  M. Wallace,et al.  A revised view of sensory cortical parcellation , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[29]  T. Ono,et al.  Auditory thalamus integrates visual inputs into behavioral gains , 2005, Nature Neuroscience.

[30]  Lisa A. de la Mothe,et al.  Thalamic connections of the auditory cortex in marmoset monkeys: Core and medial belt regions , 2006, The Journal of comparative neurology.

[31]  L. Krubitzer,et al.  Connections of auditory and visual cortex in the prairie vole (Microtus ochrogaster): evidence for multisensory processing in primary sensory areas. , 2010, Cerebral cortex.

[32]  I. Nelken,et al.  Physiological and Anatomical Evidence for Multisensory Interactions in Auditory Cortex , 2006, Cerebral cortex.

[33]  A. Hasenstaub,et al.  Visual Information Present in Infragranular Layers of Mouse Auditory Cortex , 2018, The Journal of Neuroscience.

[34]  Adrian K. C. Lee,et al.  Defining Auditory-Visual Objects: Behavioral Tests and Physiological Mechanisms , 2016, Trends in Neurosciences.

[35]  A. Cowey,et al.  Development and retraction of a crossed retinal projection to the inferior colliculus in neonatal pigmented rats , 1990, Neuroscience.

[36]  K. Grieve,et al.  The primate pulvinar nuclei: vision and action , 2000, Trends in Neurosciences.

[37]  Rogelio Luna,et al.  Do Sensory Cortices Process More than One Sensory Modality during Perceptual Judgments? , 2010, Neuron.

[38]  Stephen G. Lomber,et al.  What and How the Deaf Brain Sees , 2019, Journal of Cognitive Neuroscience.

[39]  Israel Nelken,et al.  Early multisensory integration of self and source motion in the auditory system , 2016, Proceedings of the National Academy of Sciences.

[40]  A. King,et al.  Visual–auditory spatial processing in auditory cortical neurons , 2008, Brain Research.

[41]  M. Meredith,et al.  Multiple sensory afferents to ferret pseudosylvian sulcal cortex , 2004, Neuroreport.

[42]  S. Shore,et al.  Listening to another sense: somatosensory integration in the auditory system , 2015, Cell and Tissue Research.

[43]  Brian L Allman,et al.  Single‐unit analysis of somatosensory processing in the core auditory cortex of hearing ferrets , 2015, The European journal of neuroscience.

[44]  Jennifer K Bizley,et al.  Where are multisensory signals combined for perceptual decision-making? , 2016, Current Opinion in Neurobiology.

[45]  P. Manis,et al.  Somatosensory inputs modify auditory spike timing in dorsal cochlear nucleus principal cells , 2011, The European journal of neuroscience.

[46]  Adrian K. C. Lee,et al.  Auditory selective attention is enhanced by a task-irrelevant temporally coherent visual stimulus in human listeners , 2015, eLife.

[47]  Janine L Kwapis,et al.  A neuroscientist’s guide to transgenic mice and other genetic tools , 2019, Neuroscience & Biobehavioral Reviews.

[48]  J. Groh,et al.  Representation of eye position in primate inferior colliculus. , 2006, Journal of neurophysiology.

[49]  Istvan Ulbert,et al.  Multisensory convergence in auditory cortex, II. Thalamocortical connections of the caudal superior temporal plane , 2007, The Journal of comparative neurology.

[50]  J. Winer,et al.  Auditory thalamocortical projections in the cat: Laminar and areal patterns of input , 2000, The Journal of comparative neurology.

[51]  Jacob G. Bernstein,et al.  Optogenetic tools for analyzing the neural circuits of behavior , 2011, Trends in Cognitive Sciences.

[52]  Henning Scheich,et al.  Possible anatomical pathways for short-latency multisensory integration processes in primary sensory cortices , 2014, Brain Structure and Function.

[53]  S. Shore,et al.  Multisensory activation of ventral cochlear nucleus D‐stellate cells modulates dorsal cochlear nucleus principal cell spatial coding , 2018, The Journal of physiology.

[54]  J. Pickles,et al.  Auditory pathways: anatomy and physiology. , 2015, Handbook of clinical neurology.

[55]  Multiple Nonauditory Cortical Regions Innervate the Auditory Midbrain , 2019, The Journal of Neuroscience.

[56]  S. Shore,et al.  Convergence of spinal trigeminal and cochlear nucleus projections in the inferior colliculus of the guinea pig , 2006, The Journal of comparative neurology.

[57]  M. Brecht,et al.  Vocalization–whisking coordination and multisensory integration of social signals in rat auditory cortex , 2014, eLife.

[58]  H. Ojima,et al.  Auditory-visual integration in fields of the auditory cortex , 2017, Hearing Research.

[59]  C. Schroeder,et al.  Somatosensory input to auditory association cortex in the macaque monkey. , 2001, Journal of neurophysiology.

[60]  W Owen Brimijoin,et al.  Egocentric and allocentric representations in auditory cortex , 2017, bioRxiv.

[61]  Li I. Zhang,et al.  Contextual and cross-modality modulation of auditory cortical processing through pulvinar mediated suppression , 2020, eLife.

[62]  W. H. Sumby,et al.  Visual contribution to speech intelligibility in noise , 1954 .

[63]  H. Scheich,et al.  Multisensory processing via early cortical stages: Connections of the primary auditory cortical field with other sensory systems , 2006, Neuroscience.

[64]  J. Groh,et al.  Eye Position Affects Activity in Primary Auditory Cortex of Primates , 2003, Current Biology.

[65]  N. Logothetis,et al.  Integration of Touch and Sound in Auditory Cortex , 2005, Neuron.