A Neural Circuit for Auditory Dominance over Visual Perception

When conflicts occur during integration of visual and auditory information, one modality often dominates the other, but the underlying neural circuit mechanism remains unclear. Using auditory-visual discrimination tasks for head-fixed mice, we found that audition dominates vision in a process mediated by interaction between inputs from the primary visual (VC) and auditory (AC) cortices in the posterior parietal cortex (PTLp). Co-activation of the VC and AC suppresses VC-induced PTLp responses, leaving AC-induced responses. Furthermore, parvalbumin-positive (PV+) interneurons in the PTLp mainly receive AC inputs, and muscimol inactivation of the PTLp or optogenetic inhibition of its PV+ neurons abolishes auditory dominance in the resolution of cross-modal sensory conflicts without affecting either sensory perception. Conversely, optogenetic activation of PV+ neurons in the PTLp enhances the auditory dominance. Thus, our results demonstrate that AC input-specific feedforward inhibition of VC inputs in the PTLp is responsible for the auditory dominance during cross-modal integration.

[1]  John J. Foxe,et al.  Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. , 2002, Brain research. Cognitive brain research.

[2]  Lynn Hazan,et al.  Klusters, NeuroScope, NDManager: A free software suite for neurophysiological data processing and visualization , 2006, Journal of Neuroscience Methods.

[3]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[4]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[5]  C. Petersen,et al.  Membrane potential correlates of sensory perception in mouse barrel cortex , 2013, Nature Neuroscience.

[6]  E. Boyden,et al.  Genetically encoded molecular tools for light-driven silencing of targeted neurons. , 2012, Progress in brain research.

[7]  Christoph Kayser,et al.  Do early sensory cortices integrate cross-modal information? , 2007, Brain Structure and Function.

[8]  William T. Newsome,et al.  Cortical microstimulation influences perceptual judgements of motion direction , 1990, Nature.

[9]  Ilana B. Witten,et al.  Why Seeing Is Believing: Merging Auditory and Visual Worlds , 2005, Neuron.

[10]  Wei-Cheng Chang,et al.  Cell type-specific long-range connections of basal forebrain circuit , 2016, eLife.

[11]  B. Stein,et al.  Interactions among converging sensory inputs in the superior colliculus. , 1983, Science.

[12]  V. Sloutsky,et al.  Is a picture worth a thousand words? Preference for auditory modality in young children. , 2003, Child development.

[13]  Mikko Sams,et al.  Factors influencing audiovisual fission and fusion illusions. , 2004, Brain research. Cognitive brain research.

[14]  Michael M. Halassa,et al.  Thalamic control of sensory selection in divided attention , 2015, Nature.

[15]  N. Logothetis,et al.  Visual modulation of neurons in auditory cortex. , 2008, Cerebral cortex.

[16]  Jennifer K. Bizley,et al.  Visual influences on ferret auditory cortex , 2009, Hearing Research.

[17]  Jinhyung Kim,et al.  A Flexible Depth Probe Using Liquid Crystal Polymer , 2012, IEEE Transactions on Biomedical Engineering.

[18]  G. DeAngelis,et al.  A Normalization Model of Multisensory Integration , 2011, Nature Neuroscience.

[19]  Liqun Luo,et al.  Monosynaptic Circuit Tracing with Glycoprotein-Deleted Rabies Viruses , 2015, The Journal of Neuroscience.

[20]  B. Kolb,et al.  Behavioural and anatomical studies of the posterior parietal cortex in the rat , 1987, Behavioural Brain Research.

[21]  E. Rolls,et al.  Gustatory, olfactory, and visual convergence within the primate orbitofrontal cortex , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  R. Reid,et al.  Frontiers in Cellular Neuroscience Cellular Neuroscience Methods Article , 2022 .

[23]  Brian Zingg,et al.  Auditory cortex controls sound-driven innate defense behaviour through corticofugal projections to inferior colliculus , 2015, Nature Communications.

[24]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[25]  J. Duhamel,et al.  Multisensory Integration in the Ventral Intraparietal Area of the Macaque Monkey , 2007, The Journal of Neuroscience.

[26]  M. Murray,et al.  Multisensory Integration: Flexible Use of General Operations , 2014, Neuron.

[27]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[28]  Michael S. Beauchamp,et al.  A neural basis for interindividual differences in the McGurk effect, a multisensory speech illusion , 2012, NeuroImage.

[29]  R. Romo,et al.  Somatosensory discrimination based on cortical microstimulation , 1998, Nature.

[30]  S. Shimojo,et al.  Illusions: What you see is what you hear , 2000, Nature.

[31]  Salvador Soto-Faraco,et al.  Top-down attention regulates the neural expression of audiovisual integration , 2015, NeuroImage.

[32]  Fumitaka Osakada,et al.  Design and generation of recombinant rabies virus vectors , 2013, Nature Protocols.

[33]  J. Gyoba,et al.  Changing pitch of sounds alters perceived visual motion trajectory. , 2013, Multisensory Research.

[34]  C. Schroeder,et al.  Neuronal Oscillations and Multisensory Interaction in Primary Auditory Cortex , 2007, Neuron.

[35]  Matthew T. Kaufman,et al.  A category-free neural population supports evolving demands during decision-making , 2014, Nature Neuroscience.

[36]  Karl Deisseroth,et al.  Activation of Specific Interneurons Improves V1 Feature Selectivity and Visual Perception , 2012, Nature.

[37]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[38]  J. Fadiman.  Illusions , 1999 .

[39]  M. Brecht,et al.  Behavioural report of single neuron stimulation in somatosensory cortex , 2008, Nature.

[40]  Joseph A Maldjian,et al.  Cross‐modal sensory processing in the anterior cingulate and medial prefrontal cortices , 2003, Human brain mapping.

[41]  T. Murphy,et al.  In vivo Large-Scale Cortical Mapping Using Channelrhodopsin-2 Stimulation in Transgenic Mice Reveals Asymmetric and Reciprocal Relationships between Cortical Areas , 2012, Front. Neural Circuits.

[42]  Zengcai V. Guo,et al.  Neural coding during active somatosensation revealed using illusory touch , 2013, Nature Neuroscience.

[43]  D. H. Warren,et al.  Sensory conflict in judgments of spatial direction , 1969 .

[44]  A. Ghazanfar,et al.  Is neocortex essentially multisensory? , 2006, Trends in Cognitive Sciences.

[45]  M. Giard,et al.  Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study , 1999, Journal of Cognitive Neuroscience.

[46]  H. Bülthoff,et al.  Merging the senses into a robust percept , 2004, Trends in Cognitive Sciences.

[47]  T. Powell,et al.  An anatomical study of converging sensory pathways within the cerebral cortex of the monkey. , 1970, Brain : a journal of neurology.

[48]  Michael Häusser,et al.  Multimodal sensory integration in single cerebellar granule cells in vivo , 2015, eLife.

[49]  Aaron R. Nidiffer,et al.  Multisensory Response Modulation in the Superficial Layers of the Superior Colliculus , 2014, The Journal of Neuroscience.

[50]  H. McGurk,et al.  Visual influences on speech perception processes , 1978, Perception & psychophysics.

[51]  H. R. Clemo,et al.  Cross-modal circuitry between auditory and somatosensory areas of the cat anterior ectosylvian sulcal cortex: a 'new' inhibitory form of multisensory convergence. , 2004, Cerebral cortex.

[52]  J. Young,et al.  Two Retroviral Entry Pathways Distinguished by Lipid Raft Association of the Viral Receptor and Differences in Viral Infectivity , 2003, Journal of Virology.

[53]  C. Price,et al.  Integrating Visual and Tactile Information in the Perirhinal Cortex , 2009, Cerebral cortex.

[54]  Giuliano Iurilli,et al.  Sound-Driven Synaptic Inhibition in Primary Visual Cortex , 2012, Neuron.

[55]  T. Stanford,et al.  Multisensory integration: current issues from the perspective of the single neuron , 2008, Nature Reviews Neuroscience.

[56]  Takaki Komiyama,et al.  Subtype-specific plasticity of inhibitory circuits in motor cortex during motor learning , 2015, Nature Neuroscience.

[57]  Brian Zingg,et al.  Cross-Modality Sharpening of Visual Cortical Processing through Layer-1-Mediated Inhibition and Disinhibition , 2016, Neuron.

[58]  Brian Zingg,et al.  Sensory Cortical Control of a Visually Induced Arrest Behavior via Corticotectal Projections , 2015, Neuron.

[59]  Giuliano Iurilli,et al.  Cellular and Synaptic Architecture of Multisensory Integration in the Mouse Neocortex , 2013, Neuron.

[60]  W. Jiang,et al.  Two cortical areas mediate multisensory integration in superior colliculus neurons. , 2001, Journal of neurophysiology.

[61]  Christopher W. Robinson,et al.  Auditory dominance and its change in the course of development. , 2004, Child development.