Pure tones modulate the representation of orientation and direction in the primary visual cortex

Multimodal sensory integration facilitates the generation of a unified and coherent perception of the environment. It is now well established that unimodal sensory perceptions, such as vision, are improved in multisensory contexts. While multimodal integration is primarily performed by dedicated multisensory brain regions such as the association cortices or the superior colliculus, recent studies have shown that multisensory interactions also occur in primary sensory cortices. In particular, sounds were shown to modulate the responses of neurons located in layers 2/3 (L2/3) of the mouse primary visual cortex (V1). Yet, the net effect of sound modulation at the V1 population level remained unclear. Here, we performed two-photon calcium imaging in awake mice to compare the representation of the orientation and the direction of drifting gratings by V1 L2/3 neurons in unimodal (visual only) or multi-modal (audiovisual) conditions. We found that sound modulation depended on the tuning properties (orientation and direction selectivity) and response amplitudes of V1 L2/3 neurons. Sounds potentiated the responses of neurons that were highly tuned to the cue orientation and direction but weakly active in the unimodal context, following the principle of inverse effectiveness of multimodal integration. Moreover, sound suppressed the responses of neurons untuned for the orientation and/or the direction of the visual cue. Altogether, sound modulation improved the representation of the orientation and direction of the visual stimulus in V1 L2/3. Namely, visual stimuli presented with auditory stimuli recruited a neuronal population better tuned to the visual stimulus orientation and direction than when presented alone.

[1]  B. Stein,et al.  Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. , 1986, Journal of neurophysiology.

[2]  Henry J. Alitto,et al.  Influence of contrast on orientation and temporal frequency tuning in ferret primary visual cortex. , 2004, Journal of neurophysiology.

[3]  Kathleen S Rockland,et al.  Multisensory convergence in calcarine visual areas in macaque monkey. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[4]  H. Scheich,et al.  Nonauditory Events of a Behavioral Procedure Activate Auditory Cortex of Highly Trained Monkeys , 2005, The Journal of Neuroscience.

[5]  P. Barone,et al.  Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey , 2005, The European journal of neuroscience.

[6]  P. Golshani,et al.  Cellular mechanisms of brain-state-dependent gain modulation in visual cortex , 2013, Nature Neuroscience.

[7]  Christoph Kayser,et al.  Acoustic Noise Improves Visual Perception and Modulates Occipital Oscillatory States , 2014, Journal of Cognitive Neuroscience.

[8]  Edward M. Callaway,et al.  Laminar Specificity of Functional Input to Distinct Types of Inhibitory Cortical Neurons , 2009, The Journal of Neuroscience.

[9]  Adrian K. C. Lee,et al.  Integration of Visual Information in Auditory Cortex Promotes Auditory Scene Analysis through Multisensory Binding , 2017, Neuron.

[10]  Anna R. Chambers,et al.  Robustness of Cortical Topography across Fields, Laminae, Anesthetic States, and Neurophysiological Signal Types , 2012, The Journal of Neuroscience.

[11]  M HERSHENSON,et al.  Reaction time as a measure of intersensory facilitation. , 1962, Journal of experimental psychology.

[12]  H. Kennedy,et al.  Anatomical Evidence of Multimodal Integration in Primate Striate Cortex , 2002, The Journal of Neuroscience.

[13]  Giuliano Iurilli,et al.  Sound-Driven Synaptic Inhibition in Primary Visual Cortex , 2012, Neuron.

[14]  Christoph Kayser,et al.  Audio-Visual Detection Benefits in the Rat , 2012, PloS one.

[15]  A. Ghazanfar,et al.  Is neocortex essentially multisensory? , 2006, Trends in Cognitive Sciences.

[16]  J. Driver,et al.  Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and Judgments , 2008, Neuron.

[17]  Lawrence E Marks,et al.  Brighter noise: Sensory enhancement of perceived loudness by concurrent visual stimulation , 2004, Cognitive, affective & behavioral neuroscience.

[18]  A. Zador,et al.  Neural representation and the cortical code. , 2000, Annual review of neuroscience.

[19]  R. Schmidt,et al.  On the nature of intersensory facilitation of reaction time , 1983, Perception & psychophysics.

[20]  M. Posner,et al.  Visual dominance: an information-processing account of its origins and significance. , 1976, Psychological review.

[21]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[22]  Michael T. Lippert,et al.  Improvement of visual contrast detection by a simultaneous sound , 2007, Brain Research.

[23]  D. Tank,et al.  Imaging Large-Scale Neural Activity with Cellular Resolution in Awake, Mobile Mice , 2007, Neuron.

[24]  Jennifer K Bizley,et al.  Where are multisensory signals combined for perceptual decision-making? , 2016, Current Opinion in Neurobiology.

[25]  Philipp Berens,et al.  CircStat: AMATLABToolbox for Circular Statistics , 2009, Journal of Statistical Software.

[26]  John J. Foxe,et al.  Audio-visual multisensory integration in superior parietal lobule revealed by human intracranial recordings. , 2006, Journal of neurophysiology.

[27]  J. Vroomen,et al.  Sound enhances visual perception: cross-modal effects of auditory organization on vision. , 2000, Journal of experimental psychology. Human perception and performance.

[28]  M. Stryker,et al.  Modulation of Visual Responses by Behavioral State in Mouse Visual Cortex , 2010, Neuron.

[29]  Li I. Zhang,et al.  Thresholding of auditory cortical representation by background noise , 2014, Front. Neural Circuits.

[30]  D. McCormick,et al.  Waking State: Rapid Variations Modulate Neural and Behavioral Responses , 2015, Neuron.

[31]  R. Yuste,et al.  Orientation tuning depends on spatial frequency in mouse visual cortex , 2016 .

[32]  B. Stein,et al.  Interactions among converging sensory inputs in the superior colliculus. , 1983, Science.

[33]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[34]  P. Haggard,et al.  Can vision of the body ameliorate impaired somatosensory function? , 2007, Neuropsychologia.

[35]  Lucy S. Petro,et al.  Contextual modulation of primary visual cortex by auditory signals , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[36]  H. Markram,et al.  Interneurons of the neocortical inhibitory system , 2004, Nature Reviews Neuroscience.

[37]  Brian Zingg,et al.  Cross-Modality Sharpening of Visual Cortical Processing through Layer-1-Mediated Inhibition and Disinhibition , 2016, Neuron.

[38]  Mriganka Sur,et al.  Hierarchical Bayesian modeling and Markov chain Monte Carlo sampling for tuning-curve analysis. , 2010, Journal of neurophysiology.

[39]  M. Carandini Amplification of Trial-to-Trial Response Variability by Neurons in Visual Cortex , 2004, PLoS biology.

[40]  Hye-Won Jeong,et al.  A Neural Circuit for Auditory Dominance over Visual Perception , 2017, Neuron.

[41]  Martin Vinck,et al.  Arousal and Locomotion Make Distinct Contributions to Cortical Activity Patterns and Visual Encoding , 2014, Neuron.

[42]  Cyriel M A Pennartz,et al.  Audiovisual Modulation in Mouse Primary Visual Cortex Depends on Cross-Modal Stimulus Configuration and Congruency , 2017, The Journal of Neuroscience.

[43]  W. M. Keck,et al.  Highly Selective Receptive Fields in Mouse Visual Cortex , 2008, The Journal of Neuroscience.

[44]  M. Giard,et al.  Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study , 1999, Journal of Cognitive Neuroscience.

[45]  Henry J. Alitto,et al.  Orientation tuning, but not direction selectivity, is invariant to temporal frequency in primary visual cortex. , 2005, Journal of neurophysiology.