Cross-modal responses in the primary visual cortex encode complex objects and correlate with tactile discrimination

Cortical areas that directly receive sensory inputs from the thalamus were long thought to be exclusively dedicated to a single modality, originating separate labeled lines. In the past decade, however, several independent lines of research have demonstrated cross-modal responses in primary sensory areas. To investigate whether these responses represent behaviorally relevant information, we carried out neuronal recordings in the primary somatosensory cortex (S1) and primary visual cortex (V1) of rats as they performed whisker-based tasks in the dark. During the free exploration of novel objects, V1 and S1 responses carried comparable amounts of information about object identity. During execution of an aperture tactile discrimination task, tactile recruitment was slower and less robust in V1 than in S1. However, V1 tactile responses correlated significantly with performance across sessions. Altogether, the results support the notion that primary sensory areas have a preference for a given modality but can engage in meaningful cross-modal processing depending on task demand.

[1]  B. Dreher,et al.  A correlation of receptive field properties with conduction velocity of cells in the rat's retino-geniculo-cortical pathway , 1979, Experimental Brain Research.

[2]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[3]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[4]  R. F. Thompson,et al.  The search for the engram. , 1976, The American psychologist.

[5]  Takashi Fujikado,et al.  Two pathways from the facial skin to the superior colliculus in the rat , 1981, Brain Research.

[6]  Asaf Keller,et al.  Superior sensation: superior colliculus participation in rat vibrissa system. , 2007 .

[7]  Naomi B. Pitskel,et al.  Rapid and Reversible Recruitment of Early Visual Cortex for Touch , 2008, PloS one.

[8]  M. Carandini,et al.  Stimulus contrast modulates functional connectivity in visual cortex , 2009, Nature Neuroscience.

[9]  M. Hallett,et al.  Functional relevance of cross-modal plasticity in blind humans , 1997, Nature.

[10]  Rogelio Luna,et al.  Do Sensory Cortices Process More than One Sensory Modality during Perceptual Judgments? , 2010, Neuron.

[11]  R. Jacobs Computational studies of the development of functionally specialized neural modules , 1999, Trends in Cognitive Sciences.

[12]  C. Schroeder,et al.  Neuronal Oscillations and Multisensory Interaction in Primary Auditory Cortex , 2007, Neuron.

[13]  Nelson A. M. Lemos,et al.  Neuronal Activity in the Primary Somatosensory Thalamocortical Loop Is Modulated by Reward Contingency during Tactile Discrimination , 2007, The Journal of Neuroscience.

[14]  N. Logothetis,et al.  Integration of Touch and Sound in Auditory Cortex , 2005, Neuron.

[15]  T. Hackett,et al.  Anatomical mechanisms and functional implications of multisensory convergence in early cortical processing. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[16]  M K Habib,et al.  Dynamics of neuronal firing correlation: modulation of "effective connectivity". , 1989, Journal of neurophysiology.

[17]  F. Sommer,et al.  Global Relationship between Anatomical Connectivity and Activity Propagation in the Cerebral Cortex , 2022 .

[18]  V. Bringuier,et al.  Horizontal propagation of visual activity in the synaptic integration field of area 17 neurons. , 1999, Science.

[19]  Vincent Jacob,et al.  Emergent Properties of Tactile Scenes Selectively Activate Barrel Cortex Neurons , 2008, Neuron.

[20]  Henry Kennedy,et al.  Long-distance feedback projections to area V1: Implications for multisensory integration, spatial awareness, and visual consciousness , 2004, Cognitive, affective & behavioral neuroscience.

[21]  M A Nicolelis,et al.  Spatiotemporal properties of layer V neurons of the rat primary somatosensory cortex. , 1999, Cerebral cortex.

[22]  R. Frostig,et al.  Large-Scale Organization of Rat Sensorimotor Cortex Based on a Motif of Large Activation Spreads , 2008, The Journal of Neuroscience.

[23]  Boyer D. Winters,et al.  Object recognition memory: Neurobiological mechanisms of encoding, consolidation and retrieval , 2008, Neuroscience & Biobehavioral Reviews.

[24]  Amir Amedi,et al.  Combined activation and deactivation of visual cortex during tactile sensory processing. , 2007, Journal of neurophysiology.

[25]  Á. Szél,et al.  Two cone types of rat retina detected by anti-visual pigment antibodies. , 1992, Experimental eye research.

[26]  F. Haiss,et al.  Spatiotemporal Dynamics of Cortical Sensorimotor Integration in Behaving Mice , 2007, Neuron.

[27]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[28]  A. Ghazanfar,et al.  Is neocortex essentially multisensory? , 2006, Trends in Cognitive Sciences.

[29]  J. Driver,et al.  Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and Judgments , 2008, Neuron.

[30]  Joost X. Maier,et al.  Multisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex , 2005 .

[31]  M. Wallace,et al.  A revised view of sensory cortical parcellation , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[32]  Richard Hunter,et al.  A Source Book in the History of Psychology , 1967, Medical History.

[33]  Á. Pascual-Leone,et al.  The metamodal organization of the brain. , 2001, Progress in brain research.

[34]  G. H. Jacobs,et al.  Cone-based vision of rats for ultraviolet and visible lights. , 2001, The Journal of experimental biology.

[35]  G. Karmos,et al.  Entrainment of Neuronal Oscillations as a Mechanism of Attentional Selection , 2008, Science.

[36]  G. Cecchi,et al.  Scale-free brain functional networks. , 2003, Physical review letters.

[37]  Melanie R. Bernard,et al.  Widespread spatial integration in primary somatosensory cortex , 2008, Proceedings of the National Academy of Sciences.

[38]  M. Laubach,et al.  Cortical ensemble activity increasingly predicts behaviour outcomes during learning of a motor task , 2022 .

[39]  Tomaso Poggio,et al.  Fast Readout of Object Identity from Macaque Inferior Temporal Cortex , 2005, Science.

[40]  R. Malach,et al.  Patterns of sensory intermodality relationships in the cerebral cortex of the rat , 1991, The Journal of comparative neurology.

[41]  John A. Swets,et al.  Signal Detection Theory and ROC Analysis in Psychology and Diagnostics: Collected Papers , 1996 .

[42]  Kathleen S Rockland,et al.  Multisensory convergence in calcarine visual areas in macaque monkey. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[43]  M. Hallett,et al.  Activation of the primary visual cortex by Braille reading in blind subjects , 1996, Nature.

[44]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[45]  V. Mountcastle Modality and topographic properties of single neurons of cat's somatic sensory cortex. , 1957, Journal of neurophysiology.

[46]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[47]  B. E. Reese,et al.  ‘Hidden lamination’ in the dorsal lateral geniculate nucleus: the functional organization of this thalamic region in the rat , 1988, Brain Research Reviews.

[48]  M. Wong-Riley,et al.  A metabolic map of cytochrome oxidase in the rat brain: Histochemical, densitometric and biochemical studies , 1995, Neuroscience.

[49]  John J. Foxe,et al.  Multisensory Convergence in Early Cortical Processing. , 2004 .

[50]  J. Fuster,et al.  Visuo-tactile cross-modal associations in cortical somatosensory cells. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[51]  Nelson A. M. Lemos,et al.  Novel Experience Induces Persistent Sleep-Dependent Plasticity in the Cortex but not in the Hippocampus , 2007, Front. Neurosci..

[52]  R. Malach,et al.  Early ‘visual’ cortex activation correlates with superior verbal memory performance in the blind , 2003, Nature Neuroscience.

[53]  M. Laubach,et al.  Layer-Specific Somatosensory Cortical Activation During Active Tactile Discrimination , 2004, Science.

[54]  M. Nicolelis,et al.  Behavioral Properties of the Trigeminal Somatosensory System in Rats Performing Whisker-Dependent Tactile Discriminations , 2001, The Journal of Neuroscience.

[55]  R. Andersen,et al.  Neural prosthetic control signals from plan activity , 2003, Neuroreport.

[56]  H. Kennedy,et al.  Anatomical Evidence of Multimodal Integration in Primate Striate Cortex , 2002, The Journal of Neuroscience.

[57]  Miguel A. L. Nicolelis,et al.  Methods for Simultaneous Multisite Neural Ensemble Recordings in Behaving Primates , 1998 .

[58]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[59]  R. Mooney,et al.  Organization of the projections from the trigeminal brainstem complex to the superior colliculus in the rat and hamster: Anterograde tracing with Phaseolus vulgaris leucoagglutinin and intra‐axonal injection , 1989, The Journal of comparative neurology.

[60]  N. Logothetis,et al.  Visual modulation of neurons in auditory cortex. , 2008, Cerebral cortex.