Development of visual category selectivity in ventral visual cortex does not require visual experience

Significance The brain’s ability to recognize visual categories is guided by category-selective ventral-temporal cortex (VTC). Whether visual experience is required for the functional organization of VTC into distinct functional subregions remains unknown, hampering our understanding of the mechanisms that drive category recognition. Here, we demonstrate that VTC in individuals who were blind since birth shows robust discriminatory responses to natural sounds representing different categories (faces, scenes, body parts, and objects). These activity patterns in the blind also could predict successfully which category was visually perceived by controls. The functional cortical layout in blind individuals showed remarkable similarity to the well-documented layout observed in sighted controls, suggesting that visual functional brain organization does not rely on visual input. To what extent does functional brain organization rely on sensory input? Here, we show that for the penultimate visual-processing region, ventral-temporal cortex (VTC), visual experience is not the origin of its fundamental organizational property, category selectivity. In the fMRI study reported here, we presented 14 congenitally blind participants with face-, body-, scene-, and object-related natural sounds and presented 20 healthy controls with both auditory and visual stimuli from these categories. Using macroanatomical alignment, response mapping, and surface-based multivoxel pattern analysis, we demonstrated that VTC in blind individuals shows robust discriminatory responses elicited by the four categories and that these patterns of activity in blind subjects could successfully predict the visual categories in sighted controls. These findings were confirmed in a subset of blind participants born without eyes and thus deprived from all light perception since conception. The sounds also could be decoded in primary visual and primary auditory cortex, but these regions did not sustain generalization across modalities. Surprisingly, although not as strong as visual responses, selectivity for auditory stimulation in visual cortex was stronger in blind individuals than in controls. The opposite was observed in primary auditory cortex. Overall, we demonstrated a striking similarity in the cortical response layout of VTC in blind individuals and sighted controls, demonstrating that the overall category-selective map in extrastriate cortex develops independently from visual experience.

[1]  Kingson Man,et al.  Sight and Sound Converge to Form Modality-Invariant Representations in Temporoparietal Cortex , 2012, The Journal of Neuroscience.

[2]  H. P. Op de Beeck,et al.  Dissociations and Associations between Shape and Category Representations in the Two Visual Pathways , 2015, The Journal of Neuroscience.

[3]  J. S. Guntupalli,et al.  The Representation of Biological Classes in the Human Brain , 2012, The Journal of Neuroscience.

[4]  Amir Amedi,et al.  Visual Cortex Extrastriate Body-Selective Area Activation in Congenitally Blind People “Seeing” by Using Sounds , 2014, Current Biology.

[5]  Kingson Man,et al.  Multivariate cross-classification: applying machine learning techniques to characterize abstraction in neural representations , 2015, Front. Hum. Neurosci..

[6]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[7]  Amir Amedi,et al.  A Ventral Visual Stream Reading Center Independent of Visual Experience , 2012, Current Biology.

[8]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[9]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[10]  Ione Fine,et al.  Auditory motion processing after early blindness. , 2014, Journal of vision.

[11]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[12]  Rebecca F. Schwarzlose,et al.  Separate face and body selectivity on the fusiform gyrus. , 2010, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  G. Vandewalle,et al.  Functional specialization for auditory–spatial processing in the occipital cortex of congenitally blind humans , 2011, Proceedings of the National Academy of Sciences.

[14]  The Search for the Face of the Visual Homunculus , 2015, Trends in Cognitive Sciences.

[15]  Paul E. Downing,et al.  Visuo-motor imagery of specific manual actions: A multi-variate pattern analysis fMRI study , 2012, NeuroImage.

[16]  N. Kriegeskorte,et al.  Author ' s personal copy Representational geometry : integrating cognition , computation , and the brain , 2013 .

[17]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[18]  Franco Lepore,et al.  Auditory motion in the sighted and blind: Early visual deprivation triggers a large-scale imbalance between auditory and “visual” brain regions , 2016, NeuroImage.

[19]  D. Bavelier,et al.  Cross-modal plasticity: where and how? , 2002, Nature Reviews Neuroscience.

[20]  Christian Keysers,et al.  Testing Simulation Theory with Cross-Modal Multivariate Classification of fMRI Data , 2008, PloS one.

[21]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[22]  K. Grill-Spector The neural basis of object perception , 2003, Current Opinion in Neurobiology.

[23]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[24]  S. Lederman,et al.  Early visual experience and the recognition of basic facial expressions: involvement of the middle temporal and inferior frontal gyri during haptic identification by the early blind , 2012, Front. Hum. Neurosci..

[25]  J. Haynes Brain Reading: Decoding Mental States From Brain Activity In Humans , 2011 .

[26]  Giorgio M. Innocenti,et al.  Exuberance in the development of cortical networks , 2005, Nature Reviews Neuroscience.

[27]  Thomas Serre,et al.  Reading the mind's eye: Decoding category information during mental imagery , 2010, NeuroImage.

[28]  Emiliano Ricciardi,et al.  Beyond sensory images: Object-based representation in the human ventral pathway. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Andrew S. Bock,et al.  Anatomical and functional plasticity in early blind individuals and the mixture of experts architecture , 2014, Front. Hum. Neurosci..

[30]  K. Grill-Spector,et al.  The functional architecture of the ventral temporal cortex and its role in categorization , 2014, Nature Reviews Neuroscience.

[31]  R. Wong,et al.  Retinal waves and visual system development. , 1999, Annual review of neuroscience.

[32]  C. Neil Macrae,et al.  Puddles, Parties, and Professors: Linking Word Categorization to Neural Patterns of Visuospatial Coding , 2011, Journal of Cognitive Neuroscience.

[33]  N. Sadato,et al.  The Brain Network Underlying the Recognition of Hand Gestures in the Blind: The Supramodal Role of the Extrastriate Body Area , 2014, The Journal of Neuroscience.

[34]  K. Grill-Spector,et al.  Relating retinotopic and object-selective responses in human lateral occipital cortex. , 2008, Journal of neurophysiology.

[35]  Stanislas Dehaene,et al.  A Neural Marker of Perceptual Consciousness in Infants , 2013, Science.

[36]  Alfonso Caramazza,et al.  Selectivity for large nonmanipulable objects in scene-selective visual cortex does not require visual experience , 2013, NeuroImage.

[37]  J. Kaas,et al.  Large-scale reorganization at multiple levels of the somatosensory pathway follows therapeutic amputation of the hand in monkeys , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[38]  H. Bridge,et al.  Subcortical functional reorganization due to early blindness. , 2015, Journal of neurophysiology.

[39]  Chunshui Yu,et al.  Neural Pathways Conveying Novisual Information to the Visual Cortex , 2013, Neural plasticity.

[40]  Amir Amedi,et al.  Reading with Sounds: Sensory Substitution Selectively Activates the Visual Word Form Area in the Blind , 2012, Neuron.

[41]  N. Kanwisher,et al.  The Human Body , 2001 .

[42]  Rafael Malach,et al.  Large-Scale Mirror-Symmetry Organization of Human Occipito-Temporal Object Areas , 2003, Neuron.

[43]  L. Merabet,et al.  The plastic human brain cortex. , 2005, Annual review of neuroscience.

[44]  N. Kanwisher,et al.  The fusiform face area: a cortical region specialized for the perception of faces , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[45]  A. Caramazza,et al.  Object Domain and Modality in the Ventral Visual Pathway , 2016, Trends in Cognitive Sciences.

[46]  Nicola Filippini,et al.  Language networks in anophthalmia: maintained hierarchy of processing in 'visual' cortex. , 2012, Brain : a journal of neurology.

[47]  A. Cowey,et al.  Early Auditory Processing in Area V5/MT+ of the Congenitally Blind Brain , 2013, The Journal of Neuroscience.

[48]  Giancarlo Valente,et al.  Multivariate analysis of fMRI time series: classification and regression of brain responses using machine learning. , 2008, Magnetic resonance imaging.

[49]  N. Kanwisher,et al.  Interpreting fMRI data: maps, modules and dimensions , 2008, Nature Reviews Neuroscience.

[50]  A. Oliva,et al.  A Real-World Size Organization of Object Responses in Occipitotemporal Cortex , 2012, Neuron.

[51]  Katrin Amunts,et al.  The mid-fusiform sulcus: A landmark identifying both cytoarchitectonic and functional divisions of human ventral temporal cortex , 2014, NeuroImage.

[52]  Nancy Kanwisher,et al.  Connectivity precedes function in the development of the visual word form area , 2016, Nature Neuroscience.

[53]  Talma Hendler,et al.  Center–periphery organization of human object areas , 2001, Nature Neuroscience.

[54]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[55]  Lars Muckli,et al.  Decoding Sound and Imagery Content in Early Visual Cortex , 2014, Current Biology.

[56]  M. Crair,et al.  Retinal waves coordinate patterned activity throughout the developing visual system , 2012, Nature.

[57]  R. Saxe,et al.  “Visual” Cortex Responds to Spoken Language in Blind Children , 2015, The Journal of Neuroscience.

[58]  Massimo Poesio,et al.  Decoding semantics across fMRI sessions with different stimulus modalities: a practical MVPA study , 2012, Front. Neuroinform..

[59]  A. Caramazza,et al.  Category-Specific Organization in the Human Brain Does Not Require Visual Experience , 2009, Neuron.

[60]  L. Merabet,et al.  Neural reorganization following sensory loss: the opportunity of change , 2010, Nature Reviews Neuroscience.

[61]  Ione Fine,et al.  Mechanisms of cross-modal plasticity in early-blind subjects. , 2010, Journal of neurophysiology.

[62]  Rainer Goebel,et al.  Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: From single‐subject to cortically aligned group general linear model analysis and self‐organizing group independent component analysis , 2006, Human brain mapping.

[63]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[64]  Talma Hendler,et al.  Eccentricity Bias as an Organizing Principle for Human High-Order Object Areas , 2002, Neuron.

[65]  Daniel D. Dilks,et al.  Organization of high-level visual cortex in human infants , 2017, Nature Communications.

[66]  Nikolaus Kriegeskorte,et al.  Faciotopy—a face-feature map with face-like topology in the human occipital face area , 2014 .

[67]  P. Pietrini,et al.  Mind the blind brain to understand the sighted one! Is there a supramodal cortical functional architecture? , 2014, Neuroscience & Biobehavioral Reviews.

[68]  N. Kanwisher,et al.  The lateral occipital complex and its role in object recognition , 2001, Vision Research.