Plastic reorganization of neural systems for perception of others in the congenitally blind

Recent evidence suggests that the function of the core system for face perception might extend beyond visual face-perception to a broader role in person perception. To critically test the broader role of core face-system in person perception, we examined the role of the core system during the perception of others in 7 congenitally blind individuals and 15 sighted subjects by measuring their neural responses using fMRI while they listened to voices and performed identity and emotion recognition tasks. We hypothesised that in people who have had no visual experience of faces, core face-system areas may assume a role in the perception of others via voices. Results showed that emotions conveyed by voices can be decoded in homologues of the core face system only in the blind. Moreover, there was a specific enhancement of response to verbal as compared to non-verbal stimuli in bilateral fusiform face areas and the right posterior superior temporal sulcus showing that the core system also assumes some language-related functions in the blind. These results indicate that, in individuals with no history of visual experience, areas of the core system for face perception may assume a role in aspects of voice perception that are relevant to social cognition and perception of others' emotions.

[1]  Brian A. Wandell,et al.  Position sensitivity in the visual word form area , 2012, Proceedings of the National Academy of Sciences.

[2]  Rainer Goebel,et al.  "Who" Is Saying "What"? Brain-Based Decoding of Human Voice and Speech , 2008, Science.

[3]  C. Veraart,et al.  Functional Cerebral Reorganization for Auditory Spatial Processing and Auditory Substitution of Vision in Early Blind Subjects , 2006 .

[4]  J. Haxby,et al.  Distinct representations of eye gaze and identity in the distributed human neural system for face perception , 2000, Nature Neuroscience.

[5]  L. Cohen,et al.  A Ventral Visual Stream Reading Center Independent of Visual Experience , 2012, Current Biology.

[6]  P. Belin,et al.  Thinking the voice: neural correlates of voice perception , 2004, Trends in Cognitive Sciences.

[7]  G. Yovel,et al.  A unified coding strategy for processing faces and voices , 2013, Trends in Cognitive Sciences.

[8]  Emiliano Ricciardi,et al.  The blind brain: How (lack of) vision shapes the morphological and functional architecture of the human brain , 2014, Experimental biology and medicine.

[9]  Doris Y. Tsao,et al.  Comparing face patch systems in macaques and humans , 2008, Proceedings of the National Academy of Sciences.

[10]  P. Skudlarski,et al.  The role of the fusiform face area in social cognition: implications for the pathobiology of autism. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[11]  Conny F. Schmidt,et al.  Face perception is mediated by a distributed cortical network , 2005, Brain Research Bulletin.

[12]  James V. Haxby,et al.  Mirror Neuron System Differentially Activated by Facial Expressions and Social Hand Gestures: A Functional Magnetic Resonance Imaging Study , 2008, Journal of Cognitive Neuroscience.

[13]  Christian Büchel,et al.  Crossmodal plasticity in the fusiform gyrus of late blind individuals during voice recognition , 2014, NeuroImage.

[14]  R Saxe,et al.  People thinking about thinking people The role of the temporo-parietal junction in “theory of mind” , 2003, NeuroImage.

[15]  Marlene Behrmann,et al.  Left hemisphere specialization for word reading potentially causes, rather than results from, a left lateralized bias for high spatial frequency visual information , 2015, Cortex.

[16]  J. Haxby,et al.  Neural systems for recognition of familiar faces , 2007, Neuropsychologia.

[17]  Karl J. Friston,et al.  Two distinct neural mechanisms for category-selective responses. , 2006, Cerebral cortex.

[18]  E. Zohary,et al.  V1 activation in congenitally blind humans is associated with episodic retrieval. , 2005, Cerebral cortex.

[19]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[20]  B. Röder,et al.  Sensitive periods for the functional specialization of the neural system for human face processing , 2013, Proceedings of the National Academy of Sciences.

[21]  G. Vandewalle,et al.  Functional specialization for auditory–spatial processing in the occipital cortex of congenitally blind humans , 2011, Proceedings of the National Academy of Sciences.

[22]  James V. Haxby,et al.  The Well-Tempered Social Brain , 2009, Psychological science.

[23]  T. Carlson,et al.  Patterns of Activity in the Categorical Representations of Objects , 2003 .

[24]  C. Frith,et al.  Movement and Mind: A Functional Imaging Study of Perception and Interpretation of Complex Intentional Movement Patterns , 2000, NeuroImage.

[25]  S. Dehaene,et al.  How Learning to Read Changes the Cortical Networks for Vision and Language , 2010, Science.

[26]  S. Lederman,et al.  Early visual experience and the recognition of basic facial expressions: involvement of the middle temporal and inferior frontal gyri during haptic identification by the early blind , 2012, Front. Hum. Neurosci..

[27]  Amir Amedi,et al.  Reading with Sounds: Sensory Substitution Selectively Activates the Visual Word Form Area in the Blind , 2012, Neuron.

[28]  J. Haxby,et al.  Human neural systems for face recognition and social communication , 2002, Biological Psychiatry.

[29]  Pascal Belin,et al.  Crossmodal Adaptation in Right Posterior Superior Temporal Sulcus during Face–Voice Emotional Integration , 2014, The Journal of Neuroscience.

[30]  Krzysztof J. Gorgolewski,et al.  The human voice areas: Spatial organization and inter-individual variability in temporal and extra-temporal cortices , 2015, NeuroImage.

[31]  Emiliano Ricciardi,et al.  Distinct Neural Systems Involved in Agency and Animacy Detection , 2011, Journal of Cognitive Neuroscience.

[32]  C. Büchel,et al.  Brain systems mediating voice identity processing in blind humans , 2014, Human brain mapping.

[33]  M. Hallett,et al.  Activation of the primary visual cortex by Braille reading in blind subjects , 1996, Nature.

[34]  C. Koch,et al.  Invariant visual representation by single neurons in the human brain , 2005, Nature.

[35]  D. Pitcher,et al.  Transcranial Magnetic Stimulation Disrupts the Perception and Embodiment of Facial Expressions , 2008, The Journal of Neuroscience.

[36]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[37]  M. Ida Gobbini,et al.  Disentangling the representation of identity from head view along the human face processing pathway , 2016 .

[38]  A. Caramazza,et al.  How Visual Is the Visual Cortex? Comparing Connectional and Functional Fingerprints between Congenitally Blind and Sighted Individuals , 2015, The Journal of Neuroscience.

[39]  J. Rauschecker,et al.  Cortical Representation of Natural Complex Sounds: Effects of Acoustic Features and Auditory Object Category , 2010, The Journal of Neuroscience.

[40]  Alfonso Caramazza,et al.  Category-selective neural substrates for person- and place-related concepts , 2013, Cortex.

[41]  U. Noppeney The effects of visual deprivation on functional and structural organization of the human brain , 2007, Neuroscience & Biobehavioral Reviews.

[42]  M. Hallett,et al.  Period of susceptibility for cross‐modal plasticity in the blind , 1999, Annals of neurology.

[43]  Emiliano Ricciardi,et al.  Beyond sensory images: Object-based representation in the human ventral pathway. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[44]  Michael S. Pratte,et al.  Decoding patterns of human brain activity. , 2012, Annual review of psychology.

[45]  Elia Formisano,et al.  Processing of Natural Sounds in Human Auditory Cortex: Tonotopy, Spectral Tuning, and Relation to Voice Sensitivity , 2012, The Journal of Neuroscience.

[46]  Russell A. Epstein,et al.  Where Am I Now? Distinct Roles for Parahippocampal and Retrosplenial Cortices in Place Recognition , 2007, The Journal of Neuroscience.

[47]  R. Saxe,et al.  Language processing in the occipital cortex of congenitally blind adults , 2011, Proceedings of the National Academy of Sciences.

[48]  J. Haxby,et al.  Distributed Neural Systems for Face Perception , 2011 .

[49]  Marlene Behrmann,et al.  The joint development of hemispheric lateralization for words and faces. , 2012, Journal of experimental psychology. General.

[50]  Alvaro Pascual-Leone,et al.  Growing up blind does not change the neural bases of Theory of Mind , 2009, Proceedings of the National Academy of Sciences.

[51]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[52]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[53]  Marlene Behrmann,et al.  A vision of graded hemispheric specialization , 2015, Annals of the New York Academy of Sciences.

[54]  Karl J. Friston,et al.  A multimodal language region in the ventral visual pathway , 1998, Nature.

[55]  Cheryl L. Grady,et al.  Early visual deprivation from congenital cataracts disrupts activity and functional connectivity in the face network , 2014, Neuropsychologia.

[56]  Andreas Kleinschmidt,et al.  Interaction of Face and Voice Areas during Speaker Recognition , 2005, Journal of Cognitive Neuroscience.

[57]  A. Caramazza,et al.  Decoding representations of face identity that are tolerant to rotation. , 2014, Cerebral cortex.

[58]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[59]  R. Blake,et al.  Brain Areas Active during Visual Perception of Biological Motion , 2002, Neuron.

[60]  A. Caramazza,et al.  Category-Specific Organization in the Human Brain Does Not Require Visual Experience , 2009, Neuron.

[61]  Bruce D. McCandliss,et al.  The visual word form area: expertise for reading in the fusiform gyrus , 2003, Trends in Cognitive Sciences.

[62]  Kenneth A. Norman,et al.  Graded Representations of Emotional Expressions in the Left Superior Temporal Sulcus , 2010, Front. Syst. Neurosci..

[63]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[64]  J. S. Guntupalli,et al.  Decoding neural representational spaces using multivariate pattern analysis. , 2014, Annual review of neuroscience.

[65]  Régine Kolinsky,et al.  Illiterate to literate: behavioural and cerebral changes induced by reading acquisition , 2015, Nature Reviews Neuroscience.

[66]  D. Wildgruber,et al.  Emotional voice areas: anatomic location, functional properties, and structural connections revealed by combined fMRI/DTI. , 2012, Cerebral cortex.

[67]  A. Ishai,et al.  Effective connectivity within the distributed cortical network for face perception. , 2007, Cerebral cortex.

[68]  Alan C. Evans,et al.  Specific Involvement of Human Parietal Systems and the Amygdala in the Perception of Biological Motion , 1996, The Journal of Neuroscience.

[69]  Alfonso Caramazza,et al.  Tool Selectivity in Left Occipitotemporal Cortex Develops without Vision , 2013, Journal of Cognitive Neuroscience.

[70]  S. Lederman,et al.  Haptic face identification activates ventral occipital and temporal areas: An fMRI study , 2005, Brain and Cognition.

[71]  Aaron C. Koralek,et al.  Two Takes on the Social Brain: A Comparison of Theory of Mind Tasks , 2007, Journal of Cognitive Neuroscience.

[72]  Alfonso Caramazza,et al.  Selectivity for large nonmanipulable objects in scene-selective visual cortex does not require visual experience , 2013, NeuroImage.

[73]  Bruno B Averbeck,et al.  Neural representation of vocalizations in the primate ventrolateral prefrontal cortex. , 2005, Journal of neurophysiology.

[74]  R. Malach,et al.  Early ‘visual’ cortex activation correlates with superior verbal memory performance in the blind , 2003, Nature Neuroscience.

[75]  Alfonso Caramazza,et al.  Person- and place-selective neural substrates for entity-specific semantic access. , 2014, Cerebral cortex.

[76]  R. Adolphs Social Cognition: Feeling Voices to Recognize Emotions , 2010, Current Biology.

[77]  Karl J. Friston,et al.  Different activation patterns in the visual cortex of late and congenitally blind subjects. , 1998, Brain : a journal of neurology.

[78]  E. Zohary,et al.  Transcranial magnetic stimulation of the occipital pole interferes with verbal processing in blind subjects , 2004, Nature Neuroscience.

[79]  Pascal Belin,et al.  People-selectivity, audiovisual integration and heteromodality in the superior temporal sulcus , 2014, Cortex.

[80]  Peter Erhard,et al.  A common neural basis for receptive and expressive communication of pleasant facial affect , 2005, NeuroImage.

[81]  M. Peelen,et al.  Supramodal Representations of Perceived Emotions in the Human Brain , 2010, The Journal of Neuroscience.

[82]  Christoph Kayser,et al.  Monkey drumming reveals common networks for perceiving vocal and nonvocal communication sounds , 2009, Proceedings of the National Academy of Sciences.

[83]  Dimitri Van De Ville,et al.  Decoding of Emotional Information in Voice-Sensitive Cortices , 2009, Current Biology.

[84]  A. Caramazza,et al.  Object Domain and Modality in the Ventral Visual Pathway , 2016, Trends in Cognitive Sciences.