Early visual experience and the recognition of basic facial expressions: involvement of the middle temporal and inferior frontal gyri during haptic identification by the early blind

Face perception is critical for social communication. Given its fundamental importance in the course of evolution, the innate neural mechanisms can anticipate the computations necessary for representing faces. However, the effect of visual deprivation on the formation of neural mechanisms that underlie face perception is largely unknown. We previously showed that sighted individuals can recognize basic facial expressions by haptics surprisingly well. Moreover, the inferior frontal gyrus (IFG) and posterior superior temporal sulcus (pSTS) in the sighted subjects are involved in haptic and visual recognition of facial expressions. Here, we conducted both psychophysical and functional magnetic-resonance imaging (fMRI) experiments to determine the nature of the neural representation that subserves the recognition of basic facial expressions in early blind individuals. In a psychophysical experiment, both early blind and sighted subjects haptically identified basic facial expressions at levels well above chance. In the subsequent fMRI experiment, both groups haptically identified facial expressions and shoe types (control). The sighted subjects then completed the same task visually. Within brain regions activated by the visual and haptic identification of facial expressions (relative to that of shoes) in the sighted group, corresponding haptic identification in the early blind activated regions in the inferior frontal and middle temporal gyri. These results suggest that the neural system that underlies the recognition of basic facial expressions develops supramodally even in the absence of early visual experience.

[1]  A. Amedi,et al.  The large-scale organization of "visual" streams emerges without visual experience. , 2012, Cerebral cortex.

[2]  J. Haxby,et al.  Distributed Neural Systems for Face Perception , 2011 .

[3]  Magdalena G. Wutte,et al.  Modality-Independent Coding of Spatial Layout in the Human Brain , 2011, Current Biology.

[4]  R. Hobson,et al.  Reversible autism among congenitally blind children? A controlled follow-up study. , 2010, Journal of child psychology and psychiatry, and allied disciplines.

[5]  M. Ptito,et al.  Beyond visual, aural and haptic movement perception: hMT+ is activated by electrotactile motion stimulation of the tongue in sighted and in congenitally blind individuals , 2010, Brain Research Bulletin.

[6]  C. Büchel,et al.  Increased amygdala activation to emotional auditory stimuli in the blind. , 2010, Brain : a journal of neurology.

[7]  Susan J. Lederman,et al.  Brain networks involved in haptic and visual identification of facial expressions of emotion: An fMRI study , 2010, NeuroImage.

[8]  Norihiro Sadato,et al.  An investigation of cross-modal plasticity of effective connectivity in the blind by dynamic causal modeling of functional MRI data , 2009, Neuroscience Research.

[9]  A. Caramazza,et al.  Category-Specific Organization in the Human Brain Does Not Require Visual Experience , 2009, Neuron.

[10]  Luciano Fadiga,et al.  Do We Really Need Vision? How Blind People “See” the Actions of Others , 2009, The Journal of Neuroscience.

[11]  Xiaoping Hu,et al.  Neural processing underlying tactile microspatial discrimination in the blind: a functional magnetic resonance imaging study. , 2008, Journal of vision.

[12]  Doris Y. Tsao,et al.  Comparing face patch systems in macaques and humans , 2008, Proceedings of the National Academy of Sciences.

[13]  James V. Haxby,et al.  Mirror Neuron System Differentially Activated by Facial Expressions and Social Hand Gestures: A Functional Magnetic Resonance Imaging Study , 2008, Journal of Cognitive Neuroscience.

[14]  Randall Stilla,et al.  Selective visuo‐haptic processing of shape and texture , 2008, Human brain mapping.

[15]  Doris Y. Tsao,et al.  Patches of face-selective cortex in the macaque frontal lobe , 2008, Nature Neuroscience.

[16]  Alumit Ishai,et al.  Let’s face it: It’s a cortical network , 2008, NeuroImage.

[17]  Arthur W. Toga,et al.  Construction of a 3D probabilistic atlas of human cortical structures , 2008, NeuroImage.

[18]  Y. Sugita Face perception in monkeys reared with no exposure to faces , 2008, Proceedings of the National Academy of Sciences.

[19]  J. Haxby,et al.  The effect of visual experience on the development of functional architecture in hMT+. , 2007, Cerebral cortex.

[20]  Ivan Toni,et al.  Parieto-Frontal Connectivity during Visually Guided Grasping , 2007, The Journal of Neuroscience.

[21]  Rainer Goebel,et al.  The neural correlates of human working memory for haptically explored object orientations. , 2007, Cerebral cortex.

[22]  William M. Stern,et al.  Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex , 2007, Nature Neuroscience.

[23]  R. Klatzky,et al.  Haptic Recognition of Static and Dynamic Expressions of Emotion in the Live Face , 2007, Psychological science.

[24]  M. Iacoboni,et al.  The mirror neuron system and the consequences of its dysfunction , 2006, Nature Reviews Neuroscience.

[25]  C. Keysers,et al.  Empathy and the Somatotopic Auditory Mirror System in Humans , 2006, Current Biology.

[26]  C. Blakemore,et al.  Tactile perception recruits functionally related visual areas in the late-blind , 2006, Neuroreport.

[27]  Colline Poirier,et al.  Auditory motion perception activates visual motion areas in early blind subjects , 2006, NeuroImage.

[28]  K. Amunts,et al.  Cytoarchitectonic mapping of the human amygdala, hippocampal region and entorhinal cortex: intersubject variability and probability maps , 2005, Anatomy and Embryology.

[29]  Simon B. Eickhoff,et al.  A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data , 2005, NeuroImage.

[30]  Karl J. Friston,et al.  Conjunction revisited , 2005, NeuroImage.

[31]  Jesper Andersson,et al.  Valid conjunction inference with the minimum statistic , 2005, NeuroImage.

[32]  Gilles Pourtois,et al.  View-independent coding of face identity in frontal and temporal cortices is modulated by familiarity: an event-related fMRI study , 2005, NeuroImage.

[33]  Emiliano Ricciardi,et al.  Beyond sensory images: Object-based representation in the human ventral pathway. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[34]  Dr. Stefan Geyer The Microstructural Border Between the Motor and the Cognitive Domain in the Human Cerebral Cortex , 2004, Advances in Anatomy Embryology and Cell Biology.

[35]  C. Tinti,et al.  Spontaneous Facial Expressions in Congenitally Blind and Sighted Children Aged 8–11 , 2003 .

[36]  J. Mazziotta,et al.  Neural mechanisms of empathy in humans: A relay from neural systems for imitation to limbic areas , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[37]  Thomas E. Nichols,et al.  Optimization of experimental design in fMRI: a general framework using a genetic algorithm , 2003, NeuroImage.

[38]  Karl J. Friston,et al.  Classical and Bayesian Inference in Neuroimaging: Applications , 2002, NeuroImage.

[39]  B. Mazoyer,et al.  Neural Correlates of Woman Face Processing by 2-Month-Old Infants , 2002, NeuroImage.

[40]  N. Sadato,et al.  Attention to emotion modulates fMRI activity in human right superior temporal sulcus. , 2001, Brain research. Cognitive brain research.

[41]  G. Rizzolatti,et al.  Neurophysiological mechanisms underlying the understanding and imitation of action , 2001, Nature Reviews Neuroscience.

[42]  G. Pagnoni,et al.  Explicit and Incidental Facial Expression Processing: An fMRI Study , 2001, NeuroImage.

[43]  Renato Miceli,et al.  Judging and coding facial expression of emotions in congenitally blind children , 2001 .

[44]  K. Amunts,et al.  Brodmann's Areas 17 and 18 Brought into Stereotaxic Space—Where and How Variable? , 2000, NeuroImage.

[45]  U. Dimberg,et al.  Unconscious Facial Reactions to Emotional Facial Expressions , 2000, Psychological science.

[46]  A. Schleicher,et al.  Broca's region revisited: Cytoarchitecture and intersubject variability , 1999, The Journal of comparative neurology.

[47]  Anthony Lee,et al.  Autism and Congenital Blindness , 1999, Journal of autism and developmental disorders.

[48]  Leslie G. Ungerleider,et al.  The Effect of Face Inversion on Activity in Human Neural Systems for Face and Object Perception , 1999, Neuron.

[49]  Karl J. Friston,et al.  Generalisability, Random Effects & Population Inference , 1998, NeuroImage.

[50]  U. Dimberg,et al.  Rapid facial reactions to emotional facial expressions. , 1998, Scandinavian journal of psychology.

[51]  Scott T. Grafton,et al.  Feeling with the mind's eye , 1997, Neuroreport.

[52]  M. Hallett,et al.  Functional relevance of cross-modal plasticity in blind humans , 1997, Nature.

[53]  R. Hobson,et al.  Are there "autistic-like" features in congenitally blind children? , 1997, Journal of child psychology and psychiatry, and allied disciplines.

[54]  Karl J. Friston,et al.  Detecting Activations in PET and fMRI: Levels of Inference and Power , 1996, NeuroImage.

[55]  A. Schleicher,et al.  Two different areas within the primary motor cortex of man , 1996, Nature.

[56]  T. Allison,et al.  Differential Sensitivity of Human Visual Cortex to Faces, Letterstrings, and Textures: A Functional Magnetic Resonance Imaging Study , 1996, The Journal of Neuroscience.

[57]  M. Hallett,et al.  Activation of the primary visual cortex by Braille reading in blind subjects , 1996, Nature.

[58]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited—Again , 1995, NeuroImage.

[59]  P. Ekman Facial expression and emotion. , 1993, The American psychologist.

[60]  R. Klatzky,et al.  Hand movements: A window into haptic object recognition , 1987, Cognitive Psychology.

[61]  W. Greenough,et al.  Experience and brain development. , 1987, Child development.

[62]  T. Field,et al.  Discrimination and imitation of facial expression by neonates. , 1982, Science.

[63]  C. Webb The use of myoelectric feedback in teaching facial expression to the blind , 1977, Biofeedback and self-regulation.

[64]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[65]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[66]  L. Wing,et al.  The handicaps of autistic children--a comparative study. , 1969, Journal of child psychology and psychiatry, and allied disciplines.

[67]  P. Ekman,et al.  Pan-Cultural Elements in Facial Displays of Emotion , 1969, Science.

[68]  A. Fletcher Expression of the Emotions in Man and Animals , 1956 .

[69]  Amir Amedi,et al.  A Ventral Visual Stream Reading Center Independent of Visual Experience , 2012, Current Biology.

[70]  C. Nelson,et al.  Tuning the developing brain to social signals of emotions , 2009, Nature Reviews Neuroscience.

[71]  D. Matsumoto,et al.  Spontaneous facial expressions of emotion of congenitally and noncongenitally blind individuals. , 2009, Journal of personality and social psychology.

[72]  Mark T. Waters,et al.  This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits distribution,andreproductioninanymedium,providedtheoriginalauthorandsourcearecredited.Thislicensedoesnot permit commercial exploitation or the creation of derivative works without sp , 2009 .

[73]  K. Jellinger Motor Cognition What Actions Tell the Self , 2007 .

[74]  Karl J. Friston,et al.  Statistical parametric mapping , 2013 .

[75]  K. Scherer,et al.  Voluntary facial expression of emotion: comparing congenitally blind with normally sighted encoders. , 1997, Journal of personality and social psychology.

[76]  Karl J. Friston,et al.  Analysis of functional MRI time‐series , 1994, Human Brain Mapping.

[77]  Wolfgang Prinz,et al.  Why don't we perceive our brain states? , 1992 .

[78]  W. Rinn,et al.  Neuropsychology of facial expression. , 1991 .

[79]  D. Peck,et al.  Facial expression training in blind adolescents using EMG feedback: a multiple-baseline study. , 1986, Behaviour research and therapy.

[80]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[81]  W. Keeler Autistic patterns and defective communication in blind children with retrolental fibroplasia. , 1956, Proceedings of the annual meeting of the American Psychopathological Association.

[82]  Keeler Wr Autistic patterns and defective communication in blind children with retrolental fibroplasia. , 1956 .

[83]  J. Thompson Development of facial expression of emotion in blind and seeing children. , 1941 .

[84]  C. Darwin,et al.  The Expression of the Emotions in Man and Animals , 1872 .