EEG frequency-tagging demonstrates increased left hemispheric involvement and crossmodal plasticity for face processing in congenitally deaf signers

In humans, face-processing relies on a network of brain regions predominantly in the right occipito-temporal cortex. We tested congenitally deaf (CD) signers and matched hearing controls (HC) to investigate the experience dependence of the cortical organization of face processing. Specifically, we used EEG frequency-tagging to evaluate: (1) Face-Object Categorization, (2) Emotional Facial-Expression Discrimination and (3) Individual Face Discrimination. The EEG was recorded to visual stimuli presented at a rate of 6 Hz, with oddball stimuli at a rate of 1.2 Hz. In all three experiments and in both groups, significant face discriminative responses were found. Face-Object categorization was associated to a relative increased involvement of the left hemisphere in CD individuals compared to HC individuals. A similar trend was observed for Emotional Facial-Expression discrimination but not for Individual Face Discrimination. Source reconstruction suggested a greater activation of the auditory cortices in the CD group for Individual Face Discrimination. These findings suggest that the experience dependence of the relative contribution of the two hemispheres as well as crossmodal plasticity vary with different aspects of face processing.

[1]  E. Wagenmakers,et al.  Hidden multiplicity in exploratory multiway ANOVA: Prevalence and remedies , 2014, Psychonomic Bulletin & Review.

[2]  T. Sejnowski,et al.  Removing electroencephalographic artifacts by blind source separation. , 2000, Psychophysiology.

[3]  Richard M. Leahy,et al.  Brainstorm: A User-Friendly Application for MEG/EEG Analysis , 2011, Comput. Intell. Neurosci..

[4]  E. Halgren,et al.  Dynamic Statistical Parametric Mapping Combining fMRI and MEG for High-Resolution Imaging of Cortical Activity , 2000, Neuron.

[5]  Bruno Rossion,et al.  Figures and figure supplements , 2014 .

[6]  Talia L. Retter,et al.  Understanding human individuation of unfamiliar faces with oddball fast periodic visual stimulation and electroencephalography , 2020, The European journal of neuroscience.

[7]  Helen J. Neville,et al.  Attention to central and peripheral visual space in a movement detection task: an event-related potential and behavioral study. I. Normal hearing adults , 1987, Brain Research.

[8]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[9]  B. Röder,et al.  The influence of language deprivation in early childhood on L2 processing: An ERP comparison of deaf native signers and deaf signers with a delayed language acquisition , 2012, BMC Neuroscience.

[10]  Brigitte Röder,et al.  ERP correlates of German Sign Language processing in deaf native signers , 2014, BMC Neuroscience.

[11]  D. Bavelier,et al.  Cross-modal plasticity: where and how? , 2002, Nature Reviews Neuroscience.

[12]  C. Hutton,et al.  Visual Attention to the Periphery Is Enhanced in Congenitally Deaf Individuals , 2000, The Journal of Neuroscience.

[13]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[14]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[15]  O. Pascalis,et al.  Modifications of Visual Field Asymmetries for Face Categorization in Early Deaf Adults: A Study With Chimeric Faces , 2017, Front. Psychol..

[16]  B. Rossion Understanding face perception by means of human electrophysiology , 2014, Trends in Cognitive Sciences.

[17]  N. Weisz,et al.  Revisiting the adaptive and maladaptive effects of crossmodal plasticity , 2014, Neuroscience.

[18]  M. Kutas,et al.  Event-related potential studies of cerebral specialization during reading II. Studies of congenitally deaf adults , 1982, Brain and Language.

[19]  Bruno Rossion,et al.  Understanding individual face discrimination by means of fast periodic visual stimulation , 2014, Experimental Brain Research.

[20]  B. Rossion,et al.  Supra-additive contribution of shape and surface information to individual face discrimination as revealed by fast periodic visual stimulation. , 2014, Journal of vision.

[21]  Anders M. Dale,et al.  Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature , 2010, NeuroImage.

[22]  Philippe Pinel,et al.  Cortical representations of symbols, objects, and faces are pruned back during early childhood. , 2011, Cerebral cortex.

[23]  Nobuyuki Fujisawa,et al.  Occurrence of asymmetrical flow pattern behind an orifice in a circular pipe , 2011, J. Vis..

[24]  Kendrick Kay,et al.  The Functional Neuroanatomy of Human Face Perception. , 2017, Annual review of vision science.

[25]  M. Nachman,et al.  Morphological and population genomic evidence that human faces have evolved to signal individual identity , 2014, Nature Communications.

[26]  Mohamed L. Seghier,et al.  Laterality index in functional MRI: methodological issues☆ , 2008, Magnetic resonance imaging.

[27]  Jerre Levy,et al.  Perceptual asymmetries for free viewing of several types of chimeric stimuli , 1991, Brain and Cognition.

[28]  S. Lomber,et al.  Cross-modal plasticity in specific auditory cortices underlies visual compensations in the deaf , 2010, Nature Neuroscience.

[29]  Karen Emmorey,et al.  journal homepage: www.elsevier.com/locate/b&l The bimodal bilingual brain: Effects of sign language experience q , 2022 .

[30]  Stefan Debener,et al.  Source-Modeling Auditory Processes of EEG Data Using EEGLAB and Brainstorm , 2018, Front. Neurosci..

[31]  Galit Yovel,et al.  A Revised Neural Framework for Face Processing. , 2015, Annual review of vision science.

[32]  Philip K. McGuire,et al.  Fingerspelling, signed language, text and picture processing in deaf native signers: The role of the mid-fusiform gyrus , 2007, NeuroImage.

[33]  B. Rossion,et al.  Effect of face-related task on rapid individual face discrimination , 2019, Neuropsychologia.

[34]  Katherine J. Midgley,et al.  The N170 ERP component differs in laterality, distribution, and association with continuous reading measures for deaf and hearing readers , 2017, Neuropsychologia.

[35]  C. Marra,et al.  Human Neuroscience , 2022 .

[36]  Guinevere F. Eden,et al.  Cortical plasticity for visuospatial processing and object recognition in deaf and hearing signers , 2012, NeuroImage.

[37]  R. Zatorre,et al.  Adaptation to speaker's voice in right anterior temporal lobe , 2003, Neuroreport.

[38]  T. Sejnowski,et al.  Removal of eye activity artifacts from visual event-related potentials in normal and clinical subjects , 2000, Clinical Neurophysiology.

[39]  Bruno Rossion,et al.  Functional selectivity for face processing in the temporal voice area of early deaf individuals , 2017, Proceedings of the National Academy of Sciences.

[40]  Daphne Bavelier,et al.  Motion velocity thresholds in deaf signers: changes in lateralization but not in overall sensitivity. , 2004, Brain research. Cognitive brain research.

[41]  Anders M. Dale,et al.  Dynamic Statistical Parametric Neurotechnique Mapping: Combining fMRI and MEG for High-Resolution Imaging of Cortical Activity , 2000 .

[42]  D Bavelier,et al.  Cerebral organization for language in deaf and hearing subjects: biological constraints and effects of experience. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[43]  Jens Haueisen,et al.  Comparison of three-shell and simplified volume conductor models in magnetoencephalography , 2014, NeuroImage.

[44]  B. Rossion,et al.  The non-linear development of the right hemispheric specialization for human face perception , 2017, Neuropsychologia.

[45]  D. Perrett,et al.  Perceptual asymmetries in judgements of facial attractiveness, age, gender, speech and expression , 1997, Neuropsychologia.

[46]  M. Murray,et al.  EEG source imaging , 2004, Clinical Neurophysiology.

[47]  R. Zatorre,et al.  Voice-selective areas in human auditory cortex , 2000, Nature.

[48]  Alfonso Caramazza,et al.  Reading Without Speech Sounds: VWFA and its Connectivity in the Congenitally Deaf. , 2015, Cerebral cortex.

[49]  Bruno Rossion,et al.  Uncovering the neural magnitude and spatio-temporal dynamics of natural image categorization in a fast visual stream , 2016, Neuropsychologia.

[50]  Gregory Hickok,et al.  Visual stimuli activate auditory cortex in deaf subjects: evidence from MEG , 2003, Neuroreport.

[51]  Matthew W. G. Dye,et al.  Do deaf individuals see better? , 2006, Trends in Cognitive Sciences.

[52]  Cheryl M. Capek,et al.  Dissociating cognitive and sensory neural plasticity in human superior temporal cortex , 2013, Nature Communications.

[53]  S. Debener,et al.  Visual activation of auditory cortex reflects maladaptive plasticity in cochlear implant users. , 2012, Brain : a journal of neurology.

[54]  Olivier Pascalis,et al.  Science Current Directions in Psychological Developmental Origins of the Other-race Effect on Behalf Of: Association for Psychological Science , 2022 .

[55]  F. Simion,et al.  A predisposition for biological motion in the newborn baby , 2008, Proceedings of the National Academy of Sciences.

[56]  S. Dehaene,et al.  How Learning to Read Changes the Cortical Networks for Vision and Language , 2010, Science.

[57]  U. Bellugi,et al.  Enhanced facial discrimination: effects of experience with American sign language. , 1997, Journal of deaf studies and deaf education.

[58]  J. Morford,et al.  Word recognition in deaf readers: Cross-language activation of German Sign Language and German , 2014, Applied Psycholinguistics.

[59]  Terrence J. Sejnowski,et al.  Enhanced detection of artifacts in EEG data using higher-order statistics and independent component analysis , 2007, NeuroImage.

[60]  Bruno Rossion,et al.  At a Single Glance: Fast Periodic Visual Stimulation Uncovers the Spatio-Temporal Dynamics of Brief Facial Expression Changes in the Human Brain , 2016, Cerebral cortex.

[61]  Ione Fine,et al.  Visual stimuli activate auditory cortex in the deaf , 2001, Nature Neuroscience.

[62]  Helen J. Neville,et al.  Attention to central and peripheral visual space in a movement detection task: an event-related potential and behavioral study. II. Congenitally deaf adults , 1987, Brain Research.

[63]  Régine Kolinsky,et al.  Illiterate to literate: behavioural and cerebral changes induced by reading acquisition , 2015, Nature Reviews Neuroscience.

[64]  L. Merabet,et al.  Neural reorganization following sensory loss: the opportunity of change , 2010, Nature Reviews Neuroscience.

[65]  Théodore Papadopoulo,et al.  OpenMEEG: opensource software for quasistatic bioelectromagnetics , 2010, Biomedical engineering online.

[66]  V. M. Cassia,et al.  Early Experience Predicts Later Plasticity for Face Processing , 2009, Psychological science.

[67]  Tom Eichele,et al.  Semi-automatic identification of independent components representing EEG artifact , 2009, Clinical Neurophysiology.

[68]  D. Bavelier,et al.  Neural organization and plasticity of language , 1998, Current Opinion in Neurobiology.

[69]  P. McGuire,et al.  Neural systems underlying British Sign Language and audio-visual English processing in native users. , 2002, Brain : a journal of neurology.

[70]  Marie T Banich,et al.  Asymmetry of perception in free viewing of chimeric faces , 1983, Brain and Cognition.

[71]  Bruno Rossion,et al.  Fast periodic presentation of natural images reveals a robust face-selective electrophysiological response in the human brain. , 2015, Journal of vision.

[72]  Craig J. Brozinsky,et al.  Impact of Early Deafness and Early Exposure to Sign Language on the Cerebral Organization for Motion Processing , 2001, The Journal of Neuroscience.

[73]  David C. Plaut,et al.  Variable Left-hemisphere Language and Orthographic Lateralization Reduces Right-hemisphere Face Lateralization , 2015, Journal of Cognitive Neuroscience.

[74]  Adria E. N. Hoover,et al.  Superior voice recognition in a patient with acquired prosopagnosia and object agnosia , 2010, Neuropsychologia.

[75]  M. Sereno,et al.  Neural organization for recognition of grammatical and emotional facial expressions in deaf ASL signers and hearing nonsigners. , 2005, Brain research. Cognitive brain research.

[76]  Maarten De Vos,et al.  Cross-modal reorganization in cochlear implant users: Auditory cortex contributes to visual face processing , 2015, NeuroImage.

[77]  Susan M. Letourneau,et al.  Visual field bias in hearing and deaf adults during judgments of facial expression and identity , 2013, Front. Psychol..

[78]  F. Simion,et al.  Can a Nonspecific Bias Toward Top-Heavy Patterns Explain Newborns' Face Preference? , 2004, Psychological science.

[79]  Bruce D. McCandliss,et al.  The development of reading impairment: a cognitive neuroscience model. , 2003, Mental retardation and developmental disabilities research reviews.

[80]  Karen Emmorey,et al.  Enhanced Facial Diserimination: Effects of Experience With American Sign Language , 1997 .

[81]  Bruno Rossion,et al.  All-or-none face categorization in the human brain , 2020, NeuroImage.

[82]  A. Norcia,et al.  An objective index of individual face discrimination in the right occipito-temporal cortex by means of fast periodic oddball stimulation , 2014, Neuropsychologia.

[83]  Karen R. Dobkins,et al.  Visual Field Asymmetries for Motion Processing in Deaf and Hearing Signers , 2002, Brain and Cognition.

[84]  Karen Emmorey,et al.  Mapping the reading circuitry for skilled deaf readers: An fMRI study of semantic and phonological processing , 2013, Brain and Language.

[85]  Justin M. Ales,et al.  The steady-state visual evoked potential in vision research: A review. , 2015, Journal of vision.

[86]  Francesco Pavani,et al.  Visual change detection recruits auditory cortices in early deafness , 2014, NeuroImage.

[87]  Erich Schröger,et al.  Digital filter design for electrophysiological data – a practical approach , 2015, Journal of Neuroscience Methods.

[88]  Y. Benjamini,et al.  Controlling the false discovery rate in behavior genetics research , 2001, Behavioural Brain Research.

[89]  Bruno Rossion,et al.  Tuning functions for automatic detection of brief changes of facial expression in the human brain , 2018, NeuroImage.

[90]  R. Mitchell,et al.  Demographic and Achievement Characteristics of Deaf and Hard-of-Hearing Students , 2011 .

[91]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[92]  Bruno Rossion,et al.  Mapping face categorization in the human ventral occipitotemporal cortex with direct neural intracranial recordings , 2018, Annals of the New York Academy of Sciences.

[93]  Mark H. Johnson,et al.  Oxford Handbook of Face Perception , 2011 .

[94]  B. Rossion,et al.  The effect of parametric stimulus size variation on individual face discrimination indexed by fast periodic visual stimulation , 2014, BMC Neuroscience.

[95]  Seppo P. Ahlfors,et al.  Assessing and improving the spatial accuracy in MEG source localization by depth-weighted minimum-norm estimates , 2006, NeuroImage.

[96]  H. Neville,et al.  Attention to central and peripheral visual space in a movement detection task. III. Separate effects of auditory deprivation and acquisition of a visual language , 1987, Brain Research.