Asymetric Event-Related Potential Priming Effects Between English Letters and American Sign Language Fingerspelling Fonts

Abstract Letter recognition plays an important role in reading and follows different phases of processing, from early visual feature detection to the access of abstract letter representations. Deaf ASL–English bilinguals experience orthography in two forms: English letters and fingerspelling. However, the neurobiological nature of fingerspelling representations, and the relationship between the two orthographies, remains unexplored. We examined the temporal dynamics of single English letter and ASL fingerspelling font processing in an unmasked priming paradigm with centrally presented targets for 200 ms preceded by 100 ms primes. Event-related brain potentials were recorded while participants performed a probe detection task. Experiment 1 examined English letter-to-letter priming in deaf signers and hearing non-signers. We found that English letter recognition is similar for deaf and hearing readers, extending previous findings with hearing readers to unmasked presentations. Experiment 2 examined priming effects between English letters and ASL fingerspelling fonts in deaf signers only. We found that fingerspelling fonts primed both fingerspelling fonts and English letters, but English letters did not prime fingerspelling fonts, indicating a priming asymmetry between letters and fingerspelling fonts. We also found an N400-like priming effect when the primes were fingerspelling fonts which might reflect strategic access to the lexical names of letters. The studies suggest that deaf ASL–English bilinguals process English letters and ASL fingerspelling differently and that the two systems may have distinct neural representations. However, the fact that fingerspelling fonts can prime English letters suggests that the two orthographies may share abstract representations to some extent.

[1]  P. Holcomb,et al.  Electrophysiological patterns of visual word recognition in deaf and hearing readers: an ERP mega-study , 2022, Language, cognition and neuroscience.

[2]  Zed Sevcikova Sehyr,et al.  Contribution of Lexical Quality and Sign Language Variables to Reading Comprehension. , 2022, Journal of deaf studies and deaf education.

[3]  L. Verhoeven,et al.  Predictors of Word and Text Reading Fluency of Deaf Children in Bilingual Deaf Education Programmes , 2022, Languages.

[4]  Manuel Perea,et al.  The impact of visual cues during visual word recognition in deaf readers: An ERP study , 2021, Cognition.

[5]  O. Hetzroni,et al.  Developing Reading Skills in Prelingually Deaf Preschool Children: Fingerspelling as a Strategy to Promote Orthographic Learning. , 2021, Journal of deaf studies and deaf education.

[6]  Karen Emmorey,et al.  The neurocognitive basis of skilled reading in prelingually and profoundly deaf adults , 2021, Lang. Linguistics Compass.

[7]  Katherine J. Midgley,et al.  An ERP investigation of orthographic precision in deaf and hearing readers , 2020, Neuropsychologia.

[8]  Katherine J. Midgley,et al.  Unique N170 signatures to words and faces in deaf ASL signers reflect experience-specific adaptations during early visual processing , 2020, Neuropsychologia.

[9]  Chuanji Gao,et al.  Electrophysiological correlates of masked repetition and conceptual priming for visual objects , 2019, Brain and Behavior.

[10]  Manuel Perea,et al.  Deaf readers benefit from lexical feedback during orthographic processing , 2019, Scientific Reports.

[11]  Laurie S. Glezer,et al.  Orthographic and phonological selectivity across the reading system in deaf skilled readers , 2018, Neuropsychologia.

[12]  Katherine J. Midgley,et al.  The N170 ERP component differs in laterality, distribution, and association with continuous reading measures for deaf and hearing readers , 2017, Neuropsychologia.

[13]  Karen Emmorey,et al.  The neural circuits recruited for the production of signs and fingerspelled words , 2016, Brain and Language.

[14]  Peter C. Hauser,et al.  Fingerspelling as a Novel Gateway into Reading Fluency in Deaf Bilinguals , 2015, PloS one.

[15]  J. Weisberg,et al.  Neural correlates of fingerspelling, text, and sign processing in deaf American Sign Language–English bilinguals , 2015 .

[16]  C. Padden,et al.  An Alphabet on Hand: The Acquisition of Fingerspelling in Deaf Children , 2013 .

[17]  Manuel Perea,et al.  Neural Correlates of Visual versus Abstract Letter Processing in Roman and Arabic Scripts , 2013, Journal of Cognitive Neuroscience.

[18]  Karen Emmorey,et al.  Processing orthographic structure: associations between print and fingerspelling. , 2012, Journal of deaf studies and deaf education.

[19]  Patrick Cavanagh,et al.  What Line Drawings Reveal About the Visual Brain , 2011, Front. Hum. Neurosci..

[20]  Sally Andrews,et al.  Lexical precision in skilled readers: Individual differences in masked neighbor priming. , 2010, Journal of experimental psychology. General.

[21]  Alice Mado Proverbio,et al.  Observation of Static Pictures of Dynamic Actions Enhances the Activity of Movement-Related Brain Areas , 2009, PloS one.

[22]  Jonathan Grainger,et al.  Language effects in second language learners and proficient bilinguals investigated with event-related potentials , 2009, Journal of Neurolinguistics.

[23]  Urs Maurer,et al.  Left-lateralized N170 Effects of Visual Expertise in Reading: Evidence from Japanese Syllabic and Logographic Scripts , 2008, Journal of Cognitive Neuroscience.

[24]  Philip K. McGuire,et al.  Fingerspelling, signed language, text and picture processing in deaf native signers: The role of the mid-fusiform gyrus , 2007, NeuroImage.

[25]  B. Schick,et al.  The transition from fingerspelling to English print: facilitating English decoding. , 2007, Journal of deaf studies and deaf education.

[26]  Marianna D. Eddy,et al.  Masked repetition priming and event-related brain potentials: a new approach for tracking the time-course of object perception. , 2006, Psychophysiology.

[27]  Jonathan Grainger,et al.  On the Time Course of Visual Word Recognition: An Event-related Potential Investigation using Masked Repetition Priming , 2006, Journal of Cognitive Neuroscience.

[28]  Katherine J. Midgley,et al.  On the time course of letter perception: A masked priming ERP investigation , 2006, Psychonomic bulletin & review.

[29]  C. Padden Learning to Fingerspell Twice: Young Signing Children’s Acquisition of Fingerspelling , 2005 .

[30]  Isabel Gauthier,et al.  An early electrophysiological response associated with expertise in letter perception , 2005, Cognitive, affective & behavioral neuroscience.

[31]  Bruce D. McCandliss,et al.  Fast, visual specialization for reading in English revealed by the topography of the N170 ERP response , 2005, Behavioral and Brain Functions.

[32]  M. D Rugg,et al.  The effect of repetition lag on electrophysiological and haemodynamic correlates of visual object priming , 2004, NeuroImage.

[33]  Guinevere F. Eden,et al.  Attention to single letters activates left extrastriate cortex , 2004, NeuroImage.

[34]  Tom Humphries,et al.  “Chaining" and other links: Making connections between American Sign Language and English in Two Types of School Settings , 2000 .

[35]  Carol Padden,et al.  Reading Ability in Signing Deaf Children. , 1998 .

[36]  H. Begleiter,et al.  Visual object priming differs from visual word priming: an ERP study. , 1997, Electroencephalography and clinical neurophysiology.

[37]  Harry G. Barrow,et al.  Interpreting Line Drawings as Three-Dimensional Surfaces , 1980, Artif. Intell..

[38]  Zed Sevcikova Sehyr,et al.  Fingerspelled and Printed Words Are Recoded into a Speech-based Code in Short-term Memory. , 2017, Journal of deaf studies and deaf education.

[39]  D. Corina,et al.  Embodiment and American Sign Language: Exploring sensory-motor influences in the recognition of American Sign Language , 2016 .

[40]  T. E. Allen,et al.  Assessing literacy in deaf individuals : neurocognitive measurement and predictors , 2012 .

[41]  Jonathan Grainger,et al.  Testing asymmetries in noncognate translation priming: evidence from RTs and ERPs. , 2011, Psychophysiology.

[42]  Jonathan Grainger,et al.  Watching the Word Go by: On the Time-course of Component Processes in Visual Word Recognition , 2009, Lang. Linguistics Compass.

[43]  The Metalinguistics of Fingerspelling : An Alternate Way to Increase Reading Vocabulary in Congenitally Deaf , 2008 .

[44]  Marta Kutas,et al.  Time Course of Processes and Representations Supporting Visual Object Identification and Memory , 2003, Journal of Cognitive Neuroscience.

[45]  P. Holcomb,et al.  Event-related potential indices of masked repetition priming. , 2003, Psychophysiology.

[46]  Rachel I. Mayberry,et al.  Language acquisition by eye , 2000 .

[47]  Carol Padden,et al.  American Sign Language and reading ability in deaf children. , 2000 .

[48]  John A. Spinks,et al.  Asymmetrical cross-language priming effects , 1994, Memory & cognition.

[49]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: part 1.: an account of basic findings , 1988 .