Real-time processing of ASL signs: Delayed first language acquisition affects organization of the mental lexicon.

Sign language comprehension requires visual attention to the linguistic signal and visual attention to referents in the surrounding world, whereas these processes are divided between the auditory and visual modalities for spoken language comprehension. Additionally, the age-onset of first language acquisition and the quality and quantity of linguistic input for deaf individuals is highly heterogeneous, which is rarely the case for hearing learners of spoken languages. Little is known about how these modality and developmental factors affect real-time lexical processing. In this study, we ask how these factors impact real-time recognition of American Sign Language (ASL) signs using a novel adaptation of the visual world paradigm in deaf adults who learned sign from birth (Experiment 1), and in deaf adults who were late-learners of ASL (Experiment 2). Results revealed that although both groups of signers demonstrated rapid, incremental processing of ASL signs, only native signers demonstrated early and robust activation of sublexical features of signs during real-time recognition. Our findings suggest that the organization of the mental lexicon into units of both form and meaning is a product of infant language learning and not the sensory and motor modality through which the linguistic signal is sent and received.

[1]  J. Werker,et al.  Cross-language speech perception: Evidence for perceptual reorganization during the first year of life , 1984 .

[2]  Catherine T. Best,et al.  Effects of sign language experience on categorical perception of dynamic ASL pseudosigns , 2010, Attention, perception & psychophysics.

[3]  Shui-I Shih,et al.  Phonological priming in British Sign Language , 2006 .

[4]  Diane Brentari,et al.  A Prosodic Model of Sign Language Phonology , 1999 .

[5]  Julie C. Sedivy,et al.  Subject Terms: Linguistics Language Eyes & eyesight Cognition & reasoning , 1995 .

[6]  U. Bellugi,et al.  Effects of age of acquisition on grammatical sensitivity: Evidence from on-line and off-line tasks , 1995, Applied Psycholinguistics.

[7]  Elissa L. Newport,et al.  Maturational Constraints on Language Learning , 1990, Cogn. Sci..

[8]  R. Mitchell,et al.  Chasing the Mythical Ten Percent: Parental Hearing Status of Deaf and Hard of Hearing Students in the United States , 2004 .

[9]  W. Stokoe,et al.  A dictionary of American sign language on linguistic principles , 1965 .

[10]  L. Goldstein,et al.  Phonological priming in British Sign Language , 2006 .

[11]  M. Haith.  Future-oriented processes in infancy: The case of visual expectations. , 1993 .

[12]  M. Goldstein,et al.  Social Feedback to Infants' Babbling Facilitates Rapid Phonological Learning , 2008, Psychological science.

[13]  P. Kuhl,et al.  Early Speech Perception and Later Language Development: Implications for the "Critical Period" , 2005 .

[14]  Roberta Michnick Golinkoff,et al.  New Insights Into Old Puzzles From Infants' Categorical Discrimination of Soundless Phonetic Units , 2006, Language learning and development : the official journal of the Society for Language Development.

[15]  M K Tanenhaus,et al.  Eye Movements and Lexical Access in Spoken-Language Comprehension: Evaluating a Linking Hypothesis between Fixations and Linguistic Processing , 2000, Journal of psycholinguistic research.

[16]  Paul D. Allopenna,et al.  Tracking the Time Course of Spoken Word Recognition Using Eye Movements: Evidence for Continuous Mapping Models , 1998 .

[17]  Rachel I. Mayberry,et al.  The long-lasting advantage of learning sign language in childhood: Another look at the critical period for language acquisition , 1991 .

[18]  Karen Emmorey,et al.  When does iconicity in sign language matter? , 2013, Language and cognitive processes.

[19]  Gary Morgan,et al.  Making sense of nonsense in British Sign Language (BSL): The contribution of different phonological parameters to sign recognition , 2009, Memory & cognition.

[20]  V. Marchman,et al.  Speed of word recognition and vocabulary knowledge in infancy predict cognitive and language outcomes in later childhood. , 2008, Developmental science.

[21]  Siome Goldenstein,et al.  Facial movement analysis in ASL , 2007, Universal Access in the Information Society.

[22]  Jill P. Morford,et al.  A reexamination of "early exposure" and its implications for language acquisition by eye. , 2000 .

[23]  Julie C. Sedivy,et al.  Eye movements to pictures reveal transient semantic activation during spoken word recognition. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[24]  Kearsy Cormier,et al.  First language acquisition differs from second language acquisition in prelingually deaf signers: Evidence from sensitivity to grammaticality judgement in British Sign Language , 2012, Cognition.

[25]  J. Werker,et al.  Perceptual narrowing of linguistic sign occurs in the 1st year of life. , 2012, Child development.

[26]  Jill P. Morford,et al.  Effects of language experience on the perception of American Sign Language , 2008, Cognition.

[27]  K. Emmorey,et al.  Lexical Recognition in Sign Language: Effects of Phonetic Structure and Morphology , 1990, Perceptual and motor skills.

[28]  Amy M. Lieberman,et al.  The initial stages of first-language acquisition begun in adolescence: when late looks early. , 2013, Journal of child language.

[29]  Manuel Carreiras,et al.  Lexical processing in Spanish Sign Language (LSE) , 2008 .

[30]  Rachel I. Mayberry,et al.  Phonological similarity judgments in ASL: Evidence for maturational constraints on phonetic perception in sign , 2012 .

[31]  Viorica Marian,et al.  Bimodal bilinguals co-activate both languages during spoken comprehension , 2012, Cognition.

[32]  Christopher J. Moreland,et al.  The Form of Children's Early Signs: Iconic or Motoric Determinants? , 2008 .

[33]  Judith F. Kroll,et al.  When deaf signers read English: Do written words activate their sign translations? , 2011, Cognition.

[34]  Jill P. Morford,et al.  Grammatical development in adolescent first-language learners , 2003 .

[35]  J. Elman,et al.  Knowing a lot for one's age: Vocabulary skill and not age is associated with anticipatory incremental sentence interpretation in children and adults. , 2012, Journal of experimental child psychology.

[36]  Wendy Sandler,et al.  Sign Language and Linguistic Universals: Entering the lexicon: lexicalization, backformation, and cross-modal borrowing , 2006 .

[37]  E. Klima.  The signs of language , 1979 .

[38]  Neil Fox,et al.  Is Lexical Access Driven by Temporal Order or Perceptual Salience? Evidence from British Sign Language , 2013, CogSci.

[39]  G. Altmann.  Language can mediate eye movement control within 100 milliseconds, regardless of whether there is anything to move the eyes to , 2011, Acta psychologica.

[40]  L. Verhoeven,et al.  The role of sign phonology and iconicity during sign processing: the case of deaf children. , 2009, Journal of deaf studies and deaf education.

[41]  R. Mayberry,et al.  Development: Linguistic ability and early language exposure , 2002, Nature.

[42]  S D Fischer,et al.  Looking through phonological shape to lexical meaning: The bottleneck of non-native sign language processing , 1989, Memory & cognition.

[43]  Rachel I. Mayberry,et al.  What Sign Language Reveals about the Critical Period for Language , 2009 .

[44]  A. Meyer,et al.  Using the visual world paradigm to study language processing: a review and critical evaluation. , 2011, Acta psychologica.

[45]  Constantine Stephanidis,et al.  Universal access in the information society , 1999, HCI.