Recognition of signed and spoken language: Different sensory inputs, the same segmentation procedure

Signed languages are articulated through simultaneous upper-body movements and are seen; spoken languages are articulated through sequential vocal-tract movements and are heard. But word recognition in both language modalities entails segmentation of a continuous input into discrete lexical units. According to the Possible Word Constraint (PWC), listeners segment speech so as to avoid impossible words in the input. We argue here that the PWC is a modality-general principle. Deaf signers of British Sign Language (BSL) spotted real BSL signs embedded in nonsense-sign contexts more easily when the nonsense signs were possible BSL signs than when they were not. A control experiment showed that there were no articulatory differences between the different contexts. A second control experiment on segmentation in spoken Dutch strengthened the claim that the main BSL result likely reflects the operation of a lexical-viability constraint. It appears that signed and spoken languages, in spite of radical input differences, are segmented so as to leave no residues of the input that cannot be words.

[1]  J. McQueen Segmentation of Continuous Speech Using Phonotactics , 1998 .

[2]  A. Cutler,et al.  Rhythmic Cues and Possible-Word Constraints in Japanese Speech Segmentation ☆ , 2001 .

[3]  Diane Brentari,et al.  A Prosodic Model of Sign Language Phonology , 1999 .

[4]  W. Stokoe,et al.  Sign language structure: an outline of the visual communication systems of the American deaf. 1960. , 1961, Journal of deaf studies and deaf education.

[5]  D. Corina,et al.  Modality and structure in signed and spoken languages: Psycholinguistic investigations of phonological structure in ASL , 2002 .

[6]  Scott P. Johnson,et al.  Motion and edge sensitivity in perception of object unity , 2003, Cognitive Psychology.

[7]  Taehong Cho,et al.  Prosodically driven phonetic detail in speech processing: The case of domain-initial strengthening in English , 2007, J. Phonetics.

[8]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[9]  Louis Goldstein,et al.  Effects of language modality on word segmentation: An experimental study of phonological factors in a sign language , 2006 .

[10]  J. McQueen,et al.  Possible words and fixed stress in the segmentation of Slovak speech , 2010, Quarterly journal of experimental psychology.

[11]  Refractor Vision , 2000, The Lancet.

[12]  Anne Cutler,et al.  Universality Versus Language-Specificity in Listening to Running Speech , 2002, Psychological science.

[13]  Michael C. W. Yip,et al.  Possible-Word Constraints in Cantonese Speech Segmentation , 2004, Journal of psycholinguistic research.

[14]  Elissa L. Newport,et al.  Maturational Constraints on Language Learning , 1990, Cogn. Sci..

[15]  Anne Cutler,et al.  Spotting (different kinds of) words in (different kinds of) context , 1998 .

[16]  U. Bellugi,et al.  Effects of age of acquisition on grammatical sensitivity: Evidence from on-line and off-line tasks , 1995, Applied Psycholinguistics.

[17]  Rachel I. Mayberry,et al.  The long-lasting advantage of learning sign language in childhood: Another look at the critical period for language acquisition , 1991 .

[18]  D. Norris,et al.  The Possible-Word Constraint in the Segmentation of Continuous Speech , 1997, Cognitive Psychology.

[19]  Anne Cutler,et al.  Language-universal constraints on speech segmentation , 2001 .

[20]  Anne Cutler,et al.  The role of strong syllables in segmentation for lexical access , 1988 .

[21]  Kearsy Cormier,et al.  Modality and structure in signed and spoken languages: Frontmatter , 2002 .

[22]  Manuel Carreiras,et al.  Lexical processing in Spanish Sign Language (LSE) , 2008 .

[23]  L. Goldstein,et al.  Lexical retrieval in American Sign Language production , 2006 .

[24]  Elizabeth K. Johnson,et al.  Lexical viability constraints on speech segmentation by infants , 2003, Cognitive Psychology.

[25]  Matthew H. Davis,et al.  Leading Up the Lexical Garden Path: Segmentation and Ambiguity in Spoken Word Recognition , 2002 .

[26]  L. Goldstein,et al.  Phonological priming in British Sign Language , 2006 .

[27]  D. Pisoni,et al.  Recognizing Spoken Words: The Neighborhood Activation Model , 1998, Ear and hearing.

[28]  D. Norris Shortlist: a connectionist model of continuous speech recognition , 1994, Cognition.

[29]  Wendy Sandler,et al.  Sign Language and Linguistic Universals: Entering the lexicon: lexicalization, backformation, and cross-modal borrowing , 2006 .

[30]  Gary Morgan,et al.  Making sense of nonsense in British Sign Language (BSL): The contribution of different phonological parameters to sign recognition , 2009, Memory & cognition.

[31]  Kenneth I Forster,et al.  DMDX: A Windows display program with millisecond accuracy , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[32]  Paul Boersma,et al.  Praat: doing phonetics by computer , 2003 .

[33]  Anne Cutler,et al.  Use of complex phonological patterns in speech processing: evidence from Korean , 2005, Journal of Linguistics.

[34]  A. Cutler,et al.  Vowel harmony and speech segmentation in Finnish , 1997 .

[35]  Linda Uyechi,et al.  The geometry of visual phonology , 1996 .

[36]  Adriana Hanulikova Lexical segmentation in Slovak and German , 2009 .

[37]  K. Emmorey,et al.  Lexical Recognition in Sign Language: Effects of Phonetic Structure and Morphology , 1990, Perceptual and motor skills.

[38]  A. Weber,et al.  First-language phonotactics in second-language listening. , 2006, The Journal of the Acoustical Society of America.

[39]  Ulrich H. Frauenfelder,et al.  The Role of the Syllable in Lexical Segmentation in French: Word-Spotting Data , 2002, Brain and Language.

[40]  James L. McClelland,et al.  The TRACE model of speech perception , 1986, Cognitive Psychology.

[41]  D. Norris,et al.  Shortlist B: a Bayesian model of continuous speech recognition. , 2008, Psychological review.

[42]  Diane Brentari,et al.  Effects of language modality on word segmentation : An experimental study of phonological factors in a sign language * , 2005 .

[43]  Rachel Sutton-Spence,et al.  The Linguistics of BSL: An Introduction , 1999 .

[44]  John Kingston,et al.  Papers in Laboratory Phonology: Index of names , 1990 .

[45]  Competition in spoken word recognition: Spotting words in other words , 1994 .

[46]  Laurence White,et al.  Integration of multiple speech segmentation cues: a hierarchical framework. , 2005, Journal of experimental psychology. General.

[47]  R. Mayberry The importance of childhood to language acquisition: Evidence from American Sign Language , 1994 .

[48]  Coarticulation • Suprasegmentals,et al.  Acoustic Phonetics , 2019, The SAGE Encyclopedia of Human Communication Sciences and Disorders.