The Quarterly Journal of Experimental Psychology Segmentation of British Sign Language (bsl): Mind the Gap!

This study asks how users of British Sign Language (BSL) recognize individual signs in connected sign sequences. We examined whether this is achieved through modality-specific or modality-general segmentation procedures. A modality-specific feature of signed languages is that, during continuous signing, there are salient transitions between sign locations. We used the sign-spotting task to ask if and how BSL signers use these transitions in segmentation. A total of 96 real BSL signs were preceded by nonsense signs which were produced in either the target location or another location (with a small or large transition). Half of the transitions were within the same major body area (e.g., head) and half were across body areas (e.g., chest to hand). Deaf adult BSL users (a group of natives and early learners, and a group of late learners) spotted target signs best when there was a minimal transition and worst when there was a large transition. When location changes were present, both groups performed better when transitions were to a different body area than when they were within the same area. These findings suggest that transitions do not provide explicit sign-boundary cues in a modality-specific fashion. Instead, we argue that smaller transitions help recognition in a modality-general way by limiting lexical search to signs within location neighbourhoods, and that transitions across body areas also aid segmentation in a modality-general way, by providing a phonotactic cue to a sign boundary. We propose that sign segmentation is based on modality-general procedures which are core language-processing mechanisms.

[1]  Anne Cutler,et al.  Universality Versus Language-Specificity in Listening to Running Speech , 2002, Psychological science.

[2]  Manuel Carreiras,et al.  Lexical processing in Spanish Sign Language (LSE) , 2008 .

[3]  W. Stokoe,et al.  A dictionary of American sign language on linguistic principles , 1965 .

[4]  P C Gordon,et al.  Lexical and prelexical influences on word segmentation: evidence from priming. , 1995, Journal of experimental psychology. Human perception and performance.

[5]  W. Stokoe,et al.  Sign language structure: an outline of the visual communication systems of the American deaf. 1960. , 1961, Journal of deaf studies and deaf education.

[6]  Gary Morgan,et al.  Recognition of signed and spoken language: Different sensory inputs, the same segmentation procedure , 2010 .

[7]  D. Norris,et al.  The Possible-Word Constraint in the Segmentation of Continuous Speech , 1997, Cognitive Psychology.

[8]  Laurence White,et al.  Integration of multiple speech segmentation cues: a hierarchical framework. , 2005, Journal of experimental psychology. General.

[9]  R. Mayberry The importance of childhood to language acquisition: Evidence from American Sign Language , 1994 .

[10]  M. Coltheart,et al.  The quarterly journal of experimental psychology , 1985 .

[11]  Anne Cutler,et al.  The role of strong syllables in segmentation for lexical access , 1988 .

[12]  Kearsy Cormier,et al.  Modality and structure in signed and spoken languages: Frontmatter , 2002 .

[13]  J. McQueen,et al.  Effects of first and second language on segmentation of non-native speech* , 2011, Bilingualism: Language and Cognition.

[14]  Philip K. McGuire,et al.  Neural Correlates of British Sign Language Comprehension: Spatial Processing Demands of Topographic Language , 2002, Journal of Cognitive Neuroscience.

[15]  David Brien,et al.  Dictionary of British sign language/English , 1992 .

[16]  Wendy Sandler,et al.  Sign Language and Linguistic Universals: Entering the lexicon: lexicalization, backformation, and cross-modal borrowing , 2006 .

[17]  E. Klima The signs of language , 1979 .

[18]  J. McQueen Segmentation of Continuous Speech Using Phonotactics , 1998 .

[19]  S D Fischer,et al.  Looking through phonological shape to lexical meaning: The bottleneck of non-native sign language processing , 1989, Memory & cognition.

[20]  Diane Brentari,et al.  Effects of language modality on word segmentation : An experimental study of phonological factors in a sign language * , 2005 .

[21]  Rachel Sutton-Spence,et al.  The Linguistics of BSL: An Introduction , 1999 .

[22]  Peter M. Duppenthaler Maturational Constraints on Language Learning , 1990 .

[23]  A. Cutler,et al.  Rhythmic Cues and Possible-Word Constraints in Japanese Speech Segmentation ☆ , 2001 .

[24]  Alan C. Evans,et al.  Speech-like cerebral activity in profoundly deaf people processing signed languages: implications for the neural basis of human language. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[25]  A. Hohenberger The possible range of variation between sign languages : Universal Grammar , modality , and typological aspects , 2007 .

[26]  Diana Bohm Visible Variation Comparative Studies On Sign Language Structure , 2016 .

[27]  Gary Morgan,et al.  Making sense of nonsense in British Sign Language (BSL): The contribution of different phonological parameters to sign recognition , 2009, Memory & cognition.

[28]  K. Emmorey,et al.  Lexical Recognition in Sign Language: Effects of Phonetic Structure and Morphology , 1990, Perceptual and motor skills.

[29]  A. Weber,et al.  First-language phonotactics in second-language listening. , 2006, The Journal of the Acoustical Society of America.

[30]  Michael C. W. Yip,et al.  Possible-Word Constraints in Cantonese Speech Segmentation , 2004, Journal of psycholinguistic research.

[31]  C. Padden,et al.  The emergence of grammar: systematic structure in a new language. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[32]  L. Goldstein,et al.  Lexical retrieval in American Sign Language production , 2006 .

[33]  James M. McQueen,et al.  Eight questions about spoken-word recognition , 2007 .

[34]  D. Pisoni,et al.  Recognizing Spoken Words: The Neighborhood Activation Model , 1998, Ear and hearing.

[35]  D. Norris Shortlist: a connectionist model of continuous speech recognition , 1994, Cognition.

[36]  Anne Cutler,et al.  Language-universal constraints on speech segmentation , 2001 .

[37]  R. Battison,et al.  Lexical Borrowing in American Sign Language , 1978 .

[38]  Diane Brentari,et al.  A Prosodic Model of Sign Language Phonology , 1999 .

[39]  Taehong Cho,et al.  Prosodically driven phonetic detail in speech processing: The case of domain-initial strengthening in English , 2007, J. Phonetics.

[40]  Josep Quer,et al.  Lexical access in Catalan Signed Language (LSC) production , 2008, Cognition.

[41]  Anne Cutler,et al.  Use of complex phonological patterns in speech processing: evidence from Korean , 2005, Journal of Linguistics.

[42]  S. Tipper,et al.  Quarterly Journal of Experimental Psychology , 1948, Nature.

[43]  David P Vinson,et al.  The link between form and meaning in British sign language: effects of iconicity for phonological decisions. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[44]  Aaron J. Newman,et al.  A critical period for right hemisphere recruitment in American Sign Language processing , 2002, Nature Neuroscience.

[45]  David P. Vinson,et al.  The British Sign Language (BSL) norms for age of acquisition, familiarity, and iconicity , 2008, Behavior research methods.

[46]  D. Corina,et al.  Modality and structure in signed and spoken languages: Psycholinguistic investigations of phonological structure in ASL , 2002 .

[47]  R. Meier Shared Motoric Factors in the Acquisition of Sign and Speech , 2013 .

[48]  Competition in spoken word recognition: Spotting words in other words , 1994 .

[49]  Ulrich H. Frauenfelder,et al.  The Role of the Syllable in Lexical Segmentation in French: Word-Spotting Data , 2002, Brain and Language.

[50]  K. Emmorey Language, Cognition, and the Brain: Insights From Sign Language Research , 2001 .

[51]  Gary Morgan,et al.  The First Signs of Language: Phonological Development in British Sign Language. , 2007 .

[52]  J. McQueen,et al.  Possible words and fixed stress in the segmentation of Slovak speech , 2010, Quarterly journal of experimental psychology.

[53]  Linda Uyechi,et al.  The geometry of visual phonology , 1996 .

[54]  Shui-I Shih,et al.  Phonological priming in British Sign Language , 2006 .

[55]  A. Cutler,et al.  Vowel harmony and speech segmentation in Finnish , 1997 .

[56]  W. Marslen-Wilson Functional parallelism in spoken word-recognition , 1987, Cognition.

[57]  Coarticulation • Suprasegmentals,et al.  Acoustic Phonetics , 2019, The SAGE Encyclopedia of Human Communication Sciences and Disorders.

[58]  R. Mayberry,et al.  Development: Linguistic ability and early language exposure , 2002, Nature.

[59]  Matthew H. Davis,et al.  Leading Up the Lexical Garden Path: Segmentation and Ambiguity in Spoken Word Recognition , 2002 .

[60]  P. McGuire,et al.  Neural systems underlying British Sign Language and audio-visual English processing in native users. , 2002, Brain : a journal of neurology.

[61]  Allen R. Braun,et al.  Language Lateralization in a Bimanual Language , 2003, Journal of Cognitive Neuroscience.

[62]  Kenneth I Forster,et al.  DMDX: A Windows display program with millisecond accuracy , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[63]  Anne Cutler,et al.  Spotting (different kinds of) words in (different kinds of) context , 1998 .

[64]  U. Bellugi,et al.  Effects of age of acquisition on grammatical sensitivity: Evidence from on-line and off-line tasks , 1995, Applied Psycholinguistics.

[65]  Karen Emmorey,et al.  “Tip of the Fingers” Experiences by Deaf Signers , 2005, Psychological science.

[66]  Rachel I. Mayberry,et al.  The long-lasting advantage of learning sign language in childhood: Another look at the critical period for language acquisition , 1991 .

[67]  Elizabeth K. Johnson,et al.  Lexical viability constraints on speech segmentation by infants , 2003, Cognitive Psychology.

[68]  Chupoo Alafonté,et al.  Yesterday , 2023, Calabash. A journal of Caribbean arts and letters.

[69]  Adam Schembri,et al.  One hand or two?: Nativisation of fingerspelling in ASL and BANZSL , 2008 .

[70]  James L. McClelland,et al.  The TRACE model of speech perception , 1986, Cognitive Psychology.

[71]  D. Norris,et al.  Shortlist B: a Bayesian model of continuous speech recognition. , 2008, Psychological review.