The ubiquity of mouthings in NGT. A corpus study

When deaf signers of Sign Language of the Netherlands (NGT, Nederlandse Gebarentaal) sign among themselves, they often combine their signing with moutings: mouthed lexical items from spoken Dutch. Using a corpus of (semi-)spontaneous signing by deaf native signers, this dissertation investigates the co-occurrence of these mouthings with NGT signs, how they vary between tokens of the same sign, and how they combine with signs and sentences. The relation between mouthings and signs appears to be not very tight. Although most signs are accompanied by so-called standard mouthings, there is variation in the way mouthings are temporally reduced, variation in the use of either a mouthing or a mouth gesture with a sign, and to an minor extent variation in the choice of Dutch lexical items that are used as mouthings. Mouthings do not necessarily have a one-to-one relation with the signs they co-occur with. They can spread over adjacent signs to combine and group multiple signs under one mouthing, or they can occur in the sign stream without an accompanying sign, fullfilling a role that instead could have been taken by a manual sign. The general conclusion is that mouthings are a paramount feature in NGT communication, and that they can be analysed as instances of code-blending, the simultaneous mixing of languages in different modalities.

[1]  Adam Schembri,et al.  Issues in creating annotation standards for sign language description , 2010, LREC 2010.

[2]  Philip Hoole,et al.  Rhotics : New Data and Perspectives , 2013 .

[3]  Victoria Nyst,et al.  24. Shared sign languages , 2012 .

[4]  Patricia Siple,et al.  Visual Constraints for Sign Language Communication , 2013 .

[5]  N. J. Enfield,et al.  The Anatomy of Meaning: Speech, Gesture, and Composite Utterances , 2009 .

[6]  Charlotte Baker-Shenk,et al.  A Microanalysis of the Nonmanual Components of Questions in American Sign Language , 1983 .

[7]  Jordan Fenlon,et al.  Variation in handshape and orientation in British Sign Language: The case of the ‘1’ hand configuration , 2013, Language & communication.

[8]  G. M. Schermer,et al.  From Variant to Standard: An Overview of the Standardization Process of the Lexicon of Sign Language of the Netherlands over Two Decades , 2003 .

[9]  S. Kita Pointing: Where language, culture, and cognition meet , 2003 .

[10]  Alastair Pennycook,et al.  Disinventing and (Re)Constituting Languages , 2005 .

[11]  S. McCullough,et al.  Face processing by deaf ASL signers: evidence for expertise in distinguished local features. , 1997, Journal of deaf studies and deaf education.

[12]  Gerilee Gustason,et al.  Signing Exact English , 1975 .

[13]  Meaghan Morris,et al.  The Many Faces of Tau , 2011, Neuron.

[14]  C. Myers-Scotton Multiple Voices: An Introduction to Bilingualism , 2005 .

[15]  Sabina Fontana Mouth actions as gesture in sign language , 2008 .

[16]  Onno Crasborn,et al.  Lexically bound mouth actions in Sign Language of the Netherlands: A comparison between different registers and age groups , 2009 .

[17]  Adam Kendon Vocalisation, speech, gesture, and the language origins debate: An essay review on recent contributions , 2011 .

[18]  M. Coleman,et al.  Speechreading and its association with reading among deaf, hearing and dyslexic individuals , 2006, Clinical linguistics & phonetics.

[19]  Emiel Krahmer,et al.  GREEBLES Greeble greeb. On reduction in speech and gesture in repeated references , 2011, CogSci.

[20]  Adam Kendon,et al.  1. Exploring the utterance roles of visible bodily action: A personal account , 2013 .

[21]  E. M. van den Bogaerde,et al.  Input and interaction in deaf families , 2000 .

[22]  U. Zeshan,et al.  Sign languages in village communities: Anthropological and linguistic insights , 2012 .

[23]  Eleni Efthimiou,et al.  Proceedings of the 3rd Workshop on the Representation and Processing of Signed Languages : Construction and Exploitation of Sign Language Corpora , 2008 .

[24]  Onno Crasborn,et al.  Topic agreement in NGT (Sign Language of the Netherlands) , 2009 .

[25]  Onno Crasborn,et al.  Sign language transcription conventions for the ECHO Project , 2003 .

[26]  Neil Fox,et al.  The hands and mouth do not always slip together in British Sign Language: Dissociating articulatory channels in the lexicon , 2009 .

[27]  K. Emmorey,et al.  Bilingual processing of ASL-English code-blends: The consequences of accessing two lexical representations simultaneously. , 2012, Journal of memory and language.

[28]  Bencie Woll,et al.  Speechreading Revisited , 2012 .

[29]  P. Kerswill Children, adolescents, and language change , 1996, Language Variation and Change.

[30]  David F. Armstrong,et al.  Original Signs: Gesture, Sign, and the Sources of Language , 1999 .

[31]  Peter Wittenburg,et al.  ELAN: a Professional Framework for Multimodality Research , 2006, LREC.

[32]  Ceil Lucas,et al.  Language Contact in the American Deaf Community , 1992 .

[33]  Mirjam Ernestus,et al.  An introduction to reduced pronunciation variants [Editorial] , 2011 .

[34]  Richard Bank,et al.  Alignment of two languages: The spreading of mouthings in Sign Language of the Netherlands , 2015 .

[35]  Ulrike Zeshan,et al.  Signing in the Arctic. External influences on Inuit Sign Language , 2012 .

[36]  Onno Crasborn,et al.  Phonetic implementation of phonological categories in Sign Language of the Netherlands , 2001 .

[37]  Myriam Vermeerbergen,et al.  Sign language research, uses and practices , 2013 .

[38]  L. Bernstein,et al.  Speech perception without hearing , 2000, Perception & psychophysics.

[39]  Rachel Sutton-Spence,et al.  Multilingualism: The Global Approach To Sign Languages , 2001 .

[40]  Peter Berck,et al.  ANNEX - a web-based Framework for Exploiting Annotated Media Resources , 2006, LREC.

[41]  Ceil Lucas,et al.  Sociolinguistics and Deaf Communities , 2015 .

[42]  U. Zeshan,et al.  Mouthing in Indo-Pakistani Sign Language (IPSL): Regularities and variations , 2001 .

[43]  C. Hoffmann,et al.  An Introduction to Bilingualism , 1991 .

[44]  Roland Pfau Manual communication systems: evolution and variation , 2012 .

[45]  Trevor Johnston,et al.  From archive to corpus: transcription and annotation in the creation of signed language corpora , 2008, PACLIC.

[46]  Michael Mccarthy 3. Good listenership made plain: British and American non-minimal response tokens in everyday conversation , 2002 .

[47]  Onno Crasborn,et al.  OF SENTENCES IN SIGNED LANGUAGES , 2022 .

[48]  L. Boves,et al.  Quantitative assessment of second language learners' fluency: comparisons between read and spontaneous speech. , 2002, The Journal of the Acoustical Society of America.

[49]  S. Mcburney,et al.  38. History of sign languages and sign language linguistics , 2012 .

[50]  Ceil Lucas,et al.  The Sociolinguistics of Sign Languages , 2001 .

[51]  Adam Schembri,et al.  Mouth gestures in British Sign Language: A case study of tongue protrusion in BSL narratives , 2011 .

[52]  Emiel Krahmer,et al.  Do repeated references result in sign reduction? , 2012, CogSci.

[53]  Naomi Harte,et al.  Phoneme-to-viseme Mapping for Visual Speech Recognition , 2012, ICPRAM.

[54]  Scott K. Liddell American Sign Language Syntax , 1981 .

[55]  Onno Crasborn,et al.  The Corpus NGT: An online corpus for professionals and laymen , 2008 .

[56]  S. Duncan,et al.  On the structure of speaker–auditor interaction during speaking turns , 1974, Language in Society.

[57]  I.E.P. Zwitserlood,et al.  Sign language lexicography in the early 21st century and a recently published dictionary of Sign Language of the Netherlands , 2010 .

[58]  A. de Swaan,et al.  Words of the World: The Global Language System , 2002 .

[59]  Lc Day,et al.  Mouthings and Mouth Gestures in British Sign Language , 2001 .

[60]  Victoria Nyst,et al.  A descriptive analysis of Adamorobe sign language (Ghana) , 2007 .

[61]  Onno Crasborn,et al.  Nonmanual structures in sign language , 2005 .

[62]  T. Dijkstra,et al.  Language comprehension in the bilingual brain: fMRI and ERP support for psycholinguistic models , 2010, Brain Research Reviews.

[63]  Michael McCarthy,et al.  The Routledge Handbook of Corpus Linguistics , 2010 .

[64]  R. Mitchell,et al.  Chasing the Mythical Ten Percent: Parental Hearing Status of Deaf and Hard of Hearing Students in the United States , 2004 .

[65]  Robert Bayley,et al.  Sociolinguistic Variation in American Sign Language , 2001 .

[66]  Pieter Muysken,et al.  Language contact outcomes as the result of bilingual optimization strategies , 2013 .

[67]  Michael McCarthy and Anne O’Keeffe Historical perspective: What are corpora and how have they evolved? , 2010 .

[68]  Susanne Mohr The visual-gestural modality and beyond: Mouthings as a language contact phenomenon in Irish Sign Language , 2012 .

[69]  B. MacWhinney The CHILDES project: tools for analyzing talk , 1992 .

[70]  Sherman Wilcox,et al.  The Gestural Origin of Language , 2007 .

[71]  Onno Crasborn,et al.  On the weight of phrase-final prosodic words in a sign language , 2012 .

[72]  Anne Cutler,et al.  The recognition of spoken words with variable representation , 1998 .

[73]  Judith F. Kroll,et al.  When deaf signers read English: Do written words activate their sign translations? , 2011, Cognition.

[74]  Susan Goldin-Meadow,et al.  The Development of Morphology Without a Conventional Language Model , 1990 .

[75]  E. Yoshihara Life and Reality , 1986 .

[76]  L. Bernstein,et al.  Enhanced visual speech perception in individuals with early-onset hearing impairment. , 2007, Journal of speech, language, and hearing research : JSLHR.

[77]  K. Scherer Vocal affect expression: a review and a model for future research. , 1986, Psychological bulletin.

[78]  Bencie Woll,et al.  Sharing sign language data online: experiences from the ECHO project , 2007 .

[79]  R. Schreuder,et al.  The Recognition of Reduced Word Forms , 2002, Brain and Language.

[80]  Bencie Woll Sociolinguistics of Deaf Communities. , 2016 .

[81]  Walt Detmar Meurers,et al.  Encyclopedia of Language and Linguistics , 2006 .

[82]  Els van der Kooij,et al.  Phonological Categories in Sign Language of the Netherlands: The Role of Phonetic Implementation and Iconicity , 2002 .

[83]  Marit Vogt-Svendsen,et al.  Mouth Position & Mouth Movement in Norwegian Sign Language , 2013 .

[84]  Bencie Woll,et al.  The Linguistics of British Sign Language: An Introduction , 1999 .

[85]  A. Senghas,et al.  Children's contribution to the birth of Nicaraguan sign language , 1995 .

[86]  P. Boyes-Braem,et al.  The Hands are the Head of the Mouth , 2002 .

[87]  J. Coates,et al.  Turn‐taking patterns in deaf conversation , 2001 .

[88]  Jean Ann,et al.  Frequency of Occurrence and Ease of Articulation of Sign Language Handshapes: The Taiwanese Example , 2006 .

[89]  R P Meier,et al.  Diminishing Diversity of Signed Languages , 2000, Science.

[90]  W. Stokoe,et al.  Sign language structure: an outline of the visual communication systems of the American deaf. 1960. , 1961, Journal of deaf studies and deaf education.

[91]  Myriam Vermeerbergen,et al.  Simultaneity in signed languages: form and function , 2007 .

[92]  C. Gussenhoven The phonology of tone and intonation , 2004 .

[93]  Jordan Fenlon,et al.  Building the British Sign Language Corpus , 2013 .

[94]  Bencie Woll,et al.  The sign that dares to speak its name: echo phonology in British Sign Language , 2001 .

[95]  Harry Knoors,et al.  On the relation between the signing and reading skills of deaf bilinguals , 2010 .

[96]  E. Klima The signs of language , 1979 .

[97]  R. Sutton-Spence Mouthings and Simultaneity in British Sign Language , 2007 .

[98]  M. Marschark,et al.  Language planning for the 21st century: revisiting bilingual language policy for deaf children. , 2012, Journal of deaf studies and deaf education.

[99]  Klaus R. Scherer,et al.  Vocal communication of emotion: A review of research paradigms , 2003, Speech Commun..

[100]  James M Scobbie,et al.  Articulating five liquids: A single speaker ultrasound study of Malayalam , 2013 .

[101]  H. Bos Pronoun copy in Sign Language of The Netherlands , 1995 .

[102]  Robin L. Thompson,et al.  Eye gaze during comprehension of American Sign Language by native and beginning signers. , 2009, Journal of deaf studies and deaf education.

[103]  P. Perniss,et al.  Occurrence of mouthings in American Sign Language: A preliminary study , 2007 .

[104]  J. McQueen,et al.  Processing reduced word-forms in speech perception using probabilistic knowledge about speech production. , 2009, Journal of experimental psychology. Human perception and performance.

[105]  Michel DeGraff Language Creation and Language Change: Creolization, Diachrony, and Development , 2001 .

[106]  Beppie van den Bogaerde,et al.  Code-mixing in signs and words in input to and output from children , 2008 .

[107]  M. Nespor,et al.  Prosody in Israeli Sign Language , 1999 .

[108]  Onno Crasborn,et al.  From corpus to lexicon: the creation of ID-glosses for the Corpus NGT , 2012 .

[109]  F. Grosjean Bilingual: Life and Reality , 2010 .

[110]  Lorraine Leeson,et al.  Irish sign language : a cognitive linguistic account , 2012 .

[111]  Barbara LeMaster,et al.  Knowing & Using Female & Male Signs in Dublin , 2013 .

[112]  M. Ernestus Voice Assimilation and Segment Reduction in Casual Dutch. A Corpus-based Study of the Phonology-phonetics Interface , 2000 .

[113]  Barbara Celeste LeMaster The maintenance and loss of female and male signs in the Dublin deaf community , 1990 .

[114]  L. Bernstein,et al.  Enhanced speechreading in deaf adults: can short-term training/practice close the gap for hearing adults? , 2001, Journal of speech, language, and hearing research : JSLHR.

[115]  Cheryl M. Capek,et al.  Cortical circuits for silent speechreading in deaf and hearing people , 2008, Neuropsychologia.

[116]  Pam Peters,et al.  A study of backchannels in regional varieties of English, using corpus mark-up as the means of identification , 2007 .

[117]  Barbara LeMaster,et al.  Reappropriation of Gendered Irish Sign Language in One Family , 2000 .

[118]  J. Kegl Creation through contact : Sign language emergence and sign language change in Nicaragua , 1999 .

[119]  Anne Baker,et al.  Code-mixing in mother-child interaction in deaf families , 2005 .

[120]  Jennie E. Pyers,et al.  The Source of Enhanced Cognitive Control in Bilinguals , 2008, Psychology Science.

[121]  Richard Bank,et al.  Variation in mouth actions with manual signs in Sign Language of the Netherlands (NGT) , 2011 .

[122]  D. Massaro,et al.  The temporal distribution of information in audiovisual spoken-word identification , 2010, Attention, perception & psychophysics.

[123]  B. Woll,et al.  Frequency distribution and spreading behavior of different types of mouth actions in three sign languages , 2008 .

[124]  Anna Sáfár,et al.  A corpus-based approach to manual simultaneity , 2013 .

[125]  Adam Schembri,et al.  British Sign Language Corpus Project: Open access archives and the Observer’s Paradox. , 2008, LREC 2008.

[126]  U. Bellugi,et al.  A comparison of sign language and spoken language , 1972 .

[127]  Pieter Muysken,et al.  Bilingual Speech: A Typology of Code-Mixing , 2000 .

[128]  Jean Ann,et al.  The Sociolinguistics of Sign Languages: Bilingualism and language contact , 2001 .

[129]  Onno Crasborn,et al.  Signed languages and globalization , 2011, Language in Society.

[130]  Adam Schembri,et al.  Sociolinguistic Variation in the Use of Fingerspelling in Australian Sign Language: A Pilot Study , 2007 .

[131]  Mirjam Ernestus,et al.  Corpora and exemplars in phonology , 2011 .

[132]  Annette Hohenberger,et al.  The linguistic primacy of signs and mouth gestures over mouthing: Evidence from language production in German Sign Language (DGS) , 2001 .

[133]  Onno Crasborn,et al.  Linking Corpus NGT Annotations to a Lexical Database Using Open Source Tools ELAN and LEXUS , 2012 .

[134]  Rachel Sutton-Spence,et al.  Current Trends in European Sign Language Research , 1990 .

[135]  Richard Bank,et al.  The prominence of spoken language elements in a sign language , 2016 .

[136]  Connie De Vos,et al.  Sign-spatiality in Kata Kolok: How a village sign language in Bali inscribes its signing space , 2012 .

[137]  Patrick van der Zande Hearing and seeing speech: Perceptual adjustments in auditory-visual speech processing , 2013 .

[138]  D. Massaro Perceiving talking faces: from speech perception to a behavioral principle , 1999 .

[139]  Ceil Lucas,et al.  Multilingualism and Sign Languages , 2009 .

[140]  H. Lane When the Mind Hears: A History of the Deaf , 1984 .