The semiotic diversity of doing reference in a deaf signed language

Abstract This article describes how deaf signers of Auslan (a deaf signed language of Australia) coordinate fully conventionalised forms (such as lexical manual signs and English fingerspelling and/or mouthing) with more richly improvised semiotics (such as indicating verbs, pointing signs, depicting signs, visible surrogates and/or invisible surrogates) to identify and talk about referents of varying agency. Using twenty retellings of Frog, Where Are You? and twenty retellings of The Boy Who Cried Wolf archived in the Auslan Corpus, we analysed 4,699 tokens of referring expressions with respect to: (a) activation status; (b) semiotic form; and (c) animacy. Statistical analysis confirmed choice of strategy was most strongly motivated by activation status: new referents were expressed with more conventionalised forms (especially lexical manual signs and English mouthing), whereas maintained and reintroduced referents typically involved fewer and more richly improvised, context-dependent semiotics. However, animacy was also a motivating factor: humans and animals were often depicted via visible surrogates (not pointing signs), whereas inanimate referents favoured depicting signs and invisible surrogates. These findings highlight the role of animacy in signed language discourse and challenge the claim that informativeness decreases as cognitive saliency increases, while demonstrating the ‘pretend world’ indexicality of signed language use and the pluralistic complexity of face-to-face communication.

[1]  T. Givón,et al.  Topic continuity in discourse : a quantitative cross-language study , 1983 .

[2]  Elisabeth Engberg-Pedersen,et al.  Space in Danish sign language : the semantics and morphosyntax of the use of space in a visual language , 1993 .

[3]  Alexandra D'Arcy,et al.  Quotation and Advances in Understanding Syntactic Systems , 2015 .

[4]  John B. Haviland,et al.  Anchoring, Iconicity, and Orientation in Guugu Yimithirr Pointing Gestures , 1993 .

[5]  Gary Morgan The Development of Narrative Skills in British Sign Language , 2005 .

[6]  Trevor Johnston,et al.  Lexical frequency in sign languages. , 2012, Journal of deaf studies and deaf education.

[7]  David Quinto-Pozos,et al.  Lexicalisation and de-lexicalisation processes in sign languages: Comparing depicting constructions and viewpoint gestures , 2012, Language & communication.

[8]  Lorraine Edith Kumpf,et al.  Preferred argument structure : grammar as architecture for function , 2003 .

[9]  E. Tapio,et al.  Beyond languages, beyond modalities: transforming the study of semiotic repertoires , 2017 .

[10]  Lauren Gawne,et al.  Showing the story : Enactment as performance in Auslan narratives , 2014 .

[11]  Karen Van Hoek,et al.  Conceptual Reference Points: A Cognitive Grammar Account of Pronominal Anaphora Constraints. , 1995 .

[12]  A. Schembri,et al.  Modification of indicating verbs in British Sign Language: A corpus-based study , 2018 .

[13]  T. Johnston,et al.  Variable “subject” presence in Australian Sign Language and New Zealand Sign Language , 2011, Language Variation and Change.

[14]  Jessica Daecher,et al.  Frog Where Are You , 2016 .

[15]  Ilana Mushin,et al.  Free to Bound to Free?: Interactions Between Pragmatics and Syntax in the Development of Australian Pronominal Systems , 2008 .

[16]  Mutsumi Yamamoto,et al.  Animacy and reference , 1999 .

[17]  T. Johnston,et al.  On defining lexeme in a signed language , 1999 .

[18]  L. Ferrara,et al.  Language as Description, Indication, and Depiction , 2018, Front. Psychol..

[19]  Adam Kendon,et al.  Semiotic diversity in utterance production and the concept of ‘language’ , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[20]  Elizabeth A. Winston Spatial Referencing and Cohesion in an American Sign Language Text , 2013 .

[21]  Kearsy Cormier,et al.  Framing constructed action in British Sign Language narratives , 2013 .

[22]  S. Goldin-Meadow,et al.  The influence of communication mode on written language processing and beyond , 2015, Behavioral and Brain Sciences.

[23]  Onno Crasborn,et al.  The Other Hand in Sign Language Phonology , 2011 .

[24]  Östen Dahl,et al.  Animacy and egophoricity: Grammar, ontology and phylogeny , 2008 .

[25]  R. Krauss,et al.  Concurrent feedback, confirmation, and the encoding of referents in verbal communication. , 1966, Journal of personality and social psychology.

[26]  RANDY J. LAPOLLA Why languages differ : variation in the conventionalisation of constraints on inference * , 2003 .

[27]  T. Johnston,et al.  Variation, lexicalization and grammaticalization in signed languages , 2010 .

[28]  Bühler’s two-field theory of pointing and naming and the deictic origins of grammatical morphemes , 2012 .

[29]  Joel Sherzer Verbal and nonverbal deixis: the pointed lip gesture among the San Blas Cuna , 1973, Language in Society.

[30]  山本 睦美,et al.  Animacy and reference : a cognitive approach to corpus linguistics , 1999 .

[31]  T. Stivers,et al.  Person reference in interaction: Linguistic, cultural, and social perspectives , 2007 .

[32]  Yan Huang,et al.  Anaphora : a cross-linguistic approach , 2000 .

[33]  N. J. Enfield,et al.  Reference in Conversation , 2013 .

[34]  Asli Özyürek,et al.  Gestural Viewpoint Signals Referent Accessibility , 2013 .

[35]  Lieselotte Brems,et al.  Grammaticalization and language change: new reflections , 2012 .

[36]  Paul Kockelman The semiotic stance , 2005 .

[37]  S. Goldin-Meadow,et al.  Comparing sign language and gesture: Insights from pointing , 2019, Glossa: a journal of general linguistics.

[38]  Karl Bühler,et al.  Theory of Language: The Representational Function of Language , 2011 .

[39]  David McNeill,et al.  Speech, Gesture, and Discourse. , 1992 .

[40]  Pamela M. Perniss,et al.  Achieving spatial coherence in German Sign Language narratives: The use of classifiers and perspective , 2007 .

[41]  Terry Janzen,et al.  The Grammaticization of Topics in American Sign Language , 1999 .

[42]  Mark Dingemanse,et al.  Expressiveness and system integration: On the typology of ideophones, with special reference to Siwu , 2017 .

[43]  Ö. Dahl,et al.  Animacy in grammar and discourse , 1996 .

[44]  Scott K. Liddell Grammar, Gesture, and Meaning in American Sign Language , 2003 .

[45]  Caleb Everett,et al.  A reconsideration of the motivations for preferred argument structure , 2009 .

[46]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[47]  Introduction: The sign theory of Jakob von Uexküll , 1992 .

[48]  E. Schegloff Structures of Social Action: On some gestures' relation to talk , 1985 .

[49]  Fey Parrill,et al.  Viewpoint in speech–gesture integration: Linguistic structure, discourse structure, and event structure , 2010 .

[50]  T. Johnston,et al.  On the Conventionalization of Mouth Actions in Australian Sign Language , 2016, Language and speech.

[51]  Knud Lambrecht,et al.  Information structure and sentence form , 1994 .

[52]  Gemma Barberà,et al.  Pointing and Reference in Sign Language and Spoken Language: Anchoring vs. Identifying , 2013 .

[53]  Anne Therese Frederiksen,et al.  Who's on First? Investigating the referential hierarchy in simple native ASL narratives. , 2016, Lingua. International review of general linguistics. Revue internationale de linguistique generale.

[54]  Mira Ariel Accessing Noun-Phrase Antecedents , 1990 .

[55]  김상혁 영어의 능격성(Ergativity) , 2003 .

[56]  R. Harald Baayen,et al.  Models, forests, and trees of York English: Was/were variation as a case study for statistical practice , 2012, Language Variation and Change.

[57]  Trevor Johnston,et al.  Elaborating Who's What: A Study of Constructed Action and Clause Structure in Auslan (Australian Sign Language) , 2014 .

[58]  Gabrielle Hodge,et al.  Points, Depictions, Gestures and Enactment: Partly Lexical and Non-Lexical Signs as Core Elements of Single Clause-Like Units in Auslan (Australian Sign Language)* , 2014 .

[59]  Mark Dingemanse Ideophones and gesture in everyday speech , 2013 .

[60]  Balthasar Bickel,et al.  Referential Density in Discourse and Syntactic Typology , 2003 .

[61]  Christine Dimroth,et al.  Information structure and the Dynamics of Language Acquisition , 2003 .

[62]  Trevor Johnston,et al.  Auslan Corpus Annotation Guidelines , 2013 .

[63]  Stefan Schnell,et al.  The discourse basis of ergativity revisited , 2016 .

[64]  Marianne Gullberg Gestures, referents, and anaphoric linkage in learner varieties , 2003 .

[65]  David P. Wilkins Why pointing with the index finger is not a universal (in sociocultural and semiotic terms). , 2003 .

[66]  Loraine J. DiPietro Registry of Interpreters for the Deaf. , 1970 .

[67]  David McNeill,et al.  Cohesion and Gesture. , 1993 .

[68]  Zeynep Azar,et al.  General- and Language-Specific Factors Influence Reference Tracking in Speech and Gesture in Discourse , 2018, Discourse Processes.

[69]  H. H. Clark,et al.  Quotations as Demonstrations. , 1990 .

[70]  Gabrielle Hodge,et al.  Patterns from a signed language corpus: clause-like units in Auslan (Australian sign language) , 2014 .

[71]  Trevor Johnston,et al.  Formational and functional characteristics of pointing signs in a corpus of Auslan (Australian sign language): are the data sufficient to posit a grammatical class of ‘pronouns’ in Auslan? , 2013 .

[72]  付伶俐 打磨Using Language,倡导新理念 , 2014 .

[73]  Siobhan Chapman Logic and Conversation , 2005 .

[74]  S. Kita Pointing: Where language, culture, and cognition meet , 2003 .

[75]  Robert Bayley,et al.  Variable Subject Presence in ASL Narratives , 2002 .

[76]  N. J. Enfield,et al.  The Anatomy of Meaning: Speech, Gesture, and Composite Utterances , 2009 .

[77]  R. Harald Baayen,et al.  Analyzing linguistic data: a practical introduction to statistics using R, 1st Edition , 2008 .

[78]  Elisabeth Engberg-Pedersen,et al.  Perspective in signed discourse: the privileged status of the signer’s locus and gaze , 2015 .

[79]  Kearsy Cormier,et al.  Pronouns and pointing in sign languages , 2013 .

[80]  Ellen Fricke 136. Deixis, gesture, and embodiment from a linguistic point of view , 2014 .

[81]  S. Gries Dispersions and adjusted frequencies in corpora: further explorations , 2010 .

[82]  John W. Du Bois The Discourse Basis of Ergativity , 1987 .

[83]  Natalia Levshina,et al.  How to do Linguistics with R: Data exploration and statistical analysis , 2015 .

[84]  Eleanor Longden Talking with voices. , 2011 .

[85]  Mercer Mayer,et al.  Frog, Where Are You? , 1969 .

[86]  J. Sidnell,et al.  Deixis and the Interactional Foundations of Reference , 2014 .

[87]  Jeanette K. Gundel,et al.  Cognitive Status and the Form of Referring Expressions in Discourse , 1993 .

[88]  Onno Crasborn,et al.  Enhanced ELAN functionality for sign language corpora , 2008, LREC 2008.

[89]  Asli Özyürek,et al.  Visible Cohesion: A Comparison of Reference Tracking in Sign, Speech, and Co-Speech Gesture , 2015, Top. Cogn. Sci..

[90]  J. Sidnell Coordinating Gesture, Talk, and Gaze in Reenactments , 2006 .

[91]  Yijin Wu,et al.  The Handbook of Conversation Analysis , 2015 .

[92]  Carl Börstell,et al.  The effect of being human and the basis of grammatical word order: Insights from novel communication systems and young sign languages , 2017, Cognition.

[93]  M. Csíkszentmihályi Flow: The Psychology of Optimal Experience , 1990 .

[94]  Marianne Gullberg,et al.  Handling Discourse: Gestures, Reference Tracking, and Communication Strategies in Early L2 , 2006 .

[95]  Sébastien Lê,et al.  FactoMineR: An R Package for Multivariate Analysis , 2008 .

[96]  W. Chafe Givenness, contrastiveness, definiteness, subjects, topics, and point of view , 1976 .

[97]  David Bradley,et al.  Language variation: Papers on variation and change in the Sinosphere and in the Indosphere in honour of James A. Matisoff , 2003 .

[98]  T. Johnston,et al.  Lexicalization in signed languages: when is an idiom not an idiom? , 2012 .

[99]  Danielle Barth,et al.  Discourse motivations for pronominal and zero objects across registers in Vera'a , 2018, Language Variation and Change.

[100]  Michael Halliday,et al.  An Introduction to Functional Grammar , 1985 .

[101]  K. Cormier,et al.  Rethinking constructed action , 2015 .