Interface of Linguistic and Visual Information During Audience Design

Evidence suggests that speakers can take account of the addressee's needs when referring. However, what representations drive the speaker's audience design has been less clear. This study aims to go beyond previous studies by investigating the interplay between the visual and linguistic context during audience design. Speakers repeated subordinate descriptions (e.g., firefighter) given in the prior linguistic context less and used basic-level descriptions (e.g., man) more when the addressee did not hear the linguistic context than when s/he did. But crucially, this effect happened only when the referent lacked the visual attributes associated with the expressions (e.g., the referent was in plain clothes rather than in a firefighter uniform), so there was no other contextual cue available for the identification of the referent. This suggests that speakers flexibly use different contextual cues to help their addressee map the referring expression onto the intended referent. In addition, speakers used fewer pronouns when the addressee did not hear the linguistic antecedent than when s/he did. This suggests that although speakers may be egocentric during anaphoric reference (Fukumura & Van Gompel, 2012), they can cooperatively avoid pronouns when the linguistic antecedents were not shared with their addressee during initial reference.

[1]  Herbert H. Clark,et al.  Coordinating beliefs in conversation , 1992 .

[2]  Ron Zacharski,et al.  Pronouns without NP antecedents: how do we know when a pronoun is referential? , 2005 .

[3]  G. Dell,et al.  Stages of lexical access in language production , 1992, Cognition.

[4]  H. H. Clark,et al.  Referring as a collaborative process , 1986, Cognition.

[5]  Jennifer E. Arnold,et al.  The Effect of Thematic Roles on Pronoun Use and Frequency of Reference Continuation , 2001 .

[6]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[7]  Ron Zacharski,et al.  Pronouns Without Explicit Antecedents: How do We Know When a Pronoun is Referential? , 2002 .

[8]  Kristen S. Gorman,et al.  What's learned together stays together: speakers' choice of referring expression reflects shared experience. , 2013, Journal of experimental psychology. Learning, memory, and cognition.

[9]  Amanda Stent,et al.  Production and Comprehension of Unheralded Pronouns: A Corpus Analysis , 2011 .

[10]  W. Chafe Givenness, contrastiveness, definiteness, subjects, topics, and point of view , 1976 .

[11]  R. Gerrig,et al.  The impact of memory demands on audience design during language production , 2005, Cognition.

[12]  R. P. van Gompel,et al.  Effects of order of mention and grammatical role on anaphor resolution. , 2015, Journal of experimental psychology. Learning, memory, and cognition.

[13]  Jeanette K. Gundel,et al.  Cognitive Status and the form of Referring Expressions in Discourse , 1993, The Oxford Handbook of Reference.

[14]  H. H. Clark,et al.  Audience Design in Meaning and Reference , 1982 .

[15]  Rainer Bromme,et al.  Lexical Entrainment in Written Discourse: Is Experts' Word Use Adapted to the Addressee? , 2008 .

[16]  T. Givón,et al.  Topic continuity in discourse : a quantitative cross-language study , 1983 .

[17]  Carl Pollard,et al.  A Centering Approach to Pronouns , 1987, ACL.

[18]  Julie C. Sedivy,et al.  Evidence of Perspective-Taking Constraints in Children's On-Line Reference Resolution , 2002, Psychological science.

[19]  Michael K. Tanenhaus,et al.  To Name or to Describe: Shared Knowledge Affects Referential Form , 2012, Top. Cogn. Sci..

[20]  Shali Wu,et al.  The Effect of Information Overlap on Communication Effectiveness , 2007, Cogn. Sci..

[21]  B. Keysar,et al.  When do speakers take into account common ground? , 1996, Cognition.

[22]  Siobhan Chapman Logic and Conversation , 2005 .

[23]  Roger P. G. van Gompel,et al.  Producing Pronouns and Definite Noun Phrases: Do Speakers Use the Addressee's Discourse Model? , 2012, Cogn. Sci..

[24]  Mija M. Van Der Wege Lexical Entrainment and Lexical Differentiation in Reference Phrase Choice. , 2009 .

[25]  S. Garrod,et al.  Saying what you mean in dialogue: A study in conceptual and semantic co-ordination , 1987, Cognition.

[26]  H. H. Clark,et al.  Conceptual pacts and lexical choice in conversation. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[27]  T. Jaeger,et al.  Categorical Data Analysis: Away from ANOVAs (transformation or not) and towards Logit Mixed Models. , 2008, Journal of memory and language.

[28]  Hartmut Leuthold,et al.  Processing Pronouns without Antecedents: Evidence from Event-related Brain Potentials , 2008, Journal of Cognitive Neuroscience.

[29]  Matthew P. Aylett,et al.  Referential form, duration, and modelling the listener in dialogue. , 2001 .

[30]  T. Givon Topic Continuity in Discourse , 1983 .

[31]  Martin J Pickering,et al.  The use of visual context during the production of referring expressions , 2010, Quarterly journal of experimental psychology.

[32]  Zenzi M. Griffin,et al.  Properties of Spoken Language Production , 2006 .

[33]  S. Brennan,et al.  Addressees' needs influence speakers' early syntactic choices , 2002, Psychonomic bulletin & review.

[34]  Anne H. Anderson,et al.  The Accessibility of Pronominal Antecedents as a Function of Episode Shifts in Narrative Text , 1983 .

[35]  R. Gerrig,et al.  Speakers’ experiences and audience design: knowing when and knowing how to adjust utterances to addressees☆ , 2002 .

[36]  Scott Weinstein,et al.  Centering: A Framework for Modeling the Local Coherence of Discourse , 1995, CL.

[37]  H. H. Clark,et al.  References in Conversation Between Experts and Novices , 1987 .

[38]  J. Perner,et al.  Identity: Key to Children’s Understanding of Belief , 2011, Science.

[39]  Roger P. G. van Gompel,et al.  How does similarity-based interference affect the choice of referring expression? , 2011 .

[40]  Fernanda Ferreira,et al.  The effect of noun phrase length on the form of referring expressions , 2014, Memory & cognition.

[41]  Mira Ariel Accessing Noun-Phrase Antecedents , 1990 .

[42]  D. Barr,et al.  Random effects structure for confirmatory hypothesis testing: Keep it maximal. , 2013, Journal of memory and language.

[43]  C. Roßnagel,et al.  Lost in thought: cognitive load and the processing of addressees' feedback in verbal communication. , 2004, Experimental psychology.

[44]  J. Hyönä,et al.  Gender affects semantic competition: the effect of gender in a non-gender-marking language. , 2013, Journal of experimental psychology. Learning, memory, and cognition.

[45]  S. Brennan,et al.  Attenuating Information in Spoken Communication: For the Speaker, or for the Addressee?. , 2010 .

[46]  Kumiko Fukumura,et al.  The effect of animacy on the choice of referring expression , 2011 .

[47]  Anne Cutler,et al.  A theory of lexical access in speech production , 1999, Behavioral and Brain Sciences.

[48]  W. Levelt,et al.  Speaking: From Intention to Articulation , 1990 .