Adapting to a listener with incomplete lexical semantics

Speakers involved in a communicative exchange construct an internal model of their addressees and draw upon the model to craft utterances that are likely to be understood. In many realworld situations (e.g., when talking to a non-expert, non-native speaker, or a child), this process of audience design involves identifying gaps in the lexical-semantic knowledge of the listener and selecting alternative expressions. We examine speaker adaptation to a listener with incomplete lexical knowledge in the spatial domain, specifically a failure to comprehend the basic terms left/right. Experimental and modeling results provide evidence of rapid adaptation that is modulated by the availability of alternative spatial terms. We consider how our approach relates to recent work in computational pragmatics, and suggest that adaptation to the lexical knowledge of the addressee is an important but relatively understudied topic for future research.

[1]  Christopher Potts,et al.  Learning in the Rational Speech Acts Model , 2015, ArXiv.

[2]  H. H. Clark,et al.  Conceptual pacts and lexical choice in conversation. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[3]  Shali Wu,et al.  The Effect of Information Overlap on Communication Effectiveness , 2007, Cogn. Sci..

[4]  Michael C. Frank,et al.  Predicting Pragmatic Reasoning in Language Games , 2012, Science.

[5]  H. H. Clark,et al.  References in Conversation Between Experts and Novices , 1987 .

[6]  Laura A. Carlson-Radvansky,et al.  The Influence of Reference Frame Selection on Spatial Template Construction , 1997 .

[7]  Stanka A. Fitneva,et al.  The Comprehension of “Left” and “Right” in a Referential Communication Task , 2009 .

[8]  H. H. Clark,et al.  Audience Design in Meaning and Reference , 1982 .

[9]  H E Egeth,et al.  Right-left confusion in the adult: A verbal labeling effect , 1981, Memory & cognition.

[10]  Sharon Goldwater,et al.  Talkers account for listener and channel characteristics to communicate efficiently , 2015 .

[11]  James H. Martin,et al.  Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition , 2000 .

[12]  Barbara Landau,et al.  Spatial Language and the Embedded Listener Model in Parents' Input to Children , 2016, Cogn. Sci..

[13]  Oliver Lemon,et al.  Adaptive Referring Expression Generation in Spoken Dialogue Systems: Evaluation with Real Users , 2010, SIGDIAL Conference.

[14]  Susan R. Fussell,et al.  Coordination of knowledge in communication: effects of speakers' assumptions about what others know. , 1992, Journal of personality and social psychology.

[15]  Chris Mellish,et al.  Production of Referring Expressions for an Unknown Audience: A Computational Model of Communal Common Ground , 2016, Front. Psychol..

[16]  G. Logan Linguistic and Conceptual Control of Visual Spatial Attention , 1995, Cognitive Psychology.

[17]  Michael F. Schober,et al.  Spatial Dialogue between Partners with Mismatched Abilities , 2009, Spatial Language and Dialogue.