The Influence of Shared Visual Context on the Successful Emergence of Conventions in a Referential Communication Task

Human communication is thoroughly context bound. We present two experiments investigating the importance of the shared context, that is, the amount of knowledge two interlocutors have in common, for the successful emergence and use of novel conventions. Using a referential communication task where black-and-white pictorial symbols are used to convey colors, pairs of participants build shared conventions peculiar to their dyad without experimenter feedback, relying purely on ostensive-inferential communication. Both experiments demonstrate that access to the visual context promotes more successful communication. Importantly, success improves cumulatively, supporting the view that pairs establish conventional ways of using the symbols to communicate. Furthermore, Experiment 2 suggests that dyads with access to the visual context successfully adapt the conventions built for one color space to another color space, unlike dyads lacking it. In linking experimental pragmatics with language evolution, the study illustrates the benefits of exploring the emergence of linguistic conventions using an ostensive-inferential model of communication.

[1]  Simon Kirby,et al.  Languages adapt to their contextual niche , 2014, Language and Cognition.

[2]  Julie C. Sedivy,et al.  Evidence of Perspective-Taking Constraints in Children's On-Line Reference Resolution , 2002, Psychological science.

[3]  Simon Garrod,et al.  Experimental Semiotics: A Review , 2010, Front. Hum. Neurosci..

[4]  Shali Wu,et al.  The Effect of Information Overlap on Communication Effectiveness , 2007, Cogn. Sci..

[5]  H. H. Clark,et al.  Understanding by addressees and overhearers , 1989, Cognitive Psychology.

[6]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[7]  S. Brown-Schmidt,et al.  Partner-specific interpretation of maintained referential precedents during interactive dialog. , 2009, Journal of memory and language.

[8]  Sarah Brown-Schmidt,et al.  Compensating for an Inattentive Audience , 2018, Cogn. Sci..

[9]  Gareth Roberts,et al.  Experimental Semiotics , 2012, Lang. Linguistics Compass.

[10]  M. Luo,et al.  The development of the CIE 2000 Colour Difference Formula , 2001 .

[11]  Philip R. Cohen,et al.  Referring as a Collaborative Process , 2003 .

[12]  Dan Sperber,et al.  Pragmatics, modularity and mindreading , 2002 .

[13]  Susan Brennan,et al.  Partner-Specific Adaptation in Dialog , 2009, Top. Cogn. Sci..

[14]  S. Brown-Schmidt,et al.  Beyond common and privileged: Gradient representations of common ground in real-time language use , 2012 .

[15]  R. Krauss,et al.  Concurrent feedback, confirmation, and the encoding of referents in verbal communication. , 1966, Journal of personality and social psychology.

[16]  Andrew D. M. Smith,et al.  The pre-linguistic basis of grammaticalisation: a unified approach to metaphor and reanalysis , 2009 .

[17]  Sarah Brown-Schmidt,et al.  Addressees distinguish shared from private information when interpreting questions during interactive conversation , 2008, Cognition.

[18]  H. H. Clark,et al.  Collaborating on contributions to conversations , 1987 .

[19]  Ichiro Umata,et al.  Graphical Language Games: Interactional Constraints on Representational Form , 2007, Cogn. Sci..

[20]  H. H. Clark,et al.  Speaking while monitoring addressees for understanding , 2004 .

[21]  S. Kirby,et al.  Contextual predictability shapes signal autonomy , 2018, Cognition.

[22]  D. Barr,et al.  Taking Perspective in Conversation: The Role of Mutual Knowledge in Comprehension , 2000, Psychological science.

[23]  Territoire Urbain,et al.  Convention , 1955, Hidden Nature.

[24]  Susan R. Fussell,et al.  The effects of intended audience on message production and comprehension: Reference in a common ground framework , 1989 .

[25]  Giosuè Baggio,et al.  Role Asymmetry and Code Transmission in Signaling Games: An Experimental and Computational Investigation , 2015, Cogn. Sci..

[26]  Simon Kirby,et al.  Cumulative cultural evolution in the laboratory: An experimental approach to the origins of structure in human language , 2008, Proceedings of the National Academy of Sciences.

[27]  Susan R. Fussell,et al.  Perspective-Taking in Communication: Representations of Others' Knowledge in Reference , 1991 .

[28]  Judith Holler,et al.  Communicating common ground: How mutually shared knowledge influences speech and gesture in a narrative task , 2009, Speech Accompanying-Gesture.

[29]  H. H. Clark,et al.  References in Conversation Between Experts and Novices , 1987 .

[30]  Noam Chomsky,et al.  Poverty of the Stimulus Revisited , 2011, Cogn. Sci..

[31]  Si On Yoon,et al.  The historical context in conversation: Lexical differentiation and memory for the discourse history , 2016, Cognition.

[32]  S. Brennan,et al.  Attenuating Information in Spoken Communication: For the Speaker, or for the Addressee?. , 2010 .

[33]  Simon Kirby,et al.  Word Meanings Evolve to Selectively Preserve Distinctions on Salient Dimensions , 2015, Cogn. Sci..

[34]  Jerome A. Niles,et al.  The Context of Comprehension , 1981 .

[35]  M. Pickering,et al.  Why is conversation so easy? , 2004, Trends in Cognitive Sciences.

[36]  Bruno Galantucci,et al.  An Experimental Study of the Emergence of Human Communication Systems , 2005, Cogn. Sci..

[37]  Mark P. J. van der Loo,et al.  The stringdist Package for Approximate String Matching , 2014, R J..

[38]  S. Brennan 4 How Conversation Is Shaped by Visual and Spoken Evidence , 2005 .

[39]  S. Kirby,et al.  Language evolution in the laboratory , 2010, Trends in Cognitive Sciences.

[40]  D. Barr,et al.  Anchoring Comprehension in Linguistic Precedents , 2002 .

[41]  T. Scott-Phillips Pragmatics and the aims of language evolution , 2016, Psychonomic bulletin & review.

[42]  Robert M. Krauss,et al.  Effect of referent similarity and communication mode on verbal encoding , 1967 .

[43]  D. Barr,et al.  Random effects structure for confirmatory hypothesis testing: Keep it maximal. , 2013, Journal of memory and language.

[44]  Jon Oberlander,et al.  Foundations of Representation: Where Might Graphical Symbol Systems Come From? , 2007, Cogn. Sci..

[45]  M. Tanenhaus,et al.  The effects of common ground and perspective on domains of referential interpretation , 2003 .

[46]  Herbert H. Clark,et al.  Coordinating beliefs in conversation , 1992 .

[47]  R. Krauss,et al.  Changes in reference phrases as a function of frequency of usage in social interaction: a preliminary study , 1964 .

[48]  Kristen S. Gorman,et al.  What's learned together stays together: speakers' choice of referring expression reflects shared experience. , 2013, Journal of experimental psychology. Learning, memory, and cognition.

[49]  M. Tanenhaus,et al.  The role of perspective in identifying domains of reference , 2008, Cognition.

[50]  Boaz Keysar,et al.  Unconfounding common ground , 1997 .

[51]  J. Scharf [Language evolution]. , 1973, Gegenbaurs morphologisches Jahrbuch.

[52]  G. Ritchie,et al.  Signalling signalhood and the emergence of communication , 2008, Cognition.

[53]  B. Keysar,et al.  When do speakers take into account common ground? , 1996, Cognition.

[54]  Michael K. Tanenhaus,et al.  To Name or to Describe: Shared Knowledge Affects Referential Form , 2012, Top. Cogn. Sci..

[55]  Timothy S. Paek,et al.  Definite Reference and Mutual Knowledge: Process Models of Common Ground in Comprehension , 1998 .

[56]  Bruno Galantucci,et al.  Experimental Semiotics: A New Approach for Studying Communication as a Form of Joint Action , 2009, Top. Cogn. Sci..

[57]  H. H. Clark,et al.  Common ground at the understanding of demonstrative reference , 1983 .

[58]  S. Kirby,et al.  Compression and communication in the cultural evolution of linguistic structure , 2015, Cognition.

[59]  T. Scott-Phillips Speaking Our Minds , 1996 .

[60]  M. Tamariz Experimental Studies on the Cultural Evolution of Language , 2017 .

[61]  Stefan Hartmann,et al.  Usage context influences the evolution of overspecification in iterated learning , 2017 .

[62]  G. Lupyan,et al.  Perspective Taking in a Novel Signaling Task: Effects of World Knowledge and Contextual Constraint , 2018, Journal of experimental psychology. General.

[63]  H. Schielzeth Simple means to improve the interpretability of regression coefficients , 2010 .