REDUNDANT REFERRING EXPRESSIONS 3 When redundancy is rational : A Bayesian approach to ‘ overinformative ’ referring expressions 1 Overinformativeness in referring expressions

Referring is one of the most basic and prevalent uses of language. How do speakers choose from the wealth of referring expressions at their disposal? Rational theories of language use have come under attack for decades for not being able to account for the seemingly irrational overinformativeness ubiquitous in referring expressions. Here we present a novel production model of referring expressions within the Rational Speech Act framework that treats speakers as agents that rationally trade off cost and informativeness of utterances. Crucially, we relax the assumption of deterministic meaning in favor of a graded semantics. This innovation allows us to capture a large number of seemingly disparate phenomena within one unified framework: the basic asymmetry in speakers’ propensity to overmodify with color rather than size; the increase in overmodification in complex scenes; the increase in overmodification with atypical features; and the preference for basic level nominal reference. These findings cast a new light on the production of referring expressions: rather than being wastefully overinformative, reference is rationally redundant.

[1]  H. Westerbeek,et al.  Stored object knowledge and the production of referring expressions: the case of color typicality , 2015, Front. Psychol..

[2]  Justine Cassell,et al.  Reactive Redundancy and Listener Comprehension in Direction-Giving , 2008, SIGDIAL Workshop.

[3]  T. Florian Jaeger,et al.  Redundancy and reduction: Speakers manage syntactic information density , 2010, Cognitive Psychology.

[4]  Julie C. Sedivy,et al.  Pragmatic Versus Form-Based Accounts of Referential Contrast: Evidence for Effects of Informativity Expectations , 2003, Journal of psycholinguistic research.

[5]  T. Pechmann Incremental speech production and referential overspecification , 1989 .

[6]  R. Levy Expectation-based syntactic comprehension , 2008, Cognition.

[7]  R. Weale Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[8]  Roger Levy,et al.  Pragmatic reasoning through semantic inference , 2016, Semantics and Pragmatics.

[9]  Brady Clark,et al.  Communicating with Cost-based Implicature: a Game-Theoretic Approach to Ambiguity , 2012 .

[10]  Noah D. Goodman,et al.  Subjectivity Predicts Adjective Ordering Preferences , 2017, Open Mind.

[11]  G. Altmann,et al.  Looking at anything that is green when hearing “frog”: How object surface colour and stored object colour knowledge influence language-mediated overt attention , 2011, Quarterly journal of experimental psychology.

[12]  D R Olson,et al.  Language and thought: aspects of a cognitive theory of semantics. , 1970, Psychological review.

[13]  Paul-Christian Bürkner,et al.  brms: An R Package for Bayesian Multilevel Models Using Stan , 2017 .

[14]  F. Ferreira,et al.  Over-specified referring expressions impair comprehension: An ERP study , 2011, Brain and Cognition.

[15]  Paula Rubio-Fernández,et al.  How Redundant Are Redundant Color Adjectives? An Efficiency-Based Analysis of Color Overspecification , 2016, Front. Psychol..

[16]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[17]  Michael Franke,et al.  Reasoning in Reference Games: Individual- vs. Population-Level Probabilistic Modeling , 2016, PloS one.

[18]  Ingmar Weber,et al.  Why do you ask this? , 2012, WWW.

[19]  Stephen M. Kosslyn,et al.  Pictures and names: Making the connection , 1984, Cognitive Psychology.

[20]  Emiel Krahmer,et al.  Factors causing overspecification in definite descriptions , 2011 .

[21]  Martijn Goudbeek,et al.  The Effect of Scene Variation on the Redundant Use of Color in Definite Reference , 2013, Cogn. Sci..

[22]  H. H. Clark,et al.  Audience Design in Meaning and Reference , 1982 .

[23]  Judith Masthoff,et al.  Generating Referring Expressions: Making Referents Easy to Identify , 2007, Computational Linguistics.

[24]  Nathaniel J. Smith,et al.  The effect of word predictability on reading time is logarithmic , 2013, Cognition.

[25]  Kees van Deemter,et al.  Typicality and Object Reference , 2013, CogSci.

[26]  Nathan Schneider,et al.  Association for Computational Linguistics: Human Language Technologies , 2011 .

[27]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[28]  Michael Franke,et al.  UC Merced Proceedings of the Annual Meeting of the Cognitive Science Society , 2013 .

[29]  Robert Dale,et al.  Cooking Up Referring Expressions , 1989, ACL.

[30]  Christopher Kennedy,et al.  Scale Structure, Degree Modification, and the Semantics of Gradable Predicates , 2005 .

[31]  R. Sproat,et al.  The Cross-Linguistic Distribution of Adjective Ordering Restrictions , 1991 .

[32]  Noah D. Goodman,et al.  Nonliteral understanding of number words , 2014, Proceedings of the National Academy of Sciences.

[33]  Emiel Krahmer,et al.  Varying image description tasks: spoken versus written descriptions , 2018, VarDial@COLING 2018.

[34]  Thomas Hofmann,et al.  Speakers optimize information density through syntactic reduction , 2007 .

[35]  T. Jaeger,et al.  Proceedings of the Annual Meeting of the Cognitive Science Society , 2008 .

[36]  Edward E. Smith,et al.  Basic-level superiority in picture categorization , 1982 .

[37]  Henk Zeevat,et al.  Bayesian Natural Language Semantics and Pragmatics , 2015 .

[38]  Alfons Maes,et al.  Overspecification facilitates object identification , 2011 .

[39]  J. Tanaka,et al.  Object categories and expertise: Is the basic level in the eye of the beholder? , 1991, Cognitive Psychology.

[40]  A Wingfield,et al.  Response Latencies in Naming Objects , 1965, The Quarterly journal of experimental psychology.

[41]  E. Krahmer,et al.  Color in Reference Production: The Role of Color Similarity and Color Codability. , 2017, Cognitive science.

[42]  Julie C. Sedivy,et al.  Evidence of Perspective-Taking Constraints in Children's On-Line Reference Resolution , 2002, Psychological science.