On the role of object knowledge in reference production: 
effects of color typicality on content determination

In two language production experiments, we investigated whether stored knowledge of the typical color of objects affects spoken reference. In experiment 1, human speakers referred to objects with colors ranging from very typical (e.g., red tomato) to very atypical (e.g., blue pepper). The probability that speakers redundantly include color in their descriptions was almost linearly predicted by the degree of atypicality. In experiment 2, we extended this finding to references to objects for which color is inherently a less salient property in stored knowledge (i.e., objects with a highly characteristic shape, making color less important for recognition). Following these findings that typicality affects reference production, we conclude that speakers utilize stored knowledge about everyday objects they refer to. We discuss the implications of our findings for artificial agents that generate natural language, arguing that computational models fall short in captur- ing general knowledge about typical properties of objects.

[1]  John K. Tsotsos,et al.  50 Years of object recognition: Directions forward , 2013, Comput. Vis. Image Underst..

[2]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[3]  Julie C. Sedivy,et al.  Pragmatic Versus Form-Based Accounts of Referential Contrast: Evidence for Effects of Informativity Expectations , 2003, Journal of psycholinguistic research.

[4]  Anna K. Kuhlen,et al.  Language in Dialogue: When Confederates Might Be Hazardous to Your Data , 2022 .

[5]  Ielka van der Sluis,et al.  Generation of Referring Expressions: Assessing the Incremental Algorithm , 2012, Cogn. Sci..

[6]  Ruud Koolen Need I say more? On overspecification in definite reference , 2013 .

[7]  Mark W. Becker,et al.  Object-intrinsic oddities draw early saccades. , 2007, Journal of experimental psychology. Human perception and performance.

[8]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[9]  Martijn Goudbeek,et al.  The Effect of Scene Variation on the Redundant Use of Color in Definite Reference , 2013, Cogn. Sci..

[10]  Kees van Deemter,et al.  Typicality and Object Reference , 2013, CogSci.

[11]  Emiel Krahmer,et al.  Toward a Computational Psycholinguistics of Reference Production , 2012, Top. Cogn. Sci..

[12]  Emiel Krahmer,et al.  Factors causing overspecification in definite descriptions , 2011 .

[13]  D. Weiskopf,et al.  The role of color in high-level vision , 2001, Trends in Cognitive Sciences.

[14]  Emiel Krahmer,et al.  The Impact of Colour Difference and Colour Codability on Reference Production , 2012, CogSci.

[15]  Michael C. Frank,et al.  Predicting Pragmatic Reasoning in Language Games , 2012, Science.

[16]  D. Barr,et al.  Random effects structure for confirmatory hypothesis testing: Keep it maximal. , 2013, Journal of memory and language.

[17]  Glyn W. Humphreys,et al.  Cascade processes in picture identification , 1988 .

[18]  G W Humphreys,et al.  The Effects of Surface Detail on Object Categorization and Naming , 1989, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[19]  Aykut Erdem,et al.  Visual saliency estimation by nonlinearly integrating features using region covariances. , 2013, Journal of vision.

[20]  David J. Therriault,et al.  The role of color diagnosticity in object recognition and representation , 2009, Cognitive Processing.

[21]  Nick Cercone,et al.  Computational Linguistics , 1986, Communications in Computer and Information Science.

[22]  Robert Dale,et al.  Computational Interpretations of the Gricean Maxims in the Generation of Referring Expressions , 1995, Cogn. Sci..

[23]  T. Pechmann Incremental speech production and referential overspecification , 1989 .

[24]  Emiel Krahmer,et al.  Computational Generation of Referring Expressions: A Survey , 2012, CL.

[25]  Daniel Kersten,et al.  Is Color an Intrinsic Property of Object Representation? , 2003, Perception.

[26]  T. Jaeger,et al.  Categorical Data Analysis: Away from ANOVAs (transformation or not) and towards Logit Mixed Models. , 2008, Journal of memory and language.

[27]  M. Tarr,et al.  Becoming a “Greeble” Expert: Exploring Mechanisms for Face Recognition , 1997, Vision Research.

[28]  M. Elsner,et al.  Where's Wally: the influence of visual salience on referring expression generation , 2013, Front. Psychol..