Communicative Efficiency, Uniform Information Density, and the Rational Speech Act Theory

One major class of approaches to explaining the distribution of linguistic forms is rooted in communicative efficiency. For theories in which an utterance’s communicative efficiency is itself dependent on the distribution of linguistic forms in the language, however, it is less clear how to make distributional predictions that escape circularity. I propose an approach for these cases that involves iterating between speaker and listener in the Rational Speech Act theory. Characteristics of the fixed points of this iterative process constitute the distributional predictions of the theory. Through computer simulation I apply this approach to the well-studied case of predictabilitysensitive optional function word omission for the theory of Uniform Information Density, and show that the approach strongly predicts the empirically observed negative correlation between phrase onset probability and rate of function word use.

[1]  Michael C. Frank,et al.  Predicting Pragmatic Reasoning in Language Games , 2012, Science.

[2]  Michael C. Frank,et al.  Learning and using language via recursive pragmatic reasoning about other agents , 2013, NIPS.

[3]  Alice Turk,et al.  The Smooth Signal Redundancy Hypothesis: A Functional Explanation for Relationships between Redundancy, Prosodic Prominence, and Duration in Spontaneous Speech , 2004, Language and speech.

[4]  Thomas Hofmann,et al.  Speakers optimize information density through syntactic reduction , 2007 .

[5]  W. Labov Principles of Linguistic Change: Cognitive and Cultural Factors , 2010 .

[6]  S. Levinson Presumptive Meanings: The theory of generalized conversational implicature , 2001 .

[7]  Jason M. Brenier,et al.  Predictability Effects on Durations of Content and Function Words in Conversational English , 2009 .

[8]  Keith Johnson,et al.  Why reduce? Phonological neighborhood density and phonetic reduction in spontaneous speech , 2012 .

[9]  Michael C. Frank,et al.  Review Pragmatic Language Interpretation as Probabilistic Inference , 2022 .

[10]  T. Florian Jaeger,et al.  Redundancy and reduction: Speakers manage syntactic information density , 2010, Cognitive Psychology.

[11]  K. Rayner,et al.  Effects of contextual constraint on eye movements in reading: A further examination , 1996, Psychonomic bulletin & review.

[12]  Michael Franke,et al.  UC Merced Proceedings of the Annual Meeting of the Cognitive Science Society , 2013 .

[13]  Richard Futrell,et al.  Large-scale evidence of dependency length minimization in 37 languages , 2015, Proceedings of the National Academy of Sciences.

[14]  Steven T Piantadosi,et al.  Word lengths are optimized for efficient communication , 2011, Proceedings of the National Academy of Sciences.

[15]  R. Levy Expectation-based syntactic comprehension , 2008, Cognition.

[16]  Michael Franke,et al.  Signal to act : game theory in pragmatics , 2009 .

[17]  Roger Levy,et al.  Pragmatic reasoning through semantic inference , 2016, Semantics and Pragmatics.

[18]  Laurence R. Horn A Natural History of Negation , 1989 .

[19]  Eugene Charniak,et al.  Entropy Rate Constancy in Text , 2002, ACL.

[20]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[21]  John A. Hawkins,et al.  A Performance Theory of Order and Constituency , 1995 .

[22]  Morten H. Christiansen,et al.  Language evolution: consensus and controversies , 2003, Trends in Cognitive Sciences.

[23]  Gerhard Jäger,et al.  Game theory in semantics and pragmatics , 2012 .

[24]  Christopher D. Manning,et al.  Probabilistic models of word order and syntactic discontinuity , 2005 .

[25]  George Kingsley Zipf,et al.  Human behavior and the principle of least effort , 1949 .

[26]  Roger Levy,et al.  Resolving Quantity- and Informativeness-Implicature in Indefinite Reference , 2015 .

[27]  John Hale,et al.  A Probabilistic Earley Parser as a Psycholinguistic Model , 2001, NAACL.

[28]  Nathaniel J. Smith,et al.  The effect of word predictability on reading time is logarithmic , 2013, Cognition.

[29]  Noah D. Goodman,et al.  The strategic use of noise in pragmatic reasoning , 2015, CogSci.

[30]  Noam Chomsky,et al.  Language and Mind , 1973 .