An Information-Theoretic Explanation of Adjective Ordering Preferences

Across languages, adjectives are subject to ordering restrictions. Recent research shows that these are predicted by adjective subjectivity, but the question remains open why this is the case. We first conduct a corpus study and not only replicate the subjectivity effect, but also find a previously undocumented effect of mutual information between adjectives and nouns. We then describe a rational model of adjective use in which listeners explicitly reason about judgments made by different speakers, formalizing the notion of subjectivity as agreement between speakers. We show that, once incremental processing is combined with memory limitations, our model predicts effects both of subjectivity and mutual information. We confirm the adequacy of our model by evaluating it on corpus data, finding that it correctly predicts ordering in unseen data with an accuracy of 96.2 %. This suggests that adjective ordering can be explained by general principles of human communication and language processing.

[1]  Daniel Gildea,et al.  Human languages order information efficiently , 2015, ArXiv.

[2]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[3]  Peter Svenonius,et al.  The position of adjectives and other phrasal modifiers in the decomposition of DP , 2008, Adjectives and Adverbs.

[4]  Ting Qian,et al.  Cue Effectiveness in Communicatively Efficient Discourse Production , 2012, Cogn. Sci..

[5]  B McElree,et al.  Working memory and focal attention. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[6]  Terry Regier,et al.  Word Meanings across Languages Support Efficient Communication , 2015 .

[7]  William M. Waite,et al.  Semantic Analysis , 1976, International Conference on Compiler Construction.

[8]  Julie C. Sedivy,et al.  Achieving incremental semantic interpretation through contextual representation , 1999, Cognition.

[9]  Artemis Alexiadou,et al.  The syntax of adjectives , 2014 .

[10]  Richard L. Lewis,et al.  An Activation-Based Model of Sentence Processing as Skilled Memory Retrieval , 2005, Cogn. Sci..

[11]  Gary-John Scott,et al.  Stacked adjectival modification and the structure of the nominal phrases , 2002 .

[12]  Robert Dixon,et al.  Where have all the adjectives gone? and other essays in semantics and syntax , 1982 .

[13]  Noah D. Goodman,et al.  Subjectivity Predicts Adjective Ordering Preferences , 2017, Open Mind.

[14]  R. Sproat,et al.  The Cross-Linguistic Distribution of Adjective Ordering Restrictions , 1991 .

[15]  Michael C. Frank,et al.  Predicting Pragmatic Reasoning in Language Games , 2012, Science.

[16]  Sanja Fidler,et al.  Aligning Books and Movies: Towards Story-Like Visual Explanations by Watching Movies and Reading Books , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[17]  Felix Hill Beauty Before Age? Applying Subjectivity to Automatic English Adjective Ordering , 2012, HLT-NAACL.

[18]  Peter Nathan Lasersohn,et al.  Context Dependence, Disagreement, and Predicates of Personal Taste* , 2005 .

[19]  Roger Levy,et al.  Noisy-context surprisal as a human sentence processing cost model , 2017, EACL.

[20]  Noah D. Goodman,et al.  Knowledge and implicature: Modeling language understanding as social cognition , 2012, CogSci.

[21]  Richard Futrell,et al.  Cute Little Puppies and Nice Cold Beers: An Information Theoretic Analysis of Prenominal Adjectives , 2017, CogSci.

[22]  Michael C. Frank,et al.  Review Pragmatic Language Interpretation as Probabilistic Inference , 2022 .

[23]  E. Gibson Linguistic complexity: locality of syntactic dependencies , 1998, Cognition.