Experience as a Free Parameter in the Cognitive Modeling of Language

To account for natural variability in cognitive processing, it is standard practice to optimize the parameters of a model to account for behavioral data. However, variability reflecting the information to which one has been exposed is usually ignored. Nevertheless, most language theories assign a large role to an individual’s experience with language. We present a new way to fit language-based behavioral data that combines simple learning and processing mechanisms using optimization of language materials. We demonstrate that benchmark fits on multiple linguistic tasks can be achieved using this method and will argue that one must account not only for the internal parameters of a model but also the external experience that people receive when theorizing about human behavior.

[1]  Brendan T. Johns,et al.  The role of semantic diversity in lexical organization. , 2012, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[2]  Marc Brysbaert,et al.  Moving beyond Kučera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English , 2009, Behavior research methods.

[3]  Douglas J. K. Mewhort,et al.  A synchronization account of false recognition , 2012, Cognitive Psychology.

[4]  John R. Anderson,et al.  Reflections of the Environment in Memory Form of the Memory Functions , 2022 .

[5]  Michael N Jones,et al.  Representing word meaning and order information in a composite holographic lexicon. , 2007, Psychological review.

[6]  Cyrus Shaoul,et al.  Exploring lexical co-occurrence space using HiDEx , 2010, Behavior research methods.

[7]  Michael J Cortese,et al.  Predicting semantic priming at the item level , 2008 .

[8]  Magnus Sahlgren,et al.  Encoding Sequential Information in Vector Space Models of Semantics: Comparing Holographic Reduced Representation and Random Permutation , 2010 .

[9]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[10]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[11]  Michael D. Lee,et al.  A Survey of Model Evaluation Approaches With a Tutorial on Hierarchical Bayesian Methods , 2008, Cogn. Sci..

[12]  Michael N. Jones,et al.  The influence of contextual variability on word learning , 2014, CogSci.

[13]  Rebecca Treiman,et al.  The English Lexicon Project , 2007, Behavior research methods.

[14]  Brendan T. Johns,et al.  Effects of word frequency, contextual diversity, and semantic distinctiveness on spoken word recognition. , 2012, The Journal of the Acoustical Society of America.

[15]  Jure Leskovec,et al.  Hidden factors and hidden topics: understanding rating dimensions with review text , 2013, RecSys.

[16]  Morten H. Christiansen,et al.  Language as shaped by the brain. , 2008, The Behavioral and brain sciences.

[17]  Gordon D. A. Brown,et al.  Contextual Diversity, Not Word Frequency, Determines Word-Naming and Lexical Decision Times , 2006, Psychological science.

[18]  W. Kintsch,et al.  High-Dimensional Semantic Space Accounts of Priming. , 2006 .

[19]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .