Associative Judgment and Vector Space Semantics

I study associative processing in high-level judgment using vector space semantic models. I find that semantic relatedness, as quantified by these models, is able to provide a good measure of the associations involved in judgment, and, in turn, predict responses in a large number of existing and novel judgment tasks. My results shed light on the representations underlying judgment, and highlight the close relationship between these representations and those at play in language and in the assessment of word meaning. In doing so, they show how one of the best-known and most studied theories in decision making research can be formalized to make quantitative a priori predictions, and how this theory can be rigorously tested on a wide range of natural language judgment problems.

[1]  J. Firth Papers in linguistics , 1958 .

[2]  A. Tversky,et al.  On the psychology of prediction , 1973 .

[3]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[4]  A. Tversky Features of Similarity , 1977 .

[5]  Nancy E. Avis,et al.  Base rates can affect individual predictions. , 1980 .

[6]  Zellig S. Harris,et al.  Distributional Structure , 1954 .

[7]  B. Fischhoff,et al.  Diagnosticity and the base-rate effect , 1984, Memory & cognition.

[8]  J. Frank Yates,et al.  Conjunction errors: Evidence for multiple judgment procedures, including "signed summation" , 1986 .

[9]  D. Medin,et al.  Problem structure and the use of base-rate information from experience. , 1988, Journal of experimental psychology. General.

[10]  Eric J. Johnson,et al.  Adaptive Strategy Selection in Decision Making. , 1988 .

[11]  A. Tversky,et al.  Extensional versus intuitive reasoning: the conjunction fallacy in probability judgment , 1983 .

[12]  D. Medin,et al.  Problem structure and the use of base-rate information from experience. , 1988, Journal of experimental psychology. General.

[13]  K. Fiedler The dependence of the conjunction fallacy on subtle linguistic factors , 1988 .

[14]  J. Frank Yates,et al.  Disjunction errors in qualitative likelihood judgment , 1989 .

[15]  H. Simon,et al.  Invariants of human behavior. , 1990, Annual review of psychology.

[16]  John R. Anderson The Adaptive Character of Thought , 1990 .

[17]  Edward E. Smith,et al.  Typicality and reasoning fallacies , 1990, Memory & cognition.

[18]  I. Gavanski,et al.  Representativeness and conjoint probability. , 1991, Journal of personality and social psychology.

[19]  John R. Anderson,et al.  Reflections of the Environment in Memory Form of the Memory Functions , 2022 .

[20]  M. Bar-Hillel,et al.  How alike is it versus how likely is it: A disjunction fallacy in probability judgments. , 1993 .

[21]  I. Erev,et al.  Simultaneous Over- and Underconfidence: The Role of Error in Judgment Processes. , 1994 .

[22]  A. Tversky,et al.  Support theory: A nonextensional representation of subjective probability. , 1994 .

[23]  G. Gigerenzer On Narrow Norms and Vague Heuristics: A Reply to Kahneman and Tversky (1996) , 1996 .

[24]  J. Koehler The base rate fallacy reconsidered: Descriptive, normative, and methodological challenges , 1996, Behavioral and Brain Sciences.

[25]  S. Sloman The empirical case for two systems of reasoning. , 1996 .

[26]  Gerd Gigerenzer,et al.  How do we tell an association from a rule , 1996 .

[27]  Curt Burgess,et al.  Producing high-dimensional semantic spaces from lexical co-occurrence , 1996 .

[28]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[29]  Edmund Fantino,et al.  The conjunction fallacy: A test of averaging hypotheses , 1997 .

[30]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[31]  Gerd Gigerenzer,et al.  Surrogates for Theories , 1998 .

[32]  Gerd Gigerenzer,et al.  The "conjunction fallacy" revisited : How intelligent inferences look like reasoning errors , 1999 .

[33]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[34]  C. Gettys,et al.  MINERVA-DM: A memory processes model for judgments of likelihood. , 1999 .

[35]  Walter Kintsch,et al.  Predication , 2001, Cogn. Sci..

[36]  R. Hastie Problems for judgment and decision making. , 2001, Annual review of psychology.

[37]  T. R. Stewart,et al.  The essential brunswik: Beginnings, explications, applications. , 2001 .

[38]  M. Sacks E-mail notification of your latest issue online! , 2002 .

[39]  Magnus Persson,et al.  PROBabilities from EXemplars (PROBEX): a "lazy" algorithm for probabilistic inference from generic knowledge , 2002, Cogn. Sci..

[40]  John E Fisk,et al.  Judgments under uncertainty: representativeness or potential surprise? , 2002, British journal of psychology.

[41]  D. Kahneman,et al.  Representativeness revisited: Attribute substitution in intuitive judgment. , 2002 .

[42]  D. Kahneman,et al.  Heuristics and Biases: The Psychology of Intuitive Judgment , 2002 .

[43]  Gerd Gigerenzer,et al.  Models of ecological rationality: the recognition heuristic. , 2002, Psychological review.

[44]  D. Kahneman A perspective on judgment and choice: mapping bounded rationality. , 2003, The American psychologist.

[45]  Charles J. Brainerd,et al.  Emerging Perspectives on Judgment and Decision Research: Memory, Development, and Rationality: An Integrative Theory of Judgment and Decision Making , 2003 .

[46]  Diederik Aerts,et al.  LETTER TO THE EDITOR: Quantum aspects of semantic analysis and symbolic artificial intelligence , 2003, quant-ph/0309022.

[47]  P. Kwantes Using context to build semantics , 2005, Psychonomic bulletin & review.

[48]  R. Hertwig,et al.  How forgetting aids heuristic inference. , 2005, Psychological review.

[49]  J. Rieskamp,et al.  SSL: a theory of how people learn to select strategies. , 2006, Journal of experimental psychology. General.

[50]  Thorsten Pachur,et al.  On the psychology of the recognition heuristic: retrieval primacy as a key determinant of its use. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[51]  D. Lagnado,et al.  Insight and strategy in multiple-cue learning. , 2006, Journal of experimental psychology. General.

[52]  Mark Steyvers,et al.  Topics in semantic representation. , 2007, Psychological review.

[53]  Riccardo Franco,et al.  The conjunction fallacy and interference effects , 2007, 0708.3948.

[54]  W. Gaissmaier,et al.  Sequential processing of cues in memory-based multiattribute decisions , 2007, Psychonomic bulletin & review.

[55]  Michael N Jones,et al.  Representing word meaning and order information in a composite holographic lexicon. , 2007, Psychological review.

[56]  S. Sloman,et al.  Base-rate respect: From ecological rationality to dual processes. , 2007, The Behavioral and brain sciences.

[57]  J. Bullinaria,et al.  Extracting semantic representations from word co-occurrence statistics: A computational study , 2007, Behavior research methods.

[58]  Daniel M. Oppenheimer,et al.  Heuristics made easy: an effort-reduction framework. , 2008, Psychological bulletin.

[59]  Stefan M. Herzog,et al.  Fluency heuristic: a model of how the mind exploits a by-product of information retrieval. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[60]  Jonathan Evans Dual-processing accounts of reasoning, judgment, and social cognition. , 2008, Annual review of psychology.

[61]  Ralph Hertwig,et al.  The conjunction fallacy and the many meanings of and , 2008, Cognition.

[62]  Branden Fitelson,et al.  Probability, confirmation, and the conjunction fallacy , 2008 .

[63]  Eric J. Johnson,et al.  Mindful judgment and decision making. , 2009, Annual review of psychology.

[64]  N. Chater,et al.  Précis of Bayesian Rationality: The Probabilistic Approach to Human Reasoning , 2009, Behavioral and Brain Sciences.

[65]  Anders Winman,et al.  Linda is not a bearded lady: configural weighting and adding as the cause of extension errors. , 2009, Journal of experimental psychology. General.

[66]  Fintan Costello,et al.  How probability theory explains the conjunction fallacy , 2009 .

[67]  Patrick Pantel,et al.  From Frequency to Meaning: Vector Space Models of Semantics , 2010, J. Artif. Intell. Res..

[68]  Mirella Lapata,et al.  Composition in Distributional Models of Semantics , 2010, Cogn. Sci..

[69]  Carey K. Morewedge,et al.  Associative processes in intuitive judgment , 2010, Trends in Cognitive Sciences.

[70]  Julian N. Marewski,et al.  Cognitive niches: an ecological model of strategy selection. , 2011, Psychological review.

[71]  Jennifer S Trueblood,et al.  A quantum theoretical explanation for probability judgment errors. , 2011, Psychological review.

[72]  Gerd Gigerenzer,et al.  Heuristic decision making. , 2011, Annual review of psychology.

[73]  Dean P. Foster,et al.  Multi-View Learning of Word Embeddings via CCA , 2011, NIPS.

[74]  Jennifer Trueblood,et al.  A Quantum Probability Account of Order Effects in Inference , 2011, Cogn. Sci..

[75]  M. Hilbert,et al.  Toward a synthesis of cognitive biases: how noisy information processing can bias human decision making. , 2012, Psychological bulletin.

[76]  Vincenzo Crupi,et al.  On the determinants of the conjunction fallacy: probability versus inductive confirmation. , 2013, Journal of experimental psychology. General.

[77]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[78]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[79]  Dean P. Foster,et al.  New Subsampling Algorithms for Fast Least Squares Regression , 2013, NIPS.

[80]  Walter Kintsch Similarity as a function of semantic distance and amount of knowledge. , 2014, Psychological review.

[81]  Fintan Costello,et al.  Surprisingly rational: probability theory plus noise explains biases in judgment. , 2012, Psychological review.

[82]  M. Marelli,et al.  Corpus-based estimates of word association predict biases in judgment of word co-occurrence likelihood , 2014, Cognitive Psychology.

[83]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[84]  Jon A. Willits,et al.  Models of Semantic Memory , 2015 .

[85]  Dean P. Foster,et al.  Eigenwords: spectral word embeddings , 2015, J. Mach. Learn. Res..

[86]  Heuristics can produce surprisingly rational probability estimates: Comment on Costello and Watts (2014). , 2016, Psychological review.

[87]  Vincenzo Crupi,et al.  Noisy probability judgment, the conjunction fallacy, and rationality: Comment on Costello and Watts (2014). , 2016, Psychological review.