CBMM Memo No . 056 October 24 , 2016 Where do hypotheses come from ?

Why are human inferences sometimes remarkably close to the Bayesian ideal and other times systematically biased? One notable instance of this discrepancy is that tasks where the candidate hypotheses are explicitly available result in close to rational inference over the hypothesis space, whereas tasks requiring the self-generation of hypotheses produce systematic deviations from rational inference. We propose that these deviations arise from algorithmic processes approximating Bayes' rule. Specifically in our account, hypotheses are generated stochastically from a sampling process, such that the sampled hypotheses form a Monte Carlo approximation of the posterior. While this approximation will converge to the true posterior in the limit of infinite samples, we take a small number of samples as we expect that the number of samples humans take is limited by time pressure and cognitive resource constraints. We show that this model recreates several well-documented experimental findings such as anchoring and adjustment, subadditivity, superadditivity, the crowd within as well as the self-generation effect, the weak evidence, and the dud alternative effects. Additionally, we confirm the model's prediction that superadditivity and subadditivity can be induced within the same paradigm by manipulating the unpacking and typicality of hypotheses, in 2 experiments. This work was supported by the Center for Brains, Minds and Machines (CBMM), funded by NSF STC award CCF-1231216. Where do hypotheses come from? Ishita Dasgupta Department of Physics and Center for Brain Science Harvard University Eric Schulz Department of Experimental Psychology University College London Samuel J. Gershman Department of Psychology and Center for Brain Science Harvard University

[1]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[2]  Tomaso Poggio,et al.  From Understanding Computation to Understanding Neural Circuitry , 1976 .

[3]  L. Shulman,et al.  Medical Problem Solving: An Analysis of Clinical Reasoning , 1978 .

[4]  C. Gettys,et al.  Hypothesis plausibility and hypothesis generation , 1979 .

[5]  B. Fischhoff,et al.  Reasons for confidence. , 1980 .

[6]  David Heckerman,et al.  A Tractable Inference Algorithm for Diagnosing Multiple Diseases , 2013, UAI.

[7]  Gregory F. Cooper,et al.  The Computational Complexity of Probabilistic Inference Using Bayesian Belief Networks , 1990, Artif. Intell..

[8]  Gregory F. Cooper,et al.  An Empirical Analysis of Likelihood-Weighting Simulation on a Large, Multiply-Connected Belief Network , 1991, Computers and biomedical research, an international journal.

[9]  E. Weber,et al.  Determinants of diagnostic hypothesis generation: effects of information, base rates, and experience. , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[10]  A. Tversky,et al.  Support theory: A nonextensional representation of subjective probability. , 1994 .

[11]  Derek J. Koehler,et al.  Hypothesis generation and confidence in judgment , 1994 .

[12]  D A Redelmeier,et al.  Probability judgement in medicine: discounting unspecified possibilities. , 1995, Medical decision making : an international journal of the Society for Medical Decision Making.

[13]  B. Ross,et al.  Category-based predictions: influence of uncertainty and feature associations. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[14]  Rick P. Thomas,et al.  Organizational Behavior and Human Decision Processes the Role of Mental Simulation in Judgments of Likelihood One Aspect of Simulation That Has Received Relatively , 2022 .

[15]  A. Tversky,et al.  A Belief-Based Account of Decision Under Uncertainty , 1998 .

[16]  Michael I. Jordan,et al.  Variational Probabilistic Inference and the QMR-DT Network , 2011, J. Artif. Intell. Res..

[17]  D. Hantula Sources of Power: How People Make Decisions , 2001 .

[18]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[19]  M. Dougherty,et al.  Probability judgment and subadditivity: The role of working memory capacity and constraining retrieval , 2003, Memory & cognition.

[20]  John R. Chambers,et al.  The dud-alternative effect in likelihood judgment. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[21]  Yuval Rottenstreich,et al.  Typical versus atypical unpacking and superadditive probability judgment. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[22]  Thomas S. Wallsten,et al.  MINERVA‐DM and subadditive frequency judgments , 2004 .

[23]  J. Tenenbaum,et al.  Optimal Predictions in Everyday Cognition , 2006, Psychological science.

[24]  J. Tenenbaum,et al.  Special issue on “Probabilistic models of cognition , 2022 .

[25]  P. Stanford Exceeding Our Grasp: Science, History, and the Problem of Unconceived Alternatives , 2006 .

[26]  Gordon D. A. Brown,et al.  Decision by sampling , 2006, Cognitive Psychology.

[27]  Thomas L. Griffiths,et al.  A Rational Analysis of Rule-Based Concept Learning , 2008, Cogn. Sci..

[28]  H. Pashler,et al.  Measuring the Crowd Within , 2008, Psychological science.

[29]  Rick P. Thomas,et al.  Diagnostic hypothesis generation and human judgment. , 2008, Psychological review.

[30]  N. Chater,et al.  Précis of Bayesian Rationality: The Probabilistic Approach to Human Reasoning , 2009, Behavioral and Brain Sciences.

[31]  George A. Alvarez,et al.  Explaining human multiple object tracking as resource-constrained approximate inference in a dynamic probabilistic model , 2009, NIPS.

[32]  Thomas L. Griffiths,et al.  Neural Implementation of Hierarchical Bayesian Inference by Importance Sampling , 2009, NIPS.

[33]  Scott D. Brown,et al.  Detecting and predicting changes , 2009, Cognitive Psychology.

[34]  Vikash K. Mansinghka,et al.  A Bayesian framework for modeling intuitive dynamics , 2009 .

[35]  Adam N Sanborn,et al.  Exemplar models as a mechanism for performing Bayesian inference , 2010, Psychonomic bulletin & review.

[36]  Ulrik R. Beierholm,et al.  Probability Matching as a Computational Strategy Used in Perception , 2010, PLoS Comput. Biol..

[37]  Jessica B. Hamrick Internal physics models guide probabilistic judgments about object dynamics , 2011 .

[38]  J. Tenenbaum,et al.  Predicting the future as Bayesian inference: people combine prior knowledge with observations when estimating duration and extent. , 2011, Journal of experimental psychology. General.

[39]  Wolfgang Maass,et al.  Probabilistic Inference in General Graphical Models through Sampling in Stochastic Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[40]  Steven A. Sloman,et al.  When good evidence goes bad: The weak evidence effect in judgment and decision-making , 2011, Cognition.

[41]  Rick P. Thomas,et al.  Implications of Cognitive Load for Hypothesis Generation and Probability Judgment , 2011, Front. Psychology.

[42]  D. Knill,et al.  Bayesian sampling in visual perception , 2011, Proceedings of the National Academy of Sciences.

[43]  Wolfgang Maass,et al.  Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[44]  Michael C. Frank,et al.  Predicting Pragmatic Reasoning in Language Games , 2012, Science.

[45]  Kevin A. Smith,et al.  Sources of uncertainty in intuitive physics , 2012, CogSci.

[46]  Adam N. Sanborn,et al.  Bridging Levels of Analysis for Probabilistic Models of Cognition , 2012 .

[47]  Thomas L. Griffiths,et al.  "Burn-in, bias, and the rationality of anchoring" , 2012, NIPS.

[48]  Thomas T. Hills,et al.  Optimal foraging in semantic memory. , 2012, Psychological review.

[49]  Joshua B. Tenenbaum,et al.  Multistability and Perceptual Inference , 2012, Neural Computation.

[50]  S. Denison,et al.  Rational variability in children’s causal inferences: The Sampling Hypothesis , 2013, Cognition.

[51]  Michelle R. Greene Statistics of high-level scene context , 2013, Front. Psychol..

[52]  Kevin A. Smith,et al.  Multiply-constrained semantic search in the Remote Associates Test , 2013, Cognition.

[53]  J. Stockman Pure Reasoning in 12-Month-Old Infants as Probabilistic Inference , 2013 .

[54]  Thomas L. Griffiths,et al.  One and Done? Optimal Decisions From Very Few Samples , 2014, Cogn. Sci..

[55]  Noah D. Goodman,et al.  Amortized Inference in Probabilistic Reasoning , 2014, CogSci.

[56]  Thomas L. Griffiths,et al.  Think again? The amount of mental simulation tracks uncertainty in the outcome , 2015, CogSci.

[57]  Thomas L. Griffiths,et al.  Rational Use of Cognitive Resources: Levels of Analysis Between the Computational and the Algorithmic , 2015, Top. Cogn. Sci..

[58]  F. Petzschner,et al.  A Bayesian perspective on magnitude estimation , 2015, Trends in Cognitive Sciences.

[59]  Charles Kemp,et al.  Evaluating the inverse reasoning account of object discovery , 2015, Cognition.

[60]  Samuel J. Gershman,et al.  Computational rationality: A converging paradigm for intelligence in brains, minds, and machines , 2015, Science.

[61]  Michael Vitale,et al.  The Wisdom of Crowds , 2015, Cell.

[62]  Maarten Speekenbrink,et al.  Simple trees in complex forests: Growing Take The Best by Approximate Bayesian Computation , 2016, CogSci.