What Are the "True" Statistics of the Environment?

A widespread assumption in the contemporary discussion of probabilistic models of cognition, often attributed to the Bayesian program, is that inference is optimal when the observer's priors match the true priors in the world-the actual "statistics of the environment." But in fact the idea of a "true" prior plays no role in traditional Bayesian philosophy, which regards probability as a quantification of belief, not an objective characteristic of the world. In this paper I discuss the significance of the traditional Bayesian epistemic view of probability and its mismatch with the more objectivist assumptions about probability that are widely held in contemporary cognitive science. I then introduce a novel mathematical framework, the observer lattice, that aims to clarify this issue while avoiding philosophically tendentious assumptions. The mathematical argument shows that even if we assume that "ground truth" probabilities actually do exist, there is no objective way to tell what they are. Different observers, conditioning on different information, will inevitably have different probability estimates, and there is no general procedure to determine which one is right. The argument sheds light on the use of probabilistic models in cognitive science, and in particular on what exactly it means for the mind to be "tuned" to its environment.

[1]  Jerome R Busemeyer,et al.  Can quantum probability provide a new direction for cognitive modeling? , 2013, The Behavioral and brain sciences.

[2]  L. Joseph,et al.  Bayesian Statistics: An Introduction , 1989 .

[3]  J. Feldman Bayesian inference and “truth”: a comment on Hoffman, Singh, and Prakash , 2015, Psychonomic bulletin & review.

[4]  Peter B. M. Vranas,et al.  Gigerenzer's normative critique of Kahneman and Tversky , 2000, Cognition.

[5]  S. S. Wilks,et al.  Probability, statistics and truth , 1939 .

[6]  R. Mausfeld,et al.  Perception and the Physical World: Psychological and Philosophical Issues in Perception , 2002 .

[7]  Jerome R. Busemeyer,et al.  Quantum Models of Cognition and Decision , 2012 .

[8]  Gerd Gigerenzer,et al.  How bad is incoherence , 2016 .

[9]  J. Keynes A Treatise on Probability. , 1923 .

[10]  Donald D. Hoffman,et al.  Objects of consciousness , 2014, Front. Psychol..

[11]  Dhiraj Joshi,et al.  Object Categorization: Computer and Human Vision Perspectives , 2008 .

[12]  Michael C. Frank Running head : RESPONSE TO ENDRESS ( 2013 ) Throwing out the Bayesian baby with the optimal bathwater : Response to Endress , 2013 .

[13]  Michael C. Frank,et al.  Relevant and Robust , 2015, Psychological science.

[14]  G. Gigerenzer Why the distinction between single-event probabilities and frequencies is important for psychology (and vice versa). , 1994 .

[15]  H. Jeffreys A Treatise on Probability , 1922, Nature.

[16]  D. H. Mellor,et al.  Probability: A Philosophical Introduction , 2004 .

[17]  Donald D. Hoffman,et al.  Object Categorization: The Interface Theory of Perception: Natural Selection Drives True Perception to Swift Extinction , 2009 .

[18]  Donald D. Hoffman,et al.  The Interface Theory of Perception , 2015, Psychonomic bulletin & review.

[19]  Stephen M. Stigler,et al.  The History of Statistics: The Measurement of Uncertainty before 1900 , 1986 .

[20]  R. T. Cox The Algebra of Probable Inference , 1962 .

[21]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[22]  B. Love,et al.  The myth of computational level theory and the vacuity of rational analysis , 2011, Behavioral and Brain Sciences.

[23]  A. Tversky,et al.  Evidential impact of base rates , 1981 .

[24]  David C. Knill,et al.  Object classification for human and ideal observers , 1995, Vision Research.

[25]  L. J. Cohen Bayes or Bust? A Critical Examination of Bayesian Confirmation Theory , 1994 .

[26]  E. Davis,et al.  How Robust Are Probabilistic Models of Higher-Level Cognition? , 2013, Psychological science.

[27]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[28]  David Lindley,et al.  Bayesian Statistics, a Review , 1987 .

[29]  Gerd Gigerenzer,et al.  Homo Heuristicus: Why Biased Minds Make Better Inferences , 2009, Top. Cogn. Sci..

[30]  Gerd Gigerenzer,et al.  “A 30% Chance of Rain Tomorrow”: How Does the Public Understand Probabilistic Weather Forecasts? , 2005, Risk analysis : an official publication of the Society for Risk Analysis.

[31]  Jan von Plato Creating Modern Probability by Jan von Plato , 1994 .

[32]  E. Jaynes On the rationale of maximum-entropy methods , 1982, Proceedings of the IEEE.

[33]  Ute Beyer,et al.  Creating Modern Probability Its Mathematics Physics And Philosophy In Historical Perspective , 2016 .

[34]  W. Richards,et al.  The probability of collective choice with shared knowledge structures , 2002 .

[35]  B. D. Finetti,et al.  Foresight: Its Logical Laws, Its Subjective Sources , 1992 .

[36]  Manish Singh,et al.  Natural Selection and Shape Perception , 2013, Shape Perception in Human and Computer Vision.

[37]  Dale Purves Brains: How They Seem to Work , 2010 .

[38]  Francisco J. Samaniego,et al.  A Comparison of the Bayesian and Frequentist Approaches to Estimation , 2010 .

[39]  G. C. Tiao,et al.  Bayesian inference in statistical analysis , 1973 .

[40]  A. A. Probability, Statistics and Truth , 1940, Nature.

[41]  G. Grätzer,et al.  Lattice Theory: First Concepts and Distributive Lattices , 1971 .

[42]  Charless C. Fowlkes,et al.  Natural-Scene Statistics Predict How the Figure–Ground Cue of Convexity Affects Human Depth Perception , 2010, The Journal of Neuroscience.

[43]  M. Tribus,et al.  Probability theory: the logic of science , 2003 .

[44]  Jan von Plato Creating Modern Probability: Index of Subjects , 1994 .

[45]  Marina Daecher,et al.  Subjective Probability The Real Thing , 2016 .

[46]  Donald D Hoffman,et al.  Natural selection and veridical perceptions. , 2010, Journal of theoretical biology.

[47]  M. Lee,et al.  Quantum models of cognition as Orwellian newspeak. , 2013, The Behavioral and brain sciences.

[48]  B. Greene The Hidden Reality: Parallel Universes and the Deep Laws of the Cosmos , 2011 .

[49]  Michael I. Jordan Bayesian Nonparametric Learning : Expressive Priors for Intelligent Systems , 2010 .

[50]  L. M. M.-T. Theory of Probability , 1929, Nature.

[51]  M. Lee How cognitive modeling can benefit from hierarchical Bayesian models. , 2011 .

[52]  B. Newell Judgment Under Uncertainty , 2013 .

[53]  Donald D. Hoffman,et al.  Lebesgue logic for probabilistic reasoning and some applications to perception , 1993 .

[54]  J. Tenenbaum,et al.  Probabilistic models of cognition: exploring representations and inductive biases , 2010, Trends in Cognitive Sciences.

[55]  James M. Joyce Interpreting Probability: Controversies and Developments in the Early Twentieth Century , 2004 .

[56]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[57]  Donald D Hoffman,et al.  Computational Evolutionary Perception , 2012, Perception.

[58]  W. Geisler,et al.  Bayesian natural selection and the evolution of perceptual systems. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[59]  Nienke Meulman,et al.  An ERP study on L2 syntax processing: When do learners fail? , 2014, Front. Psychol..

[60]  Jan J. Koenderink,et al.  Vision as a user interface , 2011, Electronic Imaging.

[61]  S. Zabell Symmetry and its discontents : essays on the history of inductive probability , 2005 .

[62]  Jacob Feldman,et al.  Tuning Your Priors to the World , 2013, Top. Cogn. Sci..

[63]  N. Chater,et al.  Précis of Bayesian Rationality: The Probabilistic Approach to Human Reasoning , 2009, Behavioral and Brain Sciences.

[64]  Brian A. Davey,et al.  An Introduction to Lattices and Order , 1989 .

[65]  Gerd Gigerenzer,et al.  How do we tell an association from a rule , 1996 .

[66]  R. T. Cox,et al.  The Algebra of Probable Inference , 1962 .

[67]  Christian P. Robert,et al.  The Bayesian choice , 1994 .

[68]  Christian P. Robert,et al.  Large-scale inference , 2010 .

[69]  G. Gigerenzer How to Make Cognitive Illusions Disappear: Beyond “Heuristics and Biases” , 1991 .

[70]  J. Koenderink Gestalts as ecological templates , 2015 .

[71]  Michael C. Frank Throwing out the Bayesian baby with the optimal bathwater: Response to Endress (2013) , 2013, Cognition.

[72]  M. Kendall Statistical Methods for Research Workers , 1937, Nature.

[73]  Matteo Colombo,et al.  Bayes in the Brain—On Bayesian Modelling in Neuroscience , 2012, The British Journal for the Philosophy of Science.

[74]  D. Lindley,et al.  Inference for a Bernoulli Process (a Bayesian View) , 1976 .

[75]  S. Stigler,et al.  The History of Statistics: The Measurement of Uncertainty before 1900 by Stephen M. Stigler (review) , 1986, Technology and Culture.

[76]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[77]  J. Schreiber Foundations Of Statistics , 2016 .

[78]  D. Rubin Should observational studies be designed to allow lack of balance in covariate distributions across treatment groups? , 2009 .

[79]  Franziska Hoffmann,et al.  Fact Fiction And Forecast , 2016 .

[80]  John Venn,et al.  The logic of chance : an essay on the foundations and province of the theory of probability, with especial reference to its logical bearings and its application to moral and social science, and to statistics , 1888 .

[81]  P. Guttorp,et al.  The Taming of Chance. , 1992 .

[82]  Leland Gerson Neuberg,et al.  Bayes or Bust?-A Critical Examination of Bayesian Confirmation Theory. , 1994 .

[83]  J. Feldman Symbolic representation of probabilistic worlds , 2012, Cognition.

[84]  John Venn,et al.  The Logic of Chance: An Essay on the Foundations and Province of the Theory of Probability, with Especial Reference to Its Logical Bearings and Its Application to Moral and Social Science , 1876 .

[85]  L. Cosmides,et al.  Are humans good intuitive statisticians after all? Rethinking some conclusions from the literature on judgment under uncertainty , 1996, Cognition.

[86]  Laurence T. Maloney,et al.  Statistical Decision Theory and Biological Vision , 2005 .

[87]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[88]  Wilson S. Geisler,et al.  A Bayesian approach to the evolution of perceptual and cognitive systems , 2003, Cogn. Sci..

[89]  Zygmunt Pizlo,et al.  Shape Perception in Human and Computer Vision: An Interdisciplinary Perspective , 2013 .

[90]  J. Pearl Myth, Confusion, and Science in Causal Analysis , 2009 .

[91]  K. Popper The Propensity Interpretation of Probability , 1959 .

[92]  Edmund Taylor Whittaker The Nature of the Physical World , 1929, Nature.

[93]  Zenon W. Pylyshyn,et al.  Computational processes in human vision : an interdisciplinary perspective , 1988 .