Why are people bad at detecting randomness? A statistical argument.

Errors in detecting randomness are often explained in terms of biases and misconceptions. We propose and provide evidence for an account that characterizes the contribution of the inherent statistical difficulty of the task. Our account is based on a Bayesian statistical analysis, focusing on the fact that a random process is a special case of systematic processes, meaning that the hypothesis of randomness is nested within the hypothesis of systematicity. This analysis shows that randomly generated outcomes are still reasonably likely to have come from a systematic process and are thus only weakly diagnostic of a random process. We tested this account through 3 experiments. Experiments 1 and 2 showed that the low accuracy in judging whether a sequence of coin flips is random (or biased toward heads or tails) is due to the weak evidence provided by random sequences. While randomness judgments were less accurate than judgments involving non-nested hypotheses in the same task domain, this difference disappeared once the strength of the available evidence was equated. Experiment 3 extended this finding to assessing whether a sequence was random or exhibited sequential dependence, showing that the distribution of statistical evidence has an effect that complements known misconceptions.

[1]  G. S. Tune A Brief Survey of Variables That Influence Random-Generation , 1964, Perceptual and motor skills.

[2]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[3]  A. Tversky,et al.  Subjective Probability: A Judgment of Representativeness , 1972 .

[4]  W. A. Wagenaar Generation of random sequences by human subjects: A critical survey of literature. , 1972 .

[5]  K. F. Riley,et al.  Mathematical methods for the physical sciences , 1975 .

[6]  Teresa M. Amabile,et al.  Judgment under uncertainty: Informal covariation assessment: Data-based versus theory-based judgments , 1982 .

[7]  Lola L. Lopes Doing the impossible: A note on induction and the experience of randomness. , 1982 .

[8]  Mary L. Boas Mathematical Methods in the Physical Sciences: 2nd Ed , 1983 .

[9]  A. Tversky,et al.  The hot hand in basketball: On the misperception of random sequences , 1985, Cognitive Psychology.

[10]  Lola L. Lopes,et al.  Distinguishing between random and nonrandom events. , 1987 .

[11]  W. Wagenaar,et al.  The perception of randomness , 1991 .

[12]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 1997, Texts in Computer Science.

[13]  A. Rapoport,et al.  Generation of random series in two-person strictly competitive games , 1992 .

[14]  Yaakov Kareev,et al.  Not that bad after all : generation of random sequences , 1992 .

[15]  John R. Anderson,et al.  The Adaptive Character of Thought , 1990 .

[16]  Y. Kareev Through a narrow window: working memory capacity and the detection of covariation , 1995, Cognition.

[17]  A. Tversky,et al.  On the belief that arthritis pain is related to the weather. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Clifford Konold,et al.  Making Sense of Randomness " Implicit Encoding as a Basis for Judgment , 1997 .

[19]  Nir Vulkan An Economist's Perspective on Probability Matching , 2000 .

[20]  J. Tenenbaum,et al.  Proceedings of the Annual Meeting of the Cognitive Science Society , 2015 .

[21]  The Rational Basis of Representatives - eScholarship , 2001 .

[22]  R. Nickerson,et al.  The production and perception of randomness. , 2002, Psychological review.

[23]  D. Shanks,et al.  A Re-examination of Probability Matching and Rational Choice , 2002 .

[24]  L. Schulz,et al.  God does not play dice: causal determinism and preschoolers' causal inferences. , 2006, Child development.

[25]  Daniel M. Oppenheimer,et al.  From a fixation on sports to an exploration of mechanism: The past, present, and future of hot hand research , 2006 .

[26]  Daniel M. Oppenheimer,et al.  Randomness in retrospect: Exploring the interactions between memory and randomness cognition , 2008, Psychonomic bulletin & review.

[27]  A. Yuille,et al.  Bayesian generic priors for causal learning. , 2008, Psychological review.