Data selection and natural sampling: Probabilities do matter

Probabilistic accounts of Wason’s selection task (Oaksford & Chater, 1994, 1996) are controversial, with some researchers failing to replicate the predicted effects of probability manipulations. This paper reports a single experiment in which participants sampled the data naturally—that is, sequentially. The proportions of possible data types (i.e., cards in the selection task) also reflected the probability manipulation. Other than this procedural difference, the materials were the same as those in Oberauer, Wilhelm, and Rosas-Diaz’s (1999) Experiment 3, which failed to show probabilistic effects. Significant probabilistic effects were observed. Moreover, in a comparative model-fitting exercise, a revised version of the information gain model (Hattori, 1999, 2002; Oaksford & Chater, in press-b) was shown to provide better fits to these data than did competing explanations.

[1]  D. Laming.  On the analysis of irrational data selection: A critique of Oaksford and Chater (1994). , 1996 .

[2]  P C Wason,et al.  Reasoning about a Rule , 1968, The Quarterly journal of experimental psychology.

[3]  Robert B. Ash,et al.  Information Theory , 2020, The SAGE International Encyclopedia of Mass Media and Society.

[4]  N. Chater,et al.  Computational levels and conditional inference: Reply to Schroyens and Schaeken (2003) , 2003 .

[5]  Nick Chater,et al.  A rational analysis of the selection task as optimal data selection. , 1994 .

[6]  David Moshman Molly Geil,et al.  Collaborative Reasoning: Evidence for Collective Rationality , 1998 .

[7]  Masasi Hattori,et al.  A quantitative model of optimal data selection in Wason's selection task , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[8]  C. Mckenzie,et al.  The psychological side of Hempel’s paradox of confirmation , 2000, Psychonomic bulletin & review.

[9]  N. Chater,et al.  Optimal data selection: Revision, review, and reevaluation , 2003, Psychonomic bulletin & review.

[10]  Nick Chater,et al.  A revised rational analysis of the selection task: Exceptions and sequential sampling , 1998 .

[11]  N. Chater,et al.  Optimal data selection in the reduced array selection task (RAST) , 1997 .

[12]  Philip N. Johnson-Laird,et al.  Quarterly Journal of Experimental Psychology Insight into a Logical Relation Insight into a Logical Relation , 2022 .

[13]  Karl Christoph Klauer,et al.  On the Normative Justification for Information Gain in Wason's Selection Task. , 1999 .

[14]  D. E. Over,et al.  Causal inference, contingency tables and the selection task , 1997 .

[15]  K. Kirby,et al.  Probabilities and utilities of fictional outcomes in Wason's four-card selection task , 1994, Cognition.

[16]  D. Over,et al.  Reaching a decision: A reply to Oaksford , 1998 .

[17]  N. Chater,et al.  Probabilistic effects in data selection , 1999 .

[18]  Klaus Oberauer,et al.  Bayesian rationality for the Wason selection task? A test of optimal data selection theory , 1999 .

[19]  David M. Riefer,et al.  Theoretical and empirical review of multinomial process tree modeling , 1999, Psychonomic bulletin & review.

[20]  John R. Anderson,et al.  Causal inferences as perceptual judgments , 1995, Memory & cognition.

[21]  W. Schroyens,et al.  A critique of Oaksford, Chater, and Larkin's (2000) conditional probability model of conditional reasoning. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[22]  Nick Chater,et al.  Conditional Probability and the Cognitive Science of Conditional Reasoning , 2003 .

[23]  Gerd Gigerenzer,et al.  How to Improve Bayesian Reasoning without Instruction , 2002 .

[24]  N. Chater,et al.  The probabilistic approach to human reasoning , 2001, Trends in Cognitive Sciences.

[25]  Ken Manktelow,et al.  Reasoning and Thinking , 1999 .

[26]  B. J. Winer.  Statistical Principles in Experimental Design , 1992 .

[27]  N. Chater,et al.  RATIONAL EXPLANATION OF THE SELECTION TASK , 1996 .

[28]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[29]  Matthew Flatt,et al.  PsyScope: An interactive graphic system for designing and controlling experiments in the psychology laboratory using Macintosh computers , 1993 .

[30]  Nick Chater,et al.  Rationality In An Uncertain World: Essays In The Cognitive Science Of Human Understanding , 1998 .

[31]  Victor S. Ferreira,et al.  Do Conditional Hypotheses Target Rare Events? , 2001, Organizational behavior and human decision processes.

[32]  David E. Over,et al.  Probability and choice in the selection task. , 1997 .

[33]  John R. Anderson.  Cognitive Psychology and Its Implications , 1980 .

[34]  Gerd Gigerenzer,et al.  How to Improve Bayesian Reasoning Without Instruction: Frequency Formats , 1995 .