The belief bias effect is aptly named: a reply to Klauer and Kellen (2011).

In "Assessing the Belief Bias Effect With ROCs: It's a Response Bias Effect," Dube, Rotello, and Heit (2010) examined the form of receiver operating characteristic (ROC) curves for reasoning and the effects of belief bias on measurement indices that differ in whether they imply a curved or linear ROC function. We concluded that the ROC data are in fact curved and that analyses using statistics that assume a linear ROC are likely to produce Type I errors. Importantly, we showed that the interaction between logic and belief that has inspired much of the theoretical work on belief bias is in fact an error stemming from inappropriate reliance on a contrast (hit rate-false alarm rate) that implies linear ROCs. Dube et al. advanced a new model of belief bias, which, in light of their data, is currently the only plausible account of the effect. Klauer and Kellen (2011) disputed these conclusions, largely on the basis of speculation about the data collection method used by Dube et al. to construct the ROCs. New data and model-based analyses are presented that refute the speculations made by Klauer and Kellen. We also show that new modeling results presented by Klauer and Kellen actually support the conclusions advanced by Dube et al. Together, these data show that the methods used by Dube et al. are valid and that the belief bias effect is simply a response bias effect.

[1]  T. Marill Detection theory and psychophysics , 1956 .

[2]  James P. Egan,et al.  Recognition memory and the operating characteristic. , 1958 .

[3]  James P. Egan,et al.  Operating Characteristics Determined by Binary Decisions and by Ratings , 1959 .

[4]  Gordon Z. Greenberg,et al.  Operating characteristics and a priori probability of the signal , 1960 .

[5]  J A SWETS,et al.  Is there a sensory threshold? , 1961, Science.

[6]  J SWETS,et al.  Decision processes in perception. , 1961, Psychological review.

[7]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[8]  John A. Swets,et al.  Factors affecting the slope of empirical ROC curves: Comparison of binary and rating responses , 1967 .

[9]  Richard C. Atkinson,et al.  Signal recognition as influenced by presentation schedules , 1967 .

[10]  C D Creelman,et al.  ROC curves for discrimination of linear extent. , 1968, Journal of experimental psychology.

[11]  David S. Emmerich,et al.  ROCs obtained with two signal intensities presented in random order, and a comparison between yes-no and rating ROCs , 1968 .

[12]  Louis S. Dickstein,et al.  Conversion and possibility in syllogistic reasoning , 1981 .

[13]  P. Pollard,et al.  On the conflict between logic and belief in syllogistic reasoning , 1983, Memory & cognition.

[14]  M. Treisman,et al.  The effect of signal probability on the slope of the receiver operating characteristic given by the rating procedure , 1984 .

[15]  Philip N. Johnson-Laird,et al.  The Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology the Effects of Belief on the Spontaneous Production of Syllogistic Conclusions , 2022 .

[16]  P. Johnson-Laird,et al.  Believability and syllogistic reasoning , 1989, Cognition.

[17]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[18]  Jonathan Evans,et al.  The source of belief bias effects in syllogistic reasoning , 1992, Cognition.

[19]  R. Kinchla Comments on Batchelder and Riefer's multinomial model for source monitoring. , 1994, Psychological review.

[20]  Allen Newell,et al.  Deduction as verbal reasoning. , 1995 .

[21]  David R. Anderson,et al.  Model Selection and Multimodel Inference , 2003 .

[22]  N. Chater,et al.  The Probability Heuristics Model of Syllogistic Reasoning , 1999, Cognitive Psychology.

[23]  J. D. Balakrishnan,et al.  Decision processes in discrimination: fundamental misrepresentations of signal detection theory. , 1999, Journal of experimental psychology. Human perception and performance.

[24]  Jochen Musch,et al.  On belief bias in syllogistic reasoning. , 2000, Psychological review.

[25]  L. Ball,et al.  Working Memory, Metacognitive Uncertainty, and Belief Bias in Syllogistic Reasoning , 2000, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[26]  K C Klauer,et al.  On belief bias in syllogistic reasoning. , 2000, Psychological review.

[27]  Trisha Van Zandt,et al.  Roc curves and confidence judgments in recognition memory , 2000 .

[28]  I. J. Myung,et al.  Toward a method of selecting among computational models of cognition. , 2002, Psychological review.

[29]  Jamie I. D. Campbell,et al.  Syllogistic reasoning time: Disconfirmation disconfirmed , 2003, Psychonomic bulletin & review.

[30]  Neil A. Macmillan,et al.  Detection theory: A user's guide, 2nd ed. , 2005 .

[31]  Shane T. Mueller,et al.  Decision noise: An explanation for observed violations of signal detection theory , 2008, Psychonomic bulletin & review.

[32]  Evan Heit,et al.  Modeling the effects of argument length and validity on inductive and deductive reasoning. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[33]  Colleen M. Parks,et al.  Evidence for a memory threshold in second-choice recognition memory responses , 2009, Proceedings of the National Academy of Sciences.

[34]  D. Parkinson,et al.  Bayesian Methods in Cosmology: Model selection and multi-model inference , 2009 .

[35]  A. Bröder,et al.  Recognition ROCs are curvilinear-or are they? On premature arguments against the two-high-threshold model of recognition. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[36]  Evan Heit,et al.  Relations between inductive reasoning and deductive reasoning. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[37]  E. Heit,et al.  Assessing the belief bias effect with ROCs: it's a response bias effect. , 2010, Psychological review.

[38]  K. C. Klauer,et al.  Assessing the belief bias effect with ROCs: reply to Dube, Rotello, and Heit (2010). , 2011, Psychological review.

[39]  E. Heit,et al.  Predicting Reasoning from Memory , 2022 .