A Philosophical and Empirical Analysis of Subjects’ Modes of Inquiry in Wason's 2–4–6 Task

Investigations of hypothesis-testing behaviour typically conclude that subjects’ methods are characterized by “confirmation bias.” However, these studies (a) relied exclusively upon Karl Popper's philosophy of science, (b) only described subjects’ strategies via a falsificationist terminology, and (c) failed to determine subjects’ precise intentions in the task situations. Alternative philosophies of science can be used to describe hitherto ignored aspects of rule discovery in Wason's (1960) 2–4–6 task as well as reinterpret findings from previous research. Using Wason's task, Experiment 1 adopted J. S. Mill's inductive methodology in order to assess better the extent of elimination in experimentation. While it was found that subjects did eliminate a large proportion of their hypotheses rather than merely confirm them, Mill's eliminative methods applied to this task failed to account for the entirety of subjects’ behaviours. Experiment 2 examined subjects’ methods in more depth by asking subjects during the task either to: (1) describe their procedures, (2) select from a list of methodology terms those that best characterized their methods, and (3) state on each learning trial their preferred hypotheses and their subjective assessments that those hypotheses were correct. Although subjects were generally unable to describe their methods of inquiry, they were able to typify them via the methodology terms as if their methods were tacitly held skills. Contrary to presumptions of previous research, analyses indicated that subjects were not testing particular hypotheses on every trial but were often examining possible instances of the rule “at random” or “different from ones examined” to that trial. It is also suggested that subjects’ decisions to announce rules and their thematic lines of inquiry be given further consideration by researchers.

[1]  I. Good A Treatise on Induction and Probability , 1952 .

[2]  Ryan D. Tweney,et al.  Strategies of Rule Discovery in an Inference Task , 1980 .

[3]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[4]  J. Mill A System of Logic , 1843 .

[5]  Clifford R. Mynatt,et al.  Consequences of Confirmation and Disconfirmation in a Simulated Research Environment , 1978 .

[6]  P. C. Wason,et al.  Dual processes in reasoning? , 1975, Cognition.

[7]  G. Maxwell Induction and empiricism: a Bayesian-Frequentist alternative , 1975 .

[8]  W. J. Dixon,et al.  BMDP-79, biomedical computer programs, P-series , 1981 .

[9]  Walter B. Weimer Notes on the methodology of scientific research , 1979 .

[10]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .

[11]  C. Gettys,et al.  Hypothesis plausibility and hypothesis generation , 1979 .

[12]  I. Lakatos Falsification and the Methodology of Scientific Research Programmes , 1976 .

[13]  K. Popper,et al.  The Logic of Scientific Discovery , 1960 .

[14]  Clifford R. Mynatt,et al.  Confirmation Bias in a Simulated Research Environment: An Experimental Study of Scientific Inference , 1977 .

[15]  P. Wason >On the Failure to Eliminate Hypotheses...< – A Second Look , 1968 .

[16]  Mary Hesse Bayesian methods and the initial probabilities of theories , 1975 .

[17]  Eliot R. Smith,et al.  Limits on perception of cognitive processes: A reply to Nisbett and Wilson. , 1978 .

[18]  J. Bruner,et al.  A study of thinking , 1956 .

[19]  E. Heidbreder Reasons used in solving problems. , 1927 .

[20]  T. Broadbent,et al.  Criticism and the Growth of Knowledge , 1972 .

[21]  B. Skyrms Choice and chance : an introduction to inductive logic , 1968 .

[22]  P. Wason On the Failure to Eliminate Hypotheses in a Conceptual Task , 1960 .

[23]  Teddy Seidenfeld,et al.  Induction, Probability, and Confirmation , 1975 .

[24]  J. Platt Strong Inference: Certain systematic methods of scientific thinking may produce much more rapid progress than others. , 1964, Science.

[25]  A. Declet,et al.  [Psychology of communication]. , 1969, Puerto Rico y su enfermera.

[26]  Stephen E. Fienberg,et al.  The analysis of cross-classified categorical data , 1980 .

[27]  M. Snyder,et al.  Testing Hypotheses about Other People , 1981 .

[28]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[29]  S. Amano,et al.  Psychology of Reasoning , 1923 .

[30]  G. Wright The logical problem of induction , 1957 .

[31]  P. Wason Problem solving and reasoning. , 1971, British medical bulletin.

[32]  M. Gorman,et al.  A Comparison of Disconfirmatory, Confirmatory and Control Strategies on Wason's 2–4–6 Task , 1984 .

[33]  N. Wetherick,et al.  Eliminative and Enumerative Behaviour in a Conceptual Task , 1962 .

[34]  William M. Smith,et al.  A Study of Thinking , 1956 .

[35]  I. Lakatos,et al.  Criticism and the Growth of Knowledge: Falsification and the Methodology of Scientific Research Programmes , 1970 .

[36]  P. C. Wason Reply to Wetherick , 1962 .

[37]  N. Wetherick Bruner's Concept of Strategy: An Experiment and a critique. , 1969, The Journal of general psychology.

[38]  W. Salmon The foundations of scientific inference , 1967 .

[39]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[40]  R. Ault,et al.  Reflection-impulsivity and the evaluation process. , 1979, Child development.