Effects of Temporal and Causal Schemas on Probability Problem Solving

Effects of Temporal and Causal Schemas on Probability Problem Solving S. Sonia Gugga (ssg34@columbia.edu) Columbia University New York, NY 10027 James E. Corter (jec34@columbia.edu) Teachers College, Columbia University New York, NY 10027 Abstract Causal beliefs have been shown to affect performance in a wide variety of reasoning and problem solving. One type of judgment bias that can result from implicit causal models is causal asymmetry -- the tendency to judge predictive inferences as more plausible than comparable diagnostic inferences. In the present study we investigate if the directionality of implicit causal models can also affect application of formal methods, specifically the solution of conditional probability word problems. The study examined temporal and causal schemas, in which the convention is that events are considered in forward direction. Pairs of conditional probability (CP) problems were written depicting events E1 and E2, such that E1 either occurs before E2 or causes E2. Problems were defined with respect to the order of events expressed in CPs, so that P(E2|E1) represents the CP in schema-consistent, intact order by considering the occurrence of E1 before E2; while P(E1|E2) represents CP in schema- inconsistent, inverted order. Participants had greater difficulty encoding CP for events in schema-inconsistent order than CP of events in the conventional deterministic order. Keywords: Conditional probability; social schemata; causal schemata. Introduction Previous research on statistical reasoning has illustrated that individuals often disregard statistically prescribed processes, employing heuristics and biases which may produce invalid inferences (see Barbey & Sloman, 2007; Cohen, 1981; Gigerenzer & Hoffrage, 2007; Kahneman & Tversky, 1979; Krynski & Tenenbaum, 2007; Nisbett, Krantz, Jepson, & Kunda, 1983; Stanovich, Toplak, & West, 2008; and Tversky & Kahneman, 1974, 1980 for extensive treatments of the debate). Improvement in inferential accuracy has been affected by training, expression of likelihood in frequency formats, partitive formulation of the information space, or by expressing real-world application to contexts in which individuals are more likely to reason probabilistically with respect to causal or social schemas (Fox & Levav, 2004; Gigerenzer & Hoffrage, 1995, 2007; Girotto & Gonzalez, 2007; Krynski & Tenenbaum, 2007; Macchi, 2000). A mathematical word problem's cover story provides real- world context and semantic content, sometimes considered “surface features”, because they are usually assumed not to directly affect a problem's technical difficulty or formal solution processes. When a cover story relates to social interactions, however, pragmatic reasoning schemas formed in response to real-world experiences may be invoked in the mind of the problem solver (e.g., Cheng & Holyoak, 1985; Fong, Krantz, & Nisbett, 1986; Bassok, Chase, & Martin, 1998). The claim made here is that problem solving in probability is particularly affected by domain-specific knowledge in probabilistic reasoning. Previous research has found discrepancies between formal quantitative probabilistic assessments (“System 2” processing) and on-the-fly, qualitative probabilistic judgments (tapping “System 1”). This prior research has led to a theory of dual-systems representations for probability judgments (Evans & Frankish, 2008; Fox & Levav, 2004; Sloman, 1996; Sloman & Rips, 1998; Smith & Collins, 2009; Stanovich, Toplak, & West, 2008; Tversky & Kahneman, 1983; Windschitl & Wells, 1998). While the two processes have been well-differentiated, it remains to be determined how they may interact in formal problem solving contexts. Individuals have been shown to have a strong bias toward System 1 processes for evaluating social behavior or characteristics qualitatively, while System 2 processes are engaged in symbolic contexts. It may be that the specific interaction of the two processes depends on how problem elements are represented in the mind of the problem solver. The study reported below examines reasoning effects stemming from the direction of temporality and causation of events in an applied problem’s content, examining whether inverting the temporal direction of a schema affects the difficulty of a conditional probability problem. It was hypothesized that it would be easier for individuals to reason forwards regarding temporal or causal events given the deterministic nature of causal and, by extension, temporal schemas (Cheng & Nisbett, 1993; Tversky & Kahneman, 1980). In other words, it should be easier for subjects to calculate the conditional probability of an event given the probability of events preceding it versus calculating the probability of an event given the probability of events occurring later. Similarly, it was expected that problems asking for the conditional probability of an effect given the probability of its cause(s) would be easier than problems asking for the probability of a cause given the probability of its effect(s). It was supposed that inverting the direction of determination should introduce an additional level of difficulty to the problem. It was also expected that the perceived causal strength between events would mediate the effect. The results, described below, yield insights into how probability problems are categorized and solved, what effects

[1]  Mark Snyder,et al.  Confidence in the prediction and postdiction of an uncertain outcome. , 1970 .

[2]  Miriam Bassok,et al.  Adding Apples and Oranges: Alignment of Semantic and Formal Knowledge , 1998, Cognitive Psychology.

[3]  B. Fischhoff,et al.  Hindsight is not equal to foresight: The effect of outcome knowledge on judgment under uncertainty. , 1975 .

[4]  A. Tversky,et al.  On the interpretation of intuitive probability: A reply to Jonathan Cohen , 1979, Cognition.

[5]  L. Cohen Can human irrationality be experimentally demonstrated? , 1981, Behavioral and Brain Sciences.

[6]  Ian Hacking,et al.  The Emergence of Probability. A Philosophical Study of Early Ideas about Probability, Induction and Statistical Inference , 1979 .

[7]  GUlden Ulkiimen,et al.  DISTINGUISHING TWO DIMENSIONS OF UNCERTAINTY , 2011 .

[8]  K. Jellinger,et al.  In two minds: Dual processes and beyond. , 2009 .

[9]  A. Tversky,et al.  Causal Schemata in Judgments under Uncertainty , 1982 .

[10]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[11]  Eliot R. Smith,et al.  Dual-process models: A social psychological perspective , 2009 .

[12]  R. Falk Of Probabilistic Knights and Knaves , 1986 .

[13]  Philip M. Fernbach,et al.  Asymmetries in predictive and diagnostic reasoning. , 2011, Journal of experimental psychology. General.

[14]  Keith J Holyoak,et al.  Pragmatic reasoning schemas , 1985, Cognitive Psychology.

[15]  Tevye R. Krynski,et al.  The role of causality in judgment under uncertainty. , 2007, Journal of experimental psychology. General.

[16]  Wibecke Brun,et al.  Prediction and postdiction preferences in guessing , 1990 .

[17]  S. Sloman The empirical case for two systems of reasoning. , 1996 .

[18]  G. Wells,et al.  The Alternative-Outcomes Effect , 1998 .

[19]  S. Sloman,et al.  Similarity and symbols in human thinking , 1998 .

[20]  Jonathan Levav,et al.  Partition-edit-count: naive extensional reasoning in judgment of conditional probability. , 2004, Journal of experimental psychology. General.

[21]  Baruch Fischhoff,et al.  The effect of temporal setting on likelihood estimates , 1976 .

[22]  D. Krantz,et al.  The effects of statistical training on thinking about everyday problems , 1986, Cognitive Psychology.

[23]  Keith E Stanovich,et al.  The development of rational thought: a taxonomy of heuristics and biases. , 2008, Advances in child development and behavior.

[24]  J. Mackie Propensity, evidence, and diagnosis , 1981, Behavioral and Brain Sciences.

[25]  Macchi Partitive Formulation of Information in Probabilistic Problems: Beyond Heuristics and Frequency Format Explanations. , 2000, Organizational behavior and human decision processes.

[26]  Carmen Díaz,et al.  Assessing Students’ Difficulties with Conditional Probability and Bayesian Reasoning , 2007, International Electronic Journal of Mathematics Education.

[27]  Gerd Gigerenzer,et al.  How to Improve Bayesian Reasoning Without Instruction: Frequency Formats , 1995 .

[28]  Andrew A. Neath Statistical Inference , Statistics Education , and the Fallacy of the Transposed Conditional , 2010 .

[29]  Gerd Gigerenzer,et al.  The role of representation in Bayesian reasoning: Correcting common misconceptions , 2007 .

[30]  Patricia W. Cheng,et al.  Pragmatic constraints on causal deduction , 1993 .

[31]  M. Bar-Hillel,et al.  Some teasers concerning conditional probabilities , 1982, Cognition.

[32]  George Wright,et al.  Changes in the realism and distribution of probability assessments as a function of question type , 1982 .

[33]  D. Krantz,et al.  The use of statistical heuristics in everyday inductive reasoning , 1983 .

[34]  A. Tversky,et al.  Extensional versus intuitive reasoning: the conjunction fallacy in probability judgment , 1983 .

[35]  Vittorio Girotto,et al.  How to elicit sound probabilistic reasoning: Beyond word problems , 2007 .

[36]  D. Mandel,et al.  The inverse fallacy: An account of deviations from Bayes’s theorem and the additivity principle , 2002, Memory & cognition.

[37]  S. Sloman,et al.  Base-rate respect: From ecological rationality to dual processes. , 2007, The Behavioral and brain sciences.