Basic understanding of posterior probability

Consider the following task[TaskA]A prenatal test determines whether an unborn child has a chromosomal anomaly. A priori,namely, before undergoing the test, a pregnant woman has a 4% chance of having a child withtheanomaly.Ifawomanhasachildwiththeanomaly,thereisa75%chancethatshehasapositivetest result. If she does not have a child with the anomaly, there is still a 12.5% chance that she hasa positive test result. Emma, a pregnant woman, undergoes a prenatal test. The result is positive.What is the probability that she has a child with the anomaly?Toanswercorrectly,onehastointegratethepriorprobabilitythatawomanhasachildwiththeanomaly (i.e., the prevalence rate: 4%) with information about the test’s statistical properties. OnthebasisofthisinformationandtheevidencethatEmmatestedpositive,onecanproduceacorrectposterior evaluation by computing the ratio:Probability(Anomaly|PositiveTestResult)=Probability(“PositiveTestResultandAnomaly”)/Probability (“Positive Test Result”).To obtain the numerator, one has to combine the prevalence rate and the test’s sensitivity rate(i.e., 4% × 75% = 3%). To obtain the denominator, one has to combine the complement of theprevalencerateandthefalsepositiverate(i.e.,96%×12.5%=12%),andthenaddittotheinitiallyobtainedvalue(i.e.,3%+12%=15%).Veryfewrespondents,includinghealth-careprofessionals,produce the correct probability ratio (i.e., 3%/15% = 20%). Failures to solve tasks of this sortlead to pessimistic conclusions about naive probabilistic reasoning (e.g., Casscells et al., 1978).Subsequent studies, however, licensed more optimistic conclusions, showing that some versionsof these tasks led to better performances. About half of the respondents succeed when reasoningwith natural frequencies (e.g., “Three out of the 4 women who had a child with the anomaly had apositive test result”) or numbers of chances (e.g., “In 3 out of the 4 chances of having a child withthe anomaly the test result is positive”; see, respectively, Hoffrage and Gigerenzer, 1998; Girottoand Gonzalez, 2001). On the basis of these results, the current, common account is that posteriorprobability reasoning improves in versions that allow respondents to both rely on an appropriaterepresentation of subsets of countable elements (e.g., observations, tokens), and to easily associateposterior evidence with one of these subsets (Barbey and Sloman, 2007).A generally unnoticed aspect of the results mentioned above is that they concern educatedrespondents, like undergraduates and physicians, and that only about half of these respondentsbenefit from the simplified versions of the tasks. Even more unnoticed is the fact that respondentssampled from the general public do not benefit at all from these versions. Indeed, in samples ofpregnantwomen,manyofwhomhadahighschoollevelofeducationorless,almostallrespondentsfailedtocomputethecorrectprobabilityratio,eveniftheyhadtoreasonaboutnaturalfrequencies(Bramwell et al., 2006) or numbers of cases (Pighin et al., 2015). In other words, they failedtasks that, in principle, should have activated the appropriate set representation. Their failure isstriking because, unlike the participants of previous studies who had to reason about hypothetical

[1]  Vittorio Girotto,et al.  Intuitions of probabilities shape expectations about the future at 12 months and beyond , 2007, Proceedings of the National Academy of Sciences.

[2]  Edward Vul,et al.  Pure Reasoning in 12-Month-Old Infants as Probabilistic Inference , 2011, Science.

[3]  Raymond S. Nickerson,et al.  AMBIGUITIES AND UNSTATED ASSUMPTIONS IN PROBABILISTIC REASONING , 1996 .

[4]  Hilary Barth,et al.  Abstract number and arithmetic in preschool children. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Maria Sonino Legrenzi,et al.  Naive probability: a mental model theory of extensional reasoning. , 1999, Psychological review.

[6]  G. Bower,et al.  From conditioning to category learning: an adaptive network model. , 1988, Journal of experimental psychology. General.

[7]  Gerd Gigerenzer,et al.  Overcoming Difficulties in Bayesian Reasoning : A Reply to Lewis and Keren ( 1999 ) and Mellers and McGraw ( 1999 ) , 1999 .

[8]  Giorgio Vallortigara,et al.  Probabilistic cognition in two indigenous Mayan groups , 2014, Proceedings of the National Academy of Sciences.

[9]  Charles J. Brainerd,et al.  Working memory and the developmental analysis of probability judgment. , 1981 .

[10]  V. Girotto,et al.  Improving Public Interpretation of Probabilistic Test Results , 2015, Medical decision making : an international journal of the Society for Medical Decision Making.

[11]  Vittorio Girotto,et al.  How to elicit sound probabilistic reasoning: Beyond word problems , 2007 .

[12]  G Gigerenzer,et al.  Using natural frequencies to improve diagnostic inferences , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[13]  Vittorio Girotto,et al.  Children’s understanding of posterior probability , 2008, Cognition.

[14]  W. Casscells,et al.  Interpretation by physicians of clinical laboratory results. , 1978, The New England journal of medicine.

[15]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[16]  Peter Salmon,et al.  Health professionals' and service users' interpretation of screening test results: experimental study , 2006, BMJ : British Medical Journal.

[17]  S. Sloman,et al.  Base-rate respect: From ecological rationality to dual processes. , 2007, The Behavioral and brain sciences.

[18]  V. Girotto,et al.  Solving probabilistic and statistical problems: a matter of information structure and question form , 2001, Cognition.

[19]  S. Dehaene,et al.  Exact and Approximate Arithmetic in an Amazonian Indigene Group , 2004, Science.

[20]  S. Denison,et al.  Rational variability in children’s causal inferences: The Sampling Hypothesis , 2013, Cognition.

[21]  C. Davies DEVELOPMENT OF THE PROBABILITY CONCEPT IN CHILDREN , 1965 .

[22]  David R. Mandel,et al.  The psychology of Bayesian reasoning , 2014, Front. Psychol..