Natural frequencies facilitate diagnostic inferences of managers

In Bayesian inference tasks, information about base rates as well as hit rate and false-alarm rate needs to be integrated according to Bayes’ rule after the result of a diagnostic test became known. Numerous studies have found that presenting information in a Bayesian inference task in terms of natural frequencies leads to better performance compared to variants with information presented in terms of probabilities or percentages. Natural frequencies are the tallies in a natural sample in which hit rate and false-alarm rate are not normalized with respect to base rates. The present research replicates the beneficial effect of natural frequencies with four tasks from the domain of management, and with management students as well as experienced executives as participants. The percentage of Bayesian responses was almost twice as high when information was presented in natural frequencies compared to a presentation in terms of percentages. In contrast to most tasks previously studied, the majority of numerical responses were lower than the Bayesian solutions. Having heard of Bayes’ rule prior to the study did not affect Bayesian performance. An implication of our work is that textbooks explaining Bayes’ rule should teach how to represent information in terms of natural frequencies instead of how to plug probabilities or percentages into a formula.

[1]  Kristy Rahimi,et al.  Communicating Data about the Benefits and Harms of Treatment: A Randomized Trial , 2011 .

[2]  A. Tversky,et al.  Subjective Probability: A Judgment of Representativeness , 1972 .

[3]  G. Gigerenzer On Narrow Norms and Vague Heuristics: A Reply to Kahneman and Tversky (1996) , 1996 .

[4]  M. Bar-Hillel The base-rate fallacy in probability judgments. , 1980 .

[5]  Ulrich Hoffrage,et al.  Teaching Bayesian reasoning: an evaluation of a classroom tutorial for medical students , 2002, Medical teacher.

[6]  Ulrich Hoffrage,et al.  Visual representation of statistical information improves diagnostic inferences in doctors and their patients. , 2013, Social science & medicine.

[7]  Lisa M. Schwartz,et al.  PSYCHOLOGICAL SCIENCE IN THE PUBLIC INTEREST Helping Doctors and Patients Make Sense of Health Statistics , 2022 .

[8]  Patrick Shannon,et al.  Business Statistics: A Decision-Making Approach , 1981 .

[9]  Gary Klein,et al.  The Power of Intuition: How to Use Your Gut Feelings to Make Better Decisions at Work , 2004 .

[10]  David R. Mandel,et al.  Instruction in information structuring improves Bayesian judgment in intelligence analysts , 2015, Front. Psychol..

[11]  Gary L. Brase,et al.  Good fences make for good neighbors but bad science: a review of what improves Bayesian reasoning and why , 2015, Front. Psychol..

[12]  Robert Sandy,et al.  Statistics for Business and Economics , 1989 .

[13]  G. Gigerenzer,et al.  Teaching Bayesian reasoning in less than two hours. , 2001, Journal of experimental psychology. General.

[14]  John A Lawrence,et al.  Applied Management Science , 2005 .

[15]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[16]  G Gigerenzer,et al.  Using natural frequencies to improve diagnostic inferences , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[17]  D. Eddy Judgment under uncertainty: Probabilistic reasoning in clinical medicine: Problems and opportunities , 1982 .

[18]  G. Gigerenzer,et al.  Representation facilitates reasoning: what natural frequencies are and what they are not , 2002, Cognition.

[19]  E. Akl,et al.  Using alternative statistical formats for presenting risks and risk reductions. , 2011, The Cochrane database of systematic reviews.

[20]  G. Gigerenzer,et al.  Cognition as Intuitive Statistics , 1987 .

[21]  Gary L. Brase,et al.  Frequency interpretation of ambiguous statistical information facilitates Bayesian reasoning , 2008, Psychonomic bulletin & review.

[22]  Ron S. Kenett,et al.  Statistics for Business and Economics , 1973 .

[23]  Gary L. Brase,et al.  When and for whom do frequencies facilitate performance? On the role of numerical literacy , 2012, Quarterly journal of experimental psychology.

[24]  Barry Alan Pasternack,et al.  Applied Management Science: Modeling, Spreadsheet Analysis, and Communication for Decision Making , 2002 .

[25]  Gerd Gigerenzer,et al.  Calculated Risks: How to Know When Numbers Deceive You , 2002 .

[26]  Gerd Gigerenzer,et al.  How to Improve Bayesian Reasoning Without Instruction: Frequency Formats , 1995 .

[27]  Gerd Gigerenzer,et al.  The role of representation in Bayesian reasoning: Correcting common misconceptions , 2007 .

[28]  G. Gigerenzer Risk Savvy: How to Make Good Decisions , 2014 .

[29]  Gerd Gigerenzer,et al.  Communicating Statistical Information , 2000, Science.

[30]  Gerd Gigerenzer,et al.  Better Doctors, Better Patients, Better Decisions: Envisioning Health Care 2020 , 2011 .