Incentives, expertise, and medical decisions: testing the robustness of natural frequency framing.

OBJECTIVES The natural frequency effect (NF effect)-whereby framing health risks using information presented as natural frequencies (NFs), instead of conditional probabilities (CPs), results in improved diagnostic problem solving-has led to the recommended use of NFs in clinical practice. This experiment tests, via incentivization of a lab-based decision, the hypothesis that the NF effect reflects differential motivation applied to solving problems that differ in complexity. The study examines if incentive effects are moderated by task complexity and expertise and also explores the extent to which NF frames improve diagnostic understanding. METHODS Three-hundred and 25 participants (235 novices and 90 medical experts) were randomly allocated to a frame (NF vs. CP) by task difficulty (short vs. standard menus) by incentive (present vs. absent) between-subjects design. The task was to calculate the positive predictive value (PPV) of the hemoccult test for colorectal cancer. Effort, self-efficacy, and diagnostic understanding were assessed. RESULTS Incentives increased correct problem solving and the NF effect was replicated. The NF effect did not vary as a function of incentivization, but was slightly attenuated by task complexity and expertise. There was no evidence that effort mediated the incentive effect. The correct PPV (which is low) was associated with reduced trust in the test's diagnostic accuracy. For those who committed errors, NF frames increased the likelihood of underestimating the PPV, with underestimation associated with greater trust in the test. CONCLUSIONS The NF effect is robust to incentives supporting the use of NF frames in clinical settings. When errors occur, however, NF frames are linked to underestimation.

[1]  R. Hertwig,et al.  Experimental practices in economics: A methodological challenge for psychologists? , 2001, Behavioral and Brain Sciences.

[2]  D. Kahneman,et al.  Attention and Effort , 1973 .

[3]  E. Akl,et al.  Using alternative statistical formats for presenting risks and risk reductions. , 2011, The Cochrane database of systematic reviews.

[4]  Peter Salmon,et al.  Health professionals' and service users' interpretation of screening test results: experimental study , 2006, BMJ : British Medical Journal.

[5]  C. Abraham,et al.  Psychological correlates of university students' academic performance: a systematic review and meta-analysis. , 2012, Psychological bulletin.

[6]  Andrew D. Oxman,et al.  The Effect of Alternative Summary Statistics for Communicating Risk Reduction on Decisions about Taking Statins: A Randomized Trial , 2009, PLoS medicine.

[7]  Gerd Gigerenzer,et al.  What are natural frequencies? , 2011, BMJ : British Medical Journal.

[8]  Gerd Gigerenzer,et al.  How to Improve Bayesian Reasoning Without Instruction: Frequency Formats , 1995 .

[9]  Gerd Gigerenzer,et al.  The role of representation in Bayesian reasoning: Correcting common misconceptions , 2007 .

[10]  E. Ferguson.  Personality is of central concern to understand health: towards a theoretical model for health psychology , 2013, Health psychology review.

[11]  Judith Covey,et al.  The Effects of Absolute Risks, Relative Risks, Frequencies, and Probabilities on Decision Quality , 2011, Journal of health communication.

[12]  Geoffrey B. Sprinkle,et al.  The effects of monetary incentives on effort and task performance: theories, evidence, and a framework for research , 2002 .

[13]  G Gigerenzer,et al.  Using natural frequencies to improve diagnostic inferences , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[14]  Alois Stutzer,et al.  Prosocial Motivation and Blood Donations: A Survey of the Empirical Literature , 2010, Transfusion Medicine and Hemotherapy.

[15]  Lisa M. Schwartz,et al.  Communicating Data About the Benefits and Harms of Treatment , 2011, Annals of Internal Medicine.

[16]  Gerd Gigerenzer,et al.  Teaching Bayesian reasoning in less than two hours. , 2001, Journal of experimental psychology. General.

[17]  D. Read.  Monetary incentives, what are they good for? , 2005 .

[18]  James J. Heckman,et al.  Personality and economics: Overview and proposed framework , 2011 .

[19]  Gary L. Brase.  How different types of participant payments alter task performance , 2009, Judgment and Decision Making.

[20]  Michael I. Norton,et al.  Psychology and Experimental Economics , 2007 .

[21]  Gerd Gigerenzer,et al.  Natural Frequencies Help Older Adults and People with Low Numeracy to Evaluate Medical Screening Tests , 2009, Medical decision making : an international journal of the Society for Medical Decision Making.

[22]  A. Caspi,et al.  The Power of Personality: The Comparative Validity of Personality Traits, Socioeconomic Status, and Cognitive Ability for Predicting Important Life Outcomes , 2007, Perspectives on psychological science : a journal of the Association for Psychological Science.

[23]  Gerd Gigerenzer,et al.  Communicating Statistical Information , 2000, Science.

[24]  J. Edwards,et al.  Methods for integrating moderation and mediation: a general analytical framework using moderated path analysis. , 2007, Psychological methods.

[25]  J. Meece,et al.  Gender and motivation , 2006 .

[26]  Angela L. Duckworth,et al.  The Economics and Psychology of Personality Traits , 2008, The Journal of Human Resources.

[27]  A. Hayes.  Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach , 2013 .

[28]  S. Sloman,et al.  Base-rate respect: From ecological rationality to dual processes. , 2007, The Behavioral and brain sciences.

[29]  John A Updegraff,et al.  Health Message Framing Effects on Attitudes, Intentions, and Behavior: A Meta-analytic Review , 2012, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[30]  Eric J. Johnson,et al.  A componential analysis of cognitive effort in choice , 1990 .

[31]  A. Bauman,et al.  Toward a better understanding of the influences on physical activity: the role of determinants, correlates, causal variables, mediators, moderators, and confounders. , 2002, American journal of preventive medicine.

[32]  G. Gigerenzer,et al.  Simple tools for understanding risks: from innumeracy to insight , 2003, BMJ : British Medical Journal.

[33]  A. Katz,et al.  False-positive gonorrhea test results with a nucleic acid amplification test: the impact of low prevalence on positive predictive value. , 2004, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[34]  Colin Camerer,et al.  The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework , 1999 .

[35]  David Keatley,et al.  Blood donors' helping behavior is driven by warm glow: more evidence for the blood donor benevolence hypothesis , 2012, Transfusion.