Communicating Relative Risk Changes with Baseline Risk

Background. Treatment benefits and harms are often communicated as relative risk reductions and increases, which are frequently misunderstood by doctors and patients. One suggestion for improving understanding of such risk information is to also communicate the baseline risk. We investigated 1) whether the presentation format of the baseline risk influences understanding of relative risk changes and 2) the mediating role of people’s numeracy skills. Method. We presented laypeople (N = 1234) with a hypothetical scenario about a treatment that decreased (Experiments 1a, 2a) or increased (Experiments 1b, 2b) the risk of heart disease. Baseline risk was provided as a percentage or a frequency. In a forced-choice paradigm, the participants’ task was to judge the risk in the treatment group given the relative risk reduction (or increase) and the baseline risk. Numeracy was assessed using the Lipkus 11-item scale. Results. Communicating baseline risk in a frequency format facilitated correct understanding of a treatment’s benefits and harms, whereas a percentage format often impeded understanding. For example, many participants misinterpreted a relative risk reduction as referring to an absolute risk reduction. Participants with higher numeracy generally performed better than those with lower numeracy, but all participants benefitted from a frequency format. Limitations are that we used a hypothetical medical scenario and a nonrepresentative sample. Conclusions. Presenting baseline risk in a frequency format improves understanding of relative risk information, whereas a percentage format is likely to lead to misunderstandings. People’s numeracy skills play an important role in correctly understanding medical information. Overall, communicating treatment benefits and harms in the form of relative risk changes remains problematic, even when the baseline risk is explicitly provided.

[1]  Chuck Shih,et al.  Improving Depiction of Benefits and Harms: Analyses of Studies of Well-Known Therapeutics and Review of High-Impact Medical Journals , 2007, Medical care.

[2]  Lisa M. Schwartz,et al.  PSYCHOLOGICAL SCIENCE IN THE PUBLIC INTEREST Helping Doctors and Patients Make Sense of Health Statistics , 2022 .

[3]  M. Galesic,et al.  Who profits from visual aids: overcoming challenges in people's understanding of risks [corrected]. , 2010, Social science & medicine.

[4]  Judith Covey,et al.  A Meta-analysis of the Effects of Presenting Treatment Benefits in Different Formats , 2007, Medical decision making : an international journal of the Society for Medical Decision Making.

[5]  MPH Michael P. Pignone MD,et al.  A randomized comparison of patients’ understanding of number needed to treat and other common risk reduction formats , 2007, Journal of General Internal Medicine.

[6]  M. Galesic,et al.  Statistical Numeracy for Health A Cross-cultural Comparison With Probabilistic National Samples , 2010 .

[7]  G. Gigerenzer Risk Savvy: How to Make Good Decisions , 2014 .

[8]  Steven Woloshin,et al.  Using a Drug Facts Box to Communicate Drug Benefits and Harms Two Randomized Trials , 2009, Annals of Internal Medicine.

[9]  P. Watkins Cardiovascular disease, hypertension, and lipids , 2003, BMJ : British Medical Journal.

[10]  Panagiotis G. Ipeirotis,et al.  Running Experiments on Amazon Mechanical Turk , 2010, Judgment and Decision Making.

[11]  V. Reyna,et al.  How numeracy influences risk comprehension and medical decision making. , 2009, Psychological bulletin.

[12]  S B Soumerai,et al.  Coverage by the news media of the benefits and risks of medications. , 2000, The New England journal of medicine.

[13]  Gerd Gigerenzer,et al.  Better Doctors, Better Patients, Better Decisions: Envisioning Health Care 2020 , 2011 .

[14]  Amanda L Golbeck,et al.  A definition and operational framework for health numeracy. , 2005, American journal of preventive medicine.

[15]  Gerd Gigerenzer,et al.  Launching the century of the patient , 2011 .

[16]  E. Akl,et al.  Using alternative statistical formats for presenting risks and risk reductions. , 2011, The Cochrane database of systematic reviews.

[17]  Judith Covey,et al.  The Effects of Absolute Risks, Relative Risks, Frequencies, and Probabilities on Decision Quality , 2011, Journal of health communication.

[18]  C. K. Mertz,et al.  PSYCHOLOGICAL SCIENCE Research Article Numeracy and Decision Making , 2022 .

[19]  Jon Sprouse A validation of Amazon Mechanical Turk for the collection of acceptability judgments in linguistic theory , 2010, Behavior research methods.

[20]  Dianne C. Berry,et al.  Effects of presenting the baseline risk when communicating absolute and relative risk reductions , 2005 .

[21]  Markus A. Feufel,et al.  Misleading communication of risk , 2010, BMJ : British Medical Journal.

[22]  B. Rimer,et al.  General Performance on a Numeracy Scale among Highly Educated Samples , 2001, Medical decision making : an international journal of the Society for Medical Decision Making.

[23]  Steven Woloshin,et al.  Ratio measures in leading medical journals: structured review of accessibility of underlying absolute risks , 2006, BMJ : British Medical Journal.

[24]  M. Slater,et al.  News Coverage of Cancer in the United States: A National Sample of Newspapers, Television, and Magazines , 2008, Journal of health communication.

[25]  I. Mühlhauser,et al.  Understanding of diabetes prevention studies: questionnaire survey of professionals in diabetes care , 2006, Diabetologia.

[26]  R M Arnold,et al.  Absolutely relative: how research results are summarized can affect treatment decisions. , 1992, The American journal of medicine.

[27]  J. Feely,et al.  Effect of the British warning on contraceptive use in the General Medical Service in Ireland. , 1998, Irish medical journal.

[28]  Peter C Gøtzsche,et al.  Presentation on websites of possible benefits and harms from screening for breast cancer: cross sectional study , 2004, BMJ : British Medical Journal.

[29]  A. Miller Screening for breast cancer with mammography , 2001, The Lancet.

[30]  Peter Knapp,et al.  Expressing medicine side effects: assessing the effectiveness of absolute risk, relative risk, and number needed to harm, and the provision of baseline risk information. , 2006, Patient education and counseling.

[31]  Ellen Peters,et al.  Understanding the Role of Numeracy in Health: Proposed Theoretical Framework and Practical Insights , 2009, Health education & behavior : the official publication of the Society for Public Health Education.

[32]  Lisa M. Schwartz,et al.  The Role of Numeracy in Understanding the Benefit of Screening Mammography , 1997, Annals of Internal Medicine.

[33]  G. Gigerenzer,et al.  Using icon arrays to communicate medical risks: overcoming low numeracy. , 2009, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[34]  G. Elwyn,et al.  Presenting risk information--a review of the effects of "framing" and other manipulations on patient outcomes. , 2001, Journal of health communication.

[35]  Adam J. Berinsky,et al.  Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk , 2012, Political Analysis.