Healthy Decisions: Towards Uncertainty Tolerance in Healthcare Policy

The pace of innovation in healthcare is accelerating, and society demands innovative healthcare programmes to become available as soon as possible. Therefore, decisions regarding the use and reimbursement of new programmes need to be made when scientific evidence is by definition still scarce and effectiveness and cost effectiveness are (highly) uncertain. Dealing with uncertainty in healthcare decision making is challenging. First, since not all uncertainties are easily incorporated, generally only some uncertainty is explicitly characterised and presented in assessments [1]. As a consequence, researchers focus on quantifiable uncertainties such as measurement error. The logic of quantification, or ‘‘mathematics of certainty’’ [2], may result in ignoring important uncertainties which are hard or impossible to quantify (such as degree of generalisability of effectiveness to different populations and long-term consequences), causing pseudo-certainty of the results generated. Second, decision makers traditionally resort to science for certainty. Being transparent about uncertainty conflicts with this notion of scientific certainty and is perceived by decision makers as complicating decision making. At the same time, the steep rise in healthcare expenses, combined with the ongoing economic crises, necessitates painful and far-reaching decisions on the allocation of healthcare resources. These decisions are often based on model-based assessments of the comparative (cost)effectiveness of the innovative programme [3]. To account for timely and optimal decisions in the long run, it is crucial that all relevant uncertainties are incorporated in the assessments [4]. These uncertainties need to be identified as soon as possible, before the assessment is performed. This allows for transparent decision-making processes leading to defensible decisions and maintaining or increasing public trust in research results as well as policymaking bodies [5]. Moreover, allowing relevant uncertainties to be neglected in the assessments may stimulate companies to not collect evidence, in order to increase the chances of reimbursement for their product [6]. What is— and, hence, also what is not—assessed sets the agenda and frames the debate [4]. In this commentary, we argue that knowledge and concepts on dealing with uncertainty from other scientific disciplines, such as environmental science and risk governance, can improve the handling of uncertainty in J. P. C. Grutters (&) Department for Health Evidence (HEV 133), Radboud University Medical Centre, PO Box 9101, 6500 HB Nijmegen, The Netherlands e-mail: janneke.grutters@radboudumc.nl

[1]  Brian Wynne,et al.  In risk assessment, one has to admit ignorance , 2002, Nature.

[2]  Cynthia Waickus,et al.  Centers for Medicare and Medicaid Services (CMS) , 2015 .

[3]  James E. Stahl,et al.  Acknowledging Patient Heterogeneity in Economic Evaluation , 2013, PharmacoEconomics.

[4]  Philippe Beutels,et al.  Accounting for Methodological, Structural, and Parameter Uncertainty in Decision-Analytic Models , 2011, Medical decision making : an international journal of the Society for Medical Decision Making.

[5]  Ian Miles,et al.  The Handbook of Technology Foresight - Concepts and Practice , 2008 .

[6]  M. Drummond,et al.  A rational framework for decision making by the National Institute For Clinical Excellence (NICE) , 2002, The Lancet.

[7]  J. Kemm Well informed uncertainties about the effects of treatment , 2004, BMJ : British Medical Journal.

[8]  Jonathan Karnon,et al.  Model Parameter Estimation and Uncertainty Analysis , 2012, Medical decision making : an international journal of the Society for Medical Decision Making.

[9]  Peter A. Vanrolleghem,et al.  Uncertainty in the environmental modelling process - A framework and guidance , 2007, Environ. Model. Softw..

[10]  Peter Littlejohns,et al.  Evidence-based decision making: when should we wait for more information? , 2008, Health affairs.

[11]  M. V. Asselt,et al.  Balancing between trade and risk : integrating legal and social science perspectives , 2013 .

[12]  M. Drummond,et al.  Early dialogue between the developers of new technologies and pricing and reimbursement agencies: a pilot study. , 2011, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[13]  Andrew R Willan,et al.  Expected value of information and decision making in HTA. , 2007, Health economics.

[14]  M. Albornoz Re-Thinking Science: Knowledge and the Public in an Age of Uncertainty , 2003 .

[15]  P. Lambin,et al.  When to wait for more evidence? Real options analysis in proton therapy. , 2011, The oncologist.

[16]  W. Walker,et al.  Defining Uncertainty: A Conceptual Basis for Uncertainty Management in Model-Based Decision Support , 2003 .

[17]  Karl Claxton,et al.  Exploring Uncertainty in Cost-Effectiveness Analysis , 2012, PharmacoEconomics.

[18]  Iain Chalmers,et al.  Well informed uncertainties about the effects of treatments , 2004, BMJ : British Medical Journal.

[19]  R. Lofstedt,et al.  Scientific Peer Review to Inform Regulatory Decision Making: A European Perspective , 2006, Risk analysis : an official publication of the Society for Risk Analysis.

[20]  Marjolein B.A. Van Asselt,et al.  The complex significance of uncertainty in a risk era: logics, manners and strategies in use , 2005 .

[21]  Wiebe E. Bijker,et al.  The role of scientific advisory bodies in precaution‐based risk governance illustrated with the issue of uncertain health effects of electromagnetic fields , 2011 .