SUPPORT Tools for evidence-informed health Policymaking (STP) 12. Dealing with insufficient evidence

Background: This article is number 12 in a series of 21 articles on tools for evidenceinformed health policymaking and addresses the issue of decision making when there is insufficient evidence. Policymakers often have insufficient evidence to know with certainty what the impacts of a health policy or programme will be. They must still make decisions. Objectives: In this article, we suggest four questions that can be considered when there is insufficient evidence to be confident about the impacts of implementing a policy or programme. Key messages:  If there is insufficient evidence to allow one to be confident about the impacts of implementing a policy or programme, the following questions should be considered: 1. Is there a systematic review of the impacts of the policy or programme? 2. Has inconclusive evidence been misinterpreted as evidence of no effect? 3. Is it possible to be confident about a decision despite a lack of evidence? 4. Is the policy or programme potentially harmful, ineffective or not worth the cost?  Common mistakes that should be avoided include: Making assumptions about the evidence without a systematic review Confusing a lack of evidence with evidence of no effect Assuming that insufficient evidence necessarily implies uncertainty about a decision Assuming that it is politically expedient to feign certainty, and  Saying “no” to a policy or programme, or saying “yes” when there are important uncertainties can have undesirable consequences. Often it would be better to say “only with a well-designed impact evaluation” STP 12 Dealing with insufficient evidence 2009 06 12 2

[1]  P. Garner,et al.  Directly observed therapy for treating tuberculosis , 2015, The Cochrane database of systematic reviews.

[2]  D. Chou,et al.  Magnesium sulphate versus diazepam for eclampsia. , 2010, The Cochrane database of systematic reviews.

[3]  D. Henderson-smart,et al.  Magnesium sulphate versus phenytoin for eclampsia. , 2010, The Cochrane database of systematic reviews.

[4]  Andrew D Oxman,et al.  SUPPORT Tools for evidence-informed health Policymaking (STP) 10: Taking equity into consideration when assessing the findings of a systematic review , 2009, Health research policy and systems.

[5]  A. Oxman,et al.  An overview of research on the effects of results-based financing , 2008 .

[6]  Sara Bennett,et al.  Effects of policy options for human resources for health: an analysis of systematic reviews , 2008, The Lancet.

[7]  A. Oxman,et al.  Pharmaceutical policies: effects of cap and co-payment on rational drug use. , 2008, The Cochrane database of systematic reviews.

[8]  K. Chalkidou,et al.  Making a decision to wait for more evidence: when the National Institute for Health and Clinical Excellence recommends a technology only in the context of research , 2007, Journal of the Royal Society of Medicine.

[9]  P Garner,et al.  Electronic mosquito repellents for preventing mosquito bites and malaria infection. , 2007, The Cochrane database of systematic reviews.

[10]  A. Oxman,et al.  Health Research Policy and Systems BioMed Central Review Improving the use of research evidence in guideline development: 1. Guidelines for guidelines , 2006 .

[11]  I. Chalmers If evidence-informed policy works in practice, does it matter if it doesn't work in theory? , 2005 .

[12]  P. Alderson,et al.  Corticosteroids for acute traumatic brain injury. , 2005, The Cochrane database of systematic reviews.

[13]  J. Volmink,et al.  Interventions for increasing the proportion of health professionals practising in under-served communities , 2005 .

[14]  I. Chalmers,et al.  Survey of claims of no effect in abstracts of Cochrane reviews , 2003, BMJ : British Medical Journal.

[15]  G. Guyatt,et al.  A systematic review and meta-analysis of studies comparing mortality rates of private for-profit and private not-for-profit hospitals. , 2002, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[16]  P. Garner,et al.  Reduced osmolarity oral rehydration solution for treating dehydration caused by acute diarrhoea in children. , 2002, The Cochrane database of systematic reviews.

[17]  G. Piaggio,et al.  Patterns of routine antenatal care for low-risk pregnancy. , 2001, The Cochrane database of systematic reviews.

[18]  I. Chalmers,et al.  Using evidence to inform health policy: case study , 2001, BMJ : British Medical Journal.

[19]  G H Guyatt,et al.  Randomized trials versus observational studies in adolescent pregnancy prevention. , 2000, Journal of clinical epidemiology.

[20]  D. Oxman SUPPORT Tools for evidence-informed health Policymaking (STP) 15:Engaging the public in evidence-informed policymaking , 2010 .

[21]  Michael G. Wilson,et al.  SUPPORT Tools for evidence-informed health Policymaking (STP) 3. Defining the problem , 2009 .

[22]  Elizabeth J. Paulsen,et al.  Evidence-Informed Health Policy: Using Research to Make Health Systems Healthier , 2008 .

[23]  A. Liberati,et al.  Human albumin solution for resuscitation and volume expansion in critically ill patients , 2006, Internal and emergency medicine.