The Use of Research Evidence in Public Health Decision Making Processes: Systematic Review

Background The use of research evidence to underpin public health policy is strongly promoted. However, its implementation has not been straightforward. The objectives of this systematic review were to synthesise empirical evidence on the use of research evidence by public health decision makers in settings with universal health care systems. Methods To locate eligible studies, 13 bibliographic databases were screened, organisational websites were scanned, key informants were contacted and bibliographies of included studies were scrutinised. Two reviewers independently assessed studies for inclusion, extracted data and assessed methodological quality. Data were synthesised as a narrative review. Findings 18 studies were included: 15 qualitative studies, and three surveys. Their methodological quality was mixed. They were set in a range of country and decision making settings. Study participants included 1063 public health decision makers, 72 researchers, and 174 with overlapping roles. Decision making processes varied widely between settings, and were viewed differently by key players. A range of research evidence was accessed. However, there was no reliable evidence on the extent of its use. Its impact was often indirect, competing with other influences. Barriers to the use of research evidence included: decision makers' perceptions of research evidence; the gulf between researchers and decision makers; the culture of decision making; competing influences on decision making; and practical constraints. Suggested (but largely untested) ways of overcoming these barriers included: research targeted at the needs of decision makers; research clearly highlighting key messages; and capacity building. There was little evidence on the role of research evidence in decision making to reduce inequalities. Conclusions To more effectively implement research informed public health policy, action is required by decision makers and researchers to address the barriers identified in this systematic review. There is an urgent need for evidence to support the use of research evidence to inform public health decision making to reduce inequalities.

[1]  Andrew Tannahill,et al.  Beyond evidence--to ethics: a decision-making framework for health promotion, public health and health improvement. , 2008, Health promotion international.

[2]  Karen Golden-Biddle,et al.  Towards systematic reviews that inform health care management and policy-making , 2005, Journal of health services research & policy.

[3]  C. Pope,et al.  Qualitative Research in Health Care , 1999 .

[4]  M. Petticrew,et al.  Good intentions and received wisdom are not enough , 2000, Journal of epidemiology and community health.

[5]  Douglas K. Martin,et al.  Priority setting at the micro-, meso- and macro-levels in Canada, Norway and Uganda. , 2007, Health policy.

[6]  M. Dobbins,et al.  Western University From the SelectedWorks of Anita Kothari 2007 Public health decision makers ’ informational needs and preferences for receiving research evidence , 2017 .

[7]  N. Biller-Andorno,et al.  Evidence-Based Medicine as an Instrument for Rational Health Policy , 2004, Health Care Analysis.

[8]  Maureen Dobbins,et al.  Use of systematic reviews in the development of new provincial public health policies in Ontario , 2004, International Journal of Technology Assessment in Health Care.

[9]  T. Harpham,et al.  From research evidence to policy: Mental health care in Viet Nam. , 2006, Bulletin of the World Health Organization.

[10]  Alejandro Gonzalez Rossetti Health Policy -An introduction to process and power , 1995 .

[11]  P. Bacon,et al.  The Primary Prevention of Rheumatic Diseases. , 1995 .

[12]  E. Feingold Health Policy: An Introduction to Process and Power , 1995 .

[13]  H. Graham,et al.  Evidence for public health policy on inequalities: 2: Assembling the evidence jigsaw , 2004, Journal of Epidemiology and Community Health.

[14]  S. Benita,et al.  Analysis for Policy: Evidence-Based Policy in Practice , 2007 .

[15]  Iain Chalmers,et al.  Trying to do more Good than Harm in Policy and Practice: The Role of Rigorous, Transparent, Up-to-Date Evaluations , 2003 .

[16]  R. Klein Evidence and policy: interpreting the Delphic oracle. , 2003, Journal of the Royal Society of Medicine.

[17]  D. Hunter,et al.  Relationship between evidence and policy: a case of evidence-based policy or policy-based evidence? , 2009, Public health.

[18]  Joseph F. Lucke,et al.  Health Policy & Systems , 2001 .

[19]  M. Sandelowski Rigor or rigor mortis: the problem of rigor in qualitative research revisited. , 1993, ANS. Advances in nursing science.

[20]  D. Nutbeam,et al.  What influences the transfer of research into health policy and practice? Observations from England and Australia. , 2008, Public health.

[21]  A. Ritter How do drug policy makers access research evidence? , 2009, The International journal on drug policy.

[22]  David Mowat,et al.  Fostering evidence-based decision-making in Canada: examining the need for a Canadian population and public health evidence centre and research network. , 2005, Canadian journal of public health = Revue canadienne de sante publique.

[23]  O. Norheim The Role of Formal Outcome Evaluations in Health Policy Making: A Normative Perspective , 2005 .

[24]  L. Rychetnik,et al.  Advocating evidence-based health promotion: reflections and a way forward. , 2004, Health promotion international.

[25]  Judith Green,et al.  Epistemology, evidence and experience: evidence based health care in the work of Accident Alliances , 2000 .

[26]  P. Tugwell,et al.  Applying clinical epidemiological methods to health equity: the equity effectiveness loop , 2006, BMJ : British Medical Journal.

[27]  J. Kemm The limitations of 'evidence-based' public health. , 2006, Journal of evaluation in clinical practice.

[28]  I. Chalmers,et al.  Using evidence to inform health policy: case study , 2001, BMJ : British Medical Journal.

[29]  A. Zwi,et al.  Pathways to “Evidence-Informed” Policy and Practice: A Framework for Action , 2005, PLoS medicine.

[30]  D. Taylor-Robinson,et al.  Planning ahead in public health? A qualitative study of the time horizons used in public health decision-making , 2008, BMC public health.

[31]  D. Nutbeam Getting evidence into policy and practice to address health inequalities. , 2004, Health promotion international.

[32]  J. Popay,et al.  Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field , 2005, Journal of health services research & policy.

[33]  J. Popay,et al.  Guidance on the conduct of narrative synthesis in sytematic reviews , 2006 .

[34]  S. Asthana,et al.  Developing an evidence base for policies and interventions to address health inequalities: the analysis of "public health regimes". , 2006, The Milbank quarterly.

[35]  K Chamberlain,et al.  Methodolatry and Qualitative Health Research , 2000, Journal of health psychology.

[36]  M. Stabile,et al.  How Does Private Finance Affect Public Health Care Systems? Marshaling the Evidence from OECD Nations , 2004, Journal of health politics, policy and law.

[37]  D. Hunter Managing for health , 2007 .

[38]  A. Higgins,et al.  Evidence-based policy-making in the NHS: exploring the interface between research and the commissioning process. , 1999, Journal of public health medicine.

[39]  Rosaline S Barbour,et al.  Checklists for improving rigour in qualitative research: a case of the tail wagging the dog? , 2001, BMJ : British Medical Journal.

[40]  O. Norheim The Role of Evidence in Health Policy Making: A Normative Perspective , 2004, Health Care Analysis.

[41]  M Dixon-Woods,et al.  Qualitative research in systematic reviews , 2001, BMJ : British Medical Journal.

[42]  R. Armstrong,et al.  Multi-sectoral health promotion and public health: the role of evidence. , 2006, Journal of public health.

[43]  N. Black,et al.  Evidence based policy: proceed with care. , 2001, BMJ : British Medical Journal.

[44]  M. Kelly,et al.  Towards an Evidence-Based Approach to Tackling Health Inequalities: the English Experience , 2004 .

[45]  Martin O'Flaherty,et al.  Policy-makers’ attitudes to decision support models for coronary heart disease: A qualitative study , 2008, Journal of health services research & policy.

[46]  Martin J Buxton,et al.  The utilisation of health research in policy-making : concepts , examples and methods of assessment , 2003 .

[47]  D. Ciliska,et al.  FACTORS OF THE INNOVATION, ORGANIZATION, ENVIRONMENT, AND INDIVIDUAL THAT PREDICT THE INFLUENCE FIVE SYSTEMATIC REVIEWS HAD ON PUBLIC HEALTH DECISIONS , 2001, International Journal of Technology Assessment in Health Care.

[48]  J. Øvretveit Research-informed public health , 2007 .

[49]  Ross Upshur,et al.  Evidence-based health policy: context and utilisation. , 2004, Social science & medicine.

[50]  Jennie Popay,et al.  How are policy makers using evidence? Models of research utilisation and local NHS policy making , 2000, Journal of epidemiology and community health.

[51]  H. Graham,et al.  Evidence for public health policy on inequalities: 1: The reality according to policymakers , 2004, Journal of Epidemiology and Community Health.

[52]  S. Babones Social inequality and public health , 2009 .

[53]  B. Kirkwood Making public health interventions more evidence based , 2004, BMJ : British Medical Journal.

[54]  Peter Heywood,et al.  How and why do interventions that increase health overall widen inequalities within populations , 2009 .

[55]  Craig Mitton,et al.  Evidence-based priority-setting: what do the decision-makers think? , 2004, Journal of Health Services Research and Policy.

[56]  K. Storeng,et al.  Collapsing the vertical-horizontal divide: an ethnographic study of evidence-based policymaking in maternal health. , 2008, American journal of public health.

[57]  Nina Jetha,et al.  Supporting knowledge into action: The Canadian Best Practices Initiative for Health Promotion and Chronic Disease Prevention. , 2008, Canadian journal of public health = Revue canadienne de sante publique.

[58]  Research and Knowledge in Ontario Tobacco Control Networks , 2008, Canadian journal of public health = Revue canadienne de sante publique.