Mediating policy-relevant evidence at speed: are systematic reviews of systematic reviews a useful approach?

When swift, accurate appraisal of evidence is required to inform policy concerning broad research questions, and budgetary constraints limit the employment of large research teams, researchers face a significant challenge which is sometimes met by reviewing existing systematic reviews. In this paper we highlight the challenges inherent in the reviews of reviews (RoR) method in order to advance understanding of this important tool for policy makers. Drawing on our experiences, we present, where possible, potential solutions to these challenges to demonstrate that RoRs, despite their limitations, can be useful for mediating policy-relevant evidence at speed.

[1]  M. Pearson,et al.  The challenge of external validity in policy-relevant systematic reviews: a case study from the field of substance misuse. , 2010, Addiction.

[2]  S. Oliver,et al.  Community engagement to reduce inequalities in health: a systematic review, meta-analysis and economic analysis , 2013 .

[3]  M. Clarke,et al.  Methodology in conducting a systematic review of systematic reviews of healthcare interventions , 2011, BMC medical research methodology.

[4]  D. Gough,et al.  Improving the emotional and behavioural health of looked-after children and young people (LACYP) , 2009 .

[5]  M. Suarez‐Almazor,et al.  Biologics for rheumatoid arthritis: an overview of Cochrane reviews. , 2009, The Cochrane database of systematic reviews.

[6]  D. Gough,et al.  Clarifying differences between review designs and methods , 2012, Systematic Reviews.

[7]  K. Shojania,et al.  How Quickly Do Systematic Reviews Go Out of Date? A Survival Analysis , 2007, Annals of Internal Medicine.

[8]  Jennifer S. Lin,et al.  Using Existing Systematic Reviews in Complex Systematic Reviews , 2008, Annals of Internal Medicine.

[9]  Jenny Woodman,et al.  How explicable are differences between reviews that appear to address a similar research question? A review of reviews of physical activity interventions , 2012, Systematic Reviews.

[10]  Annette Boaz,et al.  A multitude of syntheses: a comparison of five approaches from diverse policy fields , 2006 .

[11]  Sandy Oliver,et al.  The politics of evidence and methodology: lessons from the EPPI-Centre , 2005 .

[12]  C. Abraham,et al.  Systematic review of reviews of intervention components associated with increased effectiveness in dietary and physical activity interventions , 2011, BMC public health.

[13]  Donna Ciliska,et al.  Expediting systematic reviews: methods and implications of rapid reviews , 2010, Implementation science : IS.

[14]  J. Kavanagh,et al.  The socioeconomic value of nursing and midwifery : a rapid systematic review of reviews. Interim policy briefing , 2009 .

[15]  Denise Thomson,et al.  The evolution of a new publication type: Steps and challenges of producing overviews of reviews , 2010, Research synthesis methods.

[16]  Patriek Mistiaen,et al.  BMC Health Services Research BioMed Central , 2005 .

[17]  D. Gough,et al.  Systematic Research Synthesis to Inform Policy, Practice and Democratic Debate , 2002, Social Policy and Society.

[18]  I. Boutron,et al.  Applicability and generalisability of the results of systematic reviews to public health practice and policy: a systematic review , 2010, Trials.

[19]  Sophia Ananiadou,et al.  Applications of text mining within systematic reviews , 2011, Research synthesis methods.

[20]  G. Jamtvedt,et al.  Effectiveness of Nonpharmacological and Nonsurgical Interventions for Hip Osteoarthritis: An Umbrella Review of High-Quality Systematic Reviews , 2007, Physical Therapy.

[21]  Sandy Oliver,et al.  Rapid evidence assessments of research to inform social policy: taking stock and moving forward , 2013 .

[22]  James Thomas.  A systematic rapid evidence assessment of late diagnosis [IOE Research Briefing N°38] , 2012 .

[23]  A. Boaz,et al.  Effective implementation of research into practice: an overview of systematic reviews of the health literature , 2011, BMC Research Notes.

[24]  C. Willis,et al.  A time-responsive tool for informing policy making: rapid realist review , 2013, Implementation Science.

[25]  Michael Pignone,et al.  Challenges in Systematic Reviews of Economic Analyses , 2005, Annals of Internal Medicine.

[26]  Luke Vale,et al.  Evidence synthesis, economics and public policy , 2010, Research synthesis methods.