How to conduct systematic reviews more expeditiously?

Healthcare consumers, researchers, patients and policy makers increasingly use systematic reviews (SRs) to aid their decision-making process. However, the conduct of SRs can be a time-consuming and resource-intensive task. Often, clinical practice guideline developers or other decision-makers need to make informed decisions in a timely fashion (e.g. outbreaks of infection, hospital-based health technology assessments). Possible approaches to address the issue of timeliness in the production of SRs are to (a) implement process parallelisation, (b) adapt and apply innovative technologies, and/or (c) modify SR processes (e.g. study eligibility criteria, search sources, data extraction or quality assessment). Highly parallelised systematic reviewing requires substantial resources to support a team of experienced information specialists, reviewers and methodologists working alongside with clinical content experts to minimise the time for completing individual review steps while maximising the parallel progression of multiple steps. Effective coordination and management within the team and across external stakeholders are essential elements of this process. Emerging innovative technologies have a great potential for reducing workload and improving efficiency of SR production. The most promising areas of application would be to allow automation of specific SR tasks, in particular if these tasks are time consuming and resource intensive (e.g. language translation, study selection, data extraction). Modification of SR processes involves restricting, truncating and/or bypassing one or more SR steps, which may risk introducing bias to the review findings. Although the growing experiences in producing various types of rapid reviews (RR) and the accumulation of empirical studies exploring potential bias associated with specific SR tasks have contributed to the methodological development for expediting SR production, there is still a dearth of research examining the actual impact of methodological modifications and comparing the findings between RRs and SRs. This evidence would help to inform as to which SR tasks can be accelerated or truncated and to what degree, while maintaining the validity of review findings. Timely delivered SRs can be of value in informing healthcare decisions and recommendations, especially when there is practical urgency and there is no other relevant synthesised evidence.

[1]  Ida Sim,et al.  #CochraneTech: technology and the future of systematic reviews. , 2014, The Cochrane database of systematic reviews.

[2]  P. Glasziou,et al.  Systematic review automation technologies , 2014, Systematic Reviews.

[3]  J. Sterne,et al.  How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. , 2003, Health technology assessment.

[4]  D. Cook,et al.  Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? , 1998, The Lancet.

[5]  A. Oxman,et al.  Improving the use of research evidence in guideline development: 14. Reporting guidelines , 2006, Health research policy and systems.

[6]  Donna Ciliska,et al.  Expediting systematic reviews: methods and implications of rapid reviews , 2010, Implementation science : IS.

[7]  Michelle Fiander,et al.  THE EFFECT OF ENGLISH-LANGUAGE RESTRICTION ON SYSTEMATIC REVIEW-BASED META-ANALYSES: A SYSTEMATIC REVIEW OF EMPIRICAL STUDIES , 2012, International Journal of Technology Assessment in Health Care.

[8]  Steve Bhimji,et al.  Agency for Healthcare Research and Quality (AHRQ) , 2015 .

[9]  Pamela Royle,et al.  LITERATURE SEARCHING FOR RANDOMIZED CONTROLLED TRIALS USED IN COCHRANE REVIEWS: RAPID VERSUS EXHAUSTIVE SEARCHES , 2003, International Journal of Technology Assessment in Health Care.

[10]  David Moher,et al.  Evidence summaries: the evolution of a rapid review approach , 2012, Systematic Reviews.

[11]  Ethan M Balk,et al.  Assessing the Accuracy of Google Translate to Allow Data Extraction From Trials Published in Non-English Languages , 2013 .

[12]  Michael G. Wilson,et al.  Developing a rapid-response program for health system decision-makers in Canada: findings from an issue brief and stakeholder dialogue , 2015, Systematic Reviews.

[13]  D. Cook,et al.  Systematic Reviews: Synthesis of Best Evidence for Clinical Decisions , 1997, Annals of Internal Medicine.

[14]  George Davey Smith,et al.  meta-analysis bias in location and selection of studies , 1998 .

[15]  T. Trikalinos,et al.  Using data sources beyond PubMed has a modest impact on the results of systematic reviews of therapeutic interventions. , 2015, Journal of clinical epidemiology.

[16]  Phil Edwards,et al.  Identification of randomized controlled trials in systematic reviews: accuracy and reliability of screening records , 2002, Statistics in medicine.

[17]  Mohammed T Ansari,et al.  A surveillance system to assess the need for updating systematic reviews , 2013, Systematic Reviews.

[18]  L. Preston,et al.  Improving search efficiency for systematic reviews of diagnostic test accuracy: an exploratory study to assess the viability of limiting to MEDLINE, EMBASE and reference checking , 2015, Systematic Reviews.

[19]  David Moher,et al.  Should meta-analysts search Embase in addition to Medline? , 2003, Journal of clinical epidemiology.

[20]  Holger J Schünemann,et al.  Reviews: Rapid! Rapid! Rapid! …and systematic , 2015, Systematic Reviews.

[21]  Douglas G Altman,et al.  Systematic reviews in health care: Assessing the quality of controlled clinical trials. , 2001, BMJ.

[22]  M Egger,et al.  Grey literature in meta-analyses of randomized trials of health care interventions. , 2007, The Cochrane database of systematic reviews.

[23]  Tari Turner,et al.  Living Systematic Reviews: An Emerging Opportunity to Narrow the Evidence-Practice Gap , 2014, PLoS medicine.

[24]  Julie Polisena,et al.  Rapid review programs to support health care and policy decision making: a descriptive analysis of processes and methods , 2015, Systematic Reviews.

[25]  C. Counsell,et al.  Formulating Questions and Locating Primary Studies for Inclusion in Systematic Reviews , 1997, Annals of Internal Medicine.

[26]  Jos Kleijnen,et al.  What is a rapid review? A methodological exploration of rapid reviews in Health Technology Assessments. , 2012, International journal of evidence-based healthcare.

[27]  Sophia Ananiadou,et al.  Reducing systematic review workload through certainty-based screening , 2014, J. Biomed. Informatics.

[28]  Jesse A Berlin,et al.  Does blinding of readers affect the results of meta-analyses? , 1997, The Lancet.

[29]  Byron C. Wallace,et al.  RobotReviewer: evaluation of a system for automatically assessing bias in clinical trials , 2015, J. Am. Medical Informatics Assoc..

[30]  Lisa Hartling,et al.  Single data extraction generated more errors than double data extraction in systematic reviews. , 2006, Journal of clinical epidemiology.

[31]  S. Ananiadou,et al.  Using text mining for study identification in systematic reviews: a systematic review of current approaches , 2015, Systematic Reviews.

[32]  T P Klassen,et al.  The inclusion of reports of randomised trials published in languages other than English in systematic reviews. , 2003, Health technology assessment.

[33]  David Moher,et al.  Language of publication restrictions in systematic reviews gave different results depending on whether the intervention was conventional or complementary. , 2005, Journal of clinical epidemiology.

[34]  Alexander Tsertsvadze,et al.  Systematic reviews: when is an update an update? , 2006, The Lancet.

[35]  Lisa Hartling,et al.  EPC Methods: An Exploration of Methods and Context for the Production of Rapid Reviews , 2015 .

[36]  P. Royle,et al.  Literature searching for clinical and cost-effectiveness studies used in health technology assessment reports carried out for the National Institute for Clinical Excellence appraisal system. , 2003, Health technology assessment.

[37]  Julie Polisena,et al.  RAPID REVIEW: AN EMERGING APPROACH TO EVIDENCE SYNTHESIS IN HEALTH TECHNOLOGY ASSESSMENT , 2014, International Journal of Technology Assessment in Health Care.

[38]  David Hailey,et al.  Rapid reviews versus full systematic reviews: An inventory of current methods and practice in health technology assessment , 2008, International Journal of Technology Assessment in Health Care.

[39]  Maria J Grant,et al.  A typology of reviews: an analysis of 14 review types and associated methodologies. , 2009, Health information and libraries journal.

[40]  A R Jadad,et al.  What contributions do languages other than English make on the results of meta-analyses? , 2000, Journal of clinical epidemiology.

[41]  Carla E. Brodley,et al.  Semi-automated screening of biomedical citations for systematic reviews , 2010, BMC Bioinformatics.

[42]  M. Egger,et al.  Bias in location and selection of studies. , 1998, BMJ.

[43]  Siddhartha R. Jonnalagadda,et al.  Automating data extraction in systematic reviews: a systematic review , 2015, Systematic Reviews.

[44]  Lisa Hartling,et al.  Advancing knowledge of rapid reviews: an analysis of results, conclusions and recommendations from published review articles examining rapid reviews , 2015, Systematic Reviews.

[45]  Peter Jüni,et al.  Direction and impact of language bias in meta-analyses of controlled trials: empirical study. , 2002, International journal of epidemiology.

[46]  M. Gagnon Hospital-Based Health Technology Assessment: Developments to Date , 2014, PharmacoEconomics.

[47]  Guido Schwarzer,et al.  The demise of the randomised controlled trial: bibliometric study of the German-language health care literature, 1948 to 2004 , 2006, BMC medical research methodology.