Timely, Efficient, and Living Systematic Reviews: Opportunities in International Development

Systematic reviews provide reliable summaries of available evidence on the effects of programmes to improve people’s lives. We know that timely availability of evidence is a key factor influencing evidence use, but the time-lag between new study results becoming available and their integration into new or updated systematic reviews is typically measured in years, due to lags in study publication, coupled with a resource and time-intensive review process. Moreoever, in a sector where new evidence is being produced on a frequent basis, this time-lag means reviews can rapidly become out of date. Drawing on the developments in other sectors, this paper explores the opportunities for more efficient and timely review production in international development, including but not limited to ‘living systematic reviews.’

[1]  Lisa Hartling,et al.  Technology-assisted title and abstract screening for systematic reviews: a retrospective evaluation of the Abstrackr machine learning tool , 2018, Systematic Reviews.

[2]  Byron C. Wallace,et al.  Machine learning for identifying Randomized Controlled Trials: An evaluation and practitioner's guide , 2018, Research synthesis methods.

[3]  Neal R Haddaway,et al.  Online tools supporting the conduct and reporting of systematic reviews and systematic maps: a case study on CADIMA and review of existing tools , 2018, Environmental Evidence.

[4]  Byron C. Wallace,et al.  Living systematic reviews: 2. Combining human and machine effort. , 2017, Journal of clinical epidemiology.

[5]  Y. Lee,et al.  The application of crowdsourcing approaches to cancer research: a systematic review , 2017, Cancer medicine.

[6]  E. Akl,et al.  Living systematic review: 1. Introduction-the why, what, when, and how. , 2017, Journal of clinical epidemiology.

[7]  Byron C. Wallace,et al.  An exploration of crowdsourcing citation screening for systematic reviews , 2017, Research synthesis methods.

[8]  Claire Stansfield,et al.  Text mining for search term development in systematic reviewing: A discussion of some methods and challenges , 2017, Research synthesis methods.

[9]  Neil R. Smalheiser,et al.  Identifying reports of randomized controlled trials (RCTs) via a hybrid machine learning and crowdsourcing approach , 2017, J. Am. Medical Informatics Assoc..

[10]  Clive E. Adams,et al.  RevManHAL: towards automatic text generation in systematic reviews , 2017, Systematic Reviews.

[11]  Birte Snilstveit,et al.  3ie evidence gap maps: a starting point for strategic evidence production and use , 2017 .

[12]  M. Sampson,et al.  A pilot validation study of crowdsourcing systematic reviews: update of a searchable database of pediatric clinical trials of high-dose vitamin D. , 2017, Translational pediatrics.

[13]  Hossam M. Hammady,et al.  Rayyan—a web and mobile app for systematic reviews , 2016, Systematic Reviews.

[14]  Luke Wolfenden,et al.  Time to consider sharing data extracted from trials included in systematic reviews , 2016, Systematic Reviews.

[15]  Radhika Menon,et al.  The impact of education programmes on learning and school participation in low- and middle-income countries , 2016 .

[16]  C. Guddat,et al.  Prospective comparison of search strategies for systematic reviews: an objective approach yielded higher sensitivity than a conceptual one. , 2016, Journal of clinical epidemiology.

[17]  Hongfang Liu,et al.  A Text-Mining Framework for Supporting Systematic Reviews. , 2016, American journal of information management.

[18]  James Thomas,et al.  Use of cost-effectiveness analysis to compare the efficiency of study identification methods in systematic reviews , 2016, Systematic Reviews.

[19]  Siddhartha R. Jonnalagadda,et al.  PDF text classification to leverage information extraction from publication reports , 2016, J. Biomed. Informatics.

[20]  Brian E. Howard,et al.  SWIFT-Review: a text-mining workbench for systematic review , 2016, Systematic Reviews.

[21]  Ben Goldacre,et al.  OpenTrials: towards a collaborative open database of all available information on all clinical trials , 2016, Trials.

[22]  Annette N. Brown,et al.  The growth of impact evaluation for international development: how much have we learned? , 2016 .

[23]  C. Whitty.  What makes an academic paper useful for health policy? , 2015, BMC Medicine.

[24]  Julian PT Higgins,et al.  Machine learning to assist risk-of-bias assessments in systematic reviews , 2015, International journal of epidemiology.

[25]  Alexander Tsertsvadze,et al.  How to conduct systematic reviews more expeditiously? , 2015, Systematic Reviews.

[26]  D. Moher,et al.  A scoping review of rapid review methods , 2015, BMC Medicine.

[27]  E. Scalise,et al.  Public Overseas Investments: Ensuring Respect for and Protecting Legitimate Land Tenure Rights. A Rapid Evidence Assessment , 2015 .

[28]  C. Stevens,et al.  The Impact of Free Trade Agreements between Developed and Developing Countries on Economic Development in Developing Countries: A Rapid Evidence Assessment , 2015 .

[29]  Brian A. Nosek,et al.  Promoting an open research culture , 2015, Science.

[30]  Byron C. Wallace,et al.  RobotReviewer: evaluation of a system for automatically assessing bias in clinical trials , 2015, J. Am. Medical Informatics Assoc..

[31]  Siddhartha R. Jonnalagadda,et al.  Automating data extraction in systematic reviews: a systematic review , 2015, Systematic Reviews.

[32]  S. Hadley,et al.  Urban Finance: Rapid Evidence Assessment , 2015 .

[33]  Lisa Hartling,et al.  Advancing knowledge of rapid reviews: an analysis of results, conclusions and recommendations from published review articles examining rapid reviews , 2015, Systematic Reviews.

[34]  Lisa Hartling,et al.  EPC Methods: An Exploration of Methods and Context for the Production of Rapid Reviews , 2015 .

[35]  Holger J Schünemann,et al.  Reviews: Rapid! Rapid! Rapid! …and systematic , 2015, Systematic Reviews.

[36]  S. Ananiadou,et al.  Using text mining for study identification in systematic reviews: a systematic review of current approaches , 2015, Systematic Reviews.

[37]  Paul Glasziou,et al.  Better duplicate detection for systematic reviewers: evaluation of Systematic Review Assistant-Deduplication Module , 2015, Systematic Reviews.

[38]  Sophia Ananiadou,et al.  Reducing systematic review workload through certainty-based screening , 2014, J. Biomed. Informatics.

[39]  Guy Tsafnat,et al.  Automatic Evidence Retrieval for Systematic Reviews , 2014, Journal of medical Internet research.

[40]  P. Glasziou,et al.  Systematic review automation technologies , 2014, Systematic Reviews.

[41]  Tari Turner,et al.  Living Systematic Reviews: An Emerging Opportunity to Narrow the Evidence-Practice Gap , 2014, PLoS medicine.

[42]  T. Lorenc,et al.  A systematic review of barriers to and facilitators of the use of evidence by policymakers , 2014, BMC Health Services Research.

[43]  Pearl Brereton,et al.  Tools to Support Systematic Literature Reviews in Software Engineering: A Mapping Study , 2013, 2013 ACM / IEEE International Symposium on Empirical Software Engineering and Measurement.

[44]  Jane Noyes,et al.  Synthesizing evidence on complex interventions: how meta-analytical, qualitative, and mixed-method approaches can contribute. , 2013, Journal of clinical epidemiology.

[45]  Jm Thomas,et al.  Diffusion of innovation in systematic review methodology: why is study selection not yet assisted by automation? , 2013 .

[46]  R. Mallett,et al.  How to do a rigorous, evidence- focused literature review in international development , 2013 .

[47]  Enrico Coiera,et al.  The automation of systematic reviews , 2013, BMJ.

[48]  Birte Snilstveit,et al.  Systematic reviews: from ‘bare bones’ reviews to policy relevance , 2012 .

[49]  Susanne Hempel,et al.  Machine Learning Methods in Systematic Reviews: Identifying Quality Improvement Intervention Evaluations , 2012 .

[50]  Peter Tugwell,et al.  How to do a good systematic review of effects in international development: a tool kit , 2012 .

[51]  H. White,et al.  Why do we care about evidence synthesis? An introduction to the special issue on systematic reviews , 2012 .

[52]  Dina Demner-Fushman,et al.  Screening nonrandomized studies for medical systematic reviews: A comparative study of classifiers , 2012, Artif. Intell. Medicine.

[53]  Sally Hopewell,et al.  Empty Reviews: A Description and Consideration of Cochrane Systematic Reviews with No Included Studies , 2012, PloS one.

[54]  Ethan M Balk,et al.  A Web-based archive of systematic review data , 2012, Systematic Reviews.

[55]  David Moher,et al.  Evidence summaries: the evolution of a rapid review approach , 2012, Systematic Reviews.

[56]  Carla E. Brodley,et al.  Who Should Label What? Instance Allocation in Multiple Expert Active Learning , 2011, SDM.

[57]  Philip S. Yu,et al.  Evidence-based medicine, the essential role of systematic reviews, and the need for automated text mining tools , 2010, IHI.

[58]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions , 2010, International Coaching Psychology Review.

[59]  Donna Ciliska,et al.  Expediting systematic reviews: methods and implications of rapid reviews , 2010, Implementation science : IS.

[60]  Carla E. Brodley,et al.  Semi-automated screening of biomedical citations for systematic reviews , 2010, BMC Bioinformatics.

[61]  Gary King,et al.  An Introduction to the Dataverse Network as an Infrastructure for Data Sharing , 2007 .

[62]  M. Petticrew,et al.  Systematic Reviews in the Social Sciences: A Practical Guide , 2005 .

[63]  A. Petrosino,et al.  Meeting the Challenges of Evidence-Based Policy: The Campbell Collaboration , 2001 .

[64]  Howard L. Bleich,et al.  Technical Milestone: Medical Subject Headings Used to Search the Biomedical Literature , 2001, J. Am. Medical Informatics Assoc..

[65]  Nila A Sathe,et al.  Searching for studies: a guide to information retrieval for Campbell systematic reviews , 2017 .

[66]  Zachary F. Meisel,et al.  Crowdsourcing—Harnessing the Masses to Advance Health and Medicine, a Systematic Review , 2013, Journal of General Internal Medicine.

[67]  Silver Oliver,et al.  Systematic Reviews as an Interface to the Web of (Trial) Data: using PICO as an Ontology for Knowledge Synthesis in Evidence-based Healthcare Research , 2013, SePublica.

[68]  Mercè Crosas,et al.  The Dataverse Network®: An Open-Source Application for Sharing, Discovering and Preserving Data , 2011, D Lib Mag..

[69]  Cochrane Handbook for Systematic Reviews of Interventions Edited by Julian P. T. Higgins & , 2006 .