Eligibility screening in evidence synthesis of environmental management topics

The eligibility screening step of a systematic review or systematic map (sometimes referred to as ‘study selection’, ‘evidence selection’ or ‘inclusion screening’) determines the scope of the evidence that may answer the review or map question. Eligibility screening involves the development, testing and application of eligibility criteria (inclusion and exclusion criteria) by an evidence synthesis review team, based on methods pre-specified in the review or map protocol. Some parts of the process require judgement, meaning that consistent and transparent reporting of the eligibility criteria and the process for applying them are essential in order to reduce the risk of introducing errors or bias. The existing Collaboration for Environmental Evidence (CEE) Guidelines for Systematic Reviews in Environmental Management (version 4.2, March 2013) give relatively limited guidance on how to conduct eligibility screening. In this paper we provide more in-depth information on good practice methods for this step of evidence synthesis, based on a critical consideration of existing guidance and current practice. Our aim is to provide recommendations to support those conducting CEE systematic reviews or systematic maps for environmental management questions; however, the methods we describe are generic and should be broadly applicable across a wide range of environmental research topics.

[1]  Gábor L. Lövei,et al.  Application of Systematic Review Methodology to Food and Feed Safety Assessments to Support Decision Making , 2010 .

[2]  Sally Hopewell,et al.  PRISMA for Abstracts: Reporting Systematic Reviews in Journal and Conference Abstracts , 2013, PLoS medicine.

[3]  Ruth Stewart,et al.  How stakeholder engagement has led us to reconsider definitions of rigour in systematic reviews , 2017, Environmental Evidence.

[4]  Laura A. Levit,et al.  Finding what works in health care : standards for systematic reviews , 2011 .

[5]  Göran Englund,et al.  The importance of data-selection criteria: meta-analyses of stream predation experiments , 1999 .

[6]  E. Tacconelli Systematic reviews: CRD's guidance for undertaking reviews in health care , 2010 .

[7]  Michele Tarsilla Cochrane Handbook for Systematic Reviews of Interventions , 2010, Journal of MultiDisciplinary Evaluation.

[8]  John P A Ioannidis,et al.  Content area experts as authors: helpful or harmful for systematic reviews and meta-analyses? , 2012, BMJ : British Medical Journal.

[9]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. The Cochrane Collaboration , 2013 .

[10]  M. Petticrew,et al.  Systematic Reviews in the Social Sciences , 2006 .

[11]  A M O'Connor,et al.  Conducting Systematic Reviews of Intervention Questions II: Relevance Screening, Data Extraction, Assessing Risk of Bias, Presenting the Results and Interpreting the Findings , 2014, Zoonoses and public health.

[12]  Helen R. Bayliss,et al.  Information retrieval for ecological syntheses , 2015, Research synthesis methods.

[13]  Neal R. Haddaway,et al.  A methodology for systematic mapping in environmental sciences , 2016, Environmental Evidence.

[14]  Erik von Elm,et al.  Different patterns of duplicate publication: an analysis of articles used in systematic reviews. , 2004, JAMA.

[15]  B. J. Bailey,et al.  Duplicate Publication in the Field of Otolaryngology-Head and Neck Surgery , 2002, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[16]  Kai Petersen,et al.  Identifying Strategies for Study Selection in Systematic Reviews and Maps , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[17]  M. Petticrew,et al.  Systematic Reviews in the Social Sciences: A Practical Guide , 2005 .

[18]  John R. Bucher,et al.  Systematic Review and Evidence Integration for Literature-Based Environmental Health Science Assessments , 2014, Environmental health perspectives.

[19]  J. Ioannidis,et al.  The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration , 2009, BMJ : British Medical Journal.

[20]  Paul Glasziou,et al.  Faster title and abstract screening? Evaluating Abstrackr, a semi-automated online screening program for systematic reviewers , 2015, Systematic Reviews.

[21]  P. Gøtzsche,et al.  Multiple publication of reports of drug trials , 2004, European Journal of Clinical Pharmacology.

[22]  Shannon Robalino,et al.  Systematic searching for environmental evidence using multiple tools and sources , 2017, Environmental Evidence.

[23]  Wen Zhou,et al.  China’s conversion of cropland to forest program: a systematic review of the environmental and socioeconomic effects , 2016, Environmental Evidence.

[24]  Julian P. T. Higgins,et al.  Selecting Studies and Collecting Data , 2008 .

[25]  T. Sunderland,et al.  Are alternative livelihood projects effective at reducing local threats to specified elements of biodiversity and/or improving or maintaining the conservation status of those elements? , 2015, Environmental Evidence.

[26]  Julian Little,et al.  Systematic Reviews of Genetic Association Studies , 2009, PLoS medicine.

[27]  Chul-Min Kim,et al.  Duplicate publication of articles used in meta-analysis in Korea , 2014, SpringerPlus.

[28]  Akers,et al.  Systematic Reviews [ressource électronique]. CRD's guidance for undertaking reviews in health care , 2009 .

[29]  J Glanville,et al.  Applicability and Feasibility of Systematic Review for Performing Evidence-Based Risk Assessment in Food and Feed Safety , 2015, Critical reviews in food science and nutrition.

[30]  Steve Bhimji,et al.  Agency for Healthcare Research and Quality (AHRQ) , 2015 .

[31]  M. Tramèr,et al.  Impact of covert duplicate publication on meta-analysis: a case study , 1997, BMJ.

[32]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions , 2010, International Coaching Psychology Review.

[33]  Wen Zhou,et al.  Socioeconomic and environmental effects of China’s Conversion of Cropland to Forest Program after 15 years: a systematic review protocol , 2015, Environmental Evidence.

[34]  Phil Edwards,et al.  Identification of randomized controlled trials in systematic reviews: accuracy and reliability of screening records , 2002, Statistics in medicine.

[35]  R. Moore,et al.  Oral valdecoxib and injected parecoxib for acute postoperative pain: a quantitative systematic review , 2003, BMC anesthesiology.

[36]  Daniel C. Miller,et al.  What are the environmental impacts of property rights regimes in forests, fisheries and rangelands? , 2017, Environmental Evidence.