A primer on systematic reviews in toxicology

Systematic reviews, pioneered in the clinical field, provide a transparent, methodologically rigorous and reproducible means of summarizing the available evidence on a precisely framed research question. Having matured to a well-established approach in many research fields, systematic reviews are receiving increasing attention as a potential tool for answering toxicological questions. In the larger framework of evidence-based toxicology, the advantages and obstacles of, as well as the approaches for, adapting and adopting systematic reviews to toxicology are still being explored. To provide the toxicology community with a starting point for conducting or understanding systematic reviews, we herein summarized available guidance documents from various fields of application. We have elaborated on the systematic review process by breaking it down into ten steps, starting with planning the project, framing the question, and writing and publishing the protocol, and concluding with interpretation and reporting. In addition, we have identified the specific methodological challenges of toxicological questions and have summarized how these can be addressed. Ultimately, this primer is intended to stimulate scientific discussions of the identified issues to fuel the development of toxicology-specific methodology and to encourage the application of systematic review methodology to toxicological issues.

[1]  2 Guidelines for Systematic Reviews in Environmental Management , 2010 .

[2]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[3]  T. Woodruff,et al.  Instruments for Assessing Risk of Bias and Other Methodological Criteria of Published Animal Studies: A Systematic Review , 2013, Environmental health perspectives.

[4]  M Egger,et al.  Grey literature in meta-analyses of randomized trials of health care interventions. , 2007, The Cochrane database of systematic reviews.

[5]  Wikoff Ds,et al.  The Role of Systematic Review in the Practice of Toxicology and Risk Assessment–An Appreciation for the Primary Tool in Evidence-Based Practice , 2016 .

[6]  J. Higgins Cochrane handbook for systematic reviews of interventions. Version 5.1.0 [updated March 2011]. The Cochrane Collaboration , 2011 .

[7]  P. Glasziou,et al.  Systematic review automation technologies , 2014, Systematic Reviews.

[8]  Nancy Santesso,et al.  GRADE: Assessing the quality of evidence in environmental and occupational health. , 2016, Environment international.

[9]  Tracey J. Woodruff,et al.  The Navigation Guide—Evidence-Based Medicine Meets Environmental Health: Systematic Review of Human Evidence for PFOA Effects on Fetal Growth , 2014, Environmental health perspectives.

[10]  Gábor L. Lövei,et al.  Application of Systematic Review Methodology to Food and Feed Safety Assessments to Support Decision Making , 2010 .

[11]  E. Sena,et al.  Determinants of the Efficacy of Cardiac Ischemic Preconditioning: A Systematic Review and Meta-Analysis of Animal Studies , 2015, PloS one.

[12]  Seema K. Schappelle,et al.  Enhancing the credibility of decisions based on scientific conclusions: transparency is imperative. , 2010, Toxicological sciences : an official journal of the Society of Toxicology.

[13]  Laura A. Levit,et al.  Finding what works in health care : standards for systematic reviews , 2011 .

[14]  Sebastian Hoffmann,et al.  Evidence-based toxicology for the 21st century: opportunities and challenges. , 2013, ALTEX.

[15]  M. Rovers,et al.  Meta-Analyses of Animal Studies: An Introduction of a Valuable Instrument to Further Improve Healthcare , 2014, ILAR journal.

[16]  L. Bero,et al.  The relationship between study sponsorship, risks of bias, and research outcomes in atrazine exposure studies conducted in non-human animals: Systematic review and meta-analysis. , 2016, Environment international.

[17]  M. Meyer-Baron A meta-analytical approach to neurobehavioural effects of occupational toluene exposure. , 2005, Environmental toxicology and pharmacology.

[18]  Michael S Victoroff,et al.  Evidence-based toxicology: a comprehensive framework for causation , 2005, Human & experimental toxicology.

[19]  M. Stephens,et al.  The Usefulness of Systematic Reviews of Animal Experiments for the Design of Preclinical and Clinical Studies , 2014, ILAR journal.

[20]  Linda S. Birnbaum,et al.  Implementing Systematic Review at the National Toxicology Program: Status and Next Steps , 2013, Environmental health perspectives.

[21]  T Hartung,et al.  Toward an evidence-based toxicology , 2006, Human & experimental toxicology.

[22]  Ellen Silbergeld,et al.  Evidence-based toxicology: strait is the gate, but the road is worth taking. , 2013, ALTEX.

[23]  Biljana Macura,et al.  "A little learning is a dangerous thing": A call for better understanding of the term 'systematic review'. , 2017, Environment international.

[24]  Paula I. Johnson,et al.  The Navigation Guide—Evidence-Based Medicine Meets Environmental Health: Integration of Animal and Human Evidence for PFOA Effects on Fetal Growth , 2014, Environmental health perspectives.

[25]  L. Rhomberg,et al.  Hypothesis‐Based Weight of Evidence: An Approach to Assessing Causation and its Application to Regulatory Toxicology , 2015, Risk analysis : an official publication of the Society for Risk Analysis.

[26]  Gillian L. Currie,et al.  Systematic reviews and meta-analysis of preclinical studies: why perform them and how to appraise them critically , 2014, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[27]  Howard Balshem,et al.  GRADE guidelines: 3. Rating the quality of evidence. , 2011, Journal of clinical epidemiology.

[28]  Julie E Goodman,et al.  Rethinking Meta-Analysis: Applications for Air Pollution Data and Beyond , 2015, Risk analysis : an official publication of the Society for Risk Analysis.

[29]  C. Dejong,et al.  Systematic review of ophthalmate as a novel biomarker of hepatic glutathione depletion. , 2013, Clinical nutrition.

[30]  E. S. Senaa,et al.  Meta-analysis of data from animal studies: A practical guide , 2013 .

[31]  G. Guyatt,et al.  GRADE guidelines: a new series of articles in the Journal of Clinical Epidemiology. , 2011, Journal of clinical epidemiology.

[32]  Paula I. Johnson,et al.  The Navigation Guide—Evidence-Based Medicine Meets Environmental Health: Systematic Review of Nonhuman Evidence for PFOA Effects on Fetal Growth , 2014, Environmental health perspectives.

[33]  D. Parker,et al.  Guidance for conducting systematic scoping reviews , 2015, International journal of evidence-based healthcare.

[34]  A. Covaci,et al.  Raising the standard of systematic reviews published in Environment International. , 2016, Environment international.

[35]  D. Levac,et al.  Scoping studies: advancing the methodology , 2010, Implementation science : IS.

[36]  P. Shekelle,et al.  Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement , 2015, Systematic Reviews.

[37]  M. Rovers,et al.  SYRCLE’s risk of bias tool for animal studies , 2014, BMC Medical Research Methodology.

[38]  K M Crofton,et al.  Evaluation of the ToxRTool's ability to rate the reliability of toxicological data for human health hazard assessments. , 2015, Regulatory toxicology and pharmacology : RTP.

[39]  Marlies Leenaars,et al.  The potential of tissue engineering for developing alternatives to animal experiments: a systematic review , 2015, Journal of tissue engineering and regenerative medicine.

[40]  Marlene Ågerstrand,et al.  Implementing systematic review techniques in chemical risk assessment: Challenges, opportunities and recommendations. , 2016, Environment international.

[41]  T. Woodruff,et al.  A Systematic Review and Meta-Analysis of Multiple Airborne Pollutants and Autism Spectrum Disorder , 2016, PloS one.

[42]  John R. Bucher,et al.  Systematic Review and Evidence Integration for Literature-Based Environmental Health Science Assessments , 2014, Environmental health perspectives.

[43]  Sebastian Hoffmann,et al.  Guidance on assessing the methodological and reporting quality of toxicologically relevant studies: A scoping review. , 2016, Environment international.

[44]  S. Lazic,et al.  A call for transparent reporting to optimize the predictive value of preclinical research , 2012, Nature.

[45]  C Rudén,et al.  Interpretations of primary carcinogenicity data in 29 trichloroethylene risk assessments. , 2001, Toxicology.

[46]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. The Cochrane Collaboration , 2013 .

[47]  J. McGowan,et al.  Systematic reviews need systematic searchers. , 2005, Journal of the Medical Library Association : JMLA.

[48]  Sven Ove Hansson,et al.  Bias in toxicology , 2007, Archives of Toxicology.

[49]  Gillian L. Currie,et al.  Meta-analysis of data from animal studies: A practical guide , 2014, Journal of Neuroscience Methods.

[50]  D. Alexander,et al.  Association of low-level arsenic exposure in drinking water with cardiovascular disease: a systematic review and risk assessment. , 2014, Toxicology.

[51]  Sebastian Hoffmann,et al.  The Emergence of Systematic Review in Toxicology , 2016, Toxicological sciences : an official journal of the Society of Toxicology.

[52]  N. Cedergreen Quantifying Synergy: A Systematic Review of Mixture Toxicity Studies within Environmental Toxicology , 2014, PloS one.

[53]  M. Ritskes-Hoitinga,et al.  A Gold Standard Publication Checklist to Improve the Quality of Animal Studies, to Fully Integrate the Three Rs, and to Make Systematic Reviews More Feasible , 2010, Alternatives to laboratory animals : ATLA.

[54]  Marlies Leenaars,et al.  A protocol format for the preparation, registration and publication of systematic reviews of animal intervention studies , 2015 .

[55]  Linda S. Birnbaum,et al.  Intersection of Systematic Review Methodology with the NIH Reproducibility Initiative , 2014, Environmental health perspectives.

[56]  Tracey J. Woodruff,et al.  The Navigation Guide Systematic Review Methodology: A Rigorous and Transparent Method for Translating Environmental Health Science into Better Health Outcomes , 2014, Environmental health perspectives.

[57]  J. Mandel,et al.  Neurobehavioural testing in workers occupationally exposed to lead: systematic review and meta-analysis of publications , 2002, Occupational and environmental medicine.

[58]  J. Marshall,et al.  Evaluating mesenchymal stem cell therapy for sepsis with preclinical meta-analyses prior to initiating a first-in-human trial , 2016, eLife.

[59]  E. Guallar,et al.  Lead Exposure and Cardiovascular Disease—A Systematic Review , 2006, Environmental health perspectives.

[60]  F. Song,et al.  Dissemination and publication of research findings: an updated review of related biases. , 2010, Health technology assessment.

[61]  G. Knapp,et al.  Performance alterations associated with occupational exposure to manganese--a meta-analysis. , 2009, Neurotoxicology.

[62]  Akers,et al.  Systematic Reviews [ressource électronique]. CRD's guidance for undertaking reviews in health care , 2009 .

[63]  I. Cuthill,et al.  Reporting : The ARRIVE Guidelines for Reporting Animal Research , 2010 .

[64]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.