Integrated testing strategies for safety assessments.

Despite the fact that toxicology uses many stand-alone tests, a systematic combination of several information sources very often is required: Examples include: when not all possible outcomes of interest (e.g., modes of action), classes of test substances (applicability domains), or severity classes of effect are covered in a single test; when the positive test result is rare (low prevalence leading to excessive false-positive results); when the gold standard test is too costly or uses too many animals, creating a need for prioritization by screening. Similarly, tests are combined when the human predictivity of a single test is not satisfactory or when existing data and evidence from various tests will be integrated. Increasingly, kinetic information also will be integrated to make an in vivo extrapolation from in vitro data. Integrated Testing Strategies (ITS) offer the solution to these problems. ITS have been discussed for more than a decade, and some attempts have been made in test guidance for regulations. Despite their obvious potential for revamping regulatory toxicology, however, we still have little guidance on the composition, validation, and adaptation of ITS for different purposes. Similarly, Weight of Evidence and Evidence-based Toxicology approaches require different pieces of evidence and test data to be weighed and combined. ITS also represent the logical way of combining pathway-based tests, as suggested in Toxicology for the 21st Century. This paper describes the state of the art of ITS and makes suggestions as to the definition, systematic combination, and quality assurance of ITS.

[1]  W. Slob,et al.  Integration of Probabilistic Exposure Assessment and Probabilistic Hazard Characterization , 2007 .

[2]  T Seidle,et al.  Bringing toxicology into the 21st century: a global call to action. , 2009, Toxicology in vitro : an international journal published in association with BIBRA.

[3]  Thomas Hartung,et al.  Systematic Review of Membrane Components of Gram-Positive Bacteria Responsible as Pyrogens for Inducing Human Monocyte/Macrophage Cytokine Release , 2012, Front. Pharmacol..

[4]  Valérie Zuang,et al.  The Principles of Weight of Evidence Validation of Test Methods and Testing Strategies , 2006, Alternatives to laboratory animals : ATLA.

[5]  Aldert Piersma,et al.  The Practical Application of Three Validated In Vitro Embryotoxicity Tests , 2006, Alternatives to laboratory animals : ATLA.

[6]  Thomas Hartung,et al.  Food for Thought … Systems Toxicology , 2012 .

[7]  Petra S Kern,et al.  Integrating non-animal test information into an adaptive testing strategy - skin sensitization proof of concept case. , 2011, ALTEX.

[8]  Aldert Piersma,et al.  A Review of the Implementation of the Embryonic Stem Cell Test (EST) , 2009, Alternatives to laboratory animals : ATLA.

[9]  Dale Hattis High-throughput testing--the NRC vision, the challenge of modeling dynamic changes in biological systems, and the reality of low-throughput environmental health decision making. , 2009, Risk analysis : an official publication of the Society for Risk Analysis.

[10]  John D. Graham,et al.  Going beyond the single number: Using probabilistic risk assessment to improve risk management , 1996 .

[11]  J. Hengstler,et al.  The REACH concept and its impact on toxicological sciences. , 2006, Toxicology.

[12]  Bas J Blaauboer,et al.  The use of biomarkers of toxicity for integrating in vitro hazard estimates into risk assessment for humans. , 2012, ALTEX.

[13]  Sebastian Hoffmann,et al.  Skin irritation: prevalence, variability, and regulatory classification of existing in vivo data from industrial chemicals. , 2005, Regulatory toxicology and pharmacology : RTP.

[14]  Jonathan J Deeks,et al.  Systematic reviews in health care: Systematic reviews of evaluations of diagnostic and screening tests. , 2001, BMJ.

[15]  Thomas Hartung,et al.  Points of Reference in the Validation Process , 2008, Alternatives to laboratory animals : ATLA.

[16]  Robert Landsiedel,et al.  Non-animal test methods for predicting skin sensitization potentials , 2012, Archives of Toxicology.

[17]  Andrew P. Worth,et al.  Intelligent Testing Strategies , 2007 .

[18]  O. Demin,et al.  The Edinburgh human metabolic network reconstruction and its functional analysis , 2007, Molecular systems biology.

[19]  Igor Goryanin,et al.  The reconstruction and analysis of tissue specific human metabolic networks. , 2012, Molecular bioSystems.

[20]  Chihae Yang,et al.  Novel technologies and an overall strategy to allow hazard assessment and risk prediction of chemicals, cosmetics, and drugs with animal-free methods. , 2012, ALTEX.

[21]  J. Griffin The Cinderella story of metabolic profiling: does metabolomics get to go to the functional genomics ball? , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[22]  Anna Forsby,et al.  Integration of in vitro neurotoxicity data with biokinetic modelling for the estimation of in vivo neurotoxicity , 2007, Human & experimental toxicology.

[23]  Ivan Rusyn,et al.  Predictive modeling of chemical hazard by integrating numerical descriptors of chemical structures and short-term toxicity assay data. , 2012, Toxicological sciences : an official journal of the Society of Toxicology.

[24]  Valérie Zuang,et al.  Report of the EPAA–ECVAM Workshop on the Validation of Integrated Testing Strategies (ITS) , 2012, Alternatives to laboratory animals : ATLA.

[25]  Sven Ove Hansson,et al.  Towards more efficient testing strategies--analyzing the efficiency of toxicity data requirements in relation to the criteria for classification and labelling. , 2008, Regulatory toxicology and pharmacology : RTP.

[26]  E D Kroese,et al.  REACH, non-testing approaches and the urgent need for a change in mind set. , 2009, Regulatory toxicology and pharmacology : RTP.

[27]  J B Houston,et al.  An Integrated Approach to the Prediction of Systemic Toxicity using Computer-based Biokinetic Models and Biological In vitro Test Methods: Overview of a Prevalidation Study Based on the ECITTS Project. , 1999, Toxicology in vitro : an international journal published in association with BIBRA.

[28]  Frauke Stock,et al.  Integrated testing and intelligent assessment—new challenges under REACH , 2008, Environmental science and pollution research international.

[29]  Gordon H Guyatt,et al.  GRADE: grading quality of evidence and strength of recommendations for diagnostic tests and strategies , 2008, BMJ : British Medical Journal.

[30]  Patrick M. M. Bossuyt,et al.  Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy , 2013 .

[31]  Sebastian Hoffmann,et al.  A feasibility study developing an integrated testing strategy assessing skin irritation potential of chemicals. , 2008, Toxicology letters.

[32]  Albrecht Poth,et al.  Implementation challenges for designing integrated in vitro testing strategies (ITS) aiming at reducing and replacing animal experimentation. , 2012, Toxicology in vitro : an international journal published in association with BIBRA.

[33]  Thomas Hartung,et al.  Alternative approaches for medical countermeasures to biological and chemical terrorism and warfare. , 2012, ALTEX.

[34]  Thomas Hartung,et al.  Food for thought ... on alternative methods for cosmetics safety testing. , 2008, ALTEX.

[35]  Sebastian Hoffmann,et al.  Food for thought ... on in silico methods in toxicology. , 2009, ALTEX.

[36]  Emilio Benfenati,et al.  Quantitative consensus of bioaccumulation models for integrated testing strategies. , 2012, Environment international.

[37]  Bas J Blaauboer,et al.  Biokinetic Modeling and in Vitro–in Vivo Extrapolations , 2010, Journal of toxicology and environmental health. Part B, Critical reviews.

[38]  Valérie Zuang,et al.  A Modular Approach to the ECVAM Principles on Test Validity , 2004, Alternatives to laboratory animals : ATLA.

[39]  Thomas Hartung,et al.  A Toxicology for the 21st Century—Mapping the Road Ahead , 2009, Toxicological sciences : an official journal of the Society of Toxicology.

[40]  P. Karp,et al.  Computational prediction of human metabolic pathways from the complete human genome , 2004, Genome Biology.

[41]  Masaru Tomita,et al.  Bioinformatics Tools for Mass Spectroscopy-Based Metabolomic Data Processing and Analysis , 2012, Current bioinformatics.

[42]  A. B. Hill,et al.  "The Environment and Disease: Association or Causation?" (1965), by Austin Bradford Hill , 2017 .

[43]  Thomas Hartung,et al.  Food for thought... on evidence-based toxicology. , 2009, ALTEX.

[44]  Sebastian Hoffmann,et al.  Diagnosis: toxic!--trying to apply approaches of clinical diagnostics and prevalence in toxicology considerations. , 2005, Toxicological sciences : an official journal of the Society of Toxicology.

[45]  T. Hartung Toxicology for the twenty-first century , 2009, Nature.

[46]  Michael Schwarz,et al.  The integrated project ReProTect: a novel approach in reproductive toxicity hazard assessment. , 2005, Reproductive toxicology.

[47]  Liang Zhao,et al.  Mapping the human toxome by systems toxicology. , 2014, Basic & clinical pharmacology & toxicology.

[48]  T J Vecchio,et al.  Predictive value of a single diagnostic test in unselected populations. , 1966, The New England journal of medicine.

[49]  Silke Gabbert,et al.  Towards optimization of chemical testing under REACH: a Bayesian network approach to Integrated Testing Strategies. , 2010, Regulatory toxicology and pharmacology : RTP.

[50]  T Hartung,et al.  Toward an evidence-based toxicology , 2006, Human & experimental toxicology.

[51]  Victor M Montori,et al.  Conducting systematic reviews of diagnostic studies: didactic guidelines , 2002, BMC medical research methodology.

[52]  Cyrille Krul,et al.  Toxicology in the 21st century--working our way towards a visionary reality. , 2011, Toxicology in vitro : an international journal published in association with BIBRA.

[53]  J B Houston,et al.  The Integrated Use of Alternative Methods in Toxicological Risk Evaluation , 1999, Alternatives to laboratory animals : ATLA.

[54]  Silke Gabbert,et al.  Cost-Effectiveness Analysis of Chemical Testing for Decision-Support: How to Include Animal Welfare? , 2010 .

[55]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[56]  Bernhard O. Palsson,et al.  The human metabolic reconstruction Recon 1 directs hypotheses of novel human metabolic functions , 2011, BMC Systems Biology.

[57]  Helmut Segner,et al.  The use of Mechanisms and Modes of Toxic Action in Integrated Testing Strategies: The Report and Recommendations of a Workshop held as part of the European Union OSIRIS Integrated Project , 2009, Alternatives to laboratory animals : ATLA.

[58]  David Kirkland,et al.  Evaluation of the ability of a battery of three in vitro genotoxicity tests to discriminate rodent carcinogens and non-carcinogens III. Appropriate follow-up testing in vivo. , 2005, Mutation research.

[59]  Donald G Robertson,et al.  Metabolomics in toxicology: preclinical and clinical applications. , 2011, Toxicological sciences : an official journal of the Society of Toxicology.

[60]  M. Pavan,et al.  The role of the European Chemicals Bureau in promoting the regulatory use of (Q)SAR methods , 2007, SAR and QSAR in environmental research.

[61]  Andrew Worth,et al.  Overcoming Barriers to Validation of Non-animal Partial Replacement Methods/Integrated Testing Strategies: The Report of an EPAA–ECVAM Workshop , 2009, Alternatives to laboratory animals : ATLA.

[62]  Catherine E Willett,et al.  Application of an integrated testing strategy to the U.S. EPA endocrine disruptor screening program. , 2011, Toxicological sciences : an official journal of the Society of Toxicology.

[63]  Thomas Hartung,et al.  "ToxRTool", a new tool to assess the reliability of toxicological data. , 2009, Toxicology letters.

[64]  George Sugihara,et al.  Detecting Causality in Complex Ecosystems , 2012, Science.

[65]  Erwin van Vliet,et al.  Current standing and future prospects for the technologies proposed to transform toxicity testing in the 21st century. , 2011 .

[66]  T. Hartung Evidence-based toxicology - the toolbox of validation for the 21st century? , 2010, ALTEX.

[67]  Theo Vermeire,et al.  Risk assessment of chemicals , 2021, Bioanalytical Tools in Water Quality Assessment.

[68]  B J Blaauboer,et al.  An alternative approach for the safety evaluation of new and existing chemicals, an exercise in integrated testing. , 2005, Regulatory toxicology and pharmacology : RTP.

[69]  Valérie Zuang,et al.  Alternative (non-animal) methods for cosmetics testing: current status and future prospects—2010 , 2011, Archives of Toxicology.

[70]  Hilda Witters,et al.  The ReProTect Feasibility Study, a novel comprehensive in vitro approach to detect reproductive toxicants. , 2010, Reproductive toxicology.

[71]  Michael Balls,et al.  Integrated Testing Strategies for Toxicity Employing New and Existing Technologies , 2011, Alternatives to laboratory animals : ATLA.

[72]  Silke Gabbert,et al.  Quo vadis integrated testing strategies? Experiences and observations from the work floor , 2012 .

[73]  Sebastian Hoffmann,et al.  Integrated Testing Strategy (ITS) - Opportunities to better use existing data and guide future testing in toxicology. , 2010, ALTEX.

[74]  Thomas Hartung,et al.  Food for Thought ... on mapping the human toxome. , 2011, ALTEX.

[75]  Watze de Wolf,et al.  Animal Use Replacement, Reduction, and Refinement: Development of an Integrated Testing Strategy for Bioconcentration of Chemicals in Fish , 2007 .

[76]  Patrick Bossuyt,et al.  Systematic Reviews of Diagnostic Test Accuracy , 2008, Annals of Internal Medicine.

[77]  Andrea E M Seiler,et al.  The validated embryonic stem cell test to predict embryotoxicity in vitro , 2011, Nature Protocols.

[78]  T. Knudsen,et al.  A roadmap for the development of alternative (non-animal) methods for systemic toxicity testing. , 2012, ALTEX.

[79]  Thomas Hartung,et al.  Lessons Learned from Alternative Methods and their Validation for a New Toxicology in the 21st Century , 2010, Journal of toxicology and environmental health. Part B, Critical reviews.

[80]  J. S. Jaworska,et al.  Chapter 22:Multiple Test In Silico Weight-of-Evidence for Toxicological Endpoints , 2010 .

[81]  T. Hartung Food for thought ... on validation. , 2007, ALTEX.

[82]  Thomas Hartung,et al.  Comparative analysis of the revised Directive 2010/63/EU for the protection of laboratory animals with its predecessor 86/609/EEC - a t4 report. , 2010, ALTEX.

[83]  Nicola J Hewitt,et al.  A tiered approach to the use of alternatives to animal testing for the safety assessment of cosmetics: skin irritation. , 2009, Regulatory toxicology and pharmacology : RTP.