Integrated Testing Strategy (ITS) - Opportunities to better use existing data and guide future testing in toxicology.

The topic of Integrated Testing Strategies (ITS) has attracted considerable attention, and not only because it is supposed to be a central element of REACH, the ambitious European chemical regulation effort. Although what ITSs are supposed to do seems unambiguous, i.e. speeding up hazard and risk assessment while reducing testing costs, not much has been said, except basic conceptual proposals, about the methodologies that would allow execution of these concepts. Although a pressing concern, the topic of ITS has drawn mostly general reviews, broad concepts, and the expression of a clear need for more research on ITS. Published research in the field remains scarce. Solutions for ITS design emerge slowly, most likely due to the methodological challenges of the task, and perhaps also to it its complexity and the need for multidisciplinary collaboration. Along with the challenge, ITS offer a unique opportunity to contribute to the Toxicology of the 21st century by providing frameworks and tools to actually implement 21st century toxicology data in the chemical management and decision making processes. Further, ITS have the potential to significantly contribute to a modernization of the science of risk assessment. Therefore, to advance ITS research we propose a methodical approach to their design and will discuss currently available approaches as well as challenges to overcome. To this end, we define a framework for ITS that will inform toxicological decisions in a systematic, transparent, and consistent way. We review conceptual requirements for ITS developed earlier and present a roadmap to an operational framework that should be probabilistic, hypothesis-driven, and adaptive. Furthermore, we define properties an ITS should have in order to meet the identified requirements and differentiate them from evidence synthesis. Making use of an ITS for skin sensitization, we demonstrate how the proposed ITS concepts can be implemented.

[1]  Theo Vermeire,et al.  Risk assessment of chemicals , 2021, Bioanalytical Tools in Water Quality Assessment.

[2]  B J Blaauboer,et al.  An alternative approach for the safety evaluation of new and existing chemicals, an exercise in integrated testing. , 2005, Regulatory toxicology and pharmacology : RTP.

[3]  S Hoffmann 1.2 Aspects of test assessment , 2009, Human & experimental toxicology.

[4]  Silke Gabbert,et al.  Towards optimization of chemical testing under REACH: a Bayesian network approach to Integrated Testing Strategies. , 2010, Regulatory toxicology and pharmacology : RTP.

[5]  Martin Kuiper,et al.  Biological knowledge management: the emerging role of the Semantic Web technologies , 2009, Briefings Bioinform..

[6]  M S Pepe,et al.  Using a combination of reference tests to assess the accuracy of a new diagnostic test. , 1999, Statistics in medicine.

[7]  Pat McInturff,et al.  Modelling risk when binary outcomes are subject to error , 2004, Statistics in medicine.

[8]  D. Cook,et al.  Systematic Reviews: Synthesis of Best Evidence for Clinical Decisions , 1997, Annals of Internal Medicine.

[9]  Sac-fry Stages,et al.  OECD GUIDELINE FOR TESTING OF CHEMICALS , 2002 .

[10]  Thomas Hartung,et al.  Food for thought... on evidence-based toxicology. , 2009, ALTEX.

[11]  Sebastian Hoffmann,et al.  Diagnosis: toxic!--trying to apply approaches of clinical diagnostics and prevalence in toxicology considerations. , 2005, Toxicological sciences : an official journal of the Society of Toxicology.

[12]  Ludwig A Hothorn Selected Biostatistical Aspects of the Validation of In Vitro Toxicological Assays , 2002, Alternatives to laboratory animals : ATLA.

[13]  M. Pepe The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[14]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[15]  G. Smith,et al.  Meta-analysis: Potentials and promise , 1997, BMJ.

[16]  N. Meinshausen Hierarchical testing of variable importance , 2008 .

[17]  Ingrid Gerner,et al.  Weight factors in an Integrated Testing Strategy using adjusted OECD principles for (Q)SARs and extended Klimisch codes to decide on skin irritation classification. , 2010, Regulatory toxicology and pharmacology : RTP.

[18]  Elie Sanchez,et al.  Fuzzy Logic and the Semantic Web , 2005 .

[19]  Emanuela Gadaleta,et al.  Online resources of cancer data: barriers, benefits and lessons , 2011, Briefings Bioinform..

[20]  Michael St J Warne,et al.  Evaluation of Criteria Used to Assess the Quality of Aquatic Toxicity Data , 2005, Integrated environmental assessment and management.

[21]  P. Bossuyt,et al.  Evaluation of diagnostic tests when there is no gold standard. A review of methods. , 2007, Health technology assessment.

[22]  Martin Posch,et al.  Post hoc power estimation in large-scale multiple testing problems , 2010, Bioinform..

[23]  T. Hartung Evidence-based toxicology - the toolbox of validation for the 21st century? , 2010, ALTEX.

[24]  D. Weed Weight of Evidence: A Review of Concept and Methods , 2005, Risk analysis : an official publication of the Society for Risk Analysis.

[25]  Pantelis Sopasakis,et al.  Collaborative development of predictive toxicology applications , 2010, J. Cheminformatics.

[26]  E D Kroese,et al.  REACH, non-testing approaches and the urgent need for a change in mind set. , 2009, Regulatory toxicology and pharmacology : RTP.

[27]  Johannes B. Reitsma,et al.  A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard. , 2009, Journal of clinical epidemiology.

[28]  Jingtai Han Understanding biological functions through molecular networks , 2008, Cell Research.

[29]  George Davey Smith,et al.  Meta-analysis: Beyond the grand mean? , 1997, BMJ.

[30]  C Rudén,et al.  The use and evaluation of primary data in 29 trichloroethylene carcinogen risk assessments. , 2001, Regulatory toxicology and pharmacology : RTP.

[31]  Arthur D Lander,et al.  The edges of understanding , 2010, BMC Biology.

[32]  C. Rao,et al.  Control, exploitation and tolerance of intracellular noise , 2002, Nature.

[33]  Seema K. Schappelle,et al.  Enhancing the credibility of decisions based on scientific conclusions: transparency is imperative. , 2010, Toxicological sciences : an official journal of the Society of Toxicology.

[34]  M. Pavan,et al.  The role of the European Chemicals Bureau in promoting the regulatory use of (Q)SAR methods , 2007, SAR and QSAR in environmental research.

[35]  Sebastian Hoffmann,et al.  A feasibility study developing an integrated testing strategy assessing skin irritation potential of chemicals. , 2008, Toxicology letters.

[36]  William W. Thompson,et al.  Utility of Composite Reference Standards and Latent Class Analysis in Evaluating the Clinical Accuracy of Diagnostic Tests for Pertussis , 2007, Clinical and Vaccine Immunology.

[37]  Ryan Thompson,et al.  A New Quality Assurance System for the Evaluation of Ecotoxicity Studies Submitted Under the New Substances Notification Regulations in Canada , 2009, Integrated environmental assessment and management.

[38]  Dawei Hong,et al.  Signal propagation in small-world biological networks with weak noise. , 2010, Journal of theoretical biology.

[39]  Robert J Kavlock,et al.  Computational toxicology--a state of the science mini review. , 2008, Toxicological sciences : an official journal of the Society of Toxicology.

[40]  Emilio Benfenati,et al.  Comparing In Vivo, In Vitro and In Silico Methods and Integrated Strategies for Chemical Assessment: Problems and Prospects , 2010, Alternatives to laboratory animals : ATLA.

[41]  M. Tanner,et al.  Gibbs posterior for variable selection in high-dimensional classification and data mining , 2008, 0810.5655.

[42]  Thomas Hartung,et al.  "ToxRTool", a new tool to assess the reliability of toxicological data. , 2009, Toxicology letters.

[43]  Anne-Laure Boulesteix,et al.  Over-optimism in bioinformatics research , 2010, Bioinform..

[44]  Matthew A. Hibbs,et al.  Finding function: evaluation methods for functional genomic data , 2006, BMC Genomics.

[45]  Tom Brijs,et al.  COMPARING COMPLETE AND PARTIAL CLASSIFICATION FOR IDENTIFYING CUSTOMERS AT RISK , 2003 .

[46]  Melvin E Andersen,et al.  Toxicity testing in the 21st century: bringing the vision to life. , 2009, Toxicological sciences : an official journal of the Society of Toxicology.

[47]  Sir,et al.  Opinion on the usefulness of in vitro data for human risk assessment. Suggestions for better use of non-testing approaches , 2009 .

[48]  Gilles Blanchard,et al.  Adaptive FDR control under independence and dependence , 2007, 0707.0536.

[49]  Claes Enùea,et al.  Estimation of sensitivity and specificity of diagnostic tests and disease prevalence when the true disease state is unknown , 2000 .

[50]  Nikola Kasabov,et al.  Evolving ontologies for intelligent decision support , 2006, Fuzzy Logic and the Semantic Web.

[51]  Wen-Chung Lee,et al.  Incorporating prior knowledge to facilitate discoveries in a genome-wide association study on age-related macular degeneration , 2010, BMC Research Notes.

[52]  Ivan Bratko,et al.  Qualitatively Faithful Quantitative Prediction , 2003, IJCAI.

[53]  W. Wu,et al.  On false discovery control under dependence , 2008, 0803.1971.

[54]  Valérie Zuang,et al.  A proposed eye irritation testing strategy to reduce and replace in vivo studies using Bottom-Up and Top-Down approaches. , 2010, Toxicology in vitro : an international journal published in association with BIBRA.

[55]  Samuel Kaski,et al.  Probabilistic retrieval and visualization of biologically relevant microarray experiments , 2009, Bioinform..

[56]  Frauke Stock,et al.  Integrated testing and intelligent assessment—new challenges under REACH , 2008, Environmental science and pollution research international.

[57]  Wesley O Johnson,et al.  Sample size determination for estimation of the accuracy of two conditionally independent tests in the absence of a gold standard. , 2005, Preventive veterinary medicine.

[58]  Lincoln Stein,et al.  Reactome knowledgebase of human biological pathways and processes , 2008, Nucleic Acids Res..

[59]  T Hartung,et al.  Toward an evidence-based toxicology , 2006, Human & experimental toxicology.

[60]  U. Tillmann,et al.  A systematic approach for evaluating the quality of experimental toxicological and ecotoxicological data. , 1997, Regulatory toxicology and pharmacology : RTP.

[61]  J. Knottnerus,et al.  Assessment of the accuracy of diagnostic tests: the cross-sectional study. , 2003, Journal of clinical epidemiology.

[62]  Sven Ove Hansson,et al.  Towards a theory of tiered testing. , 2007, Regulatory toxicology and pharmacology : RTP.

[63]  Torsten Hothorn,et al.  Testing the additional predictive value of high-dimensional molecular data , 2010, BMC Bioinformatics.

[64]  A. Horvath,et al.  Systematic reviews in laboratory medicine: principles, processes and practical considerations. , 2004, Clinica chimica acta; international journal of clinical chemistry.

[65]  Anne-Laure Boulesteix,et al.  Optimal classifier selection and negative bias in error rate estimation: an empirical study on high-dimensional prediction , 2009, BMC medical research methodology.

[66]  S. Bradbury,et al.  Meeting the scientific needs of ecological risk assessment in a regulatory context. , 2004, Environmental science & technology.

[67]  Nancy A. Obuchowski,et al.  Methods for Correcting Imperfect Gold Standard Bias , 2008 .

[68]  J. Hengstler,et al.  The REACH concept and its impact on toxicological sciences. , 2006, Toxicology.

[69]  Andrew P. Worth,et al.  Intelligent Testing Strategies , 2007 .

[70]  Hong-Gee Kim,et al.  Visualizing a Dynamic Knowledge Map Using Semantic Web Technology , 2002, EDCIS.

[71]  Thomas Hartung,et al.  Points of Reference in the Validation Process , 2008, Alternatives to laboratory animals : ATLA.

[72]  Barend Mons,et al.  Online tools to support literature-based discovery in the life sciences , 2005, Briefings Bioinform..