Chapter 4 – Validation methodologies

This chapter provides an overview of techniques applied for validating drug sensitivity prediction models. We first discuss the fitness measures such as normalized root mean square error, correlation coefficient, and Akaike Information Criterion, followed by a description of sample selection techniques for model accuracy estimation. The penultimate section deals with small sample issues along with a study of NCI-DREAM drug sensitivity data and Cancer Cell Line Encyclopedia data to explore the bias and variance of various error estimation techniques. The final section of this chapter discusses various in vitro and in vivo experimental models used for validating drug sensitivity predictions.

[1]  J. Castell,et al.  Liver cell culture techniques. , 2009, Methods in molecular biology.

[2]  B. Ljung,et al.  Cell dissociation techniques in human breast cancer — Variations in tumor cell viability and DNA ploidy , 1989, Breast Cancer Research and Treatment.

[3]  Amanda Capes-Davis,et al.  Check your cultures! A list of cross‐contaminated or misidentified cell lines , 2010, International journal of cancer.

[4]  L. Mishra,et al.  Technologies for deriving primary tumor cells for use in personalized cancer therapy. , 2013, Trends in biotechnology.

[5]  K. Lindblad-Toh,et al.  The dog as a cancer model , 2006, Nature Biotechnology.

[6]  Martin L Yarmush,et al.  Three-dimensional primary hepatocyte culture in synthetic self-assembling peptide hydrogel. , 2008, Tissue engineering. Part A.

[7]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[8]  A. Carroll,et al.  The SCID mouse mutant: definition, characterization, and potential uses. , 1991, Annual review of immunology.

[9]  H. Akaike.  A new look at the statistical model identification , 1974 .

[10]  Karlyne M. Reilly,et al.  Genetically engineered mouse models in cancer research. , 2010, Advances in cancer research.

[11]  M. Kendall.  A NEW MEASURE OF RANK CORRELATION , 1938 .

[12]  T. Mitaka.  The current status of primary hepatocyte culture , 1998, International journal of experimental pathology.

[13]  Genee Y. Lee,et al.  The morphologies of breast cancer cell lines in three‐dimensional assays correlate with their profiles of gene expression , 2007, Molecular oncology.

[14]  B. Efron.  Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation , 1983 .

[15]  M. Capecchi,et al.  Site-directed mutagenesis by gene targeting in mouse embryo-derived stem cells , 1987, Cell.

[16]  R. Dickson,et al.  Explant-cell culture of primary mammary tumors from MMTV-c-Myc transgenic mice , 2004, In Vitro Cellular & Developmental Biology - Animal.

[17]  Ho Lee.  Genetically Engineered Mouse Models for Drug Development and Preclinical Trials , 2014, Biomolecules & therapeutics.

[18]  H. Kleinman,et al.  Enhanced tumor growth of both primary and established human and murine tumor cells in athymic mice after coinjection with Matrigel. , 1991, Journal of the National Cancer Institute.

[19]  Edward R. Dougherty,et al.  Is cross-validation valid for small-sample microarray classification? , 2004, Bioinform..

[20]  Nci Dream Community.  A community effort to assess and improve drug sensitivity prediction algorithms , 2014 .

[21]  H. Fiebig,et al.  Correlation of drug response in patients and in the clonogenic assay with solid human tumour xenografts. , 1990, European journal of cancer.

[22]  R. Prather,et al.  A Genetic Porcine Model of Cancer , 2015, PloS one.

[23]  Tobias Schmelzle,et al.  Engineering tumors with 3D scaffolds , 2007, Nature Methods.

[24]  Jean-Pierre Gillet,et al.  Redefining the relevance of established cancer cell lines to the study of mechanisms of clinical anti-cancer drug resistance , 2011, Proceedings of the National Academy of Sciences.

[25]  N. Parajuli,et al.  Precision-cut slice cultures of tumors from MMTV-neu mice for the study of the ex vivo response to cytokines and cytotoxic drugs , 2009, In Vitro Cellular & Developmental Biology - Animal.

[26]  S. Flanagan,et al.  'Nude', a new hairless gene with pleiotropic effects in the mouse. , 1966, Genetical research.

[27]  F H Ruddle,et al.  Genetic transformation of mouse embryos by microinjection of purified DNA. , 1980, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Adam A. Margolin,et al.  The Cancer Cell Line Encyclopedia enables predictive modeling of anticancer drug sensitivity , 2012, Nature.

[29]  C. Willmott,et al.  Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance , 2005 .

[30]  M. O'hare,et al.  Three-dimensional in vitro tissue culture models of breast cancer — a review , 2004, Breast Cancer Research and Treatment.

[31]  B. Efron.  Bootstrap Methods: Another Look at the Jackknife , 1979 .

[32]  H. Parkes,et al.  The costs of using unauthenticated, over-passaged cell lines: how much more data do we need? , 2007, BioTechniques.

[33]  Ranadip Pal,et al.  S1: Supplementary Information for Article: A copula based S1: Supplementary Information for Article: A copula based approach for design of multivariate random forests for drug approach for design of multivariate random forests for drug sensitivity prediction sensitivity prediction , 2015 .

[34]  A. Richmond,et al.  Mouse xenograft models vs GEM models for human cancer therapeutics , 2008, Disease Models & Mechanisms.

[35]  C. Harris,et al.  SOME EFFECTS OF EDTA AND TETRAPHENYLBORON ON THE ULTRASTRUCTURE OF MITOCHONDRIA IN MOUSE LIVER CELLS , 1966, The Journal of cell biology.

[36]  Ranadip Pal,et al.  A new approach for prediction of tumor sensitivity to targeted drugs based on functional data , 2013, BMC Bioinformatics.

[37]  M. Christian,et al.  Relationships between drug activity in NCI preclinical in vitro and in vivo models and early clinical trials , 2001, British Journal of Cancer.

[38]  John R. W. Masters,et al.  Human cancer cell lines: fact and fantasy , 2000, Nature Reviews Molecular Cell Biology.

[39]  M. Yliperttula,et al.  Peptide nanofiber hydrogel induces formation of bile canaliculi structures in three-dimensional hepatic cell culture. , 2012, Tissue engineering. Part A.

[40]  E. Holland,et al.  Genetically engineered models have advantages over xenografts for preclinical studies. , 2006, Cancer research.

[41]  R. Pal,et al.  An Ensemble Based Top Performing Approach for NCI-DREAM Drug Sensitivity Prediction Challenge , 2014, PloS one.

[42]  Francis S. Collins,et al.  Fixing problems with cell lines , 2014, Science.

[43]  R. Jaenisch,et al.  Generating genetically modified mice using CRISPR/Cas-mediated genome engineering , 2014, Nature Protocols.

[44]  Peter J Houghton,et al.  Establishment of human tumor xenografts in immunodeficient mice , 2007, Nature Protocols.

[45]  H. Varmus,et al.  Regulation of transgenes in three-dimensional cultures of primary mouse mammary cells demonstrates oncogene dependence and identifies cells that survive deinduction. , 2009, Genes & development.