Optimal Experimental Design for Mathematical Models of Hematopoiesis

Author(s): Lomeli, Luis Martinez; Iniguez, Abdon; Shahbaba, Babak; Lowengrub, John S; Minin, Vladimir | Abstract: The hematopoietic system has a highly regulated and complex structure in which cells are organized to successfully create and maintain new blood cells. Feedback regulation is crucial to tightly control this system, but the specific mechanisms by which control is exerted are not completely understood. In this work, we aim to uncover the underlying mechanisms in hematopoiesis by conducting perturbation experiments, where animal subjects are exposed to an external agent in order to observe the system response and evolution. Developing a proper experimental design for these studies is an extremely challenging task. To address this issue, we have developed a novel Bayesian framework for optimal design of perturbation experiments. We model the numbers of hematopoietic stem and progenitor cells in mice that are exposed to a low dose of radiation. We use a differential equations model that accounts for feedback and feedforward regulation. A significant obstacle is that the experimental data are not longitudinal, rather each data point corresponds to a different animal. This model is embedded in a hierarchical framework with latent variables that capture unobserved cellular population levels. We select the optimum design based on the amount of information gain, measured by the Kullback-Leibler divergence between the probability distributions before and after observing the data. We evaluate our approach using synthetic and experimental data. We show that a proper design can lead to better estimates of model parameters even with relatively few subjects. Additionally, we demonstrate that the model parameters show a wide range of sensitivities to design options. Our method should allow scientists to find the optimal design by focusing on their specific parameters of interest and provide insight to hematopoiesis. Our approach can be extended to more complex models where latent components are used.

[1]  Babak Shahbaba,et al.  Deep Markov Chain Monte Carlo , 2019, 1910.05692.

[2]  B. Harley,et al.  A computational model of feedback-mediated hematopoietic stem cell differentiation in vitro , 2019, PloS one.

[3]  Peter Guttorp,et al.  Visualizing hematopoiesis as a stochastic process. , 2018, Blood advances.

[4]  R. Staversky,et al.  The Chemokine CCL3 Regulates Myeloid Differentiation and Hematopoietic Stem Cell Numbers , 2018, Scientific Reports.

[5]  F. Jäkel,et al.  A stochastic model of myeloid cell lineages in hematopoiesis and pathway mutations in acute myeloid leukemia , 2018, PLoS ONE.

[6]  J. Mettetal,et al.  Understanding Hematological Toxicities Using Mathematical Modeling , 2018, Clinical pharmacology and therapeutics.

[7]  I. Glauche,et al.  Quantitative prediction of long-term molecular response in TKI-treated CML – Lessons from an imatinib versus dasatinib comparison , 2018, Scientific Reports.

[8]  James M. McGree,et al.  Optimal Bayesian design for discriminating between models with intractable likelihoods in epidemiology , 2018, Comput. Stat. Data Anal..

[9]  Christopher C. Drovandi,et al.  Optimal experimental design for predator–prey functional response experiments , 2018, Journal of The Royal Society Interface.

[10]  P. Tsapogas,et al.  The changing face of hematopoiesis: a spectrum of options is available to stem cells , 2018, Immunology and cell biology.

[11]  Christopher C. Drovandi,et al.  Improving the efficiency of fully Bayesian optimal design of experiments using randomised quasi-Monte Carlo , 2018 .

[12]  G. Scapin,et al.  Tracking the origin, development, and differentiation of hematopoietic stem cells. , 2017, Current opinion in cell biology.

[13]  J. Oden,et al.  Adaptive selection and validation of models of complex systems in the presence of uncertainty , 2017, Research in the Mathematical Sciences.

[14]  David S. Leslie,et al.  A tutorial on bridge sampling , 2017, Journal of mathematical psychology.

[15]  Jiqiang Guo,et al.  Stan: A Probabilistic Programming Language. , 2017, Journal of statistical software.

[16]  Adam L. Maclean,et al.  Concise Review: Stem Cell Population Biology: Insights from Hematopoiesis , 2016, Stem cells.

[17]  Andrew M. Stuart,et al.  Geometric MCMC for infinite-dimensional inverse problems , 2016, J. Comput. Phys..

[18]  Peter Guttorp,et al.  Statistical inference in partially observed stochastic compartmental models with application to cell lineage tracking of in vivo hematopoiesis , 2016 .

[19]  Bruce J. Aronow,et al.  Single-cell analysis of mixed-lineage states leading to a binary cell fate choice , 2016, Nature.

[20]  Thomas Höfer,et al.  Stem-cell dynamics and lineage topology from in vivo fate mapping in the hematopoietic system. , 2016, Current opinion in biotechnology.

[21]  Anthony N. Pettitt,et al.  A Review of Modern Computational Algorithms for Bayesian Optimal Design , 2016 .

[22]  J. DeGregori,et al.  Stochastic modeling reveals an evolutionary mechanism underlying elevated rates of childhood leukemia , 2016, Proceedings of the National Academy of Sciences.

[23]  A. R. Humphries,et al.  A Mathematical Model of Granulopoiesis Incorporating the Negative Feedback Dynamics and Kinetics of G-CSF/Neutrophil Binding and Internalization , 2015, Bulletin of mathematical biology.

[24]  Doreen Eichel,et al.  Data Analysis A Bayesian Tutorial , 2016 .

[25]  Laurent Pujo-Menjouet,et al.  Blood Cell Dynamics: Half of a Century of Modelling , 2016 .

[26]  Tim Holland-Letz,et al.  Fundamental properties of unperturbed haematopoiesis from stem cells in vivo , 2015, Nature.

[27]  Gentian Buzi,et al.  Cell lineage branching as a strategy for proliferative control , 2015, BMC Biology.

[28]  Paul D. W. Kirk,et al.  Model Selection in Systems Biology Depends on Experimental Design , 2014, PLoS Comput. Biol..

[29]  Anthony N. Pettitt,et al.  Towards Bayesian experimental design for nonlinear models that require a large number of sampling times , 2014, Comput. Stat. Data Anal..

[30]  Marek Kimmel,et al.  Stochasticity and determinism in models of hematopoiesis. , 2014, Advances in experimental medicine and biology.

[31]  S. Corey,et al.  A Systems Biology Approach to Blood , 2014, Advances in Experimental Medicine and Biology.

[32]  M. Girolami,et al.  Bayesian Solution Uncertainty Quantification for Differential Equations , 2013 .

[33]  C. Peterson,et al.  Dynamical modelling of haematopoiesis: an integrated view over the system in homeostasis and under perturbation , 2013, Journal of The Royal Society Interface.

[34]  Michael P. H. Stumpf,et al.  Maximizing the Information Content of Experiments in Systems Biology , 2013, PLoS Comput. Biol..

[35]  Xun Huan,et al.  Simulation-based optimal Bayesian experimental design for nonlinear systems , 2011, J. Comput. Phys..

[36]  James M. McGree,et al.  Sequential Monte Carlo for Bayesian sequentially designed experiments for discrete data , 2013, Comput. Stat. Data Anal..

[37]  Axel Krinner,et al.  Merging concepts - coupling an agent-based model of hematopoietic stem cells with an ODE model of granulopoiesis , 2013, BMC Systems Biology.

[38]  P. Guttorp,et al.  BAYESIAN INFERENCE AND MODEL CHOICE IN A HIDDEN STOCHASTIC TWO-COMPARTMENT MODEL OF HEMATOPOIETIC STEM CELL FATE DECISIONS. , 2009, The annals of applied statistics.

[39]  Willi Jäger,et al.  Modeling of asymmetric cell division in hematopoietic stem cells--regulation of self-renewal is essential for efficient repopulation. , 2009, Stem cells and development.

[40]  Q. Nie,et al.  Cell Lineages and the Logic of Proliferative Control , 2009, PLoS biology.

[41]  Neil D. Lawrence,et al.  Accelerating Bayesian Inference over Nonlinear Differential Equations with Gaussian Processes , 2008, NIPS.

[42]  G. Gibson,et al.  Optimal Observation Times in Experimental Epidemic Processes , 2008, Biometrics.

[43]  Arne Traulsen,et al.  Stochastic Dynamics of Hematopoietic Tumor Stem Cells , 2007, Cell cycle.

[44]  Peter Müller,et al.  A Bayesian Decision-Theoretic Dose-Finding Trial , 2006, Decis. Anal..

[45]  P. Guttorp,et al.  Bayesian inference in a hidden stochastic two-compartment model for feline hematopoiesis. , 2006, Mathematical medicine and biology : a journal of the IMA.

[46]  Yalchin Efendiev,et al.  An efficient two‐stage Markov chain Monte Carlo method for dynamic data integration , 2005 .

[47]  Martin A. Nowak,et al.  Dynamics of chronic myeloid leukaemia , 2005, Nature.

[48]  P. Müller.  Simulation Based Optimal Design , 2005 .

[49]  Keisuke Ito,et al.  Tie2/Angiopoietin-1 Signaling Regulates Hematopoietic Stem Cell Quiescence in the Bone Marrow Niche , 2004, Cell.

[50]  Kathryn Chaloner,et al.  Bayesian Experimental Design for Nonlinear Mixed‐Effects Models with Application to HIV Dynamics , 2004, Biometrics.

[51]  Ingo Roeder,et al.  A novel dynamic model of hematopoietic stem cell organization based on the concept of within-tissue plasticity. , 2002, Experimental hematology.

[52]  Eric Jones,et al.  SciPy: Open Source Scientific Tools for Python , 2001 .

[53]  J L Palmer,et al.  Bayesian optimal design in population models for haematologic data. , 1998, Statistics in medicine.

[54]  J. Wuu,et al.  Lymphohematopoietic engraftment in minimally myeloablated hosts. , 1998, Blood.

[55]  Huaiyu Zhu.  On Information and Sufficiency , 1997 .

[56]  L. Skovgaard.  NONLINEAR MODELS FOR REPEATED MEASUREMENT DATA. , 1996 .

[57]  John Skilling,et al.  Data analysis : a Bayesian tutorial , 1996 .

[58]  K. Chaloner,et al.  Bayesian Experimental Design: A Review , 1995 .

[59]  Peter Müller,et al.  Optimal Design via Curve Fitting of Monte Carlo Experiments , 1995 .

[60]  Jon Wakefield,et al.  An Expected Loss Approach to the Design of Dosage Regimens Via Sampling‐Based Methods , 1994 .

[61]  D. W. Scott,et al.  Multivariate Density Estimation, Theory, Practice and Visualization , 1992 .

[62]  D. Lindley.  On a Measure of the Information Provided by an Experiment , 1956 .