Estimation methods for heterogeneous cell population models in systems biology

Heterogeneity among individual cells is a characteristic and relevant feature of living systems. A range of experimental techniques to investigate this heterogeneity is available, and multiple modelling frameworks have been developed to describe and simulate the dynamics of heterogeneous populations. Measurement data are used to adjust computational models, which results in parameter and state estimation problems. Methods to solve these estimation problems need to take the specific properties of data and models into account. The aim of this review is to give an overview on the state of the art in estimation methods for heterogeneous cell population data and models. The focus is on models based on the population balance equation, but stochastic and individual-based models are also discussed. It starts with a brief discussion of common experimental approaches and types of measurement data that can be obtained in this context. The second part describes computational modelling frameworks for heterogeneous populations and the types of estimation problems occurring for these models. The third part starts with a discussion of observability and identifiability properties, after which the computational methods to solve the various estimation problems are described.

[1]  J. Ulrich,et al.  Process Control Using Advanced Particle Analyzing Systems: Applications from Crystallization to Fermentation Processes , 2014 .

[2]  Alan S. Perelson,et al.  Estimating division and death rates from CFSE data , 2005 .

[3]  Frank Allgöwer,et al.  An inverse problem of tomographic type in population dynamics , 2014, 53rd IEEE Conference on Decision and Control.

[4]  Ingo Röder,et al.  Stem Cell Proliferation and Quiescence—Two Sides of the Same Coin , 2009, PLoS Comput. Biol..

[5]  P. Daoutidis,et al.  Numerical solution of multi-variable cell population balance models. II. Spectral methods , 2001 .

[6]  Andreas Bück,et al.  Numerical simulation of particulate processes for control and estimation by spectral methods , 2012 .

[7]  M Bergeron,et al.  Principles of flow cytometry. , 1995, Transfusion science.

[8]  Reinhart Heinrich,et al.  Effect of cellular interaction on glycolytic oscillations in yeast: a theoretical investigation , 2000 .

[9]  Matthias Reuss,et al.  Cell population modelling of yeast glycolytic oscillations. , 2002, The Biochemical journal.

[10]  Francis J. Doyle,et al.  A feasible solution technique for higher-dimensional population balance models , 2007, Comput. Chem. Eng..

[11]  Frank Allgöwer,et al.  Analysis of heterogeneous cell populations: A density-based modeling and identification framework , 2011 .

[12]  João Pedro Hespanha,et al.  Approximate Moment Dynamics for Chemically Reacting Systems , 2011, IEEE Transactions on Automatic Control.

[13]  Carmen G. Moles,et al.  Parameter estimation in biochemical pathways: a comparison of global optimization methods. , 2003, Genome research.

[14]  Frank Allgöwer,et al.  Identifiability of population models via a measure theoretical approach , 2014 .

[15]  Jan Hasenauer,et al.  Analysis of CFSE time-series data using division-, age- and label-structured population models , 2016, Bioinform..

[16]  A. Schmid,et al.  Single-cell analysis in biotechnology, systems biology, and biocatalysis. , 2012, Annual review of chemical and biomolecular engineering.

[17]  Robert Frysch,et al.  A numerical evaluation of state reconstruction methods for heterogeneous cell populations , 2015, 2015 European Control Conference (ECC).

[18]  K. Zygourakis,et al.  Single-cell behavior and population heterogeneity: solving an inverse problem to compute the intrinsic physiological state functions. , 2012, Journal of biotechnology.

[19]  C. Gillespie.  Moment-closure approximations for mass-action models. , 2009, IET systems biology.

[20]  Frank Delvigne,et al.  Metabolic variability in bioprocessing: implications of microbial phenotypic heterogeneity. , 2014, Trends in biotechnology.

[21]  D Hasenclever,et al.  A novel view on stem cell development: analysing the shape of cellular genealogies , 2009, Cell proliferation.

[22]  Dirk Drasdo,et al.  Individual-based and continuum models of growing cell populations: a comparison , 2009, Journal of mathematical biology.

[23]  Andreas Milias-Argeitis,et al.  Parameter inference for stochastic single-cell dynamics from lineage tree data , 2017, BMC Systems Biology.

[24]  Jan Hasenauer,et al.  A Hierarchical, Data-Driven Approach to Modeling Single-Cell Populations Predicts Latent Causes of Cell-To-Cell Variability. , 2018, Cell systems.

[25]  Eli R. Zunder,et al.  Highly multiplexed simultaneous detection of RNAs and proteins in single cells , 2016, Nature Methods.

[26]  Frank Delvigne,et al.  Real-time monitoring of cell viability and cell density on the basis of a three dimensional optical reflectance method (3D-ORM): investigation of the effect of sub-lethal and lethal injuries , 2013, Journal of Industrial Microbiology & Biotechnology.

[27]  Olivier Burri,et al.  Automated analysis of single stem cells in microfluidic traps. , 2012, Lab on a chip.

[28]  Nikos V Mantzaris,et al.  Stochastic and deterministic simulations of heterogeneous cell population dynamics. , 2006, Journal of theoretical biology.

[29]  Doraiswami Ramkrishna,et al.  Statistical models of cell populations , 1979 .

[30]  Francis J. Doyle,et al.  Inverse problems in population balances: Growth and nucleation from dynamic data , 2002 .

[31]  Wolfgang Wiechert,et al.  Homogenizing bacterial cell factories: Analysis and engineering of phenotypic heterogeneity. , 2017, Metabolic engineering.

[32]  Ramon Grima,et al.  Approximation and inference methods for stochastic biochemical kinetics—a tutorial review , 2016, 1608.06582.

[33]  Mads Kærn,et al.  A chance at survival: gene expression noise and phenotypic diversification strategies , 2009, Molecular microbiology.

[34]  Dirk Roose,et al.  Numerical modelling of label-structured cell population growth using CFSE distribution data , 2007, Theoretical Biology and Medical Modelling.

[35]  Robert J. Gillies,et al.  Multiscale Modelling of Vascular Tumour Growth in 3D: The Roles of Domain Size and Boundary Conditions , 2011, PloS one.

[36]  Boris Barbour,et al.  Functional antigen-independent synapses formed between T cells and dendritic cells , 2001, Nature Immunology.

[37]  P. Hodgkin,et al.  A model of immune regulation as a consequence of randomized lymphocyte division and death times , 2007, Proceedings of the National Academy of Sciences.

[38]  M M Ataai,et al.  Simulation of CFSTR through development of a mathematical model for anaerobic growth of Escherichia coli cell population , 1985, Biotechnology and bioengineering.

[39]  L. Landweber.  An iteration formula for Fredholm integral equations of the first kind , 1951 .

[40]  P. Swain,et al.  Intrinsic and extrinsic contributions to stochasticity in gene expression , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[41]  Tao Li.  The Chemical Langevin Equation for Complex Reactions. , 2020, The journal of physical chemistry. A.

[42]  T. Hashimshony,et al.  CEL-Seq: single-cell RNA-Seq by multiplexed linear amplification. , 2012, Cell reports.

[43]  Marie Doumic,et al.  A Structured Population Model of Cell Differentiation , 2010, SIAM J. Appl. Math..

[44]  Carsten Marr,et al.  Analysis of Cell Lineage Trees by Exact Bayesian Inference Identifies Negative Autoregulation of Nanog in Mouse Embryonic Stem Cells. , 2016, Cell systems.

[45]  M. Richmond,et al.  Rate of growth of Bacillus cereus between divisions. , 1962, Journal of general microbiology.

[46]  Frank Allgöwer,et al.  Pain modulators regulate the dynamics of PKA-RII phosphorylation in subgroups of sensory neurons , 2014, Journal of Cell Science.

[47]  M. A. Henson,et al.  A molecular model for intercellular synchronization in the mammalian circadian clock. , 2007, Biophysical journal.

[48]  Frank Allgöwer,et al.  Ensemble Observability of Linear Systems , 2015, IEEE Transactions on Automatic Control.

[49]  Karen Sachs,et al.  Multiplexed mass cytometry profiling of cellular states perturbed by small-molecule regulators , 2012, Nature Biotechnology.

[50]  A. van Oudenaarden,et al.  Single-cell sequencing reveals dissociation-induced gene expression in tissue subpopulations , 2017, Nature Methods.

[51]  Zackary R. Kenz,et al.  A review of selected techniques in inverse problem nonparametric probability distribution estimation , 2012 .

[52]  Steffen Waldherr,et al.  Dynamic Density Estimation in Heterogeneous Cell Populations , 2018, IEEE Control Systems Letters.

[53]  Rajan P Kulkarni,et al.  Advances in high-throughput single-cell microtechnologies. , 2014, Current opinion in biotechnology.

[54]  Yan Zhang,et al.  Reconciling Estimates of Cell Proliferation from Stable Isotope Labeling Experiments , 2015, PLoS Comput. Biol..

[55]  D. Gillespie.  A rigorous derivation of the chemical master equation , 1992 .

[56]  Eva Balsa-Canto,et al.  Hybrid optimization method with general switching strategy for parameter estimation , 2008, BMC Systems Biology.

[57]  Dirk Roose,et al.  Estimation of Cell Proliferation Dynamics Using CFSE Data , 2011, Bulletin of mathematical biology.

[58]  Carsten Marr,et al.  Software tools for single-cell tracking and quantification of cellular and molecular properties , 2016, Nature Biotechnology.

[59]  Marcello Farina,et al.  Results Towards Identifiability Properties of Biochemical Reaction Networks , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[60]  Frank Allgöwer,et al.  An individual-based simulation framework for dynamic, heterogeneous cell populations during extrinsic stimulations , 2015 .

[61]  Martín Velasco-Villa,et al.  Observability and observers for nonlinear systems with time delays , 2000, Kybernetika.

[62]  Steffen Waldherr,et al.  Hybrid Simulation of Heterogeneous Cell Populations , 2016, IEEE Life Sciences Letters.

[63]  A. Louis,et al.  Numerical rate function determination in partial differential equations modeling cell population dynamics , 2017, Journal of mathematical biology.

[64]  P. Maini,et al.  Mathematical modeling of cell population dynamics in the colonic crypt and in colorectal cancer , 2007, Proceedings of the National Academy of Sciences.

[65]  M M Domach,et al.  A finite representation model for an asynchronous culture of E. coli , 1984, Biotechnology and bioengineering.

[66]  O Wolkenhauer.  Defining systems biology: an engineering perspective. , 2007, IET systems biology.

[67]  Amy E Herr,et al.  Single-Cell Western Blotting. , 2015, Methods in molecular biology.

[68]  Rong Fan,et al.  Single-cell proteomic chip for profiling intracellular signaling pathways in single tumor cells , 2011, Proceedings of the National Academy of Sciences.

[69]  Frank Allgöwer,et al.  Identification of models of heterogeneous cell populations from population snapshot data , 2011, BMC Bioinformatics.

[70]  Bernard Haasdonk,et al.  Efficient parametric analysis of the chemical master equation through model order reduction , 2012, BMC Systems Biology.

[71]  Ursula Klingmüller,et al.  Structural and practical identifiability analysis of partially observed dynamical models by exploiting the profile likelihood , 2009, Bioinform..

[72]  Joseph D Butner,et al.  Simulating cancer growth with multiscale agent-based modeling. , 2015, Seminars in cancer biology.

[73]  A. Perelson,et al.  Using 5-Bromo-2 Quantification of Cell Turnover Kinetics , 2000 .

[74]  Lit-Hsin Loo,et al.  Heterogeneity in the physiological states and pharmacological responses of differentiating 3T3-L1 preadipocytes , 2009, The Journal of cell biology.

[75]  Jan Hasenauer,et al.  Estimation of biochemical network parameter distributions in cell populations , 2009, 0905.1191.

[76]  Frank Allgöwer,et al.  Bridging time scales in cellular decision making with a stochastic bistable switch , 2010, BMC Systems Biology.

[77]  Mustafa Khammash,et al.  Parameter Estimation and Model Selection in Computational Biology , 2010, PLoS Comput. Biol..

[78]  Eugenio Cinquemani,et al.  Identification of metabolic network models from incomplete high-throughput datasets , 2011, Bioinform..

[79]  D. Vitkup,et al.  Maximum Entropy Framework For Inference Of Cell Population Heterogeneity In Signaling Networks , 2017 .

[80]  Nikos V Mantzaris,et al.  From single-cell genetic architecture to cell population dynamics: quantitatively decomposing the effects of different population heterogeneity sources for a genetic network with positive feedback architecture. , 2007, Biophysical journal.

[81]  M. Khammash,et al.  The finite state projection algorithm for the solution of the chemical master equation. , 2006, The Journal of chemical physics.

[82]  Frank Allgöwer,et al.  A new model to simulate and analyze proliferating cell populations in BrdU labeling experiments , 2013, BMC Systems Biology.

[83]  Michail Stamatakis,et al.  Cell population balance and hybrid modeling of population dynamics for a single gene with feedback , 2013, Comput. Chem. Eng..

[84]  Mustafa Khammash,et al.  Digital Quantification of Proteins and mRNA in Single Mammalian Cells. , 2016, Molecular cell.

[85]  Doraiswami Ramkrishna,et al.  Statistics and dynamics of procaryotic cell populations , 1967 .

[86]  Jan Hasenauer,et al.  Modeling and parameter estimation for heterogeneous cell populations , 2013 .

[87]  Kyriacos Zygourakis,et al.  A novel assay based on fluorescence microscopy and image processing for determining phenotypic distributions of rod‐shaped bacteria , 2009, Biotechnology and bioengineering.

[88]  Friedrich Srienc,et al.  Solutions of population balance models based on a successive generations approach , 1997 .

[89]  F. Allgöwer,et al.  Analysis and Simulation of Division- and Label-Structured Population Models , 2012, Bulletin of mathematical biology.

[90]  Aaron M. Streets,et al.  Microfluidic single-cell whole-transcriptome sequencing , 2014, Proceedings of the National Academy of Sciences.

[91]  S. Bodovitz,et al.  Single cell analysis: the new frontier in 'omics'. , 2010, Trends in biotechnology.

[92]  Lani F. Wu,et al.  Multidimensional Drug Profiling By Automated Microscopy , 2004, Science.

[93]  Fabian J Theis,et al.  Lessons Learned from Quantitative Dynamical Modeling in Systems Biology , 2013, PloS one.

[94]  P. Sorger,et al.  Cyclic Immunofluorescence (CycIF), A Highly Multiplexed Method for Single‐cell Imaging , 2016, Current protocols in chemical biology.

[95]  Stefan Heinrich,et al.  Improved accuracy and convergence of discretized population balance for aggregation: The cell average technique , 2006 .

[96]  H. D. Jong,et al.  On the identifiability of metabolic network models , 2013, Journal of mathematical biology.

[97]  M. A. Henson.  Dynamic modeling of microbial cell populations. , 2003, Current opinion in biotechnology.

[98]  Olaf Wolkenhauer.  Essay: Defining Systems Biology: An Engineering Perspective , 2007 .

[99]  David Basiji,et al.  Quantitative measurement of nuclear translocation events using similarity analysis of multispectral cellular images obtained in flow. , 2006, Journal of immunological methods.

[100]  Henrique Veiga-Fernandes,et al.  Response of naïve and memory CD8+ T cells to antigen stimulation in vivo , 2000, Nature Immunology.

[101]  J. Hasenauer,et al.  Mechanistic hierarchical population model identifies latent causes of cell-to-cell variability , 2017, bioRxiv.

[102]  D. Roose,et al.  Distributed parameter identification for a label-structured cell population dynamics model using CFSE histogram time-series data , 2009, Journal of mathematical biology.

[103]  Moritz Lang,et al.  Autonomous Synchronization of Chemically Coupled Synthetic Oscillators , 2011, Bulletin of mathematical biology.

[104]  D. Wilkinson.  Stochastic modelling for quantitative description of heterogeneous biological systems , 2009, Nature Reviews Genetics.

[105]  Reinhart Heinrich,et al.  Effect of cellular interaction on glycolytic oscillations in yeast: a theoretical investigation. , 2000, The Biochemical journal.

[106]  Eugenio Cinquemani,et al.  Validation methods for population models of gene expression dynamics , 2016 .

[107]  Brian Munsky,et al.  Listening to the noise: random fluctuations reveal gene network parameters , 2009, Molecular systems biology.

[108]  Doraiswami Ramkrishna,et al.  Bistability versus Bimodal Distributions in Gene Regulatory Processes from Population Balance , 2011, PLoS Comput. Biol..

[109]  Grace X. Y. Zheng,et al.  Massively parallel digital transcriptional profiling of single cells , 2016, bioRxiv.

[110]  D. Gillespie.  Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[111]  Lani F. Wu,et al.  Cellular Heterogeneity: Do Differences Make a Difference? , 2010, Cell.

[112]  R. Milo,et al.  Dynamic Proteomics of Individual Cancer Cells in Response to a Drug , 2008, Science.

[113]  Bjørn Olav Hald,et al.  Programming strategy for efficient modeling of dynamics in a population of heterogeneous cells , 2013, Bioinform..

[114]  D. Ramkrishna,et al.  Population balance modeling: current status and future prospects. , 2014, Annual review of chemical and biomolecular engineering.

[115]  D. Ramkrishna,et al.  Solution of inverse problems in population balances. II: Particle break-up , 1995 .

[116]  J. Lygeros,et al.  Moment-based inference predicts bimodality in transient gene expression , 2012, Proceedings of the National Academy of Sciences.

[117]  Prodromos Daoutidis,et al.  Numerical solution of multi-variable cell population balance models. III. Finite element methods , 2001 .

[118]  Denis Dochain,et al.  State and parameter estimation in chemical and biochemical processes: a tutorial , 2003 .