Nonlinear mixed-effects modelling for single cell estimation: when, why, and how to use it

BackgroundStudies of cell-to-cell variation have in recent years grown in interest, due to improved bioanalytical techniques which facilitates determination of small changes with high uncertainty. Like much high-quality data, single-cell data is best analysed using a systems biology approach. The most common systems biology approach to single-cell data is the standard two-stage (STS) approach. In STS, data from each cell is analysed in a separate sub-problem, meaning that only data from the same cell is used to calculate the parameter values within that cell. Because only parts of the data are considered, problems with parameter unidentifiability are exaggerated in STS. In contrast, a related approach to data analysis has been developed for the studies of patient-to-patient variations. This approach, called nonlinear mixed-effects modelling (NLME), makes use of all data, when estimating the patient-specific parameters. NLME would therefore be advantageous compared to STS also for the study of cell-to-cell variation. However, no such systematic evaluation of the two approaches exists.ResultsHerein, such a systematic comparison between STS and NLME has been performed. Different examples, both linear and nonlinear, and both simulated and real experimental data, have been examined. With informative data, there is no significant difference in the results for either parameter or noise estimation. However, when data becomes uninformative, NLME is significantly superior to STS. These results hold independently of whether the loss of information is due to a low signal-to-noise ratio, too few data points, or a bad input signal. The improvement is shown to come from both the consideration of a joint likelihood (JLH) function, describing all parameters and data, and from an a priori postulated form of the population parameters. Finally, we provide a small tutorial that shows how to use NLME for single-cell analysis, using the free and user-friendly software Monolix.ConclusionsWhen considering uninformative single-cell data, NLME yields more accurate parameter and noise estimates, compared to more traditional approaches, such as STS and JLH.

[1]  Narendra Ahuja,et al.  Robust Visual Tracking via Structured Multi-Task Sparse Learning , 2012, International Journal of Computer Vision.

[2]  Heinz Koeppl,et al.  Accounting for extrinsic variability in the estimation of stochastic rate constants , 2012 .

[3]  Jacob Roll,et al.  Systems biology: model based evaluation and comparison of potential explanations for given biological data , 2009, The FEBS journal.

[4]  Gunnar Cedersund,et al.  Mathematical modeling improves EC50 estimations from classical dose–response curves , 2015, The FEBS journal.

[5]  E. Niclas Jonsson,et al.  PsN-Toolkit - A collection of computer intensive statistical methods for non-linear mixed effect modeling using NONMEM , 2005, Comput. Methods Programs Biomed..

[6]  Sotirios A. Tsaftaris,et al.  Medical Image Computing and Computer Assisted Intervention , 2017 .

[7]  Mats O. Karlsson,et al.  Nonlinearity detection: Advantages of nonlinear mixed-effects modeling , 2000, AAPS PharmSci.

[8]  Melanie I. Stefan,et al.  Molecules for memory: modelling CaMKII , 2007, BMC Systems Biology.

[9]  Trevor Darrell,et al.  The Pyramid Match Kernel: Efficient Learning with Sets of Features , 2007, J. Mach. Learn. Res..

[10]  M. Peter,et al.  Scalable inference of heterogeneous reaction kinetics from pooled single-cell recordings , 2014, Nature Methods.

[11]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[12]  Ss Beal,et al.  NONMEM User’s Guides. (1989–2009) , 2009 .

[13]  Gunnar Cedersund,et al.  Quantification of nuclear transport in single cells , 2014 .

[14]  J. Lygeros,et al.  Moment-based inference predicts bimodality in transient gene expression , 2012, Proceedings of the National Academy of Sciences.

[15]  Kwang-Hyun Cho,et al.  Coupled positive feedbacks provoke slow induction plus fast switching in apoptosis , 2007, FEBS letters.

[16]  Ping Zhang,et al.  Knee-Loading Modality Drives Molecular Transport in Mouse Femur , 2006, Annals of Biomedical Engineering.

[17]  Gunnar Cedersund,et al.  Insulin Signaling in Type 2 Diabetes , 2013, The Journal of Biological Chemistry.

[18]  Mats O. Karlsson,et al.  Automated Covariate Model Building Within NONMEM , 1998, Pharmaceutical Research.

[19]  Stefan Hohmann,et al.  A Simple Mathematical Model of Adaptation to High Osmolarity in Yeast , 2006, Silico Biol..

[20]  van der Arjan Schaft,et al.  50th IEEE Conference on Decision and Control and European Control Conference, 2011 , 2011 .

[21]  Eugenio Cinquemani,et al.  Identification of biological models from single-cell data: A comparison between mixed-effects and moment-based inference , 2013, 2013 European Control Conference (ECC).

[22]  Robert J. Bauer,et al.  A survey of population analysis methods and software for complex pharmacokinetic and pharmacodynamic models with examples , 2007, The AAPS Journal.

[23]  Heiko Enderling,et al.  Visualisation of the numerical solution of partial differential equation systems in three space dimensions and its importance for mathematical models in biology. , 2006, Mathematical biosciences and engineering : MBE.

[24]  Roger Fletcher,et al.  FORTRAN subroutines for minimization by quasi-Newton methods , 1972 .

[25]  E. Niclas Jonsson,et al.  Perl-speaks-NONMEM (PsN) - a Perl module for NONMEM related programming , 2004, Comput. Methods Programs Biomed..

[26]  Heinz Koeppl,et al.  Recursive Bayesian estimation of stochastic rate constants from heterogeneous cell populations , 2011, IEEE Conference on Decision and Control and European Control Conference.

[27]  C. Pesce,et al.  Regulated cell-to-cell variation in a cell-fate decision system , 2005, Nature.

[28]  É. Moulines,et al.  Convergence of a stochastic approximation version of the EM algorithm , 1999 .

[29]  Florence d'Alché-Buc,et al.  A Multi-task Learning Approach for Compartmental Model Parameter Estimation in DCE-CT Sequences , 2013, MICCAI.

[30]  Peter L. Bonate,et al.  Recommended reading in population pharmacokinetic pharmacodynamics , 2005, The AAPS Journal.

[31]  Vdi,et al.  European control conference ECC'99 , 1999 .

[32]  Charles A. Micchelli,et al.  Learning Multiple Tasks with Kernel Methods , 2005, J. Mach. Learn. Res..

[33]  Sven Sahle,et al.  Applications and trends in systems biology in biochemistry , 2011, The FEBS journal.

[34]  Nicholas T. Ingolia,et al.  Systems biology: Reverse engineering the cell , 2008, Nature.

[35]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[36]  J. Knoblich,et al.  Dividing cellular asymmetry: asymmetric cell division and its implications for stem cells and cancer. , 2009, Genes & development.