Trajectory-oriented Bayesian experiment design versus Fisher A-optimal design: an in depth comparison study

Motivation: Experiment design strategies for biomedical models with the purpose of parameter estimation or model discrimination are in the focus of intense research. Experimental limitations such as sparse and noisy data result in unidentifiable parameters and render-related design tasks challenging problems. Often, the temporal resolution of data is a limiting factor and the amount of possible experimental interventions is finite. To address this issue, we propose a Bayesian experiment design algorithm to minimize the prediction uncertainty for a given set of experiments and compare it to traditional A-optimal design. Results: In an in depth numerical study involving an ordinary differential equation model of the trans-Golgi network with 12 partly non-identifiable parameters, we minimized the prediction uncertainty efficiently for predefined scenarios. The introduced method results in twice the prediction precision as the same amount of A-optimal designed experiments while introducing a useful stopping criterion. The simulation intensity of the algorithm's major design step is thereby reasonably affordable. Besides smaller variances in the predicted trajectories compared with Fisher design, we could also achieve smaller parameter posterior distribution entropies, rendering this method superior to A-optimal Fisher design also in the parameter space. Availability: Necessary software/toolbox information are available in the supplementary material. The project script including example data can be downloaded from http://www.ist.uni-stuttgart.de/%7eweber/BayesFisher2012. Contact: patrick.weber@ist.uni-stuttgart.de Supplementary Information: Supplementary data are available at Bioinformatics online.

[1]  Johannes Vogel,et al.  Quantifying Western blots: Pitfalls of densitometry , 2009, Electrophoresis.

[2]  Eric Becker,et al.  An XBP-1 dependent bottle-neck in production of IgG subtype antibodies in chemically defined serum-free Chinese hamster ovary (CHO) fed-batch processes. , 2008, Journal of biotechnology.

[3]  Mats Jirstrand,et al.  Systems biology Systems Biology Toolbox for MATLAB : a computational platform for research in systems biology , 2006 .

[4]  K. Pfizenmaier,et al.  Regulation of secretory transport by protein kinase D–mediated phosphorylation of the ceramide transfer protein , 2007, The Journal of cell biology.

[5]  Bernard De Baets,et al.  A kernel‐based method to determine optimal sampling times for the simultaneous estimation of the parameters of rival mathematical models , 2009, J. Comput. Chem..

[6]  Jens Timmer,et al.  Likelihood based observability analysis and confidence intervals for predictions of dynamic models , 2011, BMC Systems Biology.

[7]  David J. Klinke,et al.  An empirical Bayesian approach for model-based inference of cellular signaling networks , 2009, BMC Bioinformatics.

[8]  Heikki Haario,et al.  DRAM: Efficient adaptive MCMC , 2006, Stat. Comput..

[9]  P. Laycock,et al.  Optimum Experimental Designs , 1995 .

[10]  Christopher R. Myers,et al.  Universally Sloppy Parameter Sensitivities in Systems Biology Models , 2007, PLoS Comput. Biol..

[11]  W. Filipowicz,et al.  Inhibition of Translational Initiation by Let-7 MicroRNA in Human Cells , 2005, Science.

[12]  Peter Storz,et al.  Protein kinase D regulates vesicular transport by phosphorylating and activating phosphatidylinositol-4 kinase IIIβ at the Golgi complex , 2005, Nature Cell Biology.

[13]  Melanie I. Stefan,et al.  BioModels Database: An enhanced, curated and annotated resource for published quantitative kinetic models , 2010, BMC Systems Biology.

[14]  Uri Alon,et al.  Proteome Half-Life Dynamics in Living Human Cells , 2011, Science.

[15]  Peter A. J. Hilbers,et al.  A Bayesian approach to targeted experiment design , 2012, Bioinform..

[16]  V. Malhotra,et al.  The formation of TGN-to-plasma-membrane transport carriers. , 2006, Annual review of cell and developmental biology.

[17]  K. S. Brown,et al.  Optimal experimental design in an epidermal growth factor receptor signalling and down-regulation model. , 2007, IET systems biology.

[18]  Roland Eils,et al.  Optimal Experimental Design for Parameter Estimation of a Cell Signaling Model , 2009, PLoS Comput. Biol..

[19]  W. Näther.  Optimum experimental designs , 1994 .

[20]  Nicole Radde,et al.  Towards experimental design using a Bayesian framework for parameter identification in dynamic intracellular network models , 2010, ICCS.

[21]  K. Chaloner,et al.  Bayesian Experimental Design: A Review , 1995 .

[22]  Jens Timmer,et al.  An error model for protein quantification , 2007, Bioinform..

[23]  Darren J. Wilkinson,et al.  Bayesian methods in bioinformatics and computational systems biology , 2006, Briefings Bioinform..

[24]  Bernard De Baets,et al.  Performance assessment of the anticipatory approach to optimal experimental design for model discrimination , 2012 .

[25]  K. H. Lee,et al.  The statistical mechanics of complex signaling networks: nerve growth factor signaling , 2004, Physical biology.