Model-driven data collection for biological systems

For biological experiments aiming at calibrating models with unknown parameters, a good experimental design is crucial, especially for those subject to various constraints, such as financial limitations, time consumption and physical practicability. In this paper, we discuss a sequential experimental design based on information theory for parameter estimation and apply it to two biological systems. Two specific issues are addressed in the proposed applications, namely the determination of the optimal sampling time and the optimal choice of observable. The optimal design, either sampling time or observable, is achieved by an information-theoretic sensitivity analysis. It is shown that this is equivalent with maximizing the mutual information and contrasted with non-adaptive designs, this information theoretic strategy provides the fastest reduction of uncertainty.

[1]  A. Kraskov,et al.  Estimating mutual information. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  H. Wynn,et al.  Maximum entropy sampling and optimal Bayesian experimental design , 2000 .

[3]  S. Saigal,et al.  Relative performance of mutual information estimation methods for quantifying the dependence among short and noisy data. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  Charles F. Hockett,et al.  A mathematical theory of communication , 1948, MOCO.

[5]  P. Strevens Iii , 1985 .

[6]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[7]  J. Timmer,et al.  Identification of nucleocytoplasmic cycling as a remote sensor in cellular signaling by databased modeling , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[8]  D. Lindley On a Measure of the Information Provided by an Experiment , 1956 .

[9]  J. Timmer,et al.  Systems biology: experimental design , 2009, The FEBS journal.

[10]  N A W van Riel,et al.  Parameter uncertainty in biochemical models described by ordinary differential equations. , 2013, Mathematical biosciences.

[11]  Gabriel Terejanu,et al.  Bayesian experimental design for the active nitridation of graphite by atomic nitrogen , 2011, ArXiv.

[12]  Liam Paninski,et al.  Asymptotic Theory of Information-Theoretic Experimental Design , 2005, Neural Computation.

[13]  Yan Li,et al.  Estimation of Mutual Information: A Survey , 2009, RSKT.