Reconstructing nonlinear dynamic models of gene regulation using stochastic sampling

BackgroundThe reconstruction of gene regulatory networks from time series gene expression data is one of the most difficult problems in systems biology. This is due to several reasons, among them the combinatorial explosion of possible network topologies, limited information content of the experimental data with high levels of noise, and the complexity of gene regulation at the transcriptional, translational and post-translational levels. At the same time, quantitative, dynamic models, ideally with probability distributions over model topologies and parameters, are highly desirable.ResultsWe present a novel approach to infer such models from data, based on nonlinear differential equations, which we embed into a stochastic Bayesian framework. We thus address both the stochasticity of experimental data and the need for quantitative dynamic models. Furthermore, the Bayesian framework allows it to easily integrate prior knowledge into the inference process. Using stochastic sampling from the Bayes' posterior distribution, our approach can infer different likely network topologies and model parameters along with their respective probabilities from given data. We evaluate our approach on simulated data and the challenge #3 data from the DREAM 2 initiative. On the simulated data, we study effects of different levels of noise and dataset sizes. Results on real data show that the dynamics and main regulatory interactions are correctly reconstructed.ConclusionsOur approach combines dynamic modeling using differential equations with a stochastic learning framework, thus bridging the gap between biophysical modeling and stochastic inference approaches. Results show that the method can reap the advantages of both worlds, and allows the reconstruction of biophysically accurate dynamic models from noisy data. In addition, the stochastic learning framework used permits the computation of probability distributions over models and model parameters, which holds interesting prospects for experimental design purposes.

[1]  Rainer Spang,et al.  Inferring cellular networks – a review , 2007, BMC Bioinformatics.

[2]  Yufeng Liu,et al.  Support vector machines with adaptive Lq penalty , 2007, Comput. Stat. Data Anal..

[3]  D. Lilley,et al.  Biochemical systems analysis: A study of function and design in molecular biology Michael A. Savageau Addison-Wesley (1977) London. Hardback E21.30 Paperback E13.20 , 1978 .

[4]  E. Davidson,et al.  The hardwiring of development: organization and function of genomic regulatory systems. , 1997, Development.

[5]  J. Collins,et al.  Inferring Genetic Networks and Identifying Compound Mode of Action via Expression Profiling , 2003, Science.

[6]  J. Monod,et al.  Genetic regulatory mechanisms in the synthesis of proteins. , 1961, Journal of molecular biology.

[7]  D. di Bernardo,et al.  How to infer gene networks from expression profiles , 2007, Molecular systems biology.

[8]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[9]  P. James McLellan,et al.  Parameter estimation in continuous-time dynamic models using principal differential analysis , 2006, Comput. Chem. Eng..

[10]  Jürgen Wolf,et al.  CASPAR: a hierarchical Bayesian approach to predict survival times in cancer from gene expression data , 2006, Bioinform..

[11]  Kwang-Hyun Cho,et al.  Identification of small scale biochemical networks based on general type system perturbations , 2005, The FEBS journal.

[12]  Isabel M. Tienda-Luna,et al.  Reverse engineering gene regulatory networks , 2009, IEEE Signal Processing Magazine.

[13]  Ting Chen,et al.  Modeling Gene Expression with Differential Equations , 1998, Pacific Symposium on Biocomputing.

[14]  Vladimir Filkov,et al.  Identifying Gene Regulatory Networks from Gene Expression Data , 2005 .

[15]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[16]  Andreas Zell,et al.  A memetic inference method for gene regulatory networks based on S-Systems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[17]  J. Varah.  A Spline Least Squares Method for Numerical Parameter Estimation in Differential Equations , 1982 .

[18]  R. Eils,et al.  Gene network dynamics controlling keratinocyte migration , 2008, Molecular systems biology.

[19]  M. Savageau.  Biochemical systems analysis. III. Dynamic solutions using a power-law approximation , 1970 .

[20]  Timothy S Gardner,et al.  Reverse-engineering transcription control networks. , 2005, Physics of life reviews.

[21]  Hidde de Jong,et al.  Qualitative Simulation of Large and Complex Genetic Regulation Systems , 2000, ECAI.

[22]  Jiguo Cao,et al.  Parameter estimation for differential equations: a generalized smoothing approach , 2007 .

[23]  Shuhei Kimura,et al.  Inference of S-system models of genetic networks using a cooperative coevolutionary algorithm , 2005, Bioinform..

[24]  Florian Steinke,et al.  Experimental design for efficient identification of gene regulatory networks using sparse Bayesian models , 2006, BMC Systems Biology.

[25]  D. Husmeier,et al.  Reconstructing Gene Regulatory Networks with Bayesian Networks by Combining Expression Data with Multiple Sources of Prior Knowledge , 2007, Statistical applications in genetics and molecular biology.

[26]  M A Savageau,et al.  Biochemical systems theory: operational differences among variant representations and their significance. , 1991, Journal of theoretical biology.

[27]  N. Lee,et al.  Computational and experimental approaches for modeling gene regulatory networks. , 2007, Current pharmaceutical design.

[28]  Hidde de Jong,et al.  Modeling and Simulation of Genetic Regulatory Systems: A Literature Review , 2002, J. Comput. Biol..

[29]  Eduardo D. Sontag,et al.  Inferring dynamic architecture of cellular networks using time series of gene expression, protein and metabolite data , 2004, Bioinform..

[30]  Eberhard O. Voit,et al.  Computational Analysis of Biochemical Systems: A Practical Guide for Biochemists and Molecular Biologists , 2000 .

[31]  Nir Friedman,et al.  Inferring quantitative models of regulatory networks from expression data , 2004, ISMB/ECCB.

[32]  Nicole Radde,et al.  Inference of an oscillating model for the yeast cell cycle , 2009, Discret. Appl. Math..

[33]  S. Wiggins.  Introduction to Applied Nonlinear Dynamical Systems and Chaos , 1989 .

[34]  Leon Glass,et al.  Reverse Engineering the Gap Gene Network of Drosophila melanogaster , 2006, PLoS Comput. Biol..

[35]  Nicole Radde,et al.  Bayesian Inference of Gene Regulatory Networks Using Gene Expression Time Series Data , 2007, BIRD.

[36]  Srinivas Aluru,et al.  Handbook Of Computational Molecular Biology , 2010 .

[37]  R. Heinrich,et al.  The Regulation of Cellular Systems , 1996, Springer US.

[38]  Gary D. Stormo,et al.  Modeling Regulatory Networks with Weight Matrices , 1998, Pacific Symposium on Biocomputing.

[39]  Geoffrey E. Hinton,et al.  Bayesian Learning for Neural Networks , 1995 .

[40]  A. Califano,et al.  Dialogue on Reverse‐Engineering Assessment and Methods , 2007, Annals of the New York Academy of Sciences.

[41]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[42]  M. Savageau.  Biochemical systems analysis. II. The steady-state solutions for an n-pool system using a power-law approximation. , 1969, Journal of theoretical biology.

[43]  Hod Lipson,et al.  Automated reverse engineering of nonlinear dynamical systems , 2007, Proceedings of the National Academy of Sciences.

[44]  Andreas Zell,et al.  Multi-objective Model Optimization for Inferring Gene Regulatory Networks , 2005, EMO.

[45]  Nicole Radde,et al.  Inferring Gene Regulatory Networks from Expression Data , 2019 .

[46]  G. Yagil,et al.  On the relation between effector concentration and the rate of induced enzyme synthesis. , 1971, Biophysical journal.

[47]  Cheng-Yan Kao,et al.  A stochastic differential equation model for quantifying transcriptional regulatory network in Saccharomyces cerevisiae , 2005, Bioinform..

[48]  Marcel J. T. Reinders,et al.  Least absolute regression network analysis of the murine osteoblast differentiation network , 2006, Bioinform..

[49]  Eduardo Sontag,et al.  Untangling the wires: A strategy to trace functional interactions in signaling and gene networks , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[50]  Felix Streichert,et al.  Comparing mathematical models on the problem of network inference , 2006, GECCO.

[51]  KonagayaAkihiko,et al.  Inference of S-system models of genetic networks using a cooperative coevolutionary algorithm , 2005 .

[52]  Jesper Tegnér,et al.  Reverse engineering gene networks using singular value decomposition and robust regression , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[53]  S. Duane,et al.  Hybrid Monte Carlo , 1987 .

[54]  D. Bernardo,et al.  A Yeast Synthetic Network for In Vivo Assessment of Reverse-Engineering and Modeling Approaches , 2009, Cell.