Computing the Projected Reachable Set of Stochastic Biochemical Reaction Networks Modeled by Switched Affine Systems

A fundamental question in systems biology is what combinations of mean and variance of the species present in a stochastic biochemical reaction network are attainable by perturbing the system with an external signal. To address this question, we show that the moments evolution in any generic network can be either approximated or, under suitable assumptions, computed exactly as the solution of a switched affine system. We then propose a new method to approximate the reachable set of such a switched affine system. A remarkable feature of our approach is that it allows one to easily compute projections of the reachable set for pairs of moments of interest, without requiring the computation of the full reachable set, which can be prohibitive for large networks. As a second contribution, we also show how to select the external signal in order to maximize the probability of reaching a target set. To illustrate the method, we study a renowned model of the controlled gene expression and we derive estimates of the reachable set, for the protein mean and variance, that are more accurate than those available in the literature and consistent with experimental data.

[1]  Stefan Engblom,et al.  On the Stability of Stochastic Jump Kinetics , 2012, 1202.3892.

[2]  G. Vinnicombe,et al.  Fundamental limits on the suppression of molecular fluctuations , 2010, Nature.

[3]  John Lygeros,et al.  Designing experiments to understand the variability in biochemical reaction networks , 2013, Journal of The Royal Society Interface.

[4]  John Lygeros,et al.  Iterative experiment design guides the characterization of a light-inducible gene expression circuit , 2015, Proceedings of the National Academy of Sciences.

[5]  Stavros Tripakis,et al.  Verification of Hybrid Systems with Linear Differential Inclusions Using Ellipsoidal Approximations , 2000, HSCC.

[6]  Oded Maler,et al.  Reachability Analysis via Face Lifting , 1998, HSCC.

[7]  Christel Baier,et al.  Model-Checking Algorithms for Continuous-Time Markov Chains , 2002, IEEE Trans. Software Eng..

[8]  Corentin Briat,et al.  Integral population control of a quadratic dimerization process , 2013, 52nd IEEE Conference on Decision and Control.

[9]  Pravin Varaiya,et al.  Reach Set Computation Using Optimal Control , 2000 .

[10]  D. Pincus,et al.  In silico feedback for in vivo regulation of a gene expression circuit , 2011, Nature Biotechnology.

[11]  Joost-Pieter Katoen,et al.  Approximate Model Checking of Stochastic Hybrid Systems , 2010, Eur. J. Control.

[12]  Francesca Parise,et al.  On the reachable set of the controlled gene expression system , 2014, 53rd IEEE Conference on Decision and Control.

[13]  Mark R. Greenstreet Verifying Safety Properties of Differential Equations , 1996, CAV.

[14]  François Fages,et al.  Symbolic Model Checking of Biochemical Networks , 2003, CMSB.

[15]  D. Gillespie A rigorous derivation of the chemical master equation , 1992 .

[16]  M. Khammash,et al.  The finite state projection algorithm for the solution of the chemical master equation. , 2006, The Journal of chemical physics.

[17]  Antonis Papachristodoulou,et al.  Advanced Methods and Algorithms for Biological Networks Analysis , 2006, Proceedings of the IEEE.

[18]  Andreas Beyer,et al.  Posttranscriptional Expression Regulation: What Determines Translation Rates? , 2007, PLoS Comput. Biol..

[19]  Willem Hagemann Reachability Analysis of Hybrid Systems Using Symbolic Orthogonal Projections , 2014, CAV.

[20]  Ankit Gupta,et al.  A Scalable Computational Framework for Establishing Long-Term Behavior of Stochastic Reaction Networks , 2013, PLoS Comput. Biol..

[21]  P. Varaiya,et al.  Ellipsoidal Techniques for Hybrid Dynamics: the Reachability Problem , 2005 .

[22]  Antoine Girard,et al.  Efficient Computation of Reachable Sets of Linear Time-Invariant Systems with Inputs , 2006, HSCC.

[23]  Bruce H. Krogh,et al.  Verification of Polyhedral-Invariant Hybrid Automata Using Polygonal Flow Pipe Approximations , 1999, HSCC.

[24]  Mustafa Khammash,et al.  Design of a synthetic integral feedback circuit: dynamic analysis and DNA implementation , 2016, ACS synthetic biology.

[25]  Francesca Parise,et al.  On the use of hyperplane methods to compute the reachable set of controlled stochastic biochemical reaction networks , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[26]  Alexander V. Lotov,et al.  Interactive Decision Maps: Approximation and Visualization of Pareto Frontier , 2004 .

[27]  Michael P. H. Stumpf,et al.  Control mechanisms for stochastic biochemical systems via computation of reachable sets , 2016 .

[28]  Antoine Girard,et al.  Reachability of Uncertain Linear Systems Using Zonotopes , 2005, HSCC.

[29]  Jeffrey J. Tabor,et al.  Characterizing bacterial gene circuit dynamics with optically programmed gene expression signals , 2014, Nature Methods.

[30]  Jeff T. Linderoth,et al.  MILP Software , 2010 .

[31]  Olaf Wolkenhauer,et al.  Stochastic Modeling for Systems Biology edited by D. J. Wilkinson , 2007 .

[32]  Chang Hyeong Lee,et al.  A moment closure method for stochastic reaction networks. , 2009, The Journal of chemical physics.

[33]  B. Krogh,et al.  Hyperplane method for reachable state estimation for linear time-invariant systems , 1991 .

[34]  A. Girard,et al.  Efficient reachability analysis for linear systems using support functions , 2008 .

[35]  Muruhan Rathinam,et al.  Moment growth bounds on continuous time Markov processes on non-negative integer lattices , 2013, 1304.5169.

[36]  Hidde de Jong,et al.  Symbolic reachability analysis of genetic regulatory networks using discrete abstractions , 2008, Autom..

[37]  Alberto Bemporad,et al.  Optimal control of continuous-time switched affine systems , 2006, IEEE Transactions on Automatic Control.

[38]  F. Fages,et al.  Long-term model predictive control of gene expression at the population and single-cell levels , 2012, Proceedings of the National Academy of Sciences.

[39]  Mario di Bernardo,et al.  Analysis, design and implementation of a novel scheme for in-vivo control of synthetic gene regulatory networks , 2011, Autom..

[40]  Jane Kondev,et al.  Regulation of noise in gene expression. , 2013, Annual review of biophysics.

[41]  Terence Hwa,et al.  Combinatorial transcriptional control of the lactose operon of Escherichia coli , 2007, Proceedings of the National Academy of Sciences.

[42]  Olivier Bournez,et al.  Approximate Reachability Analysis of Piecewise-Linear Dynamical Systems , 2000, HSCC.

[43]  J. Goutsias,et al.  Markovian dynamics on complex reaction networks , 2012, 1205.5524.

[44]  A. Girard,et al.  Reachability analysis of linear systems using support functions , 2010 .

[45]  Mark R. Greenstreet,et al.  Faster projection based methods for circuit level verification , 2008, 2008 Asia and South Pacific Design Automation Conference.

[46]  Corentin Briat,et al.  Computer control of gene expression: Robust setpoint tracking of protein mean and variance using integral feedback , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[47]  Angelika Bayer,et al.  Ellipsoidal Calculus For Estimation And Control , 2016 .

[48]  J. Hespanha Moment closure for biochemical networks , 2008, 2008 3rd International Symposium on Communications, Control and Signal Processing.

[49]  Pravin Varaiya,et al.  Ellipsoidal Techniques for Reachability Analysis of Discrete-Time Linear Systems , 2007, IEEE Transactions on Automatic Control.

[50]  Alfonso Martinez Arias,et al.  Filtering transcriptional noise during development: concepts and mechanisms , 2006, Nature Reviews Genetics.

[51]  Alberto Bemporad,et al.  Control of systems integrating logic, dynamics, and constraints , 1999, Autom..

[52]  Matthias Althoff,et al.  Combining zonotopes and support functions for efficient reachability analysis of linear systems , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[53]  Olaf Stursberg,et al.  Efficient Representation and Computation of Reachable Sets for Hybrid Systems , 2003, HSCC.

[54]  Matthias Althoff,et al.  An Introduction to CORA 2015 , 2015, ARCH@CPSWeek.

[55]  Jeff T. Linderoth,et al.  Algorithms and Software for Convex Mixed Integer Nonlinear Programs , 2012 .

[56]  Daniel Liberzon,et al.  Calculus of Variations and Optimal Control Theory: A Concise Introduction , 2012 .

[57]  Farren J. Isaacs,et al.  Phenotypic consequences of promoter-mediated transcriptional noise. , 2006, Molecular cell.

[58]  Antoine Girard,et al.  Reachability Analysis of Hybrid Systems Using Support Functions , 2009, CAV.

[59]  Francesca Parise,et al.  Reachability analysis for switched affine systems and its application to controlled stochastic biochemical reaction networks , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[60]  Antoine Girard,et al.  SpaceEx: Scalable Verification of Hybrid Systems , 2011, CAV.

[61]  Eugene Asarin,et al.  Abstraction by Projection and Application to Multi-affine Systems , 2004, HSCC.