Robustness and parameter geography in post-translational modification systems

Biological systems are acknowledged to be robust to perturbations but a rigorous understanding of this has been elusive. In a mathematical model, perturbations often exert their effect through parameters, so sizes and shapes of parametric regions offer an integrated global estimate of robustness. Here, we explore this “parameter geography” for bistability in post-translational modification (PTM) systems. We use the previously developed “linear framework” for timescale separation to describe the steady-states of a two-site PTM system as the solutions of two polynomial equations in two variables, with eight non-dimensional parameters. Importantly, this approach allows us to accommodate enzyme mechanisms of arbitrary complexity beyond the conventional Michaelis-Menten scheme, which unrealistically forbids product rebinding. We further use the numerical algebraic geometry tools Bertini, Paramotopy, and alphaCertified to statistically assess the solutions to these equations at ∼109 parameter points in total. Subject to sampling limitations, we find no bistability when substrate amount is below a threshold relative to enzyme amounts. As substrate increases, the bistable region acquires 8-dimensional volume which increases in an apparently monotonic and sigmoidal manner towards saturation. The region remains connected but not convex, albeit with a high visibility ratio. Surprisingly, the saturating bistable region occupies a much smaller proportion of the sampling domain under mechanistic assumptions more realistic than the Michaelis-Menten scheme. We find that bistability is compromised by product rebinding and that unrealistic assumptions on enzyme mechanisms have obscured its parametric rarity. The apparent monotonic increase in volume of the bistable region remains perplexing because the region itself does not grow monotonically: parameter points can move back and forth between monostability and bistability. We suggest mathematical conjectures and questions arising from these findings. Advances in theory and software now permit insights into parameter geography to be uncovered by high-dimensional, data-centric analysis. Author Summary Biological organisms are often said to have robust properties but it is difficult to understand how such robustness arises from molecular interactions. Here, we use a mathematical model to study how the molecular mechanism of protein modification exhibits the property of multiple internal states, which has been suggested to underlie memory and decision making. The robustness of this property is revealed by the size and shape, or “geography,” of the parametric region in which the property holds. We use advances in reducing model complexity and in rapidly solving the underlying equations, to extensively sample parameter points in an 8-dimensional space. We find that under realistic molecular assumptions the size of the region is surprisingly small, suggesting that generating multiple internal states with such a mechanism is much harder than expected. While the shape of the region appears straightforward, we find surprising complexity in how the region grows with increasing amounts of the modified substrate. Our approach uses statistical analysis of data generated from a model, rather than from experiments, but leads to precise mathematical conjectures about parameter geography and biological robustness.

[1]  J. Lisman,et al.  The molecular basis of CaMKII function in synaptic and behavioural memory , 2002, Nature Reviews Neuroscience.

[2]  J. Gunawardena Multisite protein phosphorylation makes a good threshold but can be a poor switch. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Jeremy Gunawardena,et al.  The rational parameterization theorem for multisite post-translational modification systems. , 2009, Journal of theoretical biology.

[4]  H. Westerhoff,et al.  Product dependence and bifunctionality compromise the ultrasensitivity of signal transduction cascades , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[5]  B. Eipper,et al.  :Posttranslational Modification of Proteins: Expanding Nature's Inventory , 2008 .

[6]  P. Y. Lum,et al.  Extracting insights from the shape of complex data using topology , 2013, Scientific Reports.

[7]  Jonathan D. Hauenstein,et al.  Numerically Solving Polynomial Systems with Bertini , 2013, Software, environments, tools.

[8]  Frank Sottile,et al.  ALGORITHM XXX: ALPHACERTIFIED: CERTIFYING SOLUTIONS TO POLYNOMIAL SYSTEMS , 2011 .

[9]  J. Ferrell,et al.  A positive-feedback-based bistable ‘memory module’ that governs a cell fate decision , 2003, Nature.

[10]  Sui Huang Non-genetic heterogeneity of cells in development: more than just noise , 2009, Development.

[11]  Dietrich Flockerzi,et al.  Multistationarity in Sequential Distributed Multisite Phosphorylation Networks , 2013, Bulletin of Mathematical Biology.

[12]  Richard E. Ewing,et al.  "The Merging of Disciplines: New Directions in Pure, Applied, and Computational Mathematics" , 1986 .

[13]  S. Smale Newton’s Method Estimates from Data at One Point , 1986 .

[14]  B. Kholodenko,et al.  Signaling switches and bistability arising from multisite phosphorylation in protein kinase cascades , 2004, The Journal of cell biology.

[15]  Jeremy Gunawardena,et al.  A Fundamental Trade-off in Covalent Switching and Its Circumvention by Enzyme Bifunctionality in Glucose Homeostasis* , 2014, The Journal of Biological Chemistry.

[16]  Meredith V. Trotter,et al.  Robustness and evolvability. , 2010, Trends in genetics : TIG.

[17]  Alicia Dickenstein,et al.  Regions of multistationarity in cascades of Goldbeter–Koshland loops , 2018, Journal of Mathematical Biology.

[18]  Badal Joshi,et al.  Simplifying the Jacobian Criterion for Precluding Multistationarity in Chemical Reaction Networks , 2011, SIAM J. Appl. Math..

[19]  Mitsuo Kawato,et al.  The protein kinase Mζ network as a bistable switch to store neuronal memory , 2010, BMC Systems Biology.

[20]  M. Bennett,et al.  A fast, robust, and tunable synthetic gene oscillator , 2008, Nature.

[21]  J. Stelling,et al.  Robustness of Cellular Functions , 2004, Cell.

[22]  Robert D. Tortora,et al.  Sampling: Design and Analysis , 2000 .

[23]  Nils Blüthgen,et al.  Mathematical Modeling Identifies Inhibitors of Apoptosis as Mediators of Positive Feedback and Bistability , 2006, PLoS Comput. Biol..

[24]  Kenneth L. Ho,et al.  Bistability in Apoptosis by Receptor Clustering , 2009, PLoS Comput. Biol..

[25]  M Laurent,et al.  Multistability: a major means of differentiation and evolution in biological systems. , 1999, Trends in biochemical sciences.

[26]  Jeremy Gunawardena,et al.  A Linear Framework for Time-Scale Separation in Nonlinear Biochemical Systems , 2012, PloS one.

[27]  Marc Hafner,et al.  Efficient characterization of high-dimensional parameter spaces for systems biology , 2011, BMC Systems Biology.

[28]  Helen M. Byrne,et al.  Decomposing the Parameter Space of Biological Networks via a Numerical Discriminant Approach , 2016, MC.

[29]  Jeremy Gunawardena,et al.  Realistic enzymology for post-translational modification: zero-order ultrasensitivity revisited. , 2012, Journal of theoretical biology.

[30]  Philippe Silar,et al.  Bistability and hysteresis of the 'Secteur' differentiation are controlled by a two-gene locus in Nectria haematococca , 2004, BMC Biology.

[31]  Martin Feinberg,et al.  Multiple Equilibria in Complex Chemical Reaction Networks: I. the Injectivity Property * , 2006 .

[32]  G. Lepage A new algorithm for adaptive multidimensional integration , 1978 .

[33]  Krishanu Saha,et al.  Pluripotency and Cellular Reprogramming: Facts, Hypotheses, Unresolved Issues , 2010, Cell.

[34]  M. Savageau,et al.  Parameter Sensitivity as a Criterion for Evaluating and Comparing the Performance of Biochemical Systems , 1971, Nature.

[35]  Sunil Arya,et al.  ANN: library for approximate nearest neighbor searching , 1998 .

[36]  Hannah H. Chang,et al.  Multistable and multistep dynamics in neutrophil differentiation , 2006, BMC Cell Biology.

[37]  Mohab Safey El Din,et al.  Proceedings of the 2017 ACM on International Symposium on Symbolic and Algebraic Computation , 2017, ISSAC.

[38]  Mercedes Pérez Millán,et al.  MAPK's networks and their capacity for multistationarity due to toric steady states. , 2014, Mathematical biosciences.

[39]  Lydia E. Kavraki,et al.  Capturing the Connectivity of High-Dimensional Geometric Spaces by Parallelizable Random Sampling Techniques , 1998, IPPS/SPDP Workshops.

[40]  W. Lim,et al.  Defining Network Topologies that Can Achieve Biochemical Adaptation , 2009, Cell.

[41]  Casim A. Sarkar,et al.  Robust Network Topologies for Generating Switch-Like Cellular Responses , 2011, PLoS Comput. Biol..

[42]  James E. Ferrell,et al.  A positive-feedback-based bistable ‘memory module’ that governs a cell fate decision , 2007, Nature.

[43]  Panos M. Pardalos,et al.  Advances in Randomized Parallel Computing , 2011 .

[44]  Jeremy Gunawardena,et al.  Some lessons about models from Michaelis and Menten , 2012, Molecular biology of the cell.

[45]  Elisenda Feliu,et al.  Injectivity, multiple zeros and multistationarity in reaction networks , 2014, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[46]  R. Ghrist Barcodes: The persistent topology of data , 2007 .

[47]  Hiroaki Kitano,et al.  Biological robustness , 2008, Nature Reviews Genetics.

[48]  Eduardo Sontag,et al.  Building a cell cycle oscillator: hysteresis and bistability in the activation of Cdc2 , 2003, Nature Cell Biology.

[49]  Jennifer Werfel,et al.  Parametric Sensitivity In Chemical Systems , 2016 .

[50]  Hanno Steen,et al.  Post‐translational modification: nature's escape from genetic imprisonment and the basis for dynamic information encoding , 2012, Wiley interdisciplinary reviews. Systems biology and medicine.

[51]  P. Lásló,et al.  Multilineage Transcriptional Priming and Determination of Alternate Hematopoietic Cell Fates , 2006, Cell.

[52]  Stephen Muggleton,et al.  Elements of computational systems biology , 2010 .

[53]  Z Zi,et al.  Sensitivity analysis approaches applied to systems biology models. , 2011, IET systems biology.

[54]  F. Crick Neurobiology: Memory and molecular turnover , 1984, Nature.

[55]  Jörg Stelling,et al.  Chemical Reaction Network Theory elucidates sources of multistability in interferon signaling , 2017, PLoS Comput. Biol..

[56]  Alicia Dickenstein,et al.  Lower bounds for positive roots and regions of multistationarity in chemical reaction networks , 2018, Journal of Algebra.

[57]  Jean-Daniel Boissonnat,et al.  Algorithmic Foundations of Robotics V, Selected Contributions of the Fifth International Workshop on the Algorithmic Foundations of Robotics, WAFR 2002, Nice, France, December 15-17, 2002 , 2004, WAFR.

[58]  E. Seibert,et al.  Fundamentals of enzyme kinetics. , 2014, Methods in molecular biology.

[59]  R. Losick,et al.  Bistability in bacteria , 2006, Molecular microbiology.

[60]  E. Andrianantoandro,et al.  Synthetic biology: new engineering rules for an emerging discipline , 2006, Molecular systems biology.

[61]  Eduardo D. Sontag,et al.  Shape, Size, and Robustness: Feasible Regions in the Parameter Space of Biochemical Networks , 2007, PLoS Comput. Biol..

[62]  R. Zahler Enzyme Structure and Mechanism , 1979, The Yale Journal of Biology and Medicine.

[63]  C. Waddington Canalization of Development and the Inheritance of Acquired Characters , 1942, Nature.

[64]  J. Ferrell Bistability, Bifurcations, and Waddington's Epigenetic Landscape , 2012, Current Biology.

[65]  Mark H. Overmars,et al.  A Comparative Study of Probabilistic Roadmap Planners , 2002, WAFR.

[66]  Alicia Dickenstein,et al.  Sign Conditions for Injectivity of Generalized Polynomial Maps with Applications to Chemical Reaction Networks and Real Algebraic Geometry , 2013, Found. Comput. Math..

[67]  Vahid Shahrezaei,et al.  The scaffold protein Ste5 directly controls a switch-like mating decision in yeast , 2010, Nature.

[68]  Bernd Sturmfels,et al.  Algebraic Systems Biology: A Case Study for the Wnt Pathway , 2015, Bulletin of Mathematical Biology.

[69]  Wendell A. Lim,et al.  Designing Synthetic Regulatory Networks Capable of Self-Organizing Cell Polarization , 2012, Cell.

[70]  Christopher R. Myers,et al.  Universally Sloppy Parameter Sensitivities in Systems Biology Models , 2007, PLoS Comput. Biol..

[71]  J. Gunawardena,et al.  Unlimited multistability in multisite phosphorylation systems , 2009, Nature.

[72]  Christopher T. Walsh,et al.  Posttranslational Modification of Proteins: Expanding Nature's Inventory , 2005 .

[73]  M. Feinberg Chemical reaction network structure and the stability of complex isothermal reactors—I. The deficiency zero and deficiency one theorems , 1987 .

[74]  J. Gunawardena Models in Systems Biology: The Parameter Problem and the Meanings of Robustness , 2010 .

[75]  Jeremy Gunawardena,et al.  The geometry of multisite phosphorylation. , 2008, Biophysical journal.

[76]  Alicia Dickenstein,et al.  Chemical Reaction Systems with Toric Steady States , 2011, Bulletin of mathematical biology.

[77]  Sunil Arya,et al.  An optimal algorithm for approximate nearest neighbor searching fixed dimensions , 1998, JACM.

[78]  C. S. Holling Resilience and Stability of Ecological Systems , 1973 .

[79]  Thapanar Suwanmajo,et al.  Mixed mechanisms of multi-site phosphorylation , 2015, Journal of The Royal Society Interface.

[80]  J. Lisman A mechanism for memory storage insensitive to molecular turnover: a bistable autophosphorylating kinase. , 1985, Proceedings of the National Academy of Sciences of the United States of America.

[81]  A. Novick,et al.  ENZYME INDUCTION AS AN ALL-OR-NONE PHENOMENON. , 1957, Proceedings of the National Academy of Sciences of the United States of America.

[82]  Nils Blüthgen,et al.  Effects of sequestration on signal transduction cascades , 2006, The FEBS journal.

[83]  Eduardo Sontag,et al.  Geometry and topology of parameter space: investigating measures of robustness in regulatory networks , 2009, Journal of mathematical biology.

[84]  Bruno A Bernard,et al.  The human hair follicle, a bistable organ? , 2012, Experimental dermatology.

[85]  Herbert Edelsbrunner,et al.  Computational Topology - an Introduction , 2009 .

[86]  Henry H. Mattingly,et al.  Long-term dynamics of multisite phosphorylation , 2016, Molecular biology of the cell.

[87]  H. Mori,et al.  Construction of Escherichia coli K-12 in-frame, single-gene knockout mutants: the Keio collection , 2006, Molecular systems biology.

[88]  Alicia Dickenstein,et al.  Parameter regions that give rise to 2[n/2] +1 positive steady states in the n-site phosphorylation system. , 2019, Mathematical biosciences and engineering : MBE.

[89]  Andrew J. Sommese,et al.  The numerical solution of systems of polynomials - arising in engineering and science , 2005 .

[90]  Julio R. Banga,et al.  Characterizing Multistationarity Regimes in Biochemical Reaction Networks , 2012, PloS one.

[91]  M. Félix,et al.  Pervasive robustness in biological systems , 2015, Nature Reviews Genetics.

[92]  G. Odell,et al.  The segment polarity network is a robust developmental module , 2000, Nature.

[93]  W. Cannon ORGANIZATION FOR PHYSIOLOGICAL HOMEOSTASIS , 1929 .

[94]  Richard M. Murray,et al.  An analytical approach to bistable biological circuit discrimination using real algebraic geometry , 2015, bioRxiv.

[95]  Nicholas T Ingolia,et al.  Topology and Robustness in the Drosophila Segment Polarity Network , 2004, PLoS biology.

[96]  F. Crick Memory and molecular turnover. , 1984, Nature.

[97]  Jeremy Gunawardena,et al.  Time‐scale separation – Michaelis and Menten's old idea, still bearing fruit , 2014, The FEBS journal.

[98]  Alicia Dickenstein,et al.  The Structure of MESSI Biological Systems , 2016, SIAM J. Appl. Dyn. Syst..

[99]  D. Lathrop Nonlinear Dynamics and Chaos: With Applications to Physics, Biology, Chemistry, and Engineering , 2015 .

[100]  Matthew England,et al.  A Case Study on the Parametric Occurrence of Multiple Steady States , 2017, ISSAC.

[101]  Carsten Conradi,et al.  Catalytic constants enable the emergence of bistability in dual phosphorylation , 2014, Journal of The Royal Society Interface.

[102]  Thomas Kahle,et al.  Multistationarity in the Space of Total Concentrations for Systems that Admit a Monomial Parametrization , 2018, Bulletin of Mathematical Biology.

[103]  Elisenda Feliu,et al.  Identifying parameter regions for multistationarity , 2016, PLoS Comput. Biol..

[104]  Carsten Peterson,et al.  Transcriptional Dynamics of the Embryonic Stem Cell Switch , 2006, PLoS Comput. Biol..