Using optimal control to understand complex metabolic pathways

Background We revisit the idea of explaining and predicting dynamics in biochemical pathways from first-principles. A promising approach is to exploit optimality principles that can be justified from an evolutionary perspective. In the context of the cell, several previous studies have explained the dynamics of simple metabolic pathways exploiting optimality principles in combination with dynamic models, i.e. using an optimal control framework. For example, dynamics of gene expression in small metabolic models can be explained assuming that cells have developed optimal adaptation strategies. Most of these works have considered rather simplified representations, such as small linear pathways, or reduced networks with a single branching point. Results Here we consider the extension of this approach to more realistic scenarios, i.e. biochemical pathways of arbitrary size and structure. We first show that exploiting optimality principles for these networks poses great challenges due to the complexity of the associated optimal control problems. Second, in order to surmount such challenges, we present a computational framework based on multicriteria optimal control which has been designed with scalability and efficiency in mind, extending several recent methods. This framework includes mechanisms to avoid common pitfalls, such as local optima, unstable solutions or excessive computation time. We illustrate its performance with several case studies considering the central carbon metabolism of S. cerevisiae and B. subtilis. In particular, we consider metabolic dynamics during nutrient shift experiments. Conclusions We show how multi-objective optimal control can be used to predict temporal profiles of enzyme activation and metabolite concentrations in complex metabolic pathways. Further, we show how the multicriteria approach allows us to consider general cost/benefit trade-offs that have been likely favored by evolution. In this study we have considered metabolic pathways, but this computational framework can also be applied to analyze the dynamics of other complex pathways, such as signal transduction networks.

[1]  Dennis Eichmann,et al.  Metabolic Engineering Principles And Methodologies , 2016 .

[2]  Philip Laird,et al.  Dynamic Optimization , 1992, ML.

[3]  Marija Cvijovic,et al.  Kinetic models in industrial biotechnology - Improving cell factory performance. , 2014, Metabolic engineering.

[4]  D. Koller,et al.  Activity motifs reveal principles of timing in transcriptional control of the yeast metabolic network , 2008, Nature Biotechnology.

[5]  Joseph J. DiStefano,et al.  Dynamic Systems Biology Modeling and Simulation , 2015 .

[6]  P. Hunter,et al.  Computational physiology and the physiome project , 2004, Experimental physiology.

[7]  Julio R. Banga,et al.  Multicriteria global optimization for biocircuit design , 2014, BMC Systems Biology.

[8]  Antonis Papachristodoulou,et al.  Designing feedback control in biology for robustness and scalability , 2016 .

[9]  F. J. Poelwijk,et al.  Optimality in evolution: new insights from synthetic biology. , 2013, Current opinion in biotechnology.

[10]  Michael A. Savageau,et al.  Optimal design of feedback control by inhibition , 1974, Journal of Molecular Evolution.

[11]  Eugenio Cinquemani,et al.  Optimal control of bacterial growth for metabolite production: The role of timing and costs of control , 2019, 2019 18th European Control Conference (ECC).

[12]  P. Brown,et al.  Exploring the metabolic and genetic control of gene expression on a genomic scale. , 1997, Science.

[13]  Jonathan Strutz,et al.  Metabolic kinetic modeling provides insight into complex biological questions, but hurdles remain. , 2019, Current opinion in biotechnology.

[14]  Diego A. Oyarzún,et al.  Synthetic gene circuits for metabolic control: design trade-offs and constraints , 2013, Journal of The Royal Society Interface.

[15]  Eva Balsa-Canto,et al.  AMIGO2, a toolbox for dynamic modeling, optimization and control in systems biology , 2016, Bioinform..

[16]  Jean-Luc Gouzé,et al.  Dynamical Allocation of Cellular Resources as an Optimal Control Problem: Novel Insights into Microbial Growth Strategies , 2016, PLoS Comput. Biol..

[17]  D. Oyarzún,et al.  Dynamic optimization of metabolic networks coupled with gene expression. , 2013, Journal of theoretical biology.

[18]  V Hatzimanikatis,et al.  Exploration of trade-offs between steady-state and dynamic properties in signaling cycles , 2012, Physical biology.

[19]  Christoph Kaleta,et al.  Deciphering the regulation of metabolism with dynamic optimization: an overview of recent advances. , 2017, Biochemical Society transactions.

[20]  Jairam Ramesh,et al.  Trade-offs , 2014, Current Biology.

[21]  D. Oyarzún Optimal control of metabolic networks with saturable enzyme kinetics , 2011 .

[22]  Pietro Lió,et al.  Seeing the wood for the trees: a forest of methods for optimization and omic-network integration in metabolic modelling , 2017, Briefings Bioinform..

[23]  C. Priami,et al.  Optimization Algorithms for Computational Systems Biology , 2017, Front. Appl. Math. Stat..

[24]  Julio R. Banga,et al.  Optimization in computational systems biology , 2008, BMC Systems Biology.

[25]  Frank J. Bruggeman,et al.  Optimality Principles in the Regulation of Metabolic Networks , 2012, Metabolites.

[26]  H. Westerhoff,et al.  Synthetic biology and regulatory networks: where metabolic systems biology meets control engineering , 2016, Journal of The Royal Society Interface.

[27]  R. Rosen Optimality Principles in Biology , 1967, Springer US.

[28]  R. Sargent,et al.  Solution of a Class of Multistage Dynamic Optimization Problems. 2. Problems with Path Constraints , 1994 .

[29]  John T. Workman,et al.  Optimal Control Applied to Biological Models , 2007 .

[30]  Linda R. Petzold,et al.  OPTIMAL PERFORMANCE OF THE HEAT-SHOCK GENE REGULATORY NETWORK , 2005 .

[31]  Weifeng Chen,et al.  A simultaneous approach for singular optimal control based on partial moving grid , 2019, AIChE Journal.

[32]  Corrado Priami,et al.  Simulation Algorithms for Computational Systems Biology , 2017, Texts in Theoretical Computer Science. An EATCS Series.

[33]  Luís F. Seoane Multiobjetive optimization in models of synthetic and natural living systems , 2016 .

[34]  Oliver Mason,et al.  The rôle of control and system theory in systems biology , 2008, Annu. Rev. Control..

[35]  Christoph Kaleta,et al.  Footprints of Optimal Protein Assembly Strategies in the Operonic Structure of Prokaryotes , 2015, Metabolites.

[36]  J. M. Smith,et al.  Optimality theory in evolutionary biology , 1990, Nature.

[37]  G. Church,et al.  Analysis of optimality in natural and perturbed metabolic networks , 2002 .

[38]  Edda Klipp,et al.  Metabolic optimization by re-distribution of enzyme activities , 2002 .

[39]  S. Schuster,et al.  The modelling of metabolic systems. Structure, control and optimality. , 1998, Bio Systems.

[40]  George M. Siouris,et al.  Applied Optimal Control: Optimization, Estimation, and Control , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[41]  Clara Higuera,et al.  Correction: Multi-Criteria Optimization of Regulation in Metabolic Networks , 2012, PLoS ONE.

[42]  Edda Klipp,et al.  The discrepancy between data for and expectations on metabolic models: How to match experiments and computational efforts to arrive at quantitative predictions? , 2018 .

[43]  Edison T Liu,et al.  Systems Biology, Integrative Biology, Predictive Biology , 2005, Cell.

[44]  R. Steuer,et al.  Cellular trade-offs and optimal resource allocation during cyanobacterial diurnal growth , 2017, Proceedings of the National Academy of Sciences.

[45]  Anil V. Rao,et al.  Practical Methods for Optimal Control Using Nonlinear Programming , 1987 .

[46]  Julio R. Banga,et al.  Multi-Objective Optimization of Biological Networks for Prediction of Intracellular Fluxes , 2008, IWPACBB.

[47]  Stefan Schuster,et al.  Dynamic optimization identifies optimal programmes for pathway regulation in prokaryotes , 2013, Nature Communications.

[48]  R Bellman,et al.  DYNAMIC PROGRAMMING AND LAGRANGE MULTIPLIERS. , 1956, Proceedings of the National Academy of Sciences of the United States of America.

[49]  Douglas B. Kell,et al.  Non-linear optimization of biochemical pathways: applications to metabolic engineering and parameter estimation , 1998, Bioinform..

[50]  Lorenz T. Biegler,et al.  Advanced optimization strategies for integrated dynamic process operations , 2017, Comput. Chem. Eng..

[51]  A. Oudenaarden,et al.  Optimality in the Development of Intestinal Crypts , 2012, Cell.

[52]  Delfim F. M. Torres,et al.  Optimal control and numerical software: an overview , 2014, 1401.7279.

[53]  A. L. Tits,et al.  User's Guide for FSQP Version 3.0c: A FORTRAN Code for Solving Constrained Nonlinear (Minimax) Optimization Problems, Generating Iterates Satisfying All Inequality and Linear Constraints , 1992 .

[54]  Andreas Raue,et al.  Model calibration and uncertainty analysis in signaling networks. , 2016, Current opinion in biotechnology.

[55]  Franco Blanchini,et al.  Editorial to the Special Issue of L-CSS on Control and Network Theory for Biological Systems , 2019, IEEE Control. Syst. Lett..

[56]  Hana El-Samad,et al.  Tradeoffs in adapting biological systems , 2016, Eur. J. Control.

[57]  D. Lauffenburger,et al.  Physicochemical modelling of cell signalling pathways , 2006, Nature Cell Biology.

[58]  Filip Logist,et al.  Dynamic optimization of biological networks under parametric uncertainty , 2016, BMC Systems Biology.

[59]  William W. Chen,et al.  Classic and contemporary approaches to modeling biochemical reactions. , 2010, Genes & development.

[60]  Filippo Menolascina,et al.  Engineering and control of biological systems: A new way to tackle complex diseases , 2012, FEBS letters.

[61]  D. J. Mcfarland Decision making in animals , 1977, Nature.

[62]  F. Montero,et al.  Optimization of Metabolism: The Evolution of Metabolic Pathways Toward Simplicity Through the Game of the Pentose Phosphate Cycle , 1994 .

[63]  V. Hatzimanikatis,et al.  Thermodynamics-based metabolic flux analysis. , 2007, Biophysical journal.

[64]  Aleksandra M. Walczak,et al.  Trade-Offs in Delayed Information Transmission in Biochemical Networks , 2015, 1504.03637.

[65]  Jörg Stelling,et al.  Bridging intracellular scales by mechanistic computational models. , 2018, Current opinion in biotechnology.

[66]  Igor Goryanin,et al.  Computational optimization and biological evolution. , 2010, Biochemical Society transactions.

[67]  Axel Kowald,et al.  Systems Biology - a Textbook , 2016 .

[68]  Arthur Sherman,et al.  Dynamical systems theory in physiology , 2011, The Journal of general physiology.

[69]  C D Murray,et al.  The Physiological Principle of Minimum Work: I. The Vascular System and the Cost of Blood Volume. , 1926, Proceedings of the National Academy of Sciences of the United States of America.

[70]  L. Bayón,et al.  Influence of enzyme production dynamics on the optimal control of a linear unbranched chemical process , 2018, Journal of Mathematical Chemistry.

[71]  H. McAdams,et al.  Global analysis of the genetic network controlling a bacterial cell cycle. , 2000, Science.

[72]  Jose A. Egea,et al.  Dynamic Optimization of Nonlinear Processes with an Enhanced Scatter Search Method , 2009 .

[73]  Reinhard Guthke,et al.  Optimal regulatory strategies for metabolic pathways in Escherichia coli depending on protein costs , 2011, Molecular Systems Biology.

[74]  Michael Dellnitz,et al.  A Survey of Recent Trends in Multiobjective Optimal Control—Surrogate Models, Feedback Control and Objective Reduction , 2018, Mathematical and Computational Applications.

[75]  R. Heinrich,et al.  Minimization of intermediate concentrations as a suggested optimality principle for biochemical networks , 1991 .

[76]  Eva Balsa-Canto,et al.  Global dynamic optimization approach to predict activation in metabolic pathways , 2014, BMC Systems Biology.

[77]  Jeffrey D Orth,et al.  What is flux balance analysis? , 2010, Nature Biotechnology.

[78]  Robert Rosen,et al.  Optimality in biology and medicine , 1986 .

[79]  R. Heinrich,et al.  The Regulation of Cellular Systems , 1996, Springer US.

[80]  Uri Alon,et al.  Evolutionary Tradeoffs between Economy and Effectiveness in Biological Homeostasis Systems , 2013, PLoS Comput. Biol..

[81]  Kok Lay Teo,et al.  A Unified Computational Approach to Optimal Control Problems , 1991 .

[82]  WächterAndreas,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006 .

[83]  Bruce A. Conway,et al.  A Survey of Methods Available for the Numerical Optimization of Continuous Dynamic Systems , 2011, Journal of Optimization Theory and Applications.

[84]  Daniel Liberzon,et al.  Calculus of Variations and Optimal Control Theory: A Concise Introduction , 2012 .

[85]  Eva Balsa-Canto,et al.  Prediction of activation of metabolic pathways via dynamic optimization , 2011 .

[86]  John T. Betts,et al.  Practical Methods for Optimal Control and Estimation Using Nonlinear Programming , 2009 .

[87]  Anil V. Rao,et al.  ( Preprint ) AAS 09-334 A SURVEY OF NUMERICAL METHODS FOR OPTIMAL CONTROL , 2009 .

[88]  Julio R. Banga,et al.  Model based optimization of biochemical systems using multiple objectives: a comparison of several solution strategies , 2006 .

[89]  Mariela D. Petkova,et al.  Optimal Decoding of Cellular Identities in a Genetic Network , 2016, Cell.

[90]  Manoj Srinivasan,et al.  Control theory in biology and medicine , 2019, Biological Cybernetics.

[91]  M. Mesarovic,et al.  Feedback dynamics and cell function: Why systems biology is called Systems Biology. , 2005, Molecular bioSystems.

[92]  Edda Klipp,et al.  Prediction of temporal gene expression. Metabolic opimization by re-distribution of enzyme activities. , 2002, European journal of biochemistry.

[93]  Irene Otero-Muras,et al.  Automated Design Framework for Synthetic Biology Exploiting Pareto Optimality. , 2017, ACS synthetic biology.

[94]  G. Stephanopoulos CHAPTER 1 – The Essence of Metabolic Engineering , 1998 .

[95]  U. Alon,et al.  Ordering Genes in a Flagella Pathway by Analysis of Expression Kinetics from Living Bacteria , 2001, Science.

[96]  Domitilla Del Vecchio,et al.  Control theory meets synthetic biology , 2016, Journal of The Royal Society Interface.

[97]  Graham D. Farquhar,et al.  Challenges and Opportunities of the Optimality Approach in Plant Ecology , 2002 .

[98]  R. Serban,et al.  CVODES: The Sensitivity-Enabled ODE Solver in SUNDIALS , 2005 .

[99]  Paul I. Barton,et al.  Dynamic Optimization in a Discontinuous World , 1998 .

[100]  R Heinrich,et al.  Theoretical approaches to the evolutionary optimization of glycolysis: thermodynamic and kinetic constraints. , 1997, European journal of biochemistry.

[101]  R. Heinrich,et al.  Mathematical analysis of enzymic reaction systems using optimization principles. , 1991, European journal of biochemistry.

[102]  Jean-Luc Gouzé,et al.  Optimal control of bacterial growth for the maximization of metabolite production , 2018, Journal of Mathematical Biology.

[103]  J. M. Smith,et al.  Optimization Theory in Evolution , 1978 .

[104]  Bruce Tidor,et al.  Biological network design strategies: discovery through dynamic optimization. , 2006, Molecular bioSystems.

[105]  Stefan Schuster,et al.  Modelling the optimal timing in metabolic pathway activation - Use of Pontryagin's Maximum Principle and role of the Golden section , 2010, Biosyst..

[106]  Kwang-Hyun Cho,et al.  The dynamic systems approach to control and regulation of intracellular networks , 2005, FEBS letters.

[107]  A Kremling,et al.  Systems biology--an engineering perspective. , 2007, Journal of biotechnology.

[108]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[109]  N. Novère Quantitative and logic modelling of molecular and gene networks , 2015, Nature Reviews Genetics.

[110]  R. Murray,et al.  Control Theory for Synthetic Biology: Recent Advances in System Characterization, Control Design, and Controller Implementation for Synthetic Biology , 2018, IEEE Control Systems.

[111]  R Heinrich,et al.  A theoretical approach to the evolution and structural design of enzymatic networks: linear enzymatic chains, branched pathways and glycolysis of erythrocytes. , 1987, Bulletin of mathematical biology.

[112]  S. Frank The trade‐off between rate and yield in the design of microbial metabolism , 2010, Journal of evolutionary biology.

[113]  Pedro A Saa,et al.  Formulation, construction and analysis of kinetic models of metabolism: A review of modelling frameworks. , 2017, Biotechnology advances.

[114]  U. Sauer,et al.  Multidimensional Optimality of Microbial Metabolism , 2012, Science.

[115]  P. Swain,et al.  Mechanistic links between cellular trade-offs, gene expression, and growth , 2015, Proceedings of the National Academy of Sciences.

[116]  U. Alon,et al.  Just-in-time transcription program in metabolic pathways , 2004, Nature Genetics.

[117]  Luis Froilán Bayón Arnau,et al.  Optimal control of a linear unbranched chemical process with {Mathematical expression} steps: the quasi-analytical solution , 2014 .

[118]  T. Gal Shadow prices and sensitivity analysis in linear programming under degeneracy , 1986 .

[119]  J. Geiselmann,et al.  Understanding carbon catabolite repression in Escherichia coli using quantitative models. , 2015, Trends in microbiology.

[120]  B. Ingalls,et al.  Sequential Activation of Metabolic Pathways: a Dynamic Optimization Approach , 2009, Bulletin of mathematical biology.

[121]  U. Alon,et al.  Optimality and evolutionary tuning of the expression level of a protein , 2005, Nature.

[122]  Christoph Kaleta,et al.  Optimality principles reveal a complex interplay of intermediate toxicity and kinetic efficiency in the regulation of prokaryotic metabolism , 2017, PLoS Comput. Biol..

[123]  Eva Balsa-Canto,et al.  Dynamic optimization of bioprocesses: efficient and robust numerical strategies. , 2005, Journal of biotechnology.

[124]  Michael E Phelps,et al.  Systems Biology and New Technologies Enable Predictive and Preventative Medicine , 2004, Science.

[125]  Pu Li,et al.  Optimal programs of pathway control: dissecting the influence of pathway topology and feedback inhibition on pathway regulation , 2015, BMC Bioinformatics.

[126]  M. Ehrenberg,et al.  Optimal control of gene expression for fast proteome adaptation to environmental change , 2013, Proceedings of the National Academy of Sciences.

[127]  Emmanuel Trélat,et al.  Optimal Control and Applications to Aerospace: Some Results and Challenges , 2012, Journal of Optimization Theory and Applications.

[128]  Heiner Müller-Merbach,et al.  Operations research : Methoden und Modelle der Optimalplanung , 1969 .

[129]  E. Meléndez-Hevia,et al.  Economy of design in metabolic pathways: further remarks on the game of the pentose phosphate cycle. , 1988, Journal of theoretical biology.

[130]  G. Tullock,et al.  Biological externalities. , 1971, Journal of theoretical biology.

[131]  Panos M. Pardalos,et al.  Handbook of optimization in medicine , 2009 .

[132]  D. Kell Metabolomics and systems biology: making sense of the soup. , 2004, Current opinion in microbiology.

[133]  Joshua D. Knowles,et al.  Multiobjective Optimization in Bioinformatics and Computational Biology , 2007, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[134]  S. Schuster,et al.  Minimization of intermediate concentrations as a suggested optimality principle for biochemical networks , 1991, Journal of mathematical biology.

[135]  Franco Blanchini,et al.  Control-theoretic methods for biological networks , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[136]  J. Bailey,et al.  Analysis and design of metabolic reaction networks via mixed‐integer linear optimization , 1996 .

[137]  L. Bayón,et al.  Optimal control of a linear unbranched chemical process with $$n$$n steps: the quasi-analytical solution , 2014 .

[138]  J. Vohradský,et al.  Proteomic analysis of the bacterial cell cycle , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[139]  O Shoval,et al.  Evolutionary Trade-Offs, Pareto Optimality, and the Geometry of Phenotype Space , 2012, Science.

[140]  William R Cluett,et al.  Constructing kinetic models of metabolism at genome‐scales: A review , 2015, Biotechnology journal.

[141]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[142]  Frank J. Poelwijk,et al.  Tradeoffs and Optimality in the Evolution of Gene Regulation , 2011, Cell.

[143]  William J. Sutherland,et al.  The best solution , 2005, Nature.

[144]  E. Voit,et al.  Pathway Analysis and Optimization in Metabolic Engineering , 2002 .

[145]  Bashar Ibrahim,et al.  Trends in mathematical modeling of host–pathogen interactions , 2019, Cellular and Molecular Life Sciences.

[146]  B. Palsson,et al.  Metabolic Flux Balancing: Basic Concepts, Scientific and Practical Use , 1994, Bio/Technology.

[147]  G. W. Swan Optimal control applications in biomedical engineering—a survey , 2007 .

[148]  Eva Balsa-Canto,et al.  Optimality and identification of dynamic models in systems biology: an inverse optimal control framework , 2018, Bioinform..

[149]  B. Teusink,et al.  Shifts in growth strategies reflect tradeoffs in cellular economics , 2009, Molecular systems biology.

[150]  Guillaume Terradot,et al.  Survival of the Fattest: Evolutionary Trade-offs in Cellular Resource Storage , 2018, SASB.

[151]  Daniel Segrè,et al.  Comparative multi-goal tradeoffs in systems engineering of microbial metabolism , 2012, BMC Systems Biology.

[152]  L. Biegler,et al.  Advances in simultaneous strategies for dynamic process optimization , 2002 .

[153]  Marta Cascante,et al.  Multicriteria optimization of biochemical systems by linear programming: application to production of ethanol by Saccharomyces cerevisiae. , 2003, Biotechnology and bioengineering.

[154]  Jan Hasenauer,et al.  Scalable Inference of Ordinary Differential Equation Models of Biochemical Processes. , 2017, Methods in molecular biology.

[155]  Jorge Goncalves,et al.  Control theory and systems biology , 2009 .

[156]  J. Nielsen Principles of optimal metabolic network operation , 2007, Molecular systems biology.

[157]  Harvey J. Greenberg,et al.  Reconstruction and Functional Characterization of the Human Mitochondrial Metabolic Network Based on Proteomic and Biochemical Data* , 2004, Journal of Biological Chemistry.

[158]  J. Stucki The optimal efficiency and the economic degrees of coupling of oxidative phosphorylation. , 1980, European journal of biochemistry.

[159]  Jörg Stelling,et al.  Systems interface biology , 2006, Journal of The Royal Society Interface.

[160]  Benoît Chachuat,et al.  Branch-and-Lift Algorithm for Deterministic Global Optimization in Nonlinear Optimal Control , 2014, J. Optim. Theory Appl..