Nonequilibrium thermodynamics modeling of coupled biochemical cycles in living cells

Living cells represent open, nonequilibrium, self-organizing, and dissipative systems maintained with the continuous supply of outside and inside material, energy, and information flows. The energy in the form of adenosine triphosphate is utilized in biochemical cycles, transport processes, protein synthesis, reproduction, and performing other biological work. The processes in molecular and cellular biological systems are stochastic in nature with varying spatial and time scales, and bounded with conservation laws, kinetic laws, and thermodynamic constraints, which should be taken into account by any approach for modeling biological systems. In component biology, this review focuses on the modeling of enzyme kinetics and fluctuation of single biomolecules acting as molecular motors, while in systems biology it focuses on modeling biochemical cycles and networks in which all the components of a biological system interact functionally over time and space. Biochemical cycles emerge from collective and functional efforts to devise a cyclic flow of optimal energy degradation rate, which can only be described by nonequilibrium thermodynamics. Therefore, this review emphasizes the role of nonequilibrium thermodynamics through the formulations of thermodynamically coupled biochemical cycles, entropy production, fluctuation theorems, bioenergetics, and reaction-diffusion systems. Fluctuation theorems relate the forward and backward dynamical randomness of the trajectories or paths, bridge the microscopic and macroscopic domains, and link the time-reversible and irreversible descriptions of biological systems. However, many of these approaches are in their early stages of their development and no single computational or experimental technique is able to span all the relevant and necessary spatial and temporal scales. Wide range of experimental and novel computational techniques with high accuracy, precision, coverage, and efficiency are necessary for understanding biochemical cycles.

[1]  S. Liang,et al.  A pivoting algorithm for metabolic networks in the presence of thermodynamic constraints , 2005, 2005 IEEE Computational Systems Bioinformatics Conference (CSB'05).

[2]  H. Qian.  Cycle kinetics, steady state thermodynamics and motors—a paradigm for living matter physics , 2005, Journal of physics. Condensed matter : an Institute of Physics journal.

[3]  Hong Qian,et al.  Thermodynamic limit of a nonequilibrium steady state: Maxwell-type construction for a bistable biochemical system. , 2009, Physical review letters.

[4]  H. Qian.  Entropy production and excess entropy in a nonequilibrium steady-state of single macromolecules. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  P. Kuchel,et al.  A non-equilibrium thermodynamics model of reconstituted Ca2+-ATPase , 1998, European Biophysics Journal.

[6]  A. Robert,et al.  Symmetry breaking in biological systems. From molecules to tissues , 2007 .

[7]  Daniel Russel,et al.  The structural dynamics of macromolecular processes. , 2009, Current opinion in cell biology.

[8]  Enrique Peacock-López,et al.  Bifurcation diagrams and Turing patterns in a chemical self-replicating reaction-diffusion system with cross diffusion. , 2007, The Journal of chemical physics.

[9]  M. Compiani,et al.  Efficiency of energy conversion in model biological pumps. Optimization by linear nonequilibrium thermodynamic relations. , 1983, Biophysical chemistry.

[10]  V. N. Belykh,et al.  Homoclinic bifurcations leading to the emergence of bursting oscillations in cell models , 2000 .

[11]  M. Futai,et al.  A Biological Molecular Motor, Proton-Translocating ATP Synthase: Multidisciplinary Approach for a Unique Membrane Enzyme , 2000, Journal of bioenergetics and biomembranes.

[12]  H. Qian,et al.  Ultrasensitive dual phosphorylation dephosphorylation cycle kinetics exhibits canonical competition behavior. , 2009, Chaos.

[13]  Paola Turina,et al.  H+/ATP ratio of proton transport‐coupled ATP synthesis and hydrolysis catalysed by CF0F1—liposomes , 2003, The EMBO journal.

[14]  Hong Qian,et al.  Chemical Biophysics: Quantitative Analysis of Cellular Systems , 2008 .

[15]  D. G. Leaist,et al.  Nernst-Planck analysis of propagating reaction-diffusion fronts in the aqueous iodate-arsenous acid system. , 2007, Physical chemistry chemical physics : PCCP.

[16]  A general theory of non-equilibrium dynamics of lipid-protein fluid membranes , 2004, The European physical journal. E, Soft matter.

[17]  P. Gaspard.  Hamiltonian dynamics, nanosystems, and nonequilibrium statistical mechanics , 2006, cond-mat/0603382.

[18]  Pierre Gaspard,et al.  Fluctuation theorems and the nonequilibrium thermodynamics of molecular motors. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  T. Misteli.  The concept of self-organization in cellular architecture , 2001, The Journal of cell biology.

[20]  Jason A. Papin,et al.  Extreme pathway lengths and reaction participation in genome-scale metabolic networks. , 2002, Genome research.

[21]  Ileana M Cristea,et al.  Fluorescent Proteins as Proteomic Probes*S , 2005, Molecular & Cellular Proteomics.

[22]  P. Maini,et al.  The Turing Model Comes of Molecular Age , 2006, Science.

[23]  F. Ritort,et al.  The nonequilibrium thermodynamics of small systems , 2005 .

[24]  François Nédélec,et al.  Computer simulations reveal motor properties generating stable antiparallel microtubule interactions , 2002, The Journal of cell biology.

[25]  J M Rubí,et al.  The mesoscopic dynamics of thermodynamic systems. , 2005, The journal of physical chemistry. B.

[26]  F. Schlögl.  Chemical reaction models for non-equilibrium phase transitions , 1972 .

[27]  R Nigam,et al.  Algorithm for perturbing thermodynamically infeasible metabolic networks , 2007, Comput. Biol. Medicine.

[28]  Jin Wang,et al.  Least dissipation cost as a design principle for robustness and function of cellular networks. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[29]  Hong Qian,et al.  Single-molecule enzymology: stochastic Michaelis-Menten kinetics. , 2002, Biophysical chemistry.

[30]  P. Ao,et al.  Metabolic network modelling: Including stochastic effects , 2005, Comput. Chem. Eng..

[31]  Hong Qian,et al.  Stochastic dynamics and non-equilibrium thermodynamics of a bistable chemical system: the Schlögl model revisited , 2009, Journal of The Royal Society Interface.

[32]  Ilya Nemenman,et al.  Adiabatic coarse-graining and simulations of stochastic biochemical networks , 2009, Proceedings of the National Academy of Sciences.

[33]  G. Crooks.  Entropy production fluctuation theorem and the nonequilibrium work relation for free energy differences. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[34]  On Hamiltonian dynamics , 1970 .

[35]  B. Palsson,et al.  An expanded genome-scale model of Escherichia coli K-12 (iJR904 GSM/GPR) , 2003, Genome Biology.

[36]  Friedrich Schl gl.  Chemical Reaction Models for Non-Equilibrium Phase Transitions , 2005 .

[37]  Hong Qian,et al.  Phosphorylation energy hypothesis: open chemical systems and their biological functions. , 2007, Annual review of physical chemistry.

[38]  David Parker,et al.  Coarse-Grained Structural Modeling of Molecular Motors Using Multibody Dynamics , 2009, Cellular and molecular bioengineering.

[39]  J. Baker,et al.  The biochemical kinetics underlying actin movement generated by one and many skeletal muscle myosin molecules. , 2002, Biophysical journal.

[40]  N. Dan.  Understanding dynamic disorder fluctuations in single-molecule enzymatic reactions , 2007 .

[41]  H. Qian,et al.  Energy balance for analysis of complex metabolic networks. , 2002, Biophysical journal.

[42]  J. Schnakenberg,et al.  G. Nicolis und I. Prigogine: Self‐Organization in Nonequilibrium Systems. From Dissipative Structures to Order through Fluctuations. J. Wiley & Sons, New York, London, Sydney, Toronto 1977. 491 Seiten, Preis: £ 20.–, $ 34.– , 1978 .

[43]  Hong Qian,et al.  Grand canonical Markov model: a stochastic theory for open nonequilibrium biochemical networks. , 2006, The Journal of chemical physics.

[44]  J. Rinzel,et al.  Noise-induced alternations in an attractor network model of perceptual bistability. , 2007, Journal of neurophysiology.

[45]  Carlos Bustamante,et al.  Differential detection of dual traps improves the spatial resolution of optical tweezers. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[46]  M. Crommelinck,et al.  Self-organization and emergence in life sciences , 2006 .

[47]  Masasuke Yoshida,et al.  Effect of e subunit on the rotation of thermophilic Bacillus F 1-ATPase , 2009 .

[48]  Jan V. Sengers,et al.  Hydrodynamic Fluctuations in Fluids and Fluid Mixtures , 2006 .

[49]  E. Karsenti.  Self-organization in cell biology: a brief history , 2008, Nature Reviews Molecular Cell Biology.

[50]  Y. Demirel.  Non-isothermal reaction-diffusion systems with thermodynamically coupled heat and mass transfer , 2006 .

[51]  Y. Demirel,et al.  Thermodynamics and bioenergetics. , 2002, Biophysical chemistry.

[52]  Guy Theraulaz,et al.  Self-Organization in Biological Systems , 2001, Princeton studies in complexity.

[53]  Stanislaw Sieniutycz,et al.  Nonequilibrium Thermodynamics: Transport and Rate Processes in Physical and Biological Systems , 2003, Open Syst. Inf. Dyn..

[54]  Ron Elber,et al.  Extending molecular dynamics time scales with milestoning: example of complex kinetics in a solvated peptide. , 2007, The Journal of chemical physics.

[55]  H. Qian,et al.  A Quasistationary Analysis of a Stochastic Chemical Reaction: Keizer’s Paradox , 2007, Bulletin of mathematical biology.

[56]  Frank Jülicher,et al.  Oscillations in cell biology. , 2005, Current opinion in cell biology.

[57]  H. Qian,et al.  Thermodynamic constraints for biochemical networks. , 2004, Journal of theoretical biology.

[58]  Jin Wang,et al.  Quantifying robustness and dissipation cost of yeast cell cycle network: the funneled energy landscape perspectives. , 2007, Biophysical journal.

[59]  Y. Demirel,et al.  Nonequilibrium Thermodynamics in Engineering and Science , 2004 .

[60]  J. Tabony.  Historical and conceptual background of self‐organization by reactive processes , 2006, Biology of the cell.

[61]  Martin Bier,et al.  Accounting for the energies and entropies of kinesin’s catalytic cycle , 2008 .

[62]  M. L. Martins,et al.  Multiscale models for biological systems , 2010 .

[63]  F. Collins,et al.  A vision for the future of genomics research , 2003, Nature.

[64]  Wolfgang Wiechert,et al.  The thermodynamic meaning of metabolic exchange fluxes. , 2007, Biophysical journal.

[65]  D Groswasser,et al.  Active gels : dynamics of patterning and self-organization , 2006 .

[66]  S. Caplan,et al.  Degree of coupling and its relation to efficiency of energy conversion , 1965 .

[67]  Benjamin S. Glick,et al.  Let there be order , 2007, Nature Cell Biology.

[68]  Q. Jin,et al.  Kinetics of electron transfer through the respiratory chain. , 2002, Biophysical journal.

[69]  H. Qian.  Equations for stochastic macromolecular mechanics of single proteins: Equilibrium fluctuations, transient kinetics, and nonequilibrium steady-state , 2000, physics/0007017.

[70]  H. Qian,et al.  Thermodynamics of stoichiometric biochemical networks in living systems far from equilibrium. , 2005, Biophysical chemistry.

[71]  Johan Paulsson,et al.  Models of stochastic gene expression , 2005 .

[72]  Shu-Kun Lin,et al.  Modern Thermodynamics: From Heat Engines to Dissipative Structures , 1999, Entropy.

[73]  L. Pirola,et al.  Bifurcation of lipid and protein kinase signals of PI3Kgamma to the protein kinases PKB and MAPK. , 1998, Science.

[74]  Stephen R. Williams,et al.  Fluctuation theorems. , 2007, Annual review of physical chemistry.

[75]  H. Qian,et al.  Relationship between Thermodynamic Driving Force and One-Way Fluxes in Reversible Processes , 2006, PloS one.

[76]  J. Tyson,et al.  Modelling the controls of the eukaryotic cell cycle. , 2003, Biochemical Society transactions.

[77]  J. Castresana,et al.  Comparative genomics and bioenergetics. , 2001, Biochimica et biophysica acta.

[78]  Hong Qian,et al.  The mathematical theory of molecular motor movement and chemomechanical energy transduction , 2000, cond-mat/0106302.

[79]  A. Goldbeter.  Oscillations and waves of cyclic AMP in Dictyostelium: A prototype for spatio-temporal organization and pulsatile intercellular communication , 2006, Bulletin of mathematical biology.

[80]  H. Kitano.  Systems Biology: A Brief Overview , 2002, Science.

[81]  H. Qian.  A simple theory of motor protein kinetics and energetics. II. , 2000, Biophysical chemistry.

[82]  Bernhard O Palsson,et al.  Development of network-based pathway definitions: the need to analyze real metabolic networks. , 2003, Trends in biotechnology.

[83]  P Ao,et al.  LETTER TO THE EDITOR: Potential in stochastic differential equations: novel construction , 2004 .

[84]  O. Aono.  Thermodynamic coupling of diffusion with chemical reaction , 1975 .

[85]  P. Nurse,et al.  Self-organization of interphase microtubule arrays in fission yeast , 2006, Nature Cell Biology.

[86]  P. Maini,et al.  Developmental biology. The Turing model comes of molecular age. , 2006, Science.

[87]  James E. Ferrell,et al.  Bistability in cell signaling: How to make continuous processes discontinuous, and reversible processes irreversible. , 2001, Chaos.

[88]  Eberhard O. Voit,et al.  Computational Analysis of Biochemical Systems: A Practical Guide for Biochemists and Molecular Biologists , 2000 .

[89]  J. Stucki.  The thermodynamic-buffer enzymes. , 1980, European journal of biochemistry.

[90]  P. Gaspard.  Fluctuation Theorem, Nonequilibrium Work, and Molecular Machines , 2010 .

[91]  Hong Qian,et al.  Open-system nonequilibrium steady state: statistical thermodynamics, fluctuations, and chemical oscillations. , 2006, The journal of physical chemistry. B.

[92]  E. Sevick,et al.  Fluctuations and irreversibility: an experimental demonstration of a second-law-like theorem using a colloidal particle held in an optical trap. , 2004, Physical review letters.

[93]  W. Luder.  Introduction to thermodynamics of irreversible processes , 1955 .

[94]  C. Antoine,et al.  Resonance of relaxation time in the temperature modulated Schlögl model. , 2007, The Journal of chemical physics.

[95]  A. M. Turing,et al.  The chemical basis of morphogenesis , 1952, Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences.

[96]  S. Ponce Dawson,et al.  Turing Patterns Inside Cells , 2007, PloS one.

[97]  E. Klipp,et al.  Bringing metabolic networks to life: convenience rate law and thermodynamic constraints , 2006, Theoretical Biology and Medical Modelling.

[98]  P Gaspard,et al.  Entropy production and time asymmetry in nonequilibrium fluctuations. , 2007, Physical review letters.

[99]  Bambi Hu,et al.  Effects of critical fluctuations to stochastic thermodynamic behavior of chemical reaction systems at steady state far from equilibrium , 2002 .

[100]  J. Elf,et al.  Spontaneous separation of bi-stable biochemical systems into spatial domains of opposite phases. , 2004, Systems biology.

[101]  Nonequilibrium steady state of a nanometric biochemical system: determining the thermodynamic driving force from single enzyme turnover time traces. , 2005, Nano letters.

[102]  Kazuhiko Kinosita,et al.  Myosin V Walks by Lever Action and Brownian Motion , 2007, Science.

[103]  I. Prigogine,et al.  Formative Processes. (Book Reviews: Self-Organization in Nonequilibrium Systems. From Dissipative Structures to Order through Fluctuations) , 1977 .

[104]  P. McSharry,et al.  Mathematical and computational techniques to deduce complex biochemical reaction mechanisms. , 2004, Progress in biophysics and molecular biology.

[105]  Qiang Cui,et al.  Interpreting correlated motions using normal mode analysis. , 2006, Structure.

[106]  L. Hood.  Systems biology: integrating technology, biology, and computation , 2003, Mechanisms of Ageing and Development.

[107]  The nonequilibrium thermodynamics of small systems , 2007 .

[108]  Adrian H Elcock,et al.  Atomically detailed simulations of concentrated protein solutions: the effects of salt, pH, point mutations, and protein concentration in simulations of 1000-molecule systems. , 2006, Journal of the American Chemical Society.

[109]  H. Qian,et al.  Stoichiometric network theory for nonequilibrium biochemical systems. , 2003, European journal of biochemistry.

[110]  T. L. Hill,et al.  Free Energy Transduction and Biochemical Cycle Kinetics , 1988, Springer New York.

[111]  Microtubule self-organisation by reaction-diffusion processes in miniature cell-sized containers and phospholipid vesicles. , 2006, Biophysical chemistry.

[112]  A. Essig,et al.  Bioenergetics and Linear Nonequilibrium Thermodynamics: The Steady State , 1983 .

[113]  S. Leibler,et al.  Physical Properties Determining Self-Organization of Motors and Microtubules , 2001, Science.

[114]  R. Dewar.  Maximum entropy production and the fluctuation theorem , 2005 .

[115]  J. Stucki.  The optimal efficiency and the economic degrees of coupling of oxidative phosphorylation. , 1980, European journal of biochemistry.

[116]  J. Stelling,et al.  Robustness of Cellular Functions , 2004, Cell.

[117]  B. Kholodenko,et al.  Metabolic engineering in the post genomic era , 2004 .

[118]  C. Joo,et al.  Advances in single-molecule fluorescence methods for molecular biology. , 2008, Annual review of biochemistry.

[119]  C. Jarzynski,et al.  Verification of the Crooks fluctuation theorem and recovery of RNA folding free energies , 2005, Nature.

[120]  L. Wolpert.  Developmental Biology , 1968, Nature.

[121]  Dulos,et al.  Experimental evidence of a sustained standing Turing-type nonequilibrium chemical pattern. , 1990, Physical review letters.

[122]  S. Ellias,et al.  Nonequilibrium linear behavior of biological systems. Existence of enzyme-mediated multidimensional inflection points. , 1980, Biophysical journal.

[123]  A. Arkin,et al.  Stochastic kinetic analysis of developmental pathway bifurcation in phage lambda-infected Escherichia coli cells. , 1998, Genetics.

[124]  Gregory A Voth,et al.  Multiscale simulation of transmembrane proteins. , 2007, Journal of structural biology.

[125]  Yaşar Demirel,et al.  Linear-nonequilibrium thermodynamics theoryfor coupled heat and mass transport , 2001 .

[126]  E. Hernández-Lemus.  Non-equilibrium thermodynamics of gene expression and transcriptional regulation , 2009, 0904.0662.

[127]  V. Isaeva.  Self-organization in biological systems , 2012, Biology Bulletin.

[128]  S. Leibler,et al.  Robustness in simple biochemical networks , 1997, Nature.

[129]  Kunihiko Kaneko,et al.  Minimal requirements for robust cell size control in eukaryotic cells , 2007, Physical biology.

[130]  Custom design of metabolism , 2004, Nature Biotechnology.

[131]  J. Baker,et al.  Free energy transduction in a chemical motor model. , 2003, Journal of theoretical biology.

[132]  K. B. Oldham,et al.  Fundamentals of electrochemical science , 1993 .

[133]  J. Stucki.  Non-equilibrium thermodynamic sensitivity of oxidative phosphorylation , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[134]  Daniel T Gillespie,et al.  Stochastic simulation of chemical kinetics. , 2007, Annual review of physical chemistry.

[135]  Minping Qian,et al.  Mathematical Theory of Nonequilibrium Steady States , 2004 .

[136]  H. Qian.  A simple theory of motor protein kinetics and energetics. , 1997, Biophysical chemistry.

[137]  Sabine Mondié,et al.  Bifurcation analysis of a biochemical network , 2006 .

[138]  Y. Demirel.  Modeling of thermodynamically coupled reaction-transport systems , 2008 .

[139]  A. Lapidus,et al.  Methylotrophy in Methylobacterium extorquens AM1 from a Genomic Point of View , 2003, Journal of bacteriology.

[140]  P. Mazur,et al.  Non-equilibrium thermodynamics, , 1963 .

[141]  Daniel A Beard,et al.  Extreme pathways and Kirchhoff's second law. , 2002, Biophysical journal.

[142]  Rebecca C Wade,et al.  Bridging from molecular simulation to biochemical networks. , 2007, Current opinion in structural biology.

[143]  Debra J. Searles,et al.  The Fluctuation Theorem , 2002 .

[144]  A. S. Cukrowski,et al.  ON VALIDITY OF LINEAR PHENOMENOLOGICAL NONEQUILIBRIUM THERMODYNAMICS EQUATIONS IN CHEMICAL KINETICS , 2005 .

[145]  Anirban Banerjee,et al.  Mitochondrial oxidative phosphorylation thermodynamic efficiencies reflect physiological organ roles. , 1998, American journal of physiology. Regulatory, integrative and comparative physiology.

[146]  Peter Hänggi,et al.  Introduction to the physics of Brownian motors , 2001 .

[147]  Molecular simulation and theory for nanosystems: Insights for molecular motors , 2008 .