Statistics of Infima and Stopping Times of Entropy Production and Applications to Active Molecular Processes

We study the statistics of infima, stopping times and passage probabilities of entropy production in nonequilibrium steady states, and show that they are universal. We consider two examples of stopping times: first-passage times of entropy production and waiting times of stochastic processes, which are the times when a system reaches for the first time a given state. Our main results are: (i) the distribution of the global infimum of entropy production is exponential with mean equal to minus Boltzmann's constant; (ii) we find the exact expressions for the passage probabilities of entropy production to reach a given value; (iii) we derive a fluctuation theorem for stopping-time distributions of entropy production. These results have interesting implications for stochastic processes that can be discussed in simple colloidal systems and in active molecular processes. In particular, we show that the timing and statistics of discrete chemical transitions of molecular processes, such as, the steps of molecular motors, are governed by the statistics of entropy production. We also show that the extreme-value statistics of active molecular processes are governed by entropy production, for example, the infimum of entropy production of a motor can be related to the maximal excursion of a motor against the direction of an external force. Using this relation, we make predictions for the distribution of the maximum backtrack depth of RNA polymerases, which follows from our universal results for entropy-production infima.

[1]  M. Musiela,et al.  Martingale Methods in Financial Modelling , 2002 .

[2]  Juan M R Parrondo,et al.  Entropy production and Kullback-Leibler divergence between stationary trajectories of discrete systems. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  F. Ritort,et al.  The nonequilibrium thermodynamics of small systems , 2005 .

[4]  J. Pekola,et al.  Test of the Jarzynski and Crooks fluctuation relations in an electronic system. , 2012, Physical review letters.

[5]  Cohen,et al.  Dynamical Ensembles in Nonequilibrium Statistical Mechanics. , 1994, Physical review letters.

[6]  Evans,et al.  Equilibrium microstates which generate second law violating steady states. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[7]  Toshio Yanagida,et al.  Chemomechanical coupling of the forward and backward steps of single kinesin molecules , 2002, Nature Cell Biology.

[8]  Hong Qian,et al.  On detailed balance and reversibility of semi-Markov processes and single-molecule enzyme kinetics , 2007 .

[9]  M. Kashlev,et al.  Transcriptional arrest: Escherichia coli RNA polymerase translocates backward, leaving the 3' end of the RNA intact and extruded. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Evans,et al.  Probability of second law violations in shearing steady states. , 1993, Physical review letters.

[11]  Test of the fluctuation theorem for stochastic entropy production in a nonequilibrium steady state. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  Anatoly B Kolomeisky,et al.  Understanding mechanochemical coupling in kinesins using first-passage-time processes. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  U. Seifert Stochastic thermodynamics, fluctuation theorems and molecular machines , 2012, Reports on progress in physics. Physical Society.

[14]  Jin Wang Landscape and flux theory of non-equilibrium dynamical systems with application to biology , 2015 .

[15]  J. Doob Stochastic processes , 1953 .

[16]  P. Gaspard Time-Reversed Dynamical Entropy and Irreversibility in Markovian Random Processes , 2004 .

[17]  M. Qian,et al.  Mathematical Theory of Nonequilibrium Steady States: On the Frontier of Probability and Dynamical Systems , 2004 .

[18]  Pablo Sartori,et al.  Thermodynamics of Error Correction , 2015, 1504.06407.

[19]  Martin Depken,et al.  The origin of short transcriptional pauses. , 2009, Biophysical journal.

[20]  Shunsuke Sato,et al.  Inverse gaussian distribution and its application , 1994 .

[21]  Jorge Kurchan,et al.  Fluctuation theorem for stochastic dynamics , 1998 .

[22]  Z. Schuss Theory and Applications of Stochastic Processes: An Analytical Approach , 2009 .

[23]  M. Aschwanden Statistics of Random Processes , 2021, Biomedical Measurement Systems and Data Science.

[24]  Yonggun Jun,et al.  High-precision test of Landauer's principle in a feedback trap. , 2014, Physical review letters.

[25]  H. Kramers Brownian motion in a field of force and the diffusion model of chemical reactions , 1940 .

[26]  Andre C. Barato,et al.  Affinity- and topology-dependent bound on current fluctuations , 2016, 1605.07542.

[27]  S. Ciliberto,et al.  An experimental test of the Gallavotti-Cohen fluctuation theorem , 1998 .

[28]  Decay times in turnover statistics of single enzymes. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[29]  Jordan M. Horowitz,et al.  Thermodynamic Costs of Information Processing in Sensory Adaptation , 2014, PLoS Comput. Biol..

[30]  T Speck,et al.  Measurement of stochastic entropy production. , 2006, Physical review letters.

[31]  Marco Del Giudice,et al.  Thermodynamic limits to information harvesting by sensory systems , 2014, 1408.5128.

[32]  Heinrich Meyr,et al.  Complete statistical description of the phase-error process generated by correlative tracking systems , 1977, IEEE Trans. Inf. Theory.

[33]  M. Esposito,et al.  Tightening the uncertainty principle for stochastic currents. , 2016, Physical review. E.

[34]  U. Seifert,et al.  The Jarzynski relation, fluctuation theorems, and stochastic thermodynamics for non-Markovian processes , 2007, 0709.2236.

[35]  C. Maes On the origin and the use of fluctuation relations for the entropy , 2003 .

[36]  Debra J Searles,et al.  Experimental demonstration of violations of the second law of thermodynamics for small systems and short time scales. , 2002, Physical review letters.

[37]  J. Parrondo,et al.  Dissipation: the phase-space perspective. , 2007, Physical review letters.

[38]  Kellen Petersen August Real Analysis , 2009 .

[39]  Udo Seifert Entropy production along a stochastic trajectory and an integral fluctuation theorem. , 2005, Physical review letters.

[40]  C. Maes,et al.  Time-Reversal and Entropy , 2002, cond-mat/0202501.

[41]  J. Stoyanov A Guide to First‐passage Processes , 2003 .

[42]  Dmitri Petrov,et al.  Universal features in the energetics of symmetry breaking , 2013, Nature Physics.

[43]  Helly Grundbegriffe der Wahrscheinlichkeitsrechnung , 1936 .

[44]  G. Crooks Path-ensemble averages in systems driven far from equilibrium , 1999, cond-mat/9908420.

[45]  C. DeWitt-Morette,et al.  Techniques and Applications of Path Integration , 1981 .

[46]  Antonio Celani,et al.  Multiple-scale stochastic processes: Decimation, averaging and beyond , 2016, 1612.04999.

[47]  G. N. Bochkov,et al.  Contribution to the general theory of thermal fluctuations in nonlinear systems , 1977 .

[48]  Heinrich Meyr,et al.  An information theoretic analysis of sequential decision-making , 2015, 2017 IEEE International Symposium on Information Theory (ISIT).

[49]  Jeremy L. England,et al.  Statistical physics of self-replication. , 2012, The Journal of chemical physics.

[50]  T Speck,et al.  Characterizing potentials by a generalized Boltzmann factor. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[51]  Ken Sekimoto,et al.  Langevin Equation and Thermodynamics , 1998 .

[52]  C. Bustamante,et al.  Transcription factors IIS and IIF enhance transcription efficiency by differentially modifying RNA polymerase pausing dynamics , 2014, Proceedings of the National Academy of Sciences.

[53]  T. Björk Arbitrage Theory in Continuous Time , 2019 .

[54]  A. Dhar,et al.  Waiting for rare entropic fluctuations , 2015, 1504.02187.

[55]  F. Jülicher,et al.  Motion of RNA polymerase along DNA: a stochastic model. , 1998, Biophysical journal.

[56]  P. Hänggi,et al.  Reaction-rate theory: fifty years after Kramers , 1990 .

[57]  Jay X. Tang,et al.  Flagellar Motor Switching in Caulobacter Crescentus Obeys First Passage Time Statistics. , 2015, Physical review letters.

[58]  De Barra Introduction to Measure Theory , 1974 .

[59]  C. Bustamante,et al.  Complete dissection of transcription elongation reveals slow translocation of RNA polymerase II in a linear ratchet mechanism , 2013, eLife.

[60]  Artyom Petrosyan,et al.  Steady-state fluctuation relations for systems driven by an external random force , 2009, 0912.1116.

[61]  Pau Mestres,et al.  Realization of nonequilibrium thermodynamic processes using external colored noise. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[62]  Eric D. Siggia,et al.  Decisions on the fly in cellular sensory systems , 2013, Proceedings of the National Academy of Sciences.

[63]  P. Mazur,et al.  Non-equilibrium thermodynamics, , 1963 .

[64]  Artyom Petrosyan,et al.  Fluctuations and response in a non-equilibrium micron-sized system , 2010, 1006.3196.

[65]  P. Reimann Brownian motors: noisy transport far from equilibrium , 2000, cond-mat/0010237.

[66]  K. Gawȩdzki,et al.  Fluctuation Relations for Diffusion Processes , 2007, 0707.2725.

[67]  Peter G. Bergmann,et al.  New Approach to Nonequilibrium Processes , 1955 .

[68]  Todd R. Gingrich,et al.  Dissipation Bounds All Steady-State Current Fluctuations. , 2015, Physical review letters.

[69]  Carlos Bustamante,et al.  Backtracking determines the force sensitivity of RNAP II in a factor-dependent manner , 2007, Nature.

[70]  A. Shiryayev,et al.  Statistics of Random Processes I: General Theory , 1984 .

[71]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[72]  Heinrich Meyr,et al.  Decision Making in the Arrow of Time. , 2015, Physical review letters.

[73]  Sidney Redner,et al.  A guide to first-passage processes , 2001 .

[74]  F. Jülicher,et al.  Modeling molecular motors , 1997 .

[75]  É. Roldán Irreversibility and Dissipation in Microscopic Systems , 2014 .

[76]  C. Jarzynski Equalities and Inequalities: Irreversibility and the Second Law of Thermodynamics at the Nanoscale , 2011 .

[77]  Bradley M. Zamft,et al.  Nascent RNA structure modulates the transcriptional dynamics of RNA polymerases , 2012, Proceedings of the National Academy of Sciences.

[78]  A. Jayannavar,et al.  Entropy production theorems and some consequences. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[79]  Minping Qian,et al.  Mathematical Theory of Nonequilibrium Steady States , 2004 .

[80]  Shoichi Toyabe,et al.  Thermodynamic efficiency and mechanochemical coupling of F1-ATPase , 2011, Proceedings of the National Academy of Sciences.

[81]  G. Crooks Entropy production fluctuation theorem and the nonequilibrium work relation for free energy differences. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[82]  Hiroyuki Noji,et al.  Fluctuation theorem applied to F1-ATPase. , 2010, Physical review letters.

[83]  R. Hentschke Non-Equilibrium Thermodynamics , 2014 .

[84]  Arnab K. Pal,et al.  Extreme value statistics of correlated random variables , 2014, 1406.6768.

[85]  Shamik Gupta,et al.  Two Refreshing Views of Fluctuation Theorems Through Kinematics Elements and Exponential Martingale , 2010, 1009.0707.

[86]  Édgar Roldán,et al.  Mechanisms of backtrack recovery by RNA polymerases I and II , 2016, Proceedings of the National Academy of Sciences.

[87]  The Fluctuation Theorem as a Gibbs Property , 1998, math-ph/9812015.

[88]  Udo Seifert,et al.  Universal bounds on current fluctuations. , 2015, Physical review. E.

[89]  H. Risken The Fokker-Planck equation : methods of solution and applications , 1985 .

[90]  S. Sharma,et al.  The Fokker-Planck Equation , 2010 .

[91]  Andre C. Barato,et al.  Efficiency of cellular information processing , 2014, 1405.7241.

[92]  Gerhard Hummer,et al.  Free energy surfaces from single-molecule force spectroscopy. , 2005, Accounts of chemical research.

[93]  F. Cornu,et al.  Local detailed balance: a microscopic derivation , 2014, 1412.8179.

[94]  Hong Qian,et al.  Generalized Haldane equation and fluctuation theorem in the steady-state cycle kinetics of single enzymes. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[95]  C. Jarzynski,et al.  Verification of the Crooks fluctuation theorem and recovery of RNA folding free energies , 2005, Nature.

[96]  C. Maes,et al.  On the definition of entropy production, via examples , 2000 .

[97]  M. Esposito Stochastic thermodynamics under coarse graining. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[98]  F. Marchesoni,et al.  Artificial Brownian motors: Controlling transport on the nanoscale , 2008, 0807.1283.

[99]  Juan Ruben Gomez-Solano,et al.  Experimental verification of a modified fluctuation-dissipation relation for a micron-sized particle in a nonequilibrium steady state. , 2009, Physical review letters.

[100]  G. Iyengar,et al.  A universal lower bound on the free energy cost of molecular measurements , 2016, 1608.07663.

[101]  C. Bustamante,et al.  The mechanochemistry of molecular motors. , 2000, Biophysical journal.

[102]  J. Parrondo,et al.  Intermittent transcription dynamics for the rapid production of long transcripts of high fidelity. , 2013, Cell reports.

[103]  S. Majumdar,et al.  Precise asymptotics for a random walker’s maximum , 2005, cond-mat/0506195.

[104]  M. Qian,et al.  Cycle symmetries and circulation fluctuations for discrete-time and continuous-time Markov chains , 2014, 1407.1263.

[105]  C. Jarzynski,et al.  Conditional reversibility in nonequilibrium stochastic systems. , 2016, Physical review. E.

[106]  Richard E Spinney,et al.  Entropy production in full phase space for continuous stochastic dynamics. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[107]  M. Basseville,et al.  Sequential Analysis: Hypothesis Testing and Changepoint Detection , 2014 .

[108]  Alʹbert Nikolaevich Shiri︠a︡ev,et al.  Statistics of random processes , 1977 .

[109]  G. Crooks Nonequilibrium Measurements of Free Energy Differences for Microscopically Reversible Markovian Systems , 1998 .

[110]  T. Speck,et al.  Distribution of entropy production for a colloidal particle in a nonequilibrium steady state , 2007, 0705.0324.

[111]  Hao Ge Waiting cycle times and generalized Haldane equality in the steady-state cycle kinetics of single enzymes. , 2008, The journal of physical chemistry. B.

[112]  K. Funo,et al.  Nonequilibrium equalities in absolutely irreversible processes. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[113]  C. Jarzynski Nonequilibrium Equality for Free Energy Differences , 1996, cond-mat/9610209.

[114]  D. Bedeaux,et al.  Entropy production in mesoscopic stochastic thermodynamics: nonequilibrium kinetic cycles driven by chemical potentials, temperatures, and mechanical forces , 2016, Journal of physics. Condensed matter : an Institute of Physics journal.

[115]  Fluidized granular medium as an instance of the fluctuation theorem. , 2003, Physical review letters.

[116]  Pierre Gaspard,et al.  Erratum: Time-Reversed Dynamical Entropy and Irreversibility in Markovian Random Processes , 2004 .

[117]  G. Iyengar,et al.  A lower bound on the free energy cost of molecular measurements , 2016 .

[118]  David Williams,et al.  Probability with Martingales , 1991, Cambridge mathematical textbooks.

[119]  Steven M. Block,et al.  Trigger loop dynamics mediate the balance between the transcriptional fidelity and speed of RNA polymerase II , 2012, Proceedings of the National Academy of Sciences.

[120]  Udo Seifert,et al.  Thermodynamic uncertainty relation for biomolecular processes. , 2015, Physical review letters.

[121]  Tetsuya J Kobayashi,et al.  Implementation of dynamic Bayesian decision making by intracellular kinetics. , 2010, Physical review letters.

[122]  S Ciliberto,et al.  Nonequilibrium fluctuations in a resistor. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[123]  M. Bauer,et al.  Affinity and Fluctuations in a Mesoscopic Noria , 2014, 1402.2422.

[124]  J. Lebowitz,et al.  A Gallavotti–Cohen-Type Symmetry in the Large Deviation Functional for Stochastic Dynamics , 1998, cond-mat/9811220.

[125]  Irene Marzuoli Extreme values statistics in Brownian motion and other stochastic processes , 2015 .

[126]  Massimiliano Esposito,et al.  Ensemble and trajectory thermodynamics: A brief introduction , 2014, 1403.1777.

[127]  G. Biroli,et al.  Symmetries of generating functionals of Langevin processes with colored multiplicative noise , 2010, 1007.5059.

[128]  Satya N. Majumdar,et al.  Extreme Value Statistics and Traveling Fronts: Various Applications , 2003 .