Thermodynamics of computations with absolute irreversibility, unidirectional transitions, and stochastic computation times

Developing a physical theory of computation is an open challenging task at the interface of non-equilibrium thermodynamics and computer science. An important part of this task requires the examination of thermodynamic quantities in formal models of computers which execute computational tasks, such as automata or word-RAM models executing algorithms. This implies dealing with a number of difficulties such as stochastic halting times, unidirectional (possibly deterministic) transitions, and restricted initial conditions. Here, we present a framework which tackles all such difficulties by extending martingale theory of nonequilibrium thermodynamics to non-stationary Markovian dynamics with broken local detailed balance and absolute irreversibility. In doing so, we derive universal fluctuation relations and second-law-like inequalities that provide both lower and upper bounds for the intrinsic dissipation (mismatch cost) associated with any computation performed over arbitrary stochastic times, so long as it is implemented with a periodic process. We then provide universal equalities and inequalities for the acceptance probability of words of a given length by a computer in terms of thermodynamic quantities, and outline connections between computer science and stochastic resetting. We illustrate most of our results with exhaustive numerical simulations of fundamental models of computation from theoretical computer science, namely deterministic finite automata processing bit strings. Our results, while motivated from the computational context, are applicable far beyond it.

[1]  Yoshihiko Hasegawa,et al.  Upper bound for entropy production in Markov processes , 2023, 2306.15251.

[2]  Yonggun Jun,et al.  Winning strategies of a gambling demon in a Brownian particle under a squeezing potential , 2023, Physical Review Research.

[3]  F. Ritort,et al.  Variance Sum Rule for Entropy Production , 2023, 2302.08565.

[4]  Shamik Gupta,et al.  Martingales for Physicists , 2022, 2210.09983.

[5]  D. Wolpert,et al.  Thermodynamics of deterministic finite automata operating locally and periodically , 2022, 2208.06895.

[6]  I. Neri,et al.  Extreme value statistics of edge currents in Markov jump processes and their use for entropy production estimation , 2022, SciPost Physics.

[7]  C. Maes,et al.  Calorimetry for active systems , 2022, SciPost Physics.

[8]  C. Maes,et al.  A Nernst heat theorem for nonequilibrium jump processes. , 2022, The Journal of chemical physics.

[9]  M. Trakala,et al.  Proliferative advantage of specific aneuploid cells drives evolution of tumor karyotypes , 2022, bioRxiv.

[10]  T. Vu,et al.  Thermodynamic Unification of Optimal Transport: Thermodynamic Uncertainty Relation, Minimum Dissipation, and Thermodynamic Speed Limits , 2022, Physical Review X.

[11]  D. Wolpert,et al.  Inclusive Thermodynamics of Computational Machines , 2022, 2206.01165.

[12]  F. Peper,et al.  Computation time and thermodynamic uncertainty relation of Brownian circuits , 2022, 2205.10735.

[13]  D. S. P. Salazar Upper bound for quantum entropy production from entropy flux. , 2022, Physical review. E.

[14]  A. C. Barato,et al.  Second Law for Active Heat Engines , 2021, Physical Review X.

[15]  J. Parrondo,et al.  Dissipation Reduction and Information-to-Measurement Conversion in DNA Pulling Experiments with Feedback Protocols , 2021, Physical Review X.

[16]  K. Sekimoto,et al.  Martingale-induced local invariance in progressive quenching. , 2021, Physical review. E.

[17]  Shamik Gupta,et al.  Stochastic Resetting: A (Very) Brief Review , 2021, Frontiers in Physics.

[18]  D. Wolpert,et al.  Dependence of integrated, instantaneous, and fluctuating entropy production on the initial state in quantum and classical processes. , 2021, Physical review. E.

[19]  S. Ciliberto,et al.  Information and Thermodynamics: Fast and Precise Approach to Landauer's Bound in an Underdamped Micromechanical Oscillator. , 2021, Physical review letters.

[20]  S. Sasa,et al.  Kinetic uncertainty relation on first-passage time for accumulated current. , 2021, Physical review. E.

[21]  Paul C. Bressloff,et al.  Modeling active cellular transport as a directed search process with stochastic resetting and delays , 2020, Journal of Physics A: Mathematical and Theoretical.

[22]  Diego Subero,et al.  Thermodynamics of Gambling Demons. , 2020, Physical review letters.

[23]  Van Tuan Vo,et al.  Unified approach to classical speed limit and thermodynamic uncertainty relation. , 2020, Physical review. E.

[24]  J. Bechhoefer,et al.  Finite-Time Landauer Principle. , 2020, Physical review letters.

[25]  Arnab K. Pal,et al.  Experimental Realization of Diffusion with Stochastic Resetting , 2020, The journal of physical chemistry letters.

[26]  P. Riechers,et al.  Initial-state dependence of thermodynamic dissipation for any quantum process. , 2020, Physical review. E.

[27]  Todd R. Gingrich,et al.  Thermodynamic uncertainty relations constrain non-equilibrium fluctuations , 2020, Nature Physics.

[28]  Artemy Kolchinsky,et al.  Thermodynamic costs of Turing machines , 2019, Physical Review Research.

[29]  S. Majumdar,et al.  Stochastic resetting and applications , 2019, Journal of Physics A: Mathematical and Theoretical.

[30]  G. Schütz,et al.  Stochastic thermodynamics and modes of operation of a ribosome: A network theoretic perspective. , 2019, Physical review. E.

[31]  Massimiliano Esposito,et al.  Supplemental Material to : Clarifying the Nature of Entropy Production in Open Quantum Systems : Dominant Role of Intra-Environment Correlations , 2019 .

[32]  C. Maes Frenesy: Time-symmetric dynamical activity in nonequilibria , 2019, 1904.10485.

[33]  Artemy Kolchinsky,et al.  A space–time tradeoff for implementing a function with master equation dynamics , 2019, Nature Communications.

[34]  David H. Wolpert,et al.  The stochastic thermodynamics of computation , 2019, Journal of Physics A: Mathematical and Theoretical.

[35]  A. Maritan,et al.  Entropy production in systems with unidirectional transitions , 2019, Physical Review Research.

[36]  F. Ritort,et al.  Large work extraction and the Landauer limit in a continuous Maxwell demon , 2019, Nature Physics.

[37]  F. Jülicher,et al.  Integral fluctuation relations for entropy production at stopping times , 2019, Journal of Statistical Mechanics: Theory and Experiment.

[38]  R. Fazio,et al.  Quantum Martingale Theory and Entropy Production. , 2019, Physical review letters.

[39]  Shamik Gupta,et al.  Martingale theory for housekeeping heat , 2018, EPL (Europhysics Letters).

[40]  M. Baiesi,et al.  Kinetic uncertainty relation , 2018, Journal of Physics A: Mathematical and Theoretical.

[41]  T. Nemoto,et al.  How Dissipation Constrains Fluctuations in Nonequilibrium Liquids: Diffusion, Structure, and Biased Interactions , 2018, Physical Review X.

[42]  R. Eichhorn,et al.  Irreversibility in Active Matter Systems: Fluctuation Theorem and Mutual Information , 2018, Physical Review X.

[43]  Artemy Kolchinsky,et al.  Thermodynamics of computing with circuits , 2018, New Journal of Physics.

[44]  M. N. Bera,et al.  Thermodynamics from Information , 2018, 1805.10282.

[45]  K. Funo,et al.  Information-to-work conversion by Maxwell’s demon in a superconducting circuit quantum electrodynamical system , 2018, Nature Communications.

[46]  K. Funo,et al.  Speed Limit for Classical Stochastic Processes. , 2018, Physical review letters.

[47]  Jordan M. Horowitz,et al.  Quantum Fluctuation Theorems for Arbitrary Environments: Adiabatic and Nonadiabatic Entropy Production , 2017, Physical Review X.

[48]  Arnab K. Pal,et al.  Integral fluctuation theorems for stochastic resetting systems. , 2017, Physical review. E.

[49]  David H. Wolpert,et al.  Number of hidden states needed to physically implement a given conditional distribution , 2017, New Journal of Physics.

[50]  K. Funo,et al.  Information-to-work conversion by Maxwell’s demon in a superconducting circuit quantum electrodynamical system , 2017, Nature Communications.

[51]  D. Wolpert,et al.  A space–time tradeoff for implementing a function with master equation dynamics , 2017, Nature Communications.

[52]  D. Wolpert,et al.  Dependence of dissipation on the initial distribution over states , 2016, 1607.00956.

[53]  Veikko F. Geyer,et al.  Broken detailed balance at mesoscopic scales in active biological systems , 2016, Science.

[54]  Frank Julicher,et al.  Statistics of Infima and Stopping Times of Entropy Production and Applications to Active Molecular Processes , 2016, 1604.04159.

[55]  Julien Tailleur,et al.  How Far from Equilibrium Is Active Matter? , 2016, Physical review letters.

[56]  David H. Wolpert,et al.  The Free Energy Requirements of Biological Organisms; Implications for Evolution , 2016, Entropy.

[57]  Daniel Sánchez-Taltavull,et al.  Stochastic resetting in backtrack recovery by RNA polymerases. , 2016, Physical review. E.

[58]  A. Engel,et al.  Level 2 and level 2.5 large deviation functionals for systems with and without detailed balance , 2016, 1602.02545.

[59]  Gernot Schaller,et al.  Thermodynamics of stochastic Turing machines , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[60]  Jordan M Horowitz,et al.  Nonequilibrium potential and fluctuation theorems for quantum maps. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[61]  J. Carrascosa,et al.  Mechano-chemical kinetics of DNA replication: identification of the translocation step of a replicative DNA polymerase , 2015, Nucleic acids research.

[62]  Udo Seifert,et al.  Thermodynamic uncertainty relation for biomolecular processes. , 2015, Physical review letters.

[63]  K. Funo,et al.  Quantum nonequilibrium equalities with absolute irreversibility , 2014, 1412.5891.

[64]  H. Touchette,et al.  Nonequilibrium Markov Processes Conditioned on Large Deviations , 2014, Annales Henri Poincaré.

[65]  S. Rahav,et al.  An integral fluctuation theorem for systems with unidirectional transitions , 2014, 1409.4037.

[66]  T. Sagawa,et al.  Minimal model of stochastic athermal systems: origin of non-Gaussian noise. , 2014, Physical review letters.

[67]  Hugo Touchette,et al.  Nonequilibrium Markov Processes Conditioned on Large Deviations , 2014, 1405.5157.

[68]  K. Funo,et al.  Nonequilibrium equalities in absolutely irreversible processes. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[69]  T. Sagawa Thermodynamic and logical reversibilities revisited , 2013, 1311.1886.

[70]  Massimiliano Esposito,et al.  Stochastic thermodynamics of hidden pumps. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[71]  C. Jarzynski,et al.  Information Processing and the Second Law of Thermodynamics: An Inclusive Hamiltonian Approach. , 2013, 1308.5001.

[72]  Y. Benenson Biomolecular computing systems: principles, progress and potential , 2012, Nature Reviews Genetics.

[73]  U. Seifert Stochastic thermodynamics, fluctuation theorems and molecular machines , 2012, Reports on progress in physics. Physical Society.

[74]  D. Lacoste,et al.  Inequalities generalizing the second law of thermodynamics for transitions between nonstationary states. , 2012, Physical review letters.

[75]  C. Jarzynski Equalities and Inequalities: Irreversibility and the Second Law of Thermodynamics at the Nanoscale , 2011 .

[76]  M. Esposito,et al.  Three faces of the second law. I. Master equation formulation. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[77]  Gasper Tkacik,et al.  Positional information, in bits , 2010, Proceedings of the National Academy of Sciences.

[78]  Massimiliano Esposito,et al.  Three detailed fluctuation theorems. , 2009, Physical review letters.

[79]  Massimiliano Esposito,et al.  Entropy production as correlation between system and reservoir , 2009, 0908.1125.

[80]  J. Parrondo,et al.  Dissipation: the phase-space perspective. , 2007, Physical review letters.

[81]  C. Jarzynski,et al.  Path-integral analysis of fluctuation theorems for general Langevin processes , 2006, cond-mat/0605471.

[82]  S. Sasa,et al.  Steady State Thermodynamics , 2004, cond-mat/0411052.

[83]  C. Landim,et al.  Minimum Dissipation Principle in Stationary Non-Equilibrium States , 2003, cond-mat/0310072.

[84]  J. Stoyanov A Guide to First‐passage Processes , 2003 .

[85]  A. Rex,et al.  Maxwell's demon 2: entropy, classical and quantum information, computing , 2002 .

[86]  T. Hatano,et al.  Steady-state thermodynamics of Langevin systems. , 2000, Physical review letters.

[87]  C. Jarzynski Hamiltonian Derivation of a Detailed Fluctuation Theorem , 1999, cond-mat/9908286.

[88]  H. Spohn Entropy production for quantum dynamical semigroups , 1978 .

[89]  Jack W. Carlyle,et al.  Realizations by Stochastic Finite Automata , 1971, J. Comput. Syst. Sci..

[90]  Lars Onsager,et al.  Fluctuations and Irreversible Processes , 1953 .

[91]  Ludwig von Bertalanffy,et al.  Ètude thermodynamique des phénomènes irréversibles , 1949, Nature.

[92]  F. Jülicher,et al.  Quantifying entropy production in active fluctuations of the hair-cell bundle from time irreversibility and uncertainty relations , 2021 .

[93]  Ricard Gavaldà,et al.  Learning Probability Distributions Generated by Finite-State Machines , 2016 .

[94]  E. Seibert,et al.  Fundamentals of enzyme kinetics. , 2014, Methods in molecular biology.

[95]  David Williams,et al.  Probability with Martingales , 1991, Cambridge mathematical textbooks.