A space–time tradeoff for implementing a function with master equation dynamics

Master equations are commonly used to model the dynamics of physical systems, including systems that implement single-valued functions like a computer’s update step. However, many such functions cannot be implemented by any master equation, even approximately, which raises the question of how they can occur in the real world. Here we show how any function over some “visible” states can be implemented with master equation dynamics—if the dynamics exploits additional, “hidden” states at intermediate times. We also show that any master equation implementing a function can be decomposed into a sequence of “hidden” timesteps, demarcated by changes in what state-to-state transitions have nonzero probability. In many real-world situations there is a cost both for more hidden states and for more hidden timesteps. Accordingly, we derive a “space–time” tradeoff between the number of hidden states and the number of hidden timesteps needed to implement any given function.Deterministic maps from initial to final states can always be modelled using the master equation formalism, provided additional “hidden” states are available. Here, the authors demonstrate a tradeoff between the required number of such states and the number of required, suitably defined “hidden time steps”.

[1]  E. Lutz,et al.  Experimental verification of Landauer’s principle linking information and thermodynamics , 2012, Nature.

[2]  J. Schnakenberg Network theory of microscopic and macroscopic behavior of master equation systems , 1976 .

[3]  G. S. Goodman An intrinsic time for non-stationary finite markov chains , 1970 .

[4]  M. Esposito Stochastic thermodynamics under coarse graining. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  Sanjeev Arora,et al.  Computational Complexity: A Modern Approach , 2009 .

[6]  Charles H. Bennett,et al.  Notes on Landauer's Principle, Reversible Computation, and Maxwell's Demon , 2002, physics/0210005.

[7]  Christian Van Den Broeck,et al.  Stochastic thermodynamics: A brief introduction , 2013 .

[8]  L. Schoenfeld,et al.  The number of idempotent elements in symmetric semigroups , 1967 .

[9]  E. Lutz,et al.  Memory erasure in small systems. , 2008, Physical review letters.

[10]  Masahito Ueda,et al.  Minimal energy cost for thermodynamic information processing: measurement and information erasure. , 2008, Physical review letters.

[11]  Hanspeter Bieri,et al.  A Brief Introduction to Distributed Cognition© History and Background , 2022 .

[12]  Yonggun Jun,et al.  High-precision test of Landauer's principle in a feedback trap. , 2014, Physical review letters.

[13]  J. Doob Stochastic processes , 1953 .

[14]  D. Wolpert,et al.  Dependence of dissipation on the initial distribution over states , 2016, 1607.00956.

[15]  H. Spohn Kinetic equations from Hamiltonian dynamics: Markovian limits , 1980 .

[16]  J. Crutchfield,et al.  Fluctuations When Driving Between Nonequilibrium Steady States , 2016, 1610.09444.

[17]  M. Esposito,et al.  Finite-time erasing of information stored in fermionic bits. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  Products of four idempotents in finite full transformation semigroups , 1989 .

[19]  M. Esposito,et al.  Three faces of the second law. I. Master equation formulation. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  Peter M. Higgins,et al.  Techniques of semigroup theory , 1991 .

[21]  T. Rogers,et al.  From empirical data to time-inhomogeneous continuous Markov processes. , 2016, Physical review. E.

[22]  Charles R. Kime,et al.  Logic and Computer Design Fundamentals , 1997 .

[23]  Chen Jia A solution to the reversible embedding problem for finite Markov chains , 2016, 1605.03502.

[24]  Søren Johansen,et al.  The Imbedding Problem for Finite Markov Chains , 1973 .

[25]  David H. Wolpert,et al.  Number of hidden states needed to physically implement a given conditional distribution , 2017, New Journal of Physics.

[26]  Charles H. Bennett,et al.  The thermodynamics of computation—a review , 1982 .

[27]  Patrick R. Zulkowski,et al.  Optimal finite-time erasure of a classical bit. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  T. Sagawa Thermodynamic and logical reversibilities revisited , 2013, 1311.1886.

[29]  M. N. Bera,et al.  Thermodynamics from Information , 2018, 1805.10282.

[30]  Roberto Bruni,et al.  Models of Computation , 2017, Texts in Theoretical Computer Science. An EATCS Series.

[31]  Rolf Landauer,et al.  Information is Physical , 1991, Workshop on Physics and Computation.

[32]  Masahito Ueda,et al.  Fluctuation theorem with information exchange: role of correlations in stochastic thermodynamics. , 2012, Physical review letters.

[33]  A. C. Barato,et al.  Unifying three perspectives on information processing in stochastic thermodynamics. , 2013, Physical review letters.

[34]  David H. Wolpert,et al.  Extending Landauer's Bound from Bit Erasure to Arbitrary Computation , 2015, 1508.05319.

[35]  D. Andrieux,et al.  Fluctuation Theorem for Currents and Schnakenberg Network Theory , 2005, cond-mat/0512254.

[36]  David H. Wolpert,et al.  The Free Energy Requirements of Biological Organisms; Implications for Evolution , 2016, Entropy.

[37]  R. Landauer,et al.  Irreversibility and heat generation in the computing process , 1961, IBM J. Res. Dev..

[38]  O. Maroney Generalizing Landauer's principle. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[39]  J. Howie GRAVITY DEPTH AND HOMOGENEITY IN FULL TRANSFORMATION SEMIGROUPS , 1980 .

[40]  C. Ballantine,et al.  Products of idempotent matrices , 1978 .

[41]  J. Howie Products of idempotents in finite full transformation semigroups: some improved bounds , 1984 .

[42]  H. Kantz,et al.  Differential Landauer's principle , 2013, 1302.6478.

[43]  Jeremy L. England,et al.  Minimum energetic cost to maintain a target nonequilibrium state. , 2017, Physical review. E.

[44]  Massimiliano Esposito,et al.  Finite-time thermodynamics for a single-level quantum dot , 2009, 0909.3618.

[45]  U. Seifert Stochastic thermodynamics, fluctuation theorems and molecular machines , 2012, Reports on progress in physics. Physical Society.

[46]  J. Howie,et al.  The Subsemigroup Generated By the Idempotents of a Full Transformation Semigroup , 1966 .