Minimal work required for arbitrary computation

Recent studies have analyzed the minimal thermodynamic work required for a given logical map to be implemented on any physical system. These studies have focused on maps whose output does not depend on the input, e.g., bit erasure in a digital computer. In addition, they have considered physical systems whose design varies depending on the distribution of inputs to the map. However very often we are interested in implementing a map whose output depends on its input. In addition, we often want our system to implement the same map even if the system's environment changes, so that the distribution over map inputs changes. Here I introduce a thermodynamic engine that satisfies both of these desiderata. I then calculate how much work it requires, deriving an additive correction to the "generalized Landauer bound" of previous studies. I also calculate the Bayes-optimal engine for any given distribution over environments. I end with a short discussion on how these results relate the free energy flux incident on an organism / robot / biosphere to the maximal amount of (noisy) computation that the organism / robot / biosphere can do per unit time.

[1]  M. Esposito,et al.  Three faces of the second law. I. Master equation formulation. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  N. Margolus,et al.  Invertible cellular automata: a review , 1991 .

[3]  Charles H. Bennett,et al.  Notes on Landauer's Principle, Reversible Computation, and Maxwell's Demon , 2002, physics/0210005.

[4]  Massimiliano Esposito,et al.  Second law and Landauer principle far from equilibrium , 2011, 1104.5165.

[5]  G. Crooks Entropy production fluctuation theorem and the nonequilibrium work relation for free energy differences. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[6]  W. H. Zurek,et al.  Thermodynamic cost of computation, algorithmic complexity and the information metric , 1989, Nature.

[7]  Karoline Wiesner,et al.  Information-theoretic lower bound on energy cost of stochastic computation , 2011, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[8]  Blake S. Pollard A Second Law for Open Markov Processes , 2016, Open Syst. Inf. Dyn..

[9]  Seth Lloyd,et al.  Information-theoretic approach to the study of control systems , 2001, physics/0104007.

[10]  O. Maroney Generalizing Landauer's principle. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  Mikhail Prokopenko,et al.  Transfer Entropy and Transient Limits of Computation , 2014, Scientific Reports.

[12]  Johan Aberg,et al.  The thermodynamic meaning of negative entropy , 2010, Nature.

[13]  E. Fredkin Digital mechanics: an informational process based on reversible universal cellular automata , 1990 .

[14]  Charles H. Bennett,et al.  The thermodynamics of computation—a review , 1982 .

[15]  Jordan M. Horowitz,et al.  Designing optimal discrete-feedback thermodynamic engines , 2011, 1110.6808.

[16]  Dean J. Driebe,et al.  Generalization of the second law for a transition between nonequilibrium states , 2010 .

[17]  T. Toffoli,et al.  Conservative logic , 2002, Collision-Based Computing.

[18]  S. Lloyd Ultimate physical limits to computation , 1999, Nature.

[19]  L. Brillouin,et al.  Science and information theory , 1956 .

[20]  F. Moukalled,et al.  A Simple Derivation of Crooks Relation , 2013 .

[21]  L. Goddard Information Theory , 1962, Nature.

[22]  Eric Lutz,et al.  Comment on "Minimal energy cost for thermodynamic information processing: measurement and information erasure". , 2010, Physical review letters.

[23]  R. Landauer The physical nature of information , 1996 .

[24]  M. B. Plenio,et al.  The physics of forgetting: Landauer's erasure principle and information theory , 2001, quant-ph/0103108.

[25]  Shizume Heat generation required by information erasure. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[26]  U. Seifert Stochastic thermodynamics, fluctuation theorems and molecular machines , 2012, Reports on progress in physics. Physical Society.

[27]  Lloyd Use of mutual information to decrease entropy: Implications for the second law of thermodynamics. , 1989, Physical review. A, General physics.

[28]  Masahito Ueda,et al.  Fluctuation theorem with information exchange: role of correlations in stochastic thermodynamics. , 2012, Physical review letters.

[29]  E. Lutz,et al.  Experimental verification of Landauer’s principle linking information and thermodynamics , 2012, Nature.

[30]  Zurek,et al.  Algorithmic randomness and physical entropy. , 1989, Physical review. A, General physics.

[31]  Mikhail Prokopenko,et al.  On Thermodynamic Interpretation of Transfer Entropy , 2013, Entropy.

[32]  G. Crooks Nonequilibrium Measurements of Free Energy Differences for Microscopically Reversible Markovian Systems , 1998 .

[33]  Andrew F. Rex,et al.  Maxwell's Demon, Entropy, Information, Computing , 1990 .

[34]  Charles H. Bennett Time/Space Trade-Offs for Reversible Computation , 1989, SIAM J. Comput..

[35]  C. Jarzynski Nonequilibrium Equality for Free Energy Differences , 1996, cond-mat/9610209.

[36]  T. Sagawa Thermodynamic and logical reversibilities revisited , 2013, 1311.1886.

[37]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[38]  Dmitri Petrov,et al.  Universal features in the energetics of symmetry breaking , 2013, Nature Physics.

[39]  Robert B. Ash,et al.  Information Theory , 2020, The SAGE International Encyclopedia of Mass Media and Society.

[40]  Rolf Landauer,et al.  Minimal Energy Requirements in Communication , 1996, Science.

[41]  H. Hasegawa,et al.  Generalization of the Second Law for a Nonequilibrium Initial State , 2009, 0907.1569.

[42]  T. Sagawa,et al.  Thermodynamics of information , 2015, Nature Physics.

[43]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[44]  Johan Aberg,et al.  The thermodynamic meaning of negative entropy , 2011, Nature.

[45]  Susanne Still,et al.  The thermodynamics of prediction , 2012, Physical review letters.

[46]  J. Koski,et al.  Experimental realization of a Szilard engine with a single electron , 2014, Proceedings of the National Academy of Sciences.

[47]  L. Szilard On the decrease of entropy in a thermodynamic system by the intervention of intelligent beings. , 1964, Behavioral science.

[48]  Thermodynamics: Engines and demons , 2014 .

[49]  Masahito Ueda,et al.  Minimal energy cost for thermodynamic information processing: measurement and information erasure. , 2008, Physical review letters.

[50]  R. Landauer,et al.  Irreversibility and heat generation in the computing process , 1961, IBM J. Res. Dev..

[51]  Yonggun Jun,et al.  High-precision test of Landauer's principle in a feedback trap. , 2014, Physical review letters.

[52]  Charles H. Bennett,et al.  Logical reversibility of computation , 1973 .

[53]  Mikhail Prokopenko,et al.  Information thermodynamics of near-equilibrium computation. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.