Thermodynamic cost due to changing the initial distribution over states

We consider nonequilibrium systems that obey local detailed balance and are driven by an external system such that no work is dissipated for some initial distribution over states $x \in X$, $q(X)$. We show that in general work is dissipated under that driving if instead the initial distribution is some $r(X) \ne q(X)$, calculating that amount of dissipated work. We then use this result to investigate the thermodynamics of computation. Specifically, we suppose a Markov partition of $X$ into a set of coarse-grained "computational states" labelled by $v \in V$, and identify the dynamics over those computational states as a (possibly noisy) "computation" that runs on the system. We identify the initial distribution over computational states as the distribution over inputs to the computer. We calculate the work that such a computer dissipates, if it is designed to dissipate no work for some input distribution $q(V)$ but is instead used with a different input distribution $r(V)$. This dissipated work is an extra thermodynamic cost of computation, in addition to the well-known Landauer's cost. We also calculate the extra expected dissipated work if there is a probability distribution over the possible input distributions rather than a single one.

[1]  J. Herskowitz,et al.  Proceedings of the National Academy of Sciences, USA , 1996, Current Biology.

[2]  O. Bagasra,et al.  Proceedings of the National Academy of Sciences , 1914, Science.

[3]  October I Physical Review Letters , 2022 .

[4]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[5]  Axthonv G. Oettinger,et al.  IEEE Transactions on Information Theory , 1998 .

[6]  J. A. Crowther Reports on Progress in Physics , 1941, Nature.

[7]  Audra E. Kosh,et al.  Linear Algebra and its Applications , 1992 .

[8]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[9]  David H. Wolpert,et al.  Extending Landauer's Bound from Bit Erasure to Arbitrary Computation , 2015, 1508.05319.

[10]  Imre Csiszár,et al.  Information Theory - Coding Theorems for Discrete Memoryless Systems, Second Edition , 2011 .