The Functional Thermodynamics of Finite-State Maxwellian Ratchets

Autonomous Maxwellian demons exploit structured environments as a resource to generate work: They randomize ordered inputs and leverage the increased Shannon entropy to transfer energy from a thermal reservoir to a work reservoir, respecting both Liouvillian state-space dynamics and the Second Law. To date, correctly determining such functional thermodynamic operating regimes was restricted to information engines for which correlations among information-bearing degrees of freedom can be calculated exactly via compact analytical forms---a highly restricted set of engines. Despite information-engine controllers being represented as finite hidden Markov chains and rate matrices, the restriction arose since the processes generated are notoriously complicated, defying closed-form analysis. Even when finite state (i) no finite expression for their Shannon entropy rate exists, (ii) the set of their predictive features is generically uncountably infinite, and (iii) their effective memory---the statistical complexity---diverges. When attempting to circumvent these challenges, previous analyses of thermodynamic function either heavily constrained controller structure, invoked approximations that misclassified thermodynamic functioning, or simply failed. Here, we adapt recent results from dynamical-system and ergodic theories that efficiently and accurately calculate the entropy rates and the rate of statistical complexity divergence of general hidden Markov processes. Applied to information ratchets, the results precisely determine the thermodynamic functionality for previously-studied Maxwellian Demons and open up analysis to a substantially broader class of information engines.

[1]  Yuansheng Cao,et al.  Thermodynamics of information processing based on enzyme kinetics: An exactly solvable model of an information pump. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  Touchette,et al.  Information-theoretic limits of control , 1999, Physical review letters.

[3]  J. Yorke,et al.  Chaotic behavior of multidimensional difference equations , 1979 .

[4]  T. Sagawa,et al.  Role of measurement-feedback separation in autonomous Maxwell's demons , 2015, 1501.06071.

[5]  J. Yorke,et al.  The liapunov dimension of strange attractors , 1983 .

[6]  A. B. Boyd,et al.  Identifying functional thermodynamics in autonomous Maxwellian ratchets , 2015, 1507.01537.

[7]  James P. Crutchfield,et al.  Computational Mechanics of Input-Output Processes: Structured transformations and the ε-transducer , 2014, ArXiv.

[8]  James P. Crutchfield,et al.  Nearly Maximally Predictive Features and Their Dimensions , 2017, Physical review. E.

[9]  K. E.,et al.  The Theory of Heat , 1929, Nature.

[10]  Francisco J Cao,et al.  Feedback control in a collective flashing ratchet. , 2004, Physical review letters.

[11]  Gernot Schaller,et al.  Stochastic thermodynamics for “Maxwell demon” feedbacks , 2012, 1204.5671.

[12]  Chulan Kwon,et al.  Total cost of operating an information engine , 2015, 1501.03733.

[13]  James P. Crutchfield,et al.  Leveraging Environmental Correlations: The Thermodynamics of Requisite Variety , 2016, ArXiv.

[14]  James P. Crutchfield,et al.  Harnessing Fluctuations in Thermodynamic Computing via Time-Reversal Symmetries , 2019, Physical Review Research.

[15]  Anupam Kundu Nonequilibrium fluctuation theorem for systems under discrete and continuous feedback control. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  Henrik Sandberg,et al.  Second-law-like inequalities with information and their interpretations , 2014, 1409.5351.

[17]  E. Lutz,et al.  Experimental verification of Landauer’s principle linking information and thermodynamics , 2012, Nature.

[18]  Andreas Engel,et al.  On the energetics of information exchange , 2014, 1401.2270.

[19]  Laszlo B. Kish,et al.  Energy requirement of control: Comments on Szilard's engine and Maxwell's demon , 2012 .

[20]  James P. Crutchfield,et al.  Correlation-powered Information Engines and the Thermodynamics of Self-Correction , 2016, Physical review. E.

[21]  M. Esposito,et al.  Finite-time erasing of information stored in fermionic bits. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  Christopher Jarzynski,et al.  Work and information processing in a solvable model of Maxwell’s demon , 2012, Proceedings of the National Academy of Sciences.

[23]  A. C. Barato,et al.  Unifying three perspectives on information processing in stochastic thermodynamics. , 2013, Physical review letters.

[24]  Paul M. Riechers,et al.  Transforming Metastable Memories: The Nonequilibrium Thermodynamics of Computation , 2018, The Energetics of Computing in Life and Machines.

[25]  C. Davies Aerosols. Physical Chemistry and Applications. Edited by K. Spurny. pp. 943, 7″ × 9½″, 120 Czech crowns. Prague, 1965. Publishing House of the Czechoslovak Academy of Sciences , 1966 .

[26]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[27]  M. Sano,et al.  Experimental demonstration of information-to-energy conversion and validation of the generalized Jarzynski equality , 2010 .

[28]  James Odell,et al.  Between order and chaos , 2011, Nature Physics.

[29]  J. Horowitz Multipartite information flow for multiple Maxwell demons , 2015, 1501.05549.

[30]  Sosuke Ito,et al.  Information thermodynamics on causal networks. , 2013, Physical review letters.

[31]  Udo Seifert,et al.  Thermodynamics of genuine nonequilibrium states under feedback control. , 2011, Physical review letters.

[32]  James P. Crutchfield,et al.  Transient Dissipation and Structural Costs of Physical Information Transduction , 2017, Physical review letters.

[33]  Andre C. Barato,et al.  Stochastic thermodynamics of bipartite systems: transfer entropy inequalities and a Maxwell’s demon interpretation , 2014 .

[34]  Kirk T. McDonald,et al.  Maxwell ’ s Demon , 2008 .

[35]  Christopher Jarzynski,et al.  Maxwell's refrigerator: an exactly solvable model. , 2013, Physical review letters.

[36]  How can an autonomous quantum Maxwell demon harness correlated information , 2016 .

[37]  Holger Kantz,et al.  Thermodynamic cost of measurements. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[38]  James P. Crutchfield,et al.  Prediction, Retrodiction, and the Amount of Information Stored in the Present , 2009, ArXiv.

[39]  U. Seifert Stochastic thermodynamics, fluctuation theorems and molecular machines , 2012, Reports on progress in physics. Physical Society.

[40]  Gernot Schaller,et al.  Thermodynamics of a physical model implementing a Maxwell demon. , 2012, Physical review letters.

[41]  O. Penrose Foundations of Statistical Mechanics: A Deductive Treatment , 2005 .

[42]  M. N. Bera,et al.  Thermodynamics from Information , 2018, 1805.10282.

[43]  Masahito Ueda,et al.  Fluctuation theorem with information exchange: role of correlations in stochastic thermodynamics. , 2012, Physical review letters.

[44]  Modeling Maxwell's demon with a microcanonical Szilard engine. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[45]  Charles H. Bennett,et al.  The thermodynamics of computation—a review , 1982 .

[46]  R. Landauer,et al.  Irreversibility and heat generation in the computing process , 1961, IBM J. Res. Dev..

[47]  De-Jun Feng,et al.  Dimension theory of iterated function systems , 2009, 1002.2036.

[48]  Jordan M. Horowitz,et al.  Thermodynamic reversibility in feedback processes , 2011, 1104.0332.

[49]  Masahito Ueda,et al.  Generalized Jarzynski equality under nonequilibrium feedback control. , 2009, Physical review letters.

[50]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[51]  Franco Nori,et al.  Colloquium: The physics of Maxwell's demon and information , 2007, 0707.3400.

[52]  James P. Crutchfield,et al.  Anatomy of a Bit: Information in a Time Series Observation , 2011, Chaos.

[53]  M. Ponmurugan Generalized detailed fluctuation theorem under nonequilibrium feedback control. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[54]  沙川 貴大,et al.  Thermodynamics of information processing in small systems , 2011 .

[55]  Zhiyue Lu,et al.  Engineering Maxwell's demon , 2014 .

[56]  James P. Crutchfield,et al.  Exact Complexity: The Spectral Decomposition of Intrinsic Computation , 2013, ArXiv.

[57]  U. Seifert,et al.  Extracting work from a single heat bath through feedback , 2011, 1102.3826.

[58]  C Blomberg,et al.  Thermodynamic constraints on kinetic proofreading in biosynthetic pathways. , 1980, Biophysical journal.

[59]  Jordan M. Horowitz,et al.  Thermodynamics with Continuous Information Flow , 2014, 1402.3276.

[60]  Jordan M Horowitz,et al.  Imitating chemical motors with optimal information motors. , 2012, Physical review letters.

[61]  James P. Crutchfield,et al.  Above and Beyond the Landauer Bound: Thermodynamics of Modularity , 2017, Physical Review X.

[62]  J. Crutchfield,et al.  Regularities unseen, randomness observed: levels of entropy convergence. , 2001, Chaos.