Sequence complexity and work extraction

We consider a simplified version of a solvable model by Mandal and Jarzynski, which constructively demonstrates the interplay between work extraction and the increase of the Shannon entropy of an information reservoir which is in contact with the physical system. We extend Mandal and Jarzynski's main findings in several directions: First, we allow sequences of correlated bits rather than just independent bits. Secondly, at least for the case of binary information, we show that, in fact, the Shannon entropy is only one measure of complexity of the information that must increase in order for work to be extracted. The extracted work can also be upper bounded in terms of the increase in other quantities that measure complexity, like the predictability of future bits from past ones. Third, we provide an extension to the case of non-binary information (i.e., a larger alphabet), and finally, we extend the scope to the case where the incoming bits (before the interaction) form an individual sequence, rather than a random one. In this case, the entropy before the interaction can be replaced by the Lempel-Ziv (LZ) complexity of the incoming sequence, a fact that gives rise to an entropic meaning of the LZ complexity, not only in information theory, but also in physics.

[1]  Takahiro Sagawa,et al.  Role of mutual information in entropy production under information exchanges , 2013, 1307.6092.

[2]  Neri Merhav,et al.  Perfectly secure encryption of individual sequences , 2013, 2012 IEEE International Symposium on Information Theory Proceedings.

[3]  C. Jarzynski,et al.  Information Processing and the Second Law of Thermodynamics: An Inclusive Hamiltonian Approach. , 2013, 1308.5001.

[4]  Christopher Jarzynski,et al.  Work and information processing in a solvable model of Maxwell’s demon , 2012, Proceedings of the National Academy of Sciences.

[5]  A. C. Barato,et al.  Unifying three perspectives on information processing in stochastic thermodynamics. , 2013, Physical review letters.

[6]  Abraham Lempel,et al.  Compression of individual sequences via variable-rate coding , 1978, IEEE Trans. Inf. Theory.

[7]  Andre C. Barato,et al.  Optimized finite-time information machine , 2014 .

[8]  Neri Merhav,et al.  Universal prediction of individual sequences , 1992, IEEE Trans. Inf. Theory.

[9]  A. Carlo,et al.  Free energy potential and temperature with information exchange , 2013, 1305.2107.

[10]  Christopher Jarzynski,et al.  Maxwell's refrigerator: an exactly solvable model. , 2013, Physical review letters.

[11]  R. J. Joenk,et al.  IBM journal of research and development: information for authors , 1978 .

[12]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[13]  W. Ehrenberg,et al.  Maxwell's Demon , 1967 .

[14]  October I Physical Review Letters , 2022 .

[15]  Neri Merhav,et al.  Data Processing Theorems and the Second Law of Thermodynamics , 2010, IEEE Transactions on Information Theory.

[16]  Armen E. Allahverdyan,et al.  Thermodynamic efficiency of information and heat flow , 2009, 0907.3320.

[17]  L. Szilard über die Entropieverminderung in einem thermodynamischen System bei Eingriffen intelligenter Wesen , 1929 .

[18]  T. Sagawa,et al.  Thermodynamics of information , 2015, Nature Physics.

[19]  Andreas Engel,et al.  On the energetics of information exchange , 2014, 1401.2270.

[20]  Jordan M. Horowitz,et al.  Thermodynamics with Continuous Information Flow , 2014, 1402.3276.

[21]  Udo Seifert,et al.  An autonomous and reversible Maxwell's demon , 2013 .

[22]  Andre C. Barato,et al.  Stochastic thermodynamics of bipartite systems: transfer entropy inequalities and a Maxwell’s demon interpretation , 2014 .

[23]  Masahito Ueda,et al.  Fluctuation theorem with information exchange: role of correlations in stochastic thermodynamics. , 2012, Physical review letters.

[24]  Sebastian Deffner Information-driven current in a quantum Maxwell demon. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[25]  Zhiyue Lu,et al.  Engineering Maxwell's demon , 2014 .

[26]  Udo Seifert,et al.  Stochastic thermodynamics with information reservoirs. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  Massimiliano Esposito,et al.  Second law and Landauer principle far from equilibrium , 2011, 1104.5165.

[28]  Henrik Sandberg,et al.  Second-law-like inequalities with information and their interpretations , 2014, 1409.5351.