Analogy between gambling and measurement-based work extraction

In information theory, mutual information characterizes the maximal gain in wealth growth rate due to knowledge of side information on a gambling result; the betting strategy that achieves this maximum is named the Kelly criterion. In physics, it was recently shown that mutual information characterizes the maximal amount of work that can be extracted from a single heat bath using measurement-based control protocols; extraction that is done using “information engines”. However, to the best of our knowledge, no relation between gambling and information engines has been presented before. In this paper, we briefly review the two and then show an analogy between gambling, where bits are converted into wealth, and information engines, where bits representing measurements are converted into energy. From this analogy follows an extension of gambling to the continuous-valued case, which can be useful for investments in the stock market using options. Moreover, the analogy enables us to use well-known methods and results from one field to solve problems in the other. We present three such cases: maximum work extraction when the probability distributions governing the system and measurements are unknown, work extraction when some energy is lost in each cycle, e.g., due to friction, and an analysis of systems with memory. In all three cases, the analogy enables us to use known results in order to obtain new ones.

[1]  Gerhard Kramer,et al.  Directed information for channels with feedback , 1998 .

[2]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[3]  U. Seifert,et al.  Extracting work from a single heat bath through feedback , 2011, 1102.3826.

[4]  Christopher Jarzynski,et al.  Work and information processing in a solvable model of Maxwell’s demon , 2012, Proceedings of the National Academy of Sciences.

[5]  L. Brillouin Maxwell's Demon Cannot Operate: Information and Entropy. I , 1951 .

[6]  Erik Ordentlich,et al.  Universal portfolios with side information , 1996, IEEE Trans. Inf. Theory.

[7]  R. Landauer,et al.  Irreversibility and heat generation in the computing process , 1961, IBM J. Res. Dev..

[8]  Masahito Ueda,et al.  Generalized Jarzynski equality under nonequilibrium feedback control. , 2009, Physical review letters.

[9]  Andrea J. Goldsmith,et al.  Finite State Channels With Time-Invariant Deterministic Feedback , 2006, IEEE Transactions on Information Theory.

[10]  John Stache,et al.  Demons , Engines and the Second Law , 2008 .

[11]  Massimiliano Esposito,et al.  Second law and Landauer principle far from equilibrium , 2011, 1104.5165.

[12]  Neri Merhav,et al.  Analogy between gambling and measurement-based work extraction , 2014, 2014 IEEE International Symposium on Information Theory.

[13]  L. Szilard über die Entropieverminderung in einem thermodynamischen System bei Eingriffen intelligenter Wesen , 1929 .

[14]  Masahito Ueda,et al.  Second law of thermodynamics with discrete quantum feedback control. , 2007, Physical review letters.

[15]  John L. Kelly,et al.  A new interpretation of information rate , 1956, IRE Trans. Inf. Theory.

[16]  Haim H. Permuter,et al.  Extension of the Blahut-Arimoto algorithm for maximizing directed information , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[17]  K. E.,et al.  The Theory of Heat , 1929, Nature.

[18]  Haim H. Permuter,et al.  Interpretations of Directed Information in Portfolio Theory, Data Compression, and Hypothesis Testing , 2009, IEEE Transactions on Information Theory.

[19]  Christopher Jarzynski,et al.  Maxwell's refrigerator: an exactly solvable model. , 2013, Physical review letters.

[20]  Jordan M. Horowitz,et al.  Designing optimal discrete-feedback thermodynamic engines , 2011, 1110.6808.

[21]  J. Massey CAUSALITY, FEEDBACK AND DIRECTED INFORMATION , 1990 .

[22]  Gerhard Kramer Capacity results for the discrete memoryless network , 2003, IEEE Trans. Inf. Theory.

[23]  Masahito Ueda,et al.  Nonequilibrium thermodynamics of feedback control. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.