Algorithmic Information Content, Church — Turing Thesis, Physical Entropy, and Maxwell’s Demon

Measurements convert alternative possibilities of its potential outcomes into the definiteness of the “record” — data describing the actual outcome. The resulting decrease of statistical entropy has been, since the inception of Maxwell’s demon, regarded as a threat to the second law of thermodynamics. For, when the statistical entropy is employed as the measure of the useful work which can be extracted from the system, its decrease by the information gathering actions of the observer would lead one to believe that, at least from the observer’s viewpoint, the second law can be violated.

[1]  M. Planck Vorträge über die kinetische Theorie der Materie und der Elektrizität : gehalten in Göttingen auf Einladung der Kommission der Wolfskehlstiftung , 1914 .

[2]  L. Szilard über die Entropieverminderung in einem thermodynamischen System bei Eingriffen intelligenter Wesen , 1929 .

[3]  Martin D. Davis,et al.  Computability and Unsolvability , 1959, McGraw-Hill Series in Information Processing and Computers.

[4]  Gregory J. Chaitin,et al.  On the Length of Programs for Computing Finite Binary Sequences , 1966, JACM.

[5]  Robert B. Ash,et al.  Information Theory , 2020, The SAGE International Encyclopedia of Mass Media and Society.

[6]  Jr. Hartley Rogers Theory of Recursive Functions and Effective Computability , 1969 .

[7]  R. Leighton,et al.  Feynman Lectures on Physics , 1971 .

[8]  G. Chaitin Randomness and Mathematical Proof , 1975 .

[9]  D. Hofstadter Gödel, Escher, Bach , 1979 .

[10]  Richard W. Hamming,et al.  Coding and Information Theory , 2018, Feynman Lectures on Computation.

[11]  Charles H. Bennett,et al.  The thermodynamics of computation—a review , 1982 .

[12]  W. Soedel,et al.  Leonardo's Contributions to Theoretical Mechanics , 1986 .

[13]  Charles H. Bennett Demons, Engines and the Second Law , 1987 .

[14]  W. H. Zurek,et al.  Thermodynamic cost of computation, algorithmic complexity and the information metric , 1989, Nature.

[15]  Michael Barr,et al.  The Emperor's New Mind , 1989 .

[16]  Zurek,et al.  Algorithmic randomness and physical entropy. , 1989, Physical review. A, General physics.

[17]  W. H. Zurek Complexity, Entropy and the Physics of Information , 1990 .

[18]  Rolf Herken,et al.  The Universal Turing Machine: A Half-Century Survey , 1992 .