Entropy, Shannon's Measure of Information and Boltzmann's H-Theorem

We start with a clear distinction between Shannon’s Measure of Information (SMI) and the Thermodynamic Entropy. The first is defined on any probability distribution; and therefore it is a very general concept. On the other hand Entropy is defined on a very special set of distributions. Next we show that the Shannon Measure of Information (SMI) provides a solid and quantitative basis for the interpretation of the thermodynamic entropy. The entropy measures the uncertainty in the distribution of the locations and momenta of all the particles; as well as two corrections due to the uncertainty principle and the indistinguishability of the particles. Finally we show that the H-function as defined by Boltzmann is an SMI but not entropy. Therefore; much of what has been written on the H-theorem is irrelevant to entropy and the Second Law of Thermodynamics.

[1]  A. Ben-Naim Entropy and the Second Law: Interpretation and Misss-Interpretationsss , 2012 .

[2]  Arieh Ben-Naim,et al.  A Farewell to Entropy:Statistical Thermodynamics Based on Information , 1992 .

[3]  Arieh Ben-Naim,et al.  An Informational–Theoretical Formulation of the Second Law of Thermodynamics , 2009 .

[4]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[5]  Thomas M. Cover,et al.  Probability and Information. , 1986 .

[6]  Arieh Ben-Naim Information, Entropy, Life and the Universe: What We Know and What We Do Not Know , 2015 .

[7]  A. Ben-Naim Entropy: The Truth, the Whole Truth, and Nothing But the Truth , 2016 .

[8]  L. Goddard Information Theory , 1962, Nature.

[9]  Arieh Ben-Naim,et al.  Entropy: Order or Information , 2011 .

[10]  W. Wootters,et al.  Statistical Physics and the Atomic Theory of Matter , 1987 .

[11]  Friedrich C. Simmel Information, Entropy, Life and the Universe. What We Know and What We Do Not Know. By Arieh Ben-Naim. , 2015 .

[12]  A. Ben-Naim The entropy of mixing and assimilation: An information-theoretical perspective , 2006 .

[13]  S. Brush,et al.  Statistical Physics and the Atomic Theory of Matter, from Boyle and Newton to Landau and Onsager , 1986 .

[14]  Arieh Ben-Naim,et al.  Discover Entropy and the Second Law of Thermodynamics: A Playful Way of Discovering a Law of Nature , 2010 .

[15]  Ludwig Boltzmann,et al.  Lectures on Gas Theory , 1964 .

[16]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .