Thermodynamics Beyond Molecules: Statistical Thermodynamics of Probability Distributions

Statistical thermodynamics has a universal appeal that extends beyond molecular systems, and yet, as its tools are being transplanted to fields outside physics, the fundamental question, what is thermodynamics, has remained unanswered. We answer this question here. Generalized statistical thermodynamics is a variational calculus of probability distributions. It is independent of physical hypotheses but provides the means to incorporate our knowledge, assumptions and physical models about a stochastic processes that gives rise to the probability in question. We derive the familiar calculus of thermodynamics via a probabilistic argument that makes no reference to physics. At the heart of the theory is a space of distributions and a special functional that assigns probabilities to this space. The maximization of this functional generates the mathematical network of thermodynamic relationship. We obtain statistical mechanics as a special case and make contact with Information Theory and Bayesian inference.

[1]  J. Gibbs Elementary Principles in Statistical Mechanics , 1902 .

[2]  H. Touchette The large deviation approach to statistical mechanics , 2008, 0804.0327.

[3]  Thomas M. Cover,et al.  Elements of information theory (2. ed.) , 2006 .

[4]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[5]  Themis Matsoukas,et al.  Statistical Thermodynamics of Irreversible Aggregation: The Sol-Gel Transition , 2014, Scientific Reports.

[6]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[7]  Edwin T. Jaynes,et al.  Prior Probabilities , 1968, Encyclopedia of Machine Learning.

[8]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[9]  T. Matsoukas Statistical thermodynamics of clustered populations. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  R. Lourie,et al.  The Statistical Mechanics of Financial Markets , 2002 .

[11]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[12]  Rick Durrett,et al.  Stochastic Spatial Models , 1999, SIAM Rev..

[13]  Nicholas M. Timme,et al.  A Tutorial for Information Theory in Neuroscience , 2018, eNeuro.

[14]  Ina Fourie,et al.  Entropy and Information Theory (2nd ed.) , 2012 .

[15]  J. Harte,et al.  Maximum entropy and the state-variable approach to macroecology. , 2008, Ecology.

[16]  H. Callen,et al.  Thermodynamics : an introduction to the physical theories of equilibrium thermostatistics and irreversible thermodynamics / Herbert B. Callen , 1960 .