Beyond Boltzmann-Gibbs statistics: maximum entropy hyperensembles out of equilibrium.

What is the best description that we can construct of a thermodynamic system that is not in equilibrium, given only one, or a few, extra parameters over and above those needed for a description of the same system at equilibrium? Here, we argue the most appropriate additional parameter is the nonequilibrium entropy of the system. Moreover, we should not attempt to estimate the probability distribution of the system directly, but rather the metaprobability (or hyperensemble) that the system is described by a particular probability distribution. The result is an entropic distribution with two parameters, one a nonequilibrium temperature, and the other a measure of distance from equilibrium. This dispersion parameter smoothly interpolates between certainty of a canonical distribution at equilibrium and great uncertainty as to the probability distribution as we move away from equilibrium. We deduce that, in general, large, rare fluctuations become far more common as we move away from equilibrium.

[1]  J. Gibbs.  Elementary Principles in Statistical Mechanics , 1902 .

[2]  E. Jaynes.  Information Theory and Statistical Mechanics , 1957 .

[3]  H. Callen.  Thermodynamics and an Introduction to Thermostatistics , 1988 .

[4]  M. A. Cayless.  Statistical Mechanics (2nd edn) , 1977 .

[5]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  R. Callen,et al.  Thermodynamics and an Introduction to Thermostatistics, 2nd Edition , 1985 .

[7]  C. Ray Smith,et al.  Maximum-entropy and Bayesian methods in science and engineering , 1988 .

[8]  C. Tsallis.  Possible generalization of Boltzmann-Gibbs statistics , 1988 .

[9]  John Skilling,et al.  Maximum Entropy and Bayesian Methods , 1989 .

[10]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[11]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[12]  Hua Lee,et al.  Maximum Entropy and Bayesian Methods. , 1996 .

[13]  Durbin,et al.  Biological Sequence Analysis , 1998 .

[14]  Richard S. Ellis,et al.  The theory of large deviations: from Boltzmann's 1877 calculation to equilibrium macrostates in 2D turbulence , 1999 .

[15]  Matthew Brand,et al.  Structure Learning in Conditional Probability Models via an Entropic Prior and Parameter Extinction , 1999, Neural Computation.

[16]  Włodarczyk,et al.  Interpretation of the nonextensivity parameter q in some applications of tsallis statistics and Levy distributions , 2000, Physical review letters.

[17]  R. Dewar.  Information theory explanation of the fluctuation theorem, maximum entropy production and self-organized criticality in non-equilibrium stationary states , 2000, cond-mat/0005382.

[18]  H Qian.  Relative entropy: free energy associated with equilibrium fluctuations and nonequilibrium deviations. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  Multiparameter generalization of nonextensive statistical mechanics. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  Constantino Tsallis,et al.  Constructing a statistical mechanics for Beck-Cohen superstatistics. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[21]  E. Jaynes.  Probability theory : the logic of science , 2003 .

[22]  R. Preuss,et al.  Maximum entropy and Bayesian data analysis: Entropic prior distributions. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  M. Tribus,et al.  Probability theory: the logic of science , 2003 .

[24]  A. Brix.  Bayesian Data Analysis, 2nd edn , 2005 .

[25]  Hugo Touchette,et al.  Asymptotics of superstatistics. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[26]  Christian Beck,et al.  From time series to superstatistics. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  Bayesian approach to superstatistics , 2006, cond-mat/0601154.