Generalised information and entropy measures in physics

The formalism of statistical mechanics can be generalised by starting from more general measures of information than the Shannon entropy and maximising those subject to suitable constraints. We discuss some of the most important examples of information measures that are useful for the description of complex systems. Examples treated are the Rényi entropy, Tsallis entropy, Abe entropy, Kaniadakis entropy, Sharma–Mittal entropies, and a few more. Important concepts such as the axiomatic foundations, composability and Lesche stability of information measures are briefly discussed. Potential applications in physics include complex systems with long-range interactions and metastable states, scattering processes in particle physics, hydrodynamic turbulence, defect turbulence, optical lattices, and quite generally driven nonequilibrium systems with fluctuations of temperature.

[1]  Stefan Thurner,et al.  On the robustness of q-expectation values and Rényi entropy , 2008, 0812.3855.

[2]  Christian Beck,et al.  Generalized statistical mechanics of cosmic rays , 2004 .

[3]  Bernhard Lesche,et al.  Instabilities of Rényi entropies , 1982 .

[4]  Christian Beck,et al.  Superstatistical distributions from a maximum entropy principle. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  Tatsuaki Wada,et al.  A two-parameter generalization of Shannon-Khinchin axioms and the uniqueness theorem , 2007 .

[6]  Aleksandr Yakovlevich Khinchin,et al.  Mathematical foundations of information theory , 1959 .

[7]  E. Curado,et al.  A nonextensive thermodynamical equilibrium approach in e+e−→ hadrons , 1999, hep-ph/9905255.

[8]  C. Tsallis.  Possible generalization of Boltzmann-Gibbs statistics , 1988 .

[9]  P. Landsberg,et al.  Distributions and channel capacities in generalized statistical mechanics , 1998 .

[10]  A. R. Plastino,et al.  Stellar polytropes and Tsallis' entropy , 1993 .

[11]  Sumiyoshi Abe,et al.  A note on the q-deformation-theoretic aspect of the generalized entropies in nonextensive physics , 1997 .

[12]  G. Kaniadakis,et al.  Statistical mechanics in the context of special relativity. II. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Eberhard Bodenschatz,et al.  Defect turbulence and generalized statistical mechanics , 2004 .

[14]  J. Naudts.  Generalized thermostatistics based on deformed exponential and logarithmic functions , 2003, cond-mat/0311438.

[15]  P. Douglas,et al.  Tunable Tsallis distributions in dissipative optical lattices. , 2006, Physical review letters.

[16]  Christian Beck.  Non-extensive statistical mechanics and particle spectra in elementary interactions , 2000 .

[17]  Pierre-Henri Chavanis.  Generalized thermodynamics and Fokker-Planck equations: applications to stellar dynamics and two-dimensional turbulence. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  Włodarczyk,et al.  Interpretation of the nonextensivity parameter q in some applications of tsallis statistics and Levy distributions , 2000, Physical review letters.

[19]  Keith Briggs,et al.  Modelling train delays with q-exponential functions , 2007 .

[20]  A. Reynolds.  Superstatistical mechanics of tracer-particle motions in turbulence. , 2003, Physical review letters.

[21]  C. Beck,et al.  A superstatistical model of metastasis and cancer survival , 2007, 0711.4687.

[22]  Constantino Tsallis,et al.  Asymptotically scale-invariant occupancy of phase space makes the entropy Sq extensive , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[23]  C. Tsallis,et al.  The role of constraints within generalized nonextensive statistics , 1998 .

[24]  C. Beck,et al.  Thermodynamics of chaotic systems : an introduction , 1993 .

[25]  S. Abe.  Axioms and uniqueness theorem for Tsallis entropy , 2000, cond-mat/0005538.

[26]  R. Hagedorn,et al.  Statistical thermodynamics of strong interactions at high-energies. 2. Momentum spectra of particles produced in pp-collisions , 1965 .

[27]  J. Bouchaud,et al.  Theory Of Financial Risk And Derivative Pricing , 2000 .

[28]  Pierre-Henri Chavanis.  Nonlinear mean-field Fokker–Planck equations and their applications in physics, astrophysics and biology , 2006 .

[29]  C. Tsallis,et al.  Nonergodicity and central-limit behavior for long-range Hamiltonians , 2007, 0706.4021.

[30]  Glassy dynamics in the HMF model , 2003, cond-mat/0312425.

[31]  Y. Sawada,et al.  Anomalous diffusion and non-Gaussian velocity distribution of Hydra cells in cellular aggregates , 2001 .

[32]  Sumiyoshi Abe,et al.  Superstatistics, thermodynamics, and fluctuations. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[33]  C. Beck,et al.  Thermodynamics of chaotic systems , 1993 .

[34]  E. Jaynes.  Information Theory and Statistical Mechanics , 1957 .

[35]  Constantino Tsallis,et al.  Constructing a statistical mechanics for Beck-Cohen superstatistics. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  Sumiyoshi Abe,et al.  Stability of Tsallis entropy and instabilities of Rényi and normalized Tsallis entropies: a basis for q-exponential distributions. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[37]  L. Borland.  Option pricing formulas based on a non-Gaussian stock price model. , 2002, Physical review letters.

[38]  G. Kaniadakis,et al.  Statistical mechanics in the context of special relativity. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[39]  Christian Beck,et al.  From time series to superstatistics. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[40]  J. M. Oshorn.  Proc. Nat. Acad. Sei , 1978 .

[41]  Christian Beck.  Statistics of three-dimensional lagrangian turbulence. , 2007, Physical review letters.

[42]  Pierre-Henri Chavanis,et al.  Nonlinear mean field Fokker-Planck equations. Application to the chemotaxis of biological populations , 2007, 0709.1829.

[43]  E. Lutz.  Anomalous diffusion and Tsallis statistics in an optical lattice , 2003 .

[44]  Jan Havrda,et al.  Quantification method of classification processes. Concept of structural a-entropy , 1967, Kybernetika.

[45]  Christian Beck,et al.  Dynamical Foundations of Nonextensive Statistical Mechanics , 2001, cond-mat/0105374.