On generalized entropy measures and pathways

Product probability property, known in the literature as statistical independence, is examined first. Then generalized entropies are introduced, all of which give generalizations to Shannon entropy. It is shown that the nature of the recursivity postulate automatically determines the logarithmic functional form for Shannon entropy. Due to the logarithmic nature, Shannon entropy naturally gives rise to additivity, when applied to situations having product probability property. It is argued that the natural process is non-additivity, important, for example, in statistical mechanics [C. Tsallis, Possible generalization of Boltzmann–Gibbs statistics, J. Stat. Phys. 52 (1988) 479–487; E.G.D. Cohen, Boltzmann and Einstein: statistics and dynamics—an unsolved problem, Pramana 64 (2005) 635–643.], even in product probability property situations and additivity can hold due to the involvement of a recursivity postulate leading to a logarithmic function. Generalized entropies are introduced and some of their properties are examined. Situations are examined where a generalized entropy of order α leads to pathway models, exponential and power law behavior and related differential equations. Connection of this entropy to Kerridge's measure of “inaccuracy” is also explored.

[1]  A. M. Mathai,et al.  Generalized Measure of Entropy, Mathai's Distributional Pathway Model, and Tsallis Statistics , 2006, cond-mat/0609526.

[2]  C. Tsallis Possible generalization of Boltzmann-Gibbs statistics , 1988 .

[3]  E. Cohen,et al.  Boltzmann and Einstein: Statistics and dynamics — An unsolved problem , 2005 .

[4]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[5]  C. Tsallis,et al.  Nonextensive statistical mechanics , 2005 .

[6]  Arak M. Mathai,et al.  A pathway to matrix-variate gamma and normal densities , 2005 .

[7]  Arak M. Mathai,et al.  Basic Concepts in Information Theory and Statistics: Axiomatic Foundations and Applications , 1975 .

[8]  A. M. Mathai,et al.  On generalized distributions and pathways , 2008 .

[9]  P. Douglas,et al.  Tunable Tsallis distributions in dissipative optical lattices. , 2006, Physical review letters.

[10]  Jan Havrda,et al.  Quantification method of classification processes. Concept of structural a-entropy , 1967, Kybernetika.

[11]  D. Kerridge Inaccuracy and Inference , 1961 .

[12]  A. Rényi On Measures of Entropy and Information , 1961 .

[13]  Constantino Tsallis,et al.  What should a statistical mechanics satisfy to reflect nature , 2004, cond-mat/0403012.

[14]  G. L. Ferri,et al.  Equivalence of the four versions of Tsallis’s statistics , 2005, cond-mat/0503441.

[15]  Stretched exponentials from superstatistics , 2005, cond-mat/0510841.

[16]  H. L. Le Roy,et al.  Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability; Vol. IV , 1969 .