More on a New Concept of Entropy and Information

An alternative notion of entropy called CRE is proposed in [Ra1] Rao et al. (IEEE Trans. Inf. Theory 50, 2004). This preserves many of the properties of Shannon Entropy and possesses mathematical properties, which we hope will be of use in statistical estimates. In this article, we develop some more mathematical properties of CRE, show its relation to the L log L class, and characterize among others the Weibull distribution.

[1]  H. Fédérer.  Geometric Measure Theory , 1969 .

[2]  F. Smithies,et al.  Convex Functions and Orlicz Spaces , 1962, The Mathematical Gazette.

[3]  Yunmei Chen,et al.  Cumulative residual entropy: a new measure of information , 2004, IEEE Transactions on Information Theory.

[4]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[5]  Elias M. Stein,et al.  Note on the class LlogL , 1969 .

[6]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.