Self-Similar Solutions of Rényi's Entropy and the Concavity of Its Entropy Power

We study the class of self-similar probability density functions with finite mean and variance, which maximize Renyi’s entropy. The investigation is restricted in the Schwartz space S(Rd) and in the space of l-differentiable compactly supported functions Clc (Rd). Interestingly, the solutions of this optimization problem do not coincide with the solutions of the usual porous medium equation with a Dirac point source, as occurs in the optimization of Shannon’s entropy. We also study the concavity of the entropy power in Rd with respect to time using two different methods. The first one takes advantage of the solutions determined earlier, while the second one is based on a setting that could be used for Riemannian manifolds.

[1]  I. S. Gradshteyn,et al.  Table of Integrals, Series, and Products , 1976 .

[2]  J. Vázquez.  The Porous Medium Equation , 2006 .

[3]  Donald Geman,et al.  An Active Testing Model for Tracking Roads in Satellite Images , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  P. Berck,et al.  Calculus of variations and optimal control theory , 1993 .

[5]  A. Laforgia,et al.  On the asymptotic expansion of a ratio of gamma functions , 2012 .

[6]  Erwin Lutwak,et al.  Crame/spl acute/r-Rao and moment-entropy inequalities for Renyi entropy and generalized Fisher information , 2005, IEEE Transactions on Information Theory.

[7]  C. Tsallis.  Possible generalization of Boltzmann-Gibbs statistics , 1988 .

[8]  Jan Havrda,et al.  Quantification method of classification processes. Concept of structural a-entropy , 1967, Kybernetika.

[9]  Giuseppe Toscani,et al.  The Concavity of Rényi Entropy Power , 2014, IEEE Transactions on Information Theory.

[10]  Cédric Villani,et al.  A short proof of the "Concavity of entropy power" , 2000, IEEE Trans. Inf. Theory.

[11]  Yi-Ping Hung,et al.  Three-dimensional ego-motion estimation from motion fields observed with multiple cameras , 2001, Pattern Recognit..

[12]  G. I. Barenblatt.  Scaling: Self-similarity and intermediate asymptotics , 1996 .

[13]  Deniz Erdoğmuş,et al.  Clustering using Renyi's entropy , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[14]  M. Hestenes.  Calculus of variations and optimal control theory , 1966 .

[15]  Prasanna K. Sahoo,et al.  Threshold selection using Renyi's entropy , 1997, Pattern Recognit..

[16]  A. A. Mili︠u︡tin,et al.  Calculus of variations and optimal control , 1998 .

[17]  S. Evangelisti.  Quantum Correlations in Field Theory and Integrable Systems , 2013, 1302.5836.

[18]  M. Horodecki,et al.  Quantum entanglement , 2007, quant-ph/0702225.

[19]  J. Vázquez.  The Porous Medium Equation: Mathematical Theory , 2006 .

[20]  C. Vignat,et al.  Some results concerning maximum Renyi entropy distributions , 2005, math/0507400.

[21]  C. Villani,et al.  Local Aronson–Bénilan estimates and entropy formulae for porous medium and fast diffusion equations on manifolds , 2008, 0806.1142.

[22]  A. Erdélyi,et al.  The asymptotic expansion of a ratio of gamma functions. , 1951 .

[23]  F. Otto.  THE GEOMETRY OF DISSIPATIVE EVOLUTION EQUATIONS: THE POROUS MEDIUM EQUATION , 2001 .

[24]  S. Yau,et al.  On the parabolic kernel of the Schrödinger operator , 1986 .