Links between the Logarithmic Sobolev Inequality and the convolution inequalities for Entropy and Fisher Information

Relative to the Gaussian measure on $\mathbb{R}^d$, entropy and Fisher information are famously related via Gross' logarithmic Sobolev inequality (LSI). These same functionals also separately satisfy convolution inequalities, as proved by Stam. We establish a dimension-free inequality that interpolates among these relations. Several interesting corollaries follow: (i) the deficit in the LSI satisfies a convolution inequality itself; (ii) the deficit in the LSI controls convergence in the entropic and Fisher information central limit theorems; and (iii) the LSI is stable with respect to HWI jumps (i.e., a jump in any of the convolution inequalities associated to the HWI functionals). Another consequence is that the convolution inequalities for Fisher information and entropy powers are reversible in general, up to a factor depending on the Stam defect. An improved form of Nelson's hypercontractivity estimate also follows. Finally, we speculate on the possibility of an analogous reverse Brunn-Minkowski inequality and a related upper bound on surface area associated to Minkowski sums.

[1]  Thomas A. Courtade,et al.  Strengthening the entropy power inequality , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[2]  Peng Xu,et al.  Forward and Reverse Entropy Power Inequalities in Convex Geometry , 2016, ArXiv.

[3]  C. Villani,et al.  Generalization of an Inequality by Talagrand and Links with the Logarithmic Sobolev Inequality , 2000 .

[4]  Edward Nelson The free Markoff field , 1973 .

[5]  Nelson M. Blachman,et al.  The convolution inequality for entropy powers , 1965, IEEE Trans. Inf. Theory.

[6]  E. Carlen Superadditivity of Fisher's information and logarithmic Sobolev inequalities , 1991 .

[7]  M. Ledoux The concentration of measure phenomenon , 2001 .

[8]  Gennadiy P. Chistyakov,et al.  Rate of convergence and Edgeworth-type expansion in the entropic central limit theorem , 2011, 1104.3994.

[9]  A. J. Stam Some Inequalities Satisfied by the Quantities of Information of Fisher and Shannon , 1959, Inf. Control..

[10]  Amir Dembo,et al.  Simple proof of the concavity of the entropy power with respect to Gaussian noise , 1989, IEEE Trans. Inf. Theory.

[11]  Diego Marcon,et al.  A quantitative log-Sobolev inequality for a two parameter family of functions , 2013, 1302.4910.

[12]  M. Ledoux,et al.  Analysis and Geometry of Markov Diffusion Operators , 2013 .

[13]  E. Carlen,et al.  Entropy production by block variable summation and central limit theorems , 1991 .

[14]  Cyril Roberto,et al.  Bounds on the deficit in the logarithmic Sobolev inequality , 2014, 1408.2115.

[15]  Van Hoang Nguyen,et al.  Entropy jumps for isotropic log-concave random vectors and spectral gap , 2012, 1206.5098.

[16]  Cédric Villani,et al.  A short proof of the "Concavity of entropy power" , 2000, IEEE Trans. Inf. Theory.

[17]  Piotr Nayar,et al.  A reverse entropy power inequality for log-concave random vectors , 2015, 1509.05926.

[18]  A. Barron ENTROPY AND THE CENTRAL LIMIT THEOREM , 1986 .

[19]  C. Villani Topics in Optimal Transportation , 2003 .

[20]  K. Ball,et al.  Solution of Shannon's problem on the monotonicity of entropy , 2004 .

[21]  A. Barron,et al.  Fisher information inequalities and the central limit theorem , 2001, math/0111020.

[22]  Max H. M. Costa,et al.  A new entropy power inequality , 1985, IEEE Trans. Inf. Theory.

[23]  Gennadiy P. Chistyakov,et al.  Berry–Esseen bounds in the entropic central limit theorem , 2011, 1105.4119.

[24]  M. Talagrand Transportation cost for Gaussian and other product measures , 1996 .

[25]  Sergey G. Bobkov,et al.  Entropy Power Inequality for the Rényi Entropy , 2015, IEEE Transactions on Information Theory.

[26]  S. Bobkov,et al.  Reverse Brunn–Minkowski and reverse entropy power inequalities for convex measures , 2011, 1109.5287.

[27]  L. Gross LOGARITHMIC SOBOLEV INEQUALITIES. , 1975 .

[28]  Thomas A. Courtade,et al.  Entropy Jumps for Radially Symmetric Random Vectors , 2016, ArXiv.

[29]  Assaf Naor,et al.  Entropy jumps in the presence of a spectral gap , 2003 .

[30]  T. Cover,et al.  IEEE TRANSACTIONSON INFORMATIONTHEORY,VOL. IT-30,N0. 6,NOVEmER1984 Correspondence On the Similarity of the Entropy Power Inequality The preceeding equations allow the entropy power inequality and the Brunn-Minkowski Inequality to be rewritten in the equiv , 2022 .

[31]  Max Fathi,et al.  Quantitative logarithmic Sobolev inequalities and stability estimates , 2014, 1410.6922.