Entropies, convexity, and functional inequalities

Our aim is to provide a short and self contained synthesis which generalise and unify various related and unrelated works involving what we call Phi-Sobolev functional inequalities. Such inequalities related to Phi-entropies can be seen in particular as an inclusive interpolation between Poincare and Gross logarithmic Sobolev inequalities. In addition to the known material, extensions are provided and improvements are given for some aspects. Stability by tensor products, convolution, and bounded perturbations are addressed. We show that under simple convexity assumptions on Phi, such inequalities hold in a lot of situations, including hyper-contractive diffusions, uniformly strictly log-concave measures, Wiener measure (paths space of Brownian Motion on Riemannian Manifolds) and generic Poisson space (includes paths space of some pure jumps Levy processes and related infinitely divisible laws). Proofs are simple and relies essentially on convexity. We end up by a short parallel inspired by the analogy with Boltzmann-Shannon entropy appearing in Kinetic Gases and Information Theories.

[1]  I. Csiszár.  A class of measures of informativity of observation channels , 1972 .

[2]  E. Lieb.  Some Convexity and Subadditivity Properties of Entropy , 1975 .

[3]  C. R. Rao,et al.  On the convexity of some divergence measures based on entropy functions , 1982, IEEE Trans. Inf. Theory.

[4]  C. R. Rao,et al.  Entropy differential metric, distance and divergence measures in probability spaces: A unified approach , 1982 .

[5]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[6]  Marc Teboulle,et al.  Rate distortion theory with generalized information measures via convex programming duality , 1986, IEEE Trans. Inf. Theory.

[7]  Ioannis Karatzas,et al.  Brownian Motion and Stochastic Calculus , 1987 .

[8]  D. Stroock,et al.  Logarithmic Sobolev inequalities and stochastic Ising models , 1987 .

[9]  Marc Teboulle,et al.  Convergence of best phi-entropy estimates , 1993, IEEE Trans. Inf. Theory.

[10]  F. Wang.  Logarithmic Sobolev inequalities for diffusion Processes with application to path space , 1996 .

[11]  M. Ledoux.  On Talagrand's deviation inequalities for product measures , 1997 .

[12]  Elton P. Hsu,et al.  Martingale Representation and a Simple Proof of Logarithmic Sobolev Inequalities on Path Spaces , 1997 .

[13]  The Log-Sobolev Inequality on Loop Space over a Compact Riemannian Manifold☆ , 1998 .

[14]  M. Ledoux.  Concentration of measure and logarithmic Sobolev inequalities , 1999 .

[15]  On logarithmic Sobolev inequalities for normal martingales , 2000 .

[16]  Liming Wu,et al.  A new modified logarithmic Sobolev inequality for Poisson point processes and several applications , 2000 .

[17]  A unified approach to several inequalities for gaussian and diffusion measures , 2000 .

[18]  R. Latala,et al.  Between Sobolev and Poincaré , 2000, math/0003043.

[19]  On logarithmic Sobolev inequalities for continuous time random walks on graphs , 2000 .

[20]  M. Ledoux.  The concentration of measure phenomenon , 2001 .

[21]  F. Barthe.  Levels of concentration between exponential and Gaussian , 2001 .

[22]  J. Lindenstrauss,et al.  Chapter 15 - Infinite Dimensional Convexity , 2001 .

[23]  Elton P. Hsu.  Stochastic analysis on manifolds , 2002 .

[24]  Gordon Blower,et al.  Nonlinear kernel density estimation for binned data: convergence in entropy , 2002 .

[25]  F. Barthe,et al.  Sobolev inequalities for probability measures on the real line , 2003 .

[26]  C. Villani.  Topics in Optimal Transportation , 2003 .

[27]  Clark formula and logarithmic Sobolev inequalities for bernoulli measures , 2003 .