On the equality condition for the I-MMSE proof of the entropy power inequality

The paper establishes the equality condition in the I-MMSE proof of the entropy power inequality (EPI). This is done by establishing an exact expression for the deficit between the two sides of the EPI. Interestingly, a necessary condition for the equality is established by making a connection to the famous Cauchy functional equation.

[1]  Olivier Rioul.  Optimal Transport to the Entropy-Power Inequality and a Reverse Inequality , 2017, ArXiv.

[2]  Peng Xu,et al.  Forward and Reverse Entropy Power Inequalities in Convex Geometry , 2016, ArXiv.

[3]  Thomas A. Courtade,et al.  Wasserstein Stability of the Entropy Power Inequality for Log-Concave Densities , 2016, ArXiv.

[4]  Nelson M. Blachman,et al.  The convolution inequality for entropy powers , 1965, IEEE Trans. Inf. Theory.

[5]  Mokshay M. Madiman,et al.  Generalized Entropy Power Inequalities and Monotonicity Properties of Information , 2006, IEEE Transactions on Information Theory.

[6]  Olivier Rioul,et al.  Information Theoretic Proofs of Entropy Power Inequalities , 2007, IEEE Transactions on Information Theory.

[7]  Sergey G. Bobkov,et al.  Entropy Power Inequality for the Rényi Entropy , 2015, IEEE Transactions on Information Theory.

[8]  Shlomo Shamai,et al.  Proof of Entropy Power Inequalities Via MMSE , 2006, 2006 IEEE International Symposium on Information Theory.

[9]  Shlomo Shamai,et al.  Mutual information and minimum mean-square error in Gaussian channels , 2004, IEEE Transactions on Information Theory.

[10]  S. Resnick.  A Probability Path , 1999 .

[11]  J. Aczél,et al.  Lectures on Functional Equations and Their Applications , 1968 .

[12]  A. J. Stam.  Some Inequalities Satisfied by the Quantities of Information of Fisher and Shannon , 1959, Inf. Control..

[13]  C. Villani.  Topics in Optimal Transportation , 2003 .

[14]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[15]  Amir Dembo,et al.  Information theoretic inequalities , 1991, IEEE Trans. Inf. Theory.

[16]  Sergio Verdú,et al.  Mismatched Estimation and Relative Entropy , 2009, IEEE Transactions on Information Theory.

[17]  E. Lieb.  Proof of an entropy conjecture of Wehrl , 1978 .

[18]  E. Carlen,et al.  Entropy production by block variable summation and central limit theorems , 1991 .

[19]  Sergio Verdú,et al.  A simple proof of the entropy-power inequality , 2006, IEEE Transactions on Information Theory.

[20]  H. Vincent Poor,et al.  An Introduction to Signal Detection and Estimation , 1994, Springer Texts in Electrical Engineering.

[21]  Olivier Rioul,et al.  Yet Another Proof of the Entropy Power Inequality , 2016, IEEE Transactions on Information Theory.