论文信息 - Independent Gaussian Distributions Minimize the Kullback-Leibler (KL) Divergence from Independent Gaussian Distributions

Independent Gaussian Distributions Minimize the Kullback-Leibler (KL) Divergence from Independent Gaussian Distributions

This short note is on a property of the Kullback-Leibler (KL) divergence which indicates that independent Gaussian distributions minimize the KL divergence from given independent Gaussian distributions. The primary purpose of this note is for the referencing of papers that need to make use of this property entirely or partially.

Quanyan Zhu | Song Fang

[1] Thomas M. Cover,et al. Elements of Information Theory , 2005 .

[2] Huaiyu Zhu. On Information and Sufficiency , 1997 .

[3] Guigang Zhang,et al. Deep Learning , 2016, Int. J. Semantic Comput..

[4] Evgueni A. Haroutunian,et al. Information Theory and Statistics , 2011, International Encyclopedia of Statistical Science.

[5] Z. Q. Lu. Statistical Inference Based on Divergence Measures , 2007 .

[6] Jie Chen,et al. Towards Integrating Control and Information Theories , 2017 .

[7] Ruochi Zhang,et al. Stealthy Control Signal Attacks in Linear Quadratic Gaussian Control Systems: Detectability Reward Tradeoff , 2017, IEEE Transactions on Information Forensics and Security.

[8] L. Pardo. Statistical Inference Based on Divergence Measures , 2005 .

[9] G. Picci,et al. Linear Stochastic Systems: A Geometric Approach to Modeling, Estimation and Identification , 2016 .

[10] Quanyan Zhu,et al. Fundamental Stealthiness-Distortion Tradeoffs in Dynamical (Control) Systems under Injection Attacks: A Power Spectral Analysis , 2020, ArXiv.