论文信息 - Kullback-Leibler Divergence for the Normal-Gamma Distribution

Kullback-Leibler Divergence for the Normal-Gamma Distribution

We derive the Kullback-Leibler divergence for the normal-gamma distribution and show that it is identical to the Bayesian complexity penalty for the univariate general linear model with conjugate priors. Based on this finding, we provide two applications of the KL divergence, one in simulated and one in empirical data.

J. Soch | C. Allefeld

[1] Karl J. Friston,et al. Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[2] K. Koch. Introduction to Bayesian Statistics , 2007 .

[3] Radford M. Neal. Pattern Recognition and Machine Learning , 2007, Technometrics.

[4] S. Sinha. Introduction to Bayesian Statistics (2nd ed.) , 2008 .

[5] Stefan Bode,et al. Orientation pop-out processing in human visual cortex , 2013, NeuroImage.

[6] John Duchi,et al. Derivations for Linear Algebra and Optimization , 2016 .