Information Theory, Entropy, and Relative Entropy

This chapter contains sections titled: Entropy, Relative Entropy, Mutual Information, Jensen's Inequality, Maximum Entropy, Minimum Relative Entropy