Statistical Information Tools for Multivariate Discrete Data

An exposition is given of various information theoretic measures appropriate for general statistical analysis of multivariate discrete data. Such measures ought to be better known and used in descriptive and exploratory statistics, and they can also be beneficial as test statistics of probabilistic models.