Identification of new classes of non-Shannon type constrained information inequalities and their relation to finite groups

The existence of the so called non-Shannon type (NST) information inequalities stems from the fact that the basic inequalities which are based on the non-negativity of Shannon's information measures provide an incomplete characterization of the joint entropy function of n /spl ges/ 4 discrete random variables (DRVs). Based on a certain NST inequality which was derived by Zhang and Yeung (1998), we identify new classes of NST constrained information inequalities which grow double exponentially with n (n /spl ges/ 4), and generalize a previously reported result for n = 4. Relying on a fundamental relation between information theory and group theory which was devised by Chan and Yeung (see Proceedings 2000 IEEE International Symposium on Information Theory, p.492, Sorrento, Italy, June, 2000), we relate our discussion to finite groups.

[1]  Raymond W. Yeung,et al.  A class of non-Shannon-type information inequalities and their applications , 2001, Proceedings. 2001 IEEE International Symposium on Information Theory (IEEE Cat. No.01CH37252).

[2]  Zhen Zhang,et al.  On Characterization of Entropy Function via Information Inequalities , 1998, IEEE Trans. Inf. Theory.

[3]  Ho-Leung Chan,et al.  A group-theoretic approach to information inequalities , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).