Towards Information Inequalities for Generalized Graph Entropies

In this article, we discuss the problem of establishing relations between information measures for network structures. Two types of entropy based measures namely, the Shannon entropy and its generalization, the Rényi entropy have been considered for this study. Our main results involve establishing formal relationships, by means of inequalities, between these two kinds of measures. Further, we also state and prove inequalities connecting the classical partition-based graph entropies and partition-independent entropy measures. In addition, several explicit inequalities are derived for special classes of graphs.

[1]  A. Balaban,et al.  New vertex invariants and topological indices of chemical graphs based on information on distances , 1991 .

[2]  Abbe Mowshowitz,et al.  Entropy, Orbits, and Spectra of Graphs , 2009 .

[3]  Frank Harary,et al.  Graph Theory , 2016 .

[4]  Jens Christian Claussen,et al.  Offdiagonal complexity: A computationally quick complexity measure for graphs and networks , 2004, q-bio/0410024.

[5]  M. Dehmer,et al.  Entropy Bounds for Hierarchical Molecular Networks , 2008, PloS one.

[6]  Raúl Toral,et al.  RED: A Set of Molecular Descriptors Based on Re'nyi Entropy , 2009, J. Chem. Inf. Model..

[7]  Matthias Dehmer,et al.  A history of graph entropy measures , 2011, Inf. Sci..

[8]  T. Papaioannou.  Information, Measures of , 2006 .

[9]  N. Rashevsky.  Life, information theory, and topology , 1955 .

[10]  Thomas Wilhelm,et al.  What is a complex graph , 2008 .

[11]  Matthias Dehmer,et al.  Structural information content of networks: Graph entropy based on local vertex functionals , 2008, Comput. Biol. Chem..

[12]  R. Sprengel,et al.  Split-Cre Complementation Indicates Coincident Activity of Different Genes In Vivo , 2009, PloS one.

[13]  Abbe Mowshowitz,et al.  Entropy and the complexity of graphs , 1967 .

[14]  Christoph Arndt,et al.  Information Measures: Information and its Description in Science and Engineering , 2001 .

[15]  A. Mowshowitz,et al.  Entropy and the complexity of graphs. I. An index of the relative complexity of a graph. , 1968, The Bulletin of mathematical biophysics.

[16]  Danail Bonchev,et al.  Complexity in chemistry : introduction and fundamentals , 2003 .

[17]  H. L. Le Roy,et al.  Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability; Vol. IV , 1969 .

[18]  Matthias Dehmer,et al.  Generalized graph entropies , 2011, Complex..

[19]  N. Trinajstic,et al.  Information theory, distance matrix, and molecular branching , 1977 .

[20]  G. Pólya,et al.  Inequalities (Cambridge Mathematical Library) , 1934 .

[21]  Roger L. Freeman.  Wiley Series in Telecommunications and Signal Processing , 2005 .

[22]  Matthias Dehmer,et al.  Connections between Classical and Parametric Network Entropies , 2011, PloS one.

[23]  Matthias Dehmer,et al.  INFORMATION-THEORETIC CONCEPTS FOR THE ANALYSIS OF COMPLEX NETWORKS , 2008, Appl. Artif. Intell..

[24]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[25]  Matthias Dehmer,et al.  Inequalities for entropy-based measures of network information content , 2010, Appl. Math. Comput..

[26]  Subhash C. Basak,et al.  Determining structural similarity of chemicals using graph-theoretic indices , 1988, Discret. Appl. Math..

[27]  Antal Járai,et al.  On the measurable solution of a functional equation arising in information theory , 1979 .

[28]  Matthias Dehmer,et al.  Recent Developments in Quantitative Graph Theory: Information Inequalities for Networks , 2012, PloS one.

[29]  Sever S Dragomir,et al.  Some bounds on entropy measures in information theory , 1997 .

[30]  Raymond W. Yeung,et al.  A framework for linear information inequalities , 1997, IEEE Trans. Inf. Theory.

[31]  Amir Dembo,et al.  Information theoretic inequalities , 1991, IEEE Trans. Inf. Theory.

[32]  Matthias Dehmer,et al.  Information processing in complex networks: Graph entropy and information functionals , 2008, Appl. Math. Comput..

[33]  D. Bonchev,et al.  Complexity in chemistry, biology, and ecology , 2005 .

[34]  Thomas M. Cover,et al.  Elements of Information Theory (Wiley Series in Telecommunications and Signal Processing) , 2006 .

[35]  L. da F. Costa,et al.  Characterization of complex networks: A survey of measurements , 2005, cond-mat/0505185.

[36]  Carter T. Butts,et al.  The complexity of social networks: theoretical and empirical findings , 2001, Soc. Networks.

[37]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[38]  K. Varmuza,et al.  A Large Scale Analysis of Information-Theoretic Network Complexity Measures Using Chemical Structures , 2009, PloS one.

[39]  Ginestra Bianconi,et al.  Entropy measures for networks: toward an information theory of complex topologies. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.