Graph entropy rate minimization and the compressibility of undirected binary graphs

With the increasing popularity of complex network analysis through the use of graphs, a method for computing graph entropy has become important for a better understanding of a network's structure and for compressing large complex networks. There have been many different definitions of graph entropy in the literature which incorporate random walks, degree distribution, and node centrality. However, these definitions are either computationally complex or seemingly ad hoc. In this paper we propose a new approach for computing graph entropy with the intention of quantifying the compressibility of a graph. We demonstrate the effectiveness of our measure by identifying the lower bound of the entropy rate for scale-free, lattice, star, random, and real-world networks.

[1]  Donald E. Knuth,et al.  The Stanford GraphBase - a platform for combinatorial computing , 1993 .

[2]  Abraham Lempel,et al.  Compression of individual sequences via variable-rate coding , 1978, IEEE Trans. Inf. Theory.

[3]  Matthias Dehmer,et al.  Information processing in complex networks: Graph entropy and information functionals , 2008, Appl. Math. Comput..

[4]  Thomas Manke,et al.  Robustness and network evolution--an entropic principle , 2005 .

[5]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Z. Burda,et al.  Localization of the maximal entropy random walk. , 2008, Physical review letters.

[7]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[8]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[9]  E. Cuthill,et al.  Reducing the bandwidth of sparse symmetric matrices , 1969, ACM '69.

[10]  J. A. Bondy,et al.  Graph Theory , 2008, Graduate Texts in Mathematics.

[11]  Richard Rosen Matrix bandwidth minimization , 1968, ACM National Conference.

[12]  Rafael Martí,et al.  A branch and bound algorithm for the matrix bandwidth minimization , 2008, Eur. J. Oper. Res..

[13]  D. Lusseau,et al.  The bottlenose dolphin community of Doubtful Sound features a large proportion of long-lasting associations , 2003, Behavioral Ecology and Sociobiology.

[14]  J. Gómez-Gardeñes,et al.  Maximal-entropy random walks in complex networks with limited information. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  A. Bonato,et al.  Dominating Biological Networks , 2011, PloS one.