Entropy of Spatial Network Ensembles

We analyze complexity in spatial network ensembles through the lens of graph entropy. Mathematically, we model a spatial network as a soft random geometric graph, i.e., a graph with two sources of randomness, namely nodes located randomly in space and links formed independently between pairs of nodes with probability given by a specified function (the "pair connection function") of their mutual distance. We consider the general case where randomness arises in node positions as well as pairwise connections (i.e., for a given pair distance, the corresponding edge state is a random variable). Classical random geometric graph and exponential graph models can be recovered in certain limits. We derive a simple bound for the entropy of a spatial network ensemble and calculate the conditional entropy of an ensemble given the node location distribution for hard and soft (probabilistic) pair connection functions. Under this formalism, we derive the connection function that yields maximum entropy under general constraints. Finally, we apply our analytical framework to study two practical examples: ad hoc wireless networks and the US flight network. Through the study of these examples, we illustrate that both exhibit properties that are indicative of nearly maximally entropic ensembles.

[1]  G. Bianconi,et al.  Shannon and von Neumann entropy of random networks with heterogeneous expected degree. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  M. Newman,et al.  Statistical mechanics of networks. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  A. Mowshowitz,et al.  Entropy and the complexity of graphs. I. An index of the relative complexity of a graph. , 1968, The Bulletin of mathematical biophysics.

[4]  Danail Bonchev,et al.  Information theoretic indices for characterization of chemical structures , 1983 .

[5]  Marc Barthelemy,et al.  Spatial Networks , 2010, Encyclopedia of Social Network Analysis and Mining.

[6]  Wojciech Szpankowski,et al.  Compression of Graphical Structures: Fundamental Limits, Algorithms, and Experiments , 2012, IEEE Transactions on Information Theory.

[7]  Justin P. Coon,et al.  Impact of boundaries on fully connected random geometric networks , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  Abbe Mowshowitz,et al.  Entropy and the complexity of graphs: IV. Entropy measures and graphical structure , 1968 .

[9]  Petra Koenig,et al.  Information Theoretic Indices For Characterization Of Chemical Structures , 2016 .

[10]  William IEEE TRANSACTIONS ON INFORMATION THEORY VOL XX NO Y MONTH Signal Propagation and Noisy Circuits , 2019 .

[11]  C. Dettmann,et al.  Connectivity of networks with general connection functions , 2014, Physical review. E.

[12]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[13]  Martin G. Everett,et al.  Role similarity and complexity in social networks , 1985 .

[14]  S. Riley Large-Scale Spatial-Transmission Models of Infectious Disease , 2007, Science.

[15]  Justin P. Coon,et al.  Full Connectivity: Corners, Edges and Faces , 2012, ArXiv.

[16]  A. Mowshowitz Entropy and the complexity of graphs. II. The information content of digraphs and infinite graphs. , 1968, The Bulletin of mathematical biophysics.

[17]  M. Penrose CONNECTIVITY OF SOFT RANDOM GEOMETRIC GRAPHS , 2013, 1311.3897.

[18]  W. Marsden I and J , 2012 .

[19]  Ginestra Bianconi,et al.  Emergence of overlap in ensembles of spatial multiplexes and statistical mechanics of spatial interacting networks ensembles , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  Matthias Dehmer,et al.  A history of graph entropy measures , 2011, Inf. Sci..

[21]  Etienne Huens,et al.  Geographical dispersal of mobile communication networks , 2008, 0802.2178.

[22]  Mathew D. Penrose,et al.  Random Geometric Graphs , 2003 .

[23]  Justin P. Coon,et al.  Symmetric Laplacians, Quantum Density Matrices and their Von-Neumann Entropy , 2017, ArXiv.

[24]  A. Mowshowitz Entropy and the complexity of graphs: III. Graphs with prescribed information content , 1968 .

[25]  Albert-László Barabási,et al.  Understanding the Spreading Patterns of Mobile Phone Viruses , 2009, Science.

[26]  K. Sneppen,et al.  Specificity and Stability in Topology of Protein Networks , 2002, Science.

[27]  Ginestra Bianconi,et al.  Entropy measures for networks: toward an information theory of complex topologies. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  Matthias Dehmer,et al.  Information processing in complex networks: Graph entropy and information functionals , 2008, Appl. Math. Comput..

[29]  Serge Fehr,et al.  On the Conditional Rényi Entropy , 2014, IEEE Transactions on Information Theory.