Analytical maximum-likelihood method to detect patterns in real networks

In order to detect patterns in real networks, randomized graph ensembles that preserve only part of the topology of an observed network are systematically used as fundamental null models. However, the generation of them is still problematic. Existing approaches are either computationally demanding and beyond analytic control or analytically accessible but highly approximate. Here, we propose a solution to this long-standing problem by introducing a fast method that allows one to obtain expectation values and standard deviations of any topological property analytically, for any binary, weighted, directed or undirected network. Remarkably, the time required to obtain the expectation value of any property analytically across the entire graph ensemble is as short as that required to compute the same property using the adjacency matrix of the single original network. Our method reveals that the null behavior of various correlation properties is different from what was believed previously, and is highly sensitive to the particular network considered. Moreover, our approach shows that important structural properties (such as the modularity used in community detection problems) are currently based on incorrect expressions, and provides the exact quantities that should replace them.

[1]  M. Newman,et al.  Random graphs with arbitrary degree distributions and their applications. , 2000, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  R. Pastor-Satorras,et al.  Generation of uncorrelated random scale-free networks. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  G. Fagiolo Clustering in complex directed networks. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  Neo D. Martinez Artifacts or Attributes? Effects of Resolution on the Little Rock Lake Food Web , 1991 .

[5]  D. Garlaschelli The weighted random graph model , 2009, 0902.0897.

[6]  Tom A. B. Snijders,et al.  Social Network Analysis , 2011, International Encyclopedia of Statistical Science.

[7]  Tore Opsahl,et al.  Prominence and control: the weighted rich-club effect. , 2008, Physical review letters.

[8]  Alessandro Vespignani,et al.  Detecting rich-club ordering in complex networks , 2006, physics/0602134.

[9]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[10]  Luís A. Nunes Amaral,et al.  Evidence for the existence of a robust pattern of prey selection in food webs , 2007, Proceedings of the Royal Society B: Biological Sciences.

[11]  K. Sneppen,et al.  Detection of topological patterns in complex networks: correlation profile of the internet , 2002, cond-mat/0205379.

[12]  A. Vespignani,et al.  The architecture of complex weighted networks. , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[13]  D. Garlaschelli,et al.  Maximum likelihood: extracting unbiased information from complex networks. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  Marián Boguñá,et al.  Correlations in weighted networks. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  K. Kaski,et al.  The International Trade Network: weighted network analysis and modelling , 2007, 0707.4343.

[16]  Brian Everitt,et al.  Cluster analysis , 1974 .

[17]  Mikko Kivelä,et al.  Generalizations of the clustering coefficient to weighted complex networks. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  S E Ahnert,et al.  Clustering signatures classify directed networks. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  L. Stone,et al.  Generating uniformly distributed random networks. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  F. Chung,et al.  Connected Components in Random Graphs with Given Expected Degree Sequences , 2002 .

[21]  M E J Newman,et al.  Random graphs with clustering. , 2009, Physical review letters.

[22]  M. Newman,et al.  Statistical mechanics of networks. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  M. Newman Analysis of weighted networks. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  Roma,et al.  Fitness model for the Italian interbank money market. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[25]  M. Serrano,et al.  Weighted Configuration Model , 2005, cond-mat/0501750.

[26]  Alessandro Vespignani,et al.  Cut-offs and finite size effects in scale-free networks , 2003, cond-mat/0311650.

[27]  César A. Hidalgo,et al.  Scale-free networks , 2008, Scholarpedia.

[29]  John Scott What is social network analysis , 2010 .

[30]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[31]  M. Newman,et al.  Origin of degree correlations in the Internet and other networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[32]  S. Shen-Orr,et al.  Network motifs: simple building blocks of complex networks. , 2002, Science.

[33]  M Angeles Serrano,et al.  Rich-club vs rich-multipolarization phenomena in weighted networks. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  R. Guimerà,et al.  Classes of complex networks defined by role-to-role connectivity profiles. , 2007, Nature physics.

[35]  G. Bianconi Entropy of network ensembles. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[37]  R. Albert,et al.  The large-scale organization of metabolic networks , 2000, Nature.

[38]  Guido Caldarelli,et al.  Scale-Free Networks , 2007 .

[39]  E. Jaynes On the rationale of maximum-entropy methods , 1982, Proceedings of the IEEE.

[40]  Albert-László Barabási,et al.  Scale-free networks , 2008, Scholarpedia.

[41]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[42]  K. Sneppen,et al.  Specificity and Stability in Topology of Protein Networks , 2002, Science.

[43]  Stanley Wasserman,et al.  Social Network Analysis: Methods and Applications , 1994 .

[44]  Diego Garlaschelli,et al.  Generalized Bose-Fermi statistics and structural correlations in weighted networks. , 2008, Physical review letters.

[45]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[46]  D. Garlaschelli,et al.  Multispecies grand-canonical models for networks with reciprocity. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[47]  Diego Garlaschelli,et al.  Patterns of link reciprocity in directed networks. , 2004, Physical review letters.

[48]  Alessandro Vespignani,et al.  Reaction–diffusion processes and metapopulation models in heterogeneous networks , 2007, cond-mat/0703129.

[49]  V. Zlatic,et al.  Influence of reciprocal edges on degree distribution and degree correlations. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.