Algorithmic Complexity of Power Law Networks

It was experimentally observed that the majority of real-world networks are scale-free and follow power law degree distribution. The aim of this paper is to study the algorithmic complexity of such "typical" networks. The contribution of this work is twofold. First, we define a deterministic condition for checking whether a graph has a power law degree distribution and experimentally validate it on real-world networks. This definition allows us to derive interesting properties of power law networks. We observe that for exponents of the degree distribution in the range [1, 2] such networks exhibit double power law phenomenon that was observed for several real-world networks. Our observation indicates that this phenomenon could be explained by just pure graph theoretical properties. The second aim of our work is to give a novel theoretical explanation why many algorithms run faster on real-world data than what is predicted by algorithmic worst-case analysis. We show how to exploit the power law degree distribution to design faster algorithms for a number of classic P-time problems including transitive closure, maximum matching, determinant, PageRank and matrix inverse. Moreover, we deal with the problems of counting triangles and finding maximum clique. In contrast to previously done average-case analyses, we believe that this is the first "waterproof" argument that explains why many real-world networks are easier. Moreover, an interesting aspect of this study is the existence of structure oblivious algorithms, i.e., algorithms that run faster on power law networks without explicit knowledge of this fact or explicit knowledge of the parameters of the degree distribution, e.g., algorithms for maximum clique or triangle counting.

[1]  Gábor Csányi,et al.  Structure of a large social network. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  Mohit Singh,et al.  Set Covering with our Eyes Closed , 2008, FOCS.

[3]  Walter Keller-Gehrig,et al.  Fast Algorithms for the Characteristic Polynomial , 1985, Theor. Comput. Sci..

[4]  Evgeny A. Grechnikov The Degree Distribution and the Number of Edges Between Nodes of given Degrees in Directed Scale-Free Graphs , 2015, Internet Math..

[5]  Ge Xia,et al.  Strong computational lower bounds via parameterized complexity , 2006, J. Comput. Syst. Sci..

[6]  Eli Upfal,et al.  Stochastic models for the Web graph , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[7]  Ilkka Norros,et al.  Large Cliques in a Power-Law Random Graph , 2009, Journal of Applied Probability.

[8]  Tobias Friedrich,et al.  Parameterized clique on inhomogeneous random graphs , 2015, Discret. Appl. Math..

[9]  Bart Selman,et al.  Satisfiability Solvers , 2008, Handbook of Knowledge Representation.

[10]  Alan George,et al.  The Evolution of the Minimum Degree Ordering Algorithm , 1989, SIAM Rev..

[11]  Fabrizio Grandoni,et al.  Steiner Tree Approximation via Iterative Randomized Rounding , 2013, JACM.

[12]  László Lovász,et al.  On determinants, matchings, and random algorithms , 1979, FCT.

[13]  Aleksander Madry,et al.  Navigating Central Path with Electrical Flows: From Flows to Matchings, and Back , 2013, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science.

[14]  Shang-Hua Teng,et al.  Smoothed analysis of algorithms: why the simplex algorithm usually takes polynomial time , 2001, STOC '01.

[15]  Jure Leskovec,et al.  {SNAP Datasets}: {Stanford} Large Network Dataset Collection , 2014 .

[16]  A. Bonato RANDOM GRAPH MODELS FOR THE WEB GRAPH , 2007 .

[17]  Carl D. Meyer,et al.  Stochastic Complementation, Uncoupling Markov Chains, and the Theory of Nearly Reducible Systems , 1989, SIAM Rev..

[18]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[19]  Devdatt P. Dubhashi,et al.  Concentration of Measure for the Analysis of Randomized Algorithms: Contents , 2009 .

[20]  Arne Storjohann Deterministic computation of the Frobenius form , 2001, Proceedings 2001 IEEE International Conference on Cluster Computing.

[21]  Nicholas J. A. Harvey Algebraic Algorithms for Matching and Matroid Problems , 2009, SIAM J. Comput..

[22]  Renato F. Werneck,et al.  Fast local search for the steiner problem in graphs , 2012, JEAL.

[23]  François Le Gall,et al.  Faster Algorithms for Rectangular Matrix Multiplication , 2012, 2012 IEEE 53rd Annual Symposium on Foundations of Computer Science.

[24]  Albert-Lszl Barabsi,et al.  Network Science , 2016, Encyclopedia of Big Data.

[25]  Mahmoud Fouz,et al.  Social networks spread rumors in sublogarithmic time , 2011, STOC '11.

[26]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[27]  Piotr Sankowski,et al.  Maximum matchings via Gaussian elimination , 2004, 45th Annual IEEE Symposium on Foundations of Computer Science.

[28]  P. Pardalos,et al.  An exact algorithm for the maximum clique problem , 1990 .

[29]  Victor Y. Pan,et al.  Processor efficient parallel solution of linear systems over an abstract field , 1991, SPAA '91.

[30]  Vangelis Th. Paschos,et al.  Fast Algorithms for max independent set , 2010, Algorithmica.

[31]  Béla Bollobás,et al.  A Probabilistic Proof of an Asymptotic Formula for the Number of Labelled Regular Graphs , 1980, Eur. J. Comb..

[32]  Piotr Sankowski,et al.  Approximation Algorithms for Steiner Tree Problems Based on Universal Solution Frameworks , 2014, ArXiv.

[33]  V. Pan,et al.  Polynomial and Matrix Computations , 1994, Progress in Theoretical Computer Science.

[34]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[35]  Norishige Chiba,et al.  Arboricity and Subgraph Listing Algorithms , 1985, SIAM J. Comput..

[36]  Noga Alon,et al.  Finding and counting given length cycles , 1997, Algorithmica.

[37]  Silvio Lattanzi,et al.  Affiliation networks , 2009, STOC '09.

[38]  Wayne Eberly,et al.  Asymptotically Efficient Algorithms for the Frobenius Form , 2002 .

[39]  Kihong Park,et al.  On the Hardness of Optimization in Power Law Graphs , 2007, COCOON.

[40]  Matthieu Latapy,et al.  Main-memory triangle computations for very large (sparse (power-law)) graphs , 2008, Theor. Comput. Sci..

[41]  Silvio Micali,et al.  An O(v|v| c |E|) algoithm for finding maximum matching in general graphs , 1980, 21st Annual Symposium on Foundations of Computer Science (sfcs 1980).

[42]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[43]  Virginia Vassilevska Williams,et al.  Multiplying matrices faster than coppersmith-winograd , 2012, STOC '12.

[44]  Piotr Sankowski,et al.  Stochastic analyses for online combinatorial optimization problems , 2008, SODA '08.

[45]  Robert J. Plemmons,et al.  Nonnegative Matrices in the Mathematical Sciences , 1979, Classics in Applied Mathematics.

[46]  M. Newman,et al.  Random graphs with arbitrary degree distributions and their applications. , 2000, Physical review. E, Statistical, nonlinear, and soft matter physics.

[47]  Béla Bollobás,et al.  The degree sequence of a scale‐free random graph process , 2001, Random Struct. Algorithms.

[48]  Alan M. Frieze,et al.  A General Model of Undirected Web Graphs , 2001, ESA.

[49]  Santo Fortunato,et al.  Characterizing and Modeling Citation Dynamics , 2011, PloS one.

[50]  Fan Chung Graham,et al.  A Random Graph Model for Power Law Graphs , 2001, Exp. Math..

[51]  A. Martin-Löf,et al.  Generating Simple Random Graphs with Prescribed Degree Distribution , 2006, 1509.06985.

[52]  Edward A. Bender,et al.  The Asymptotic Number of Labeled Graphs with Given Degree Sequences , 1978, J. Comb. Theory A.

[53]  D. D. Han,et al.  Emergence of double scaling law in complex systems , 2011, 1103.2001.