Counting Graphlets: Space vs Time

Counting graphlets is a well-studied problem in graph mining and social network analysis. Recently, several papers explored very simple and natural approaches based on Monte Carlo sampling of Markov Chains (MC), and reported encouraging results. We show, perhaps surprisingly, that this approach is outperformed by a carefully engineered version of color coding (CC) [1], a sophisticated algorithmic technique that we extend to the case of graphlet sampling and for which we prove strong statistical guarantees. Our computational experiments on graphs with millions of nodes show CC to be more accurate than MC. Furthermore, we formally show that the mixing time of the MC approach is too high in general, even when the input graph has high conductance. All this comes at a price however. While MC is very efficient in terms of space, CC's memory requirements become demanding when the size of the input graph and that of the graphlets grow. And yet, our experiments show that a careful implementation of CC can push the limits of the state of the art, both in terms of the size of the input graph and of that of the graphlets.

[1]  John C. S. Lui,et al.  A General Framework for Estimating Graphlet Statistics via Random Walk , 2016, Proc. VLDB Endow..

[2]  Sebastiano Vigna,et al.  The webgraph framework I: compression techniques , 2004, WWW '04.

[3]  Jure Leskovec,et al.  Statistical properties of community structure in large social and information networks , 2008, WWW.

[4]  Donald F. Towsley,et al.  Efficiently Estimating Motif Statistics of Large Networks , 2013, TKDD.

[5]  Krishna P. Gummadi,et al.  On the evolution of user interaction in Facebook , 2009, WOSN '09.

[6]  Ryan Williams,et al.  Finding, minimizing, and counting weighted subgraphs , 2009, STOC '09.

[7]  Krishna P. Gummadi,et al.  Measurement and analysis of online social networks , 2007, IMC '07.

[8]  Mam Riess Jones Color Coding , 1962, Human factors.

[9]  Sergei Vassilvitskii,et al.  Counting triangles and the curse of the last reducer , 2011, WWW.

[10]  Ali Pinar,et al.  Path Sampling: A Fast and Provable Method for Estimating 4-Vertex Subgraph Counts , 2014, WWW.

[11]  F. Chung Four proofs for the Cheeger inequality and graph partition algorithms , 2007 .

[12]  W. T. Tutte Graph Theory , 1984 .

[13]  Mohammad Al Hasan,et al.  GUISE: Uniform Sampling of Graphlets for Large Graph Analysis , 2012, 2012 IEEE 12th International Conference on Data Mining.

[14]  Kamesh Madduri,et al.  Fast Approximate Subgraph Counting and Enumeration , 2013, 2013 42nd International Conference on Parallel Processing.

[15]  Madhav V. Marathe,et al.  Subgraph Enumeration in Large Social Contact Networks Using Parallel Color Coding and Streaming , 2010, 2010 39th International Conference on Parallel Processing.

[16]  Baruch Schieber,et al.  Subgraph Counting: Color Coding Beyond Trees , 2016, 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS).

[17]  Louxin Zhang,et al.  Counting motifs in the human interactome , 2013, Nature Communications.

[18]  Marco Rosa,et al.  Layered label propagation: a multiresolution coordinate-free ordering for compressing social networks , 2010, WWW.

[19]  Harish Sethu,et al.  Waddling Random Walk: Fast and Accurate Mining of Motif Statistics in Large Graphs , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[20]  Jing Tao,et al.  A Fast Sampling Method of Exploring Graphlet Degrees of Large Directed and Undirected Graphs , 2016, ArXiv.

[21]  V. Climenhaga Markov chains and mixing times , 2013 .

[22]  Christos Faloutsos,et al.  DOULION: counting triangles in massive graphs with a coin , 2009, KDD.

[23]  C S LuiJohn,et al.  A general framework for estimating graphlet statistics via random walk , 2016, VLDB 2016.

[24]  Andrzej Lingas,et al.  Detecting and Counting Small Pattern Graphs , 2013, ISAAC.

[25]  Jing Tao,et al.  Moss: A Scalable Tool for Efficiently Sampling and Counting 4- and 5-Node Graphlets , 2015, ArXiv.

[26]  Mark Jerrum,et al.  The parameterised complexity of counting connected subgraphs and graph motifs , 2013, J. Comput. Syst. Sci..