SGVCut: A Vertex-Cut Partitioning Tool for Random Walks-based Computations over Social Network graphs

Several distributed frameworks have recently emerged to perform computations on large-scale graphs. However some recent studies have highlighted that vertex-partitioning approaches, e.g. Giraph, failed to achieve workload-balanced partitioning for skewed graphs, typically having a heavy-tail degree distribution. While edge-partitioning approaches such as PowerGraph and GraphX provide beter balancing and performances for graph computation, they supply a generic framework, independent from the computation. This demonstration presents SGVCut to display our edge partitions designed for random walks-based computation, which is the foundation of many graph algorithms, on skewed graphs. The demonstration scenario introduces SGVCut interface and illustrates the benefits of our approach compare to other partitioning strategies for different settings and algorithms.

[1]  Bo Zong,et al.  Towards effective partition management for large graphs , 2012, SIGMOD Conference.

[2]  F. Radicchi,et al.  Benchmark graphs for testing community detection algorithms. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Reynold Xin,et al.  GraphX: a resilient distributed graph system on Spark , 2013, GRADES.

[4]  David F. Gleich,et al.  Vertex neighborhoods, low conductance cuts, and good seeds for local community methods , 2012, KDD.

[5]  Martin Ester,et al.  TrustWalker: a random walk model for combining trust-based and item-based recommendation , 2009, KDD.

[6]  Silvio Lattanzi,et al.  On compressing social networks , 2009, KDD.

[7]  Inderjit S. Dhillon,et al.  Overlapping community detection using seed set expansion , 2013, CIKM.

[8]  Aart J. C. Bik,et al.  Pregel: a system for large-scale graph processing , 2010, SIGMOD Conference.

[9]  Dániel Fogaras,et al.  Towards Scaling Fully Personalized PageRank , 2004, WAW.

[10]  Jennifer Widom,et al.  GPS: a graph processing system , 2013, SSDBM.

[11]  Joseph Gonzalez,et al.  PowerGraph: Distributed Graph-Parallel Computation on Natural Graphs , 2012, OSDI.

[12]  Yifan Li,et al.  A Block-Based Edge Partitioning for Random Walks Algorithms over Large Social Graphs , 2016, WISE.

[13]  Jennifer Widom,et al.  SimRank: a measure of structural-context similarity , 2002, KDD.

[14]  Marc Lelarge,et al.  Balanced graph edge partition , 2014, KDD.

[15]  Marco Gori,et al.  ItemRank: A Random-Walk Based Scoring Algorithm for Recommender Engines , 2007, IJCAI.

[16]  Fan Chung Graham,et al.  Local Graph Partitioning using PageRank Vectors , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[17]  Jennifer Widom,et al.  Scaling personalized web search , 2003, WWW '03.

[18]  Tom M. Mitchell,et al.  Random Walk Inference and Learning in A Large Scale Knowledge Base , 2011, EMNLP.

[19]  Purnamrita Sarkar,et al.  Fast nearest-neighbor search in disk-resident graphs , 2010, KDD.