A Distributed Algorithm for Balanced Hypergraph Partitioning

Hypergraph is good at modeling multi-node relationships in complex networks. Balanced hypergraph partitioning helps to optimize storage of large sets of hypergraph-structured data over multi-hosts in the Cloud, and share the query loads. Several centralized vertex partitioning algorithms have been developed to address this problem. However, edge partitioning is proved more effective than vertex partitioning for graph processing. Aim of this paper is to explore a new approach based on hyperedge partitioning, in which hyperedges, rather than vertices, are partitioned into disjoint subsets. We propose a distributed hyperedge partition algorithm, HyperSwap, to partition the hypergraph into balanced sub-hypergraph as required, without global information and central coordination. We show the feasibility, evaluate it on Facebook dataset with various settings, and compare it against two alternative solutions. Experiment findings show that HyperSwap outperforms the other two partitioners because it obtains good partitions with low cut cost while conforming to any balance requirement.

[1]  Domenico Saccà,et al.  Intrusion Detection with Hypergraph-Based Attack Models , 2013, GKR.

[2]  Iman Saleh,et al.  Social-Network-Sourced Big Data Analytics , 2013, IEEE Internet Computing.

[3]  Amir H. Payberah,et al.  JA-BE-JA: A Distributed Algorithm for Balanced Graph Partitioning , 2013, 2013 IEEE 7th International Conference on Self-Adaptive and Self-Organizing Systems.

[4]  Joseph Gonzalez,et al.  PowerGraph: Distributed Graph-Parallel Computation on Natural Graphs , 2012, OSDI.

[5]  K. Selçuk Candan,et al.  SBV-Cut: Vertex-cut based graph partitioning using structural balance vertices , 2012, Data Knowl. Eng..

[6]  Md. Zakirul Alam Bhuiyan,et al.  Partitioning of Hypergraph Modeled Complex Networks Based on Information Entropy , 2015, ICA3PP.

[7]  Tomasz Imielinski,et al.  Imbalanced Hypergraph Partitioning and Improvements for Consensus Clustering , 2013, 2013 IEEE 25th International Conference on Tools with Artificial Intelligence.

[8]  Cevdet Aykanat,et al.  Replicated partitioning for undirected hypergraphs , 2012, J. Parallel Distributed Comput..

[9]  Ralf Borndörfer,et al.  The hypergraph assignment problem , 2015, Discret. Optim..

[10]  Shashi Shekhar,et al.  Multilevel hypergraph partitioning: applications in VLSI domain , 1999, IEEE Trans. Very Large Scale Integr. Syst..

[11]  Cevdet Aykanat,et al.  Temporal Workload-Aware Replicated Partitioning for Social Networks , 2014, IEEE Transactions on Knowledge and Data Engineering.

[12]  Vipin Kumar,et al.  Multilevel k-way Hypergraph Partitioning , 2000, VLSI Design.

[13]  Yu Zhang,et al.  VSEP: A Distributed Algorithm for Graph Edge Partitioning , 2015, ICA3PP.

[14]  Pablo Rodriguez,et al.  The little engine(s) that could: scaling online social networks , 2010, SIGCOMM '10.

[15]  Alberto Montresor,et al.  Distributed Edge Partitioning for Graph Processing , 2014, ArXiv.

[16]  Amir H. Payberah,et al.  Distributed Vertex-Cut Partitioning , 2014, DAIS.

[17]  Abhishek Chandra,et al.  Beyond graphs: toward scalable hypergraph analysis systems , 2014, PERV.

[18]  R. M. Mattheyses,et al.  A Linear-Time Heuristic for Improving Network Partitions , 1982, 19th Design Automation Conference.