Multilevel approach for combinatorial optimization in bipartite network

Abstract Multilevel approaches aim at reducing the cost of a target algorithm over a given network by applying it to a coarsened (or reduced) version of the original network. They have been successfully employed in a variety of problems, most notably community detection. However, current solutions are not directly applicable to bipartite networks and the literature lacks studies that illustrate their application for solving multilevel optimization problems in such networks. This article addresses this gap and introduces a multilevel optimization approach for bipartite networks and the implementation of a general multilevel framework including novel algorithms for coarsening and uncorsening, applicable to a variety of problems. We analyze how the proposed multilevel strategy affects the topological features of bipartite networks and show that a controlled coarsening strategy can preserve properties such as degree and clustering coefficient centralities. The applicability of the general framework is illustrated in two optimization problems, one for solving the Barber’s modularity for community detection and the second for dimensionality reduction in text classification. We show that the solutions thus obtained are statistically equivalent, regarding accuracy, to those of conventional approaches, whilst requiring considerably lower execution times.

[1]  M E Newman,et al.  Scientific collaboration networks. I. Network construction and fundamental results. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  Dharma P. Agrawal,et al.  A Parallelization Domain Oriented Multilevel Graph Partitioner , 2002, IEEE Trans. Computers.

[3]  Jurij Silc,et al.  Mesh partitioning: a multilevel ant-colony-optimization algorithm , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[4]  Nan Li,et al.  Neighborhood based fast graph search in large networks , 2011, SIGMOD '11.

[5]  Vipin Kumar,et al.  Parallel multilevel graph partitioning , 1996, Proceedings of International Conference on Parallel Processing.

[6]  Giorgios Kollias,et al.  Fast parallel algorithms for graph similarity and matching , 2014, J. Parallel Distributed Comput..

[7]  Chris Walshaw,et al.  Journal of Graph Algorithms and Applications a Multilevel Algorithm for Force-directed Graph-drawing , 2022 .

[8]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[9]  Pak Ching Li,et al.  A Cooperative Multilevel Tabu Search Algorithm for the Covering Design Problem , 2005, Artificial Evolution.

[10]  Vipin Kumar,et al.  A Parallel Algorithm for Multilevel Graph Partitioning and Sparse Matrix Ordering , 1998, J. Parallel Distributed Comput..

[11]  Yaoguang Hu,et al.  Tri-level decision-making with multiple followers: Model, algorithm and case study , 2015, Inf. Sci..

[12]  Julio Ortega Lopera,et al.  A Parallel Multilevel Metaheuristic for Graph Partitioning , 2004, J. Heuristics.

[13]  Suely Oliveira,et al.  A Multilevel Approach to Identify Functional Modules in a Yeast Protein-Protein Interaction Network , 2006, International Conference on Computational Science.

[14]  Jie Lu,et al.  Multi-Level Decision Making: Models, Methods and Applications , 2015 .

[15]  William J. Knottenbelt,et al.  A parallel algorithm for multilevel k-way hypergraph partitioning , 2004, Third International Symposium on Parallel and Distributed Computing/Third International Workshop on Algorithms, Models and Tools for Parallel Computing on Heterogeneous Networks.

[16]  S.T. Barnard,et al.  PMRSB: Parallel Multilevel Recursive Spectral Bisection , 1995, Proceedings of the IEEE/ACM SC95 Conference.

[17]  M. Newman,et al.  Scientific collaboration networks. II. Shortest paths, weighted networks, and centrality. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  Zhu Wang,et al.  Discovering and Profiling Overlapping Communities in Location-Based Social Networks , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[19]  Hristo Djidjev,et al.  A Scalable Multilevel Algorithm for Graph Clustering and Community Structure Detection , 2007, WAW.

[20]  Alneu de Andrade Lopes,et al.  A Multilevel Approach for Overlapping Community Detection , 2014, 2014 Brazilian Conference on Intelligent Systems.

[21]  Jun Yu,et al.  Adaptive clustering algorithm for community detection in complex networks. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  Chris Walshaw,et al.  Multilevel Refinement for Combinatorial Optimisation Problems , 2004, Ann. Oper. Res..

[23]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[24]  Fei Wang,et al.  A multilevel approach for learning from labeled and unlabeled data on graphs , 2010, Pattern Recognit..

[25]  Mikhail Chernoskutov,et al.  Heuristic Algorithm for Approximation Betweenness Centrality Using Graph Coarsening , 2015 .

[26]  Alneu de Andrade Lopes,et al.  Optimization and label propagation in bipartite heterogeneous networks to improve transductive classification of texts , 2016, Inf. Process. Manag..

[27]  George Karypis,et al.  Multilevel algorithms for partitioning power-law graphs , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[28]  M. Newman,et al.  The structure of scientific collaboration networks. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Vincent Labatut,et al.  Generalised measures for the evaluation of community detection methods , 2013, Int. J. Soc. Netw. Min..

[30]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[31]  M. Newman,et al.  Mixing patterns in networks. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[32]  Vipin Kumar,et al.  Parallel Multilevel k-way Partitioning Scheme for Irregular Graphs , 1996, Proceedings of the 1996 ACM/IEEE Conference on Supercomputing.

[33]  Matthieu Latapy,et al.  Basic notions for the analysis of large two-mode networks , 2008, Soc. Networks.

[34]  Andreas Noack,et al.  Multi-level Algorithms for Modularity Clustering , 2008, SEA.

[35]  Chris Walshaw,et al.  Parallel optimisation algorithms for multilevel mesh partitioning , 2000, Parallel Comput..

[36]  George Karypis,et al.  Multi-threaded Graph Partitioning , 2013, 2013 IEEE 27th International Symposium on Parallel and Distributed Processing.

[37]  Stephen J Beckett,et al.  Improved community detection in weighted bipartite networks , 2016, Royal Society Open Science.

[38]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..

[39]  William J. Knottenbelt,et al.  Par kway 2.0: A Parallel Multilevel Hypergraph Partitioning Tool , 2004, ISCIS.

[40]  Chris Walshaw,et al.  Mesh Partitioning: A Multilevel Balancing and Refinement Algorithm , 2000, SIAM J. Sci. Comput..

[41]  George Karypis,et al.  Multi-threaded modularity based graph clustering using the multilevel paradigm , 2015, J. Parallel Distributed Comput..

[42]  Yaoguang Hu,et al.  Multilevel decision-making: A survey , 2016, Inf. Sci..

[43]  R. Häggkvist,et al.  Bipartite graphs and their applications , 1998 .

[44]  Tao Zhou,et al.  Link prediction in weighted networks: The role of weak ties , 2010 .

[45]  Kayhan Erciyes,et al.  Serial and Parallel Multilevel Graph Partitioning Using Fixed Centers , 2005, SOFSEM.

[46]  Christian Blum,et al.  Multi-level Ant Colony Optimization for DNA Sequencing by Hybridization , 2006, Hybrid Metaheuristics.

[47]  R. Albert,et al.  The large-scale organization of metabolic networks , 2000, Nature.

[48]  Wojciech Rytter,et al.  Fast parallel algorithms for graph matching problems , 1998 .

[49]  Amedeo Caflisch,et al.  Efficient modularity optimization by multistep greedy algorithm and vertex mover refinement. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[50]  I. Jolliffe Principal Component Analysis , 2002 .

[51]  Alan Soper,et al.  The application of Multilevel Refinement to the Vehicle Routing Problem , 2007, 2007 IEEE Symposium on Computational Intelligence in Scheduling.

[52]  Horst D. Simon,et al.  Fast multilevel implementation of recursive spectral bisection for partitioning unstructured problems , 1994, Concurr. Pract. Exp..

[53]  Hristo Djidjev,et al.  Scalable and Accurate Graph Clustering and Community Structure Detection , 2013, IEEE Transactions on Parallel and Distributed Systems.

[54]  Alneu de Andrade Lopes,et al.  Multilevel refinement based on neighborhood similarity , 2014, IDEAS.

[55]  M. Barber Modularity and community detection in bipartite networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[56]  Vipin Kumar,et al.  Analysis of Multilevel Graph Partitioning , 1995, Proceedings of the IEEE/ACM SC95 Conference.

[57]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[58]  Chris Walshaw,et al.  A Multilevel Approach to the Travelling Salesman Problem , 2002, Oper. Res..

[59]  Andreas Noack,et al.  Multilevel local search algorithms for modularity clustering , 2011, JEAL.

[60]  Vipin Kumar,et al.  Parallel Multilevel Algorithms for Multi-constraint Graph Partitioning (Distinguished Paper) , 2000, Euro-Par.