Computing Vertex Centrality Measures in Massive Real Networks with a Neural Learning Model

Vertex centrality measures are a multi-purpose analysis tool, commonly used in many application environments to retrieve information and unveil knowledge from the graphs and network structural properties. However, the algorithms of such metrics are expensive in terms of computational resources when running real-time applications or massive real world networks. Thus, approximation techniques have been developed and used to compute the measures in such scenarios. In this paper, we demonstrate and analyze the use of neural network learning algorithms to tackle such task and compare their performance in terms of solution quality and computation time with other techniques from the literature. Our work offers several contributions. We highlight both the pros and cons of approximating centralities though neural learning. By empirical means and statistics, we then show that the regression model generated with a feedforward neural networks trained by the Levenberg-Marquardt algorithm is not only the best option considering computational resources, but also achieves the best solution quality for relevant applications and large-scale networks.

[1]  Diego Noble,et al.  An Analysis of Centrality Measures for Complex and Social Networks , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[2]  Gert Sabidussi,et al.  The centrality index of a graph , 1966 .

[3]  Tamara G. Kolda,et al.  Community structure and scale-free collections of Erdös-Rényi graphs , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  P. Bonacich Factoring and weighting approaches to status scores and clique identification , 1972 .

[5]  Wei Xiong,et al.  Active learning for protein function prediction in protein-protein interaction networks , 2013, Neurocomputing.

[6]  Leonard M. Freeman,et al.  A set of measures of centrality based upon betweenness , 1977 .

[7]  Ulrik Brandes,et al.  On variants of shortest-path betweenness centrality and their generic computation , 2008, Soc. Networks.

[8]  Yves Zenou,et al.  Nestedness in Networks: A Theoretical Model and Someapplications , 2012 .

[9]  Przemyslaw Kazienko,et al.  Label-dependent node classification in the network , 2012, Neurocomputing.

[10]  Nicholas R. Jennings,et al.  Efficient Computation of the Shapley Value for Game-Theoretic Network Centrality , 2014, J. Artif. Intell. Res..

[11]  Luís C. Lamb,et al.  Collaboration in Social Problem-Solving: When Diversity Trumps Network Efficiency , 2015, AAAI.

[12]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[13]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[14]  T.,et al.  Training Feedforward Networks with the Marquardt Algorithm , 2004 .

[15]  Luís C. Lamb,et al.  The Impact of Centrality on Individual and Collective Performance in Social Problem-Solving Systems , 2015, GECCO.

[16]  Luís C. Lamb,et al.  On approximating networks centrality measures via neural learning algorithms , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[17]  Ashok Kumar,et al.  Neural Networks for Fast Estimation of Social Network Centrality Measures , 2015 .

[18]  L. da F. Costa,et al.  Characterization of complex networks: A survey of measurements , 2005, cond-mat/0505185.

[19]  E. David,et al.  Networks, Crowds, and Markets: Reasoning about a Highly Connected World , 2010 .

[20]  Sanming Zhou,et al.  Networking for Big Data: A Survey , 2017, IEEE Communications Surveys & Tutorials.

[21]  Luc De Raedt,et al.  Neural-Symbolic Learning and Reasoning: Contributions and Challenges , 2015, AAAI Spring Symposia.

[22]  Jure Leskovec,et al.  Learning to Discover Social Circles in Ego Networks , 2012, NIPS.

[23]  Ulrik Brandes,et al.  Centrality Estimation in Large Networks , 2007, Int. J. Bifurc. Chaos.

[24]  L. Freeman Centrality in social networks conceptual clarification , 1978 .

[25]  David A. Bader,et al.  Approximating Betweenness Centrality , 2007, WAW.

[26]  Luís C. Lamb,et al.  Estimating complex networks centrality via neural networks and machine learning , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[27]  Tamara G. Kolda,et al.  A Scalable Generative Graph Model with Community Structure , 2013, SIAM J. Sci. Comput..

[28]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[29]  Pengxiang Zhao,et al.  UNDERSTANDING URBAN TRAFFIC FLOW CHARACTERISTICS FROM THE NETWORK CENTRALITY PERSPECTIVE AT DIFFERENT GRANULARITIES , 2016 .

[30]  Renato Lo Cigno,et al.  On the Computation of Centrality Metrics for Network Security in Mesh Networks , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[31]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[32]  Ioannis Stavrakakis,et al.  Distributed Placement of Autonomic Internet Services , 2014, IEEE Transactions on Parallel and Distributed Systems.

[33]  O. Sporns,et al.  Network hubs in the human brain , 2013, Trends in Cognitive Sciences.

[34]  Yong Gao,et al.  Understanding Urban Traffic-Flow Characteristics: A Rethinking of Betweenness Centrality , 2013 .

[35]  U. Brandes A faster algorithm for betweenness centrality , 2001 .

[36]  Jure Leskovec,et al.  Defining and evaluating network communities based on ground-truth , 2012, Knowledge and Information Systems.

[37]  F. Chung,et al.  The average distances in random graphs with given expected degrees , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[38]  E. Todeva Networks , 2007 .

[39]  Andrew Seary,et al.  Eigen Analysis of Networks , 2000, J. Soc. Struct..

[40]  Li Wang,et al.  Pedestrian detection in unseen scenes by dynamically updating visual words , 2013, Neurocomputing.

[41]  Kazushi Sano,et al.  Explaining Traffic Flow Patterns Using Centrality Measures , 2015 .

[42]  Marko Bajec,et al.  Robust network community detection using balanced propagation , 2011, ArXiv.

[43]  Shilpa Chakravartula,et al.  Complex Networks: Structure and Dynamics , 2014 .

[44]  Alan M. Frieze,et al.  Random graphs , 2006, SODA '06.

[45]  Michael Mitzenmacher,et al.  A Brief History of Generative Models for Power Law and Lognormal Distributions , 2004, Internet Math..

[46]  Yuan-Chun Jiang,et al.  Identifying social influence in complex networks: A novel conductance eigenvector centrality model , 2016, Neurocomputing.