Kernel-based embeddings for large graphs with centrality constraints

Complex phenomena involving pairwise interactions in natural and man-made settings can be well-represented by networks. Besides statistical and computational analyses on such networks, visualization plays a crucial role towards effectively conveying “at-a-glance” structural properties such as node hierarchy. However, most graph embedding algorithms developed for network visualization are ill-equipped to cope with the sheer volume of data generated by modern networks that encompass online social interactions, the Internet, or the world-wide web. Motivated by the emergence of nonlinear manifold learning approaches for dimensionality reduction, this paper puts forth a novel scheme for embedding graphs using kernel matrices defined on graphs. In particular, a kernelized version of local linear embedding is devised for computation of reconstruction weights. Unlike contemporary approaches, the developed embedding algorithm entails low-cost, parallelizable, and closed-form updates that can easily scale to big network data. Furthermore, it turns out that inclusion of embedding constraints to emphasize centrality structure can be accomplished at minimal extra computational cost. Experimental results on Watts-Strogatz small-world networks demonstrate the efficacy of the novel approach.

[1]  Deborah F. Swayne,et al.  Data Visualization With Multidimensional Scaling , 2008 .

[2]  Kwan-Liu Ma,et al.  Visual Reasoning about Social Networks Using Centrality Sensitivity , 2012, IEEE Transactions on Visualization and Computer Graphics.

[3]  Ioannis G. Tollis,et al.  Algorithms for area-efficient orthogonal drawings , 1998, Comput. Geom..

[4]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[5]  Tony Jebara,et al.  Structure preserving embedding , 2009, ICML '09.

[6]  Lawrence K. Saul,et al.  Think Globally, Fit Locally: Unsupervised Learning of Low Dimensional Manifold , 2003, J. Mach. Learn. Res..

[7]  Martin Wattenberg,et al.  Centrality Based Visualization of Small World Graphs , 2008, Comput. Graph. Forum.

[8]  Georgios B. Giannakis,et al.  Backhaul-Constrained Multicell Cooperation Leveraging Sparsity and Spectral Clustering , 2014, IEEE Transactions on Wireless Communications.

[9]  Alessandro Vespignani,et al.  Large scale networks fingerprinting and visualization using the k-core decomposition , 2005, NIPS.

[10]  Gert Sabidussi,et al.  The centrality index of a graph , 1966 .

[11]  Eric D. Kolaczyk,et al.  Statistical Analysis of Network Data: Methods and Models , 2009 .

[12]  B. Schölkopf,et al.  Graph Laplacian Regularization for Large-Scale Semidefinite Programming , 2007 .

[13]  Ugur Dogrusoz,et al.  CiSE: A Circular Spring Embedder Layout Algorithm , 2013, IEEE Transactions on Visualization and Computer Graphics.

[14]  Patrick J. F. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 2003 .

[15]  François Fouss,et al.  Random-Walk Computation of Similarities between Nodes of a Graph with Application to Collaborative Recommendation , 2007, IEEE Transactions on Knowledge and Data Engineering.

[16]  Xin Zhang,et al.  PIWI: Visually Exploring Graphs Based on Their Community Structure , 2013, IEEE Transactions on Visualization and Computer Graphics.

[17]  David Kempe,et al.  A decentralized algorithm for spectral analysis , 2008, J. Comput. Syst. Sci..

[18]  Lane Harrison,et al.  The future of security visualization: Lessons from network visualization , 2012, IEEE Network.

[19]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[20]  Leonard M. Freeman,et al.  A set of measures of centrality based upon betweenness , 1977 .

[21]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[23]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[24]  Edward M. Reingold,et al.  Graph drawing by force‐directed placement , 1991, Softw. Pract. Exp..

[25]  Eric D. Kolaczyk,et al.  Statistical Analysis of Network Data , 2009 .

[26]  Georgios B. Giannakis,et al.  Centrality-constrained graph embedding , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[27]  François Fouss,et al.  The Principal Components Analysis of a Graph, and Its Relationships to Spectral Clustering , 2004, ECML.

[28]  Satoru Kawai,et al.  An Algorithm for Drawing General Undirected Graphs , 1989, Inf. Process. Lett..