Automatic Selection of Number of Clusters in Networks Using Relative Eigenvalue Quality

In communication networks, it is often useful to partition the networks into disjoint clusters so that hierarchical protocols, such as hierarchical routing, can be used. Many clustering techniques have been developed for this purpose, including connectivity-based, centroid-based, and spectral methods. One issue with all of these methods is how to select an appropriate number of clusters from the structure of the network. In this paper, we consider clustering techniques based on spectral graph theory in which the relations among nodes in a communication network are mapped onto a graph. We consider techniques that are designed to minimize the multiway normalized cut, a metric that tries to simultaneously minimize the number of edges cut between clusters while balancing the volumes of the clusters. We develop a new method for determining the number of clusters based on the eigenvalues of a normalized graph Laplacian matrix by comparing the eigenvalues to the statistics of a certain type of random cut of the graph. Performance results are presented to demonstrate the effectiveness of our algorithm.

[1]  Anthony Ephremides,et al.  The Architectural Organization of a Mobile Radio Network via a Distributed Algorithm , 1981, IEEE Trans. Commun..

[2]  Mario Gerla,et al.  Multicluster, mobile, multimedia radio network , 1995, Wirel. Networks.

[3]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[4]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Robert Tibshirani,et al.  Estimating the number of clusters in a data set via the gap statistic , 2000 .

[6]  Pietro Perona,et al.  Grouping and dimensionality reduction by locally linear embedding , 2001, NIPS.

[7]  Catherine A. Sugar,et al.  Finding the Number of Clusters in a Dataset , 2003 .

[8]  Edward J. Coyle,et al.  An energy efficient hierarchical clustering algorithm for wireless sensor networks , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[9]  Lihao Xu,et al.  Multiway cuts and spec-tral clustering , 2003 .

[10]  F. Chung,et al.  Spectra of random graphs with given expected degrees , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Pietro Perona,et al.  Self-Tuning Spectral Clustering , 2004, NIPS.

[12]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[14]  Joseph P. Macker,et al.  Dynamic communities in evolving network graphs , 2012, MILCOM 2012 - 2012 IEEE Military Communications Conference.