Spectral clustering with physical intuition on spring-mass dynamics

Abstract In this paper, we provide a new insight into clustering with a spring–mass dynamics, and propose a resulting hierarchical clustering algorithm. To realize the spectral graph partitioning as clustering, we model a weighted graph of a data set as a mass–spring dynamical system, where we regard a cluster as an oscillating single entity of a data set with similar properties. And then, we describe how oscillation modes are related with eigenvectors of a graph Laplacian matrix of the data set. In each step of the clustering, we select a group of clusters, which has the biggest number of constituent clusters. This group is divided into sub-clusters by examining an eigenvector minimizing a cost function, which is formed in such a way that subdivided clusters will be balanced with large size. To find k clusters out of non-spherical or complex data, we first transform the data into spherical clusters located on the unit sphere positioned in the (k−1)-dimensional space. In the sequel, we use the previous procedure to these transformed data. The computational experiments demonstrate that the proposed method works quite well on a variety of data sets, although its performance degrades with the degree of overlapping of data sets.

[1]  M. Fiedler A property of eigenvectors of nonnegative symmetric matrices and its application to graph theory , 1975 .

[2]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[3]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  François Fouss,et al.  Graph nodes clustering with the sigmoid commute-time kernel: A comparative study , 2009, Data Knowl. Eng..

[5]  Pasi Fränti,et al.  Iterative shrinking method for clustering problems , 2006, Pattern Recognit..

[6]  Michael G. Rabbat,et al.  GANC: Greedy agglomerative normalized cut for graph clustering , 2012, Pattern Recognit..

[7]  Fei Wang,et al.  Fast affinity propagation clustering: A multilevel approach , 2012, Pattern Recognit..

[8]  Koichi Fujiwara,et al.  Correlation-based spectral clustering for flexible process monitoring , 2011 .

[9]  Weifu Chen,et al.  Spectral clustering: A semi-supervised approach , 2012, Neurocomputing.

[10]  Edwin R. Hancock,et al.  Graph matching and clustering using spectral partitions , 2006, Pattern Recognit..

[11]  Tom Duckett,et al.  Incremental Spectral Clustering and Its Application To Topological Mapping , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[12]  Michael Holzrichter,et al.  A Graph Based Method for Generating the Fiedler Vector of Irregular Problems , 1999, IPPS/SPDP Workshops.

[13]  Shang-Hua Teng,et al.  How Good is Recursive Bisection? , 1997, SIAM J. Sci. Comput..

[14]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[15]  K. Fujiwara,et al.  Development of correlation-based clustering method and its application to software sensing , 2010 .

[16]  Guillermo Ricardo Simari,et al.  Non-commercial Research and Educational Use including without Limitation Use in Instruction at Your Institution, Sending It to Specific Colleagues That You Know, and Providing a Copy to Your Institution's Administrator. All Other Uses, Reproduction and Distribution, including without Limitation Comm , 2022 .

[17]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[18]  Jianbo Shi,et al.  Learning Segmentation by Random Walks , 2000, NIPS.

[19]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[20]  Andrew B. Kahng,et al.  New spectral methods for ratio cut partitioning and clustering , 1991, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[21]  M. Fiedler Algebraic connectivity of graphs , 1973 .

[22]  Alex Pothen,et al.  PARTITIONING SPARSE MATRICES WITH EIGENVECTORS OF GRAPHS* , 1990 .

[23]  Kotagiri Ramamohanarao,et al.  Approximate pairwise clustering for large data sets via sampling plus extension , 2011, Pattern Recognit..

[24]  Chris H. Q. Ding,et al.  A min-max cut algorithm for graph partitioning and data clustering , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[25]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[26]  Javier González,et al.  Subjective local maps for hybrid metric-topological SLAM , 2009, Robotics Auton. Syst..

[27]  Bruce Hendrickson,et al.  An Improved Spectral Graph Partitioning Algorithm for Mapping Parallel Computations , 1995, SIAM J. Sci. Comput..

[28]  Moongu Jeon,et al.  AN ADAPTIVE ACO-BASED FUZZY CLUSTERING ALGORITHM FOR NOISY IMAGE SEGMENTATION , 2012 .

[29]  Inderjit S. Dhillon,et al.  Co-clustering documents and words using bipartite spectral graph partitioning , 2001, KDD '01.

[30]  Fabien Moutarde,et al.  U*F clustering: a new performant "cluster-mining" method based on segmentation of Self-Organizing Maps , 2005 .

[31]  Yihong Gong,et al.  Incremental spectral clustering by efficiently updating the eigen-system , 2010, Pattern Recognit..

[32]  François Fouss,et al.  Random-Walk Computation of Similarities between Nodes of a Graph with Application to Collaborative Recommendation , 2007, IEEE Transactions on Knowledge and Data Engineering.

[33]  Yair Weiss,et al.  Segmentation using eigenvectors: a unifying view , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.