Spectral Clustering Algorithm Based on Local Sparse Representation

Clustering based on sparse representation is an important technique in machine learning and data mining fields. However, it is time-consuming because it constructs l 1-graph by solving l 1-minimization with all other samples as dictionary for each sample. This paper is focused on improving the efficiency of clustering based on sparse representation. Specifically, the Spectral Clustering Algorithm Based on Local Sparse Representation SCAL is proposed. For a given sample the algorithm solves l 1-minimization with the local $\emph{k}$ nearest neighborhood as dictionary, constructs the similarity matrix by calculating sparsity induced similarity SIS of the sparse coefficients solution, and then uses spectral clustering with the similarity matrix to cluster the samples. Experiments using face recognition data sets ORL and Extended Yale B demonstrate that the proposed SCAL can get better clustering performance and less time consumption.

[1]  Hong Cheng,et al.  Sparsity induced similarity measure for label propagation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[2]  Junjie Chen,et al.  A Heuristic Initialization-Independent Spectral Clustering , 2010, 2010 Fifth International Conference on Internet Computing for Science and Engineering.

[3]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Fei Wang,et al.  Label Propagation through Linear Neighborhoods , 2008, IEEE Trans. Knowl. Data Eng..

[5]  Gang Hua,et al.  A nonnegative sparsity induced similarity measure with application to cluster analysis of spam images , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Joshua Zhexue Huang,et al.  Extensions to the k-Means Algorithm for Clustering Large Data Sets with Categorical Values , 1998, Data Mining and Knowledge Discovery.

[7]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[8]  T. Warren Liao,et al.  Clustering of time series data - a survey , 2005, Pattern Recognit..

[9]  René Vidal,et al.  Sparse subspace clustering , 2009, CVPR.

[10]  Jun Jiao,et al.  Image Clustering via Sparse Representation , 2010, MMM.

[11]  Jane You,et al.  SC³: Triple Spectral Clustering-Based Consensus Clustering Framework for Class Discovery from Cancer Gene Expression Profiles , 2012, TCBB.

[12]  Honggang Zhang,et al.  Local Sparse Representation Based Classification , 2010, 2010 20th International Conference on Pattern Recognition.

[13]  Yihong Gong,et al.  Nonlinear Learning using Local Coordinate Coding , 2009, NIPS.

[14]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[15]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[16]  Shuicheng Yan,et al.  Semi-supervised Learning by Sparse Representation , 2009, SDM.