Developments on Solutions of the Normalized-Cut-Clustering Problem Without Eigenvectors

Normalized-cut clustering (NCC) is a benchmark graph-based approach for unsupervised data analysis. Since its traditional formulation is a quadratic form subject to orthogonality conditions, it is often solved within an eigenvector-based framework. Nonetheless, in some cases the calculation of eigenvectors is prohibitive or unfeasible due to the involved computational cost – for instance, when dealing with high dimensional data. In this work, we present an overview of recent developments on approaches to solve the NCC problem with no requiring the calculation of eigenvectors. Particularly, heuristic-search and quadratic-formulation-based approaches are studied. Such approaches are elegantly deduced and explained, as well as simple ways to implement them are provided.

[1]  Germán Castellanos-Domínguez,et al.  Novel heuristic search for ventricular arrhythmia detection using normalized cut clustering , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[2]  Yong Dou,et al.  Joint diversity regularization and graph regularization for multiple kernel k-means clustering via latent variables , 2016, Neurocomputing.

[3]  Johan A. K. Suykens,et al.  Kernel Spectral Clustering and applications , 2015, ArXiv.

[4]  Dirk P. Kroese,et al.  Kernel density estimation via diffusion , 2010, 1011.2602.

[5]  Jianbo Shi,et al.  Multiclass spectral clustering , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[6]  Inderjit S. Dhillon,et al.  Kernel k-means: spectral clustering and normalized cuts , 2004, KDD.

[7]  Germán Castellanos-Domínguez,et al.  An Improved Multi-Class Spectral Clustering Based on Normalized Cuts , 2012, CIARP.

[8]  Dale Schuurmans,et al.  Fast normalized cut with linear constraints , 2009, CVPR.

[9]  Inderjit S. Dhillon,et al.  Weighted Graph Cuts without Eigenvectors A Multilevel Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Germán Castellanos-Domínguez,et al.  Quadratic Problem Formulation with Linear Constraints for Normalized Cut Clustering , 2014, CIARP.

[11]  Germán Castellanos-Domínguez,et al.  Normalized cuts clustering with prior knowledge and a pre-clustering stage , 2013, ESANN.

[12]  Pietro Perona,et al.  Self-Tuning Spectral Clustering , 2004, NIPS.