Constrained spectral clustering through affinity propagation

Pairwise constraints specify whether or not two samples should be in one cluster. Although it has been successful to incorporate them into traditional clustering methods, such as K-means, little progress has been made in combining them with spectral clustering. The major challenge in designing an effective constrained spectral clustering is a sensible combination of the scarce pairwise constraints with the original affinity matrix. We propose to combine the two sources of affinity by propagating the pairwise constraints information over the original affinity matrix. Our method has a Gaussian process interpretation and results in a closed-form expression for the new affinity matrix. Experiments show it outperforms state-of-the-art constrained clustering methods in getting good clusterings with fewer constraints, and yields good image segmentation with user-specified pairwise constraints.

[1]  Michael I. Jordan,et al.  Distance Metric Learning with Application to Clustering with Side-Information , 2002, NIPS.

[2]  Mário A. T. Figueiredo,et al.  Clustering Under Prior Knowledge with Application to Image Segmentation , 2006, NIPS.

[3]  Stephen J. Wright,et al.  Dissimilarity in Graph-Based Semi-Supervised Classification , 2007, AISTATS.

[4]  Rong Jin,et al.  Learning nonparametric kernel matrices from pairwise constraints , 2007, ICML '07.

[5]  Dit-Yan Yeung,et al.  Semisupervised metric learning by kernel matrix adaptation , 2005 .

[6]  Anders P. Eriksson,et al.  Normalized Cuts Revisited: A Reformulation for Segmentation with Linear Grouping Constraints , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[7]  Wei Chu,et al.  Relational Learning with Gaussian Processes , 2006, NIPS.

[8]  Jitendra Malik,et al.  Normalized Cut and Image Segmentation , 1997 .

[9]  Raymond J. Mooney,et al.  A probabilistic framework for semi-supervised clustering , 2004, KDD.

[10]  Marie desJardins,et al.  Active Constrained Clustering by Examining Spectral Eigenvectors , 2005, Discovery Science.

[11]  Inderjit S. Dhillon,et al.  Information-theoretic metric learning , 2006, ICML '07.

[12]  Zhengdong Lu,et al.  Penalized Probabilistic Clustering , 2007, Neural Computation.

[13]  Mikhail Belkin,et al.  Beyond the point cloud: from transductive to semi-supervised learning , 2005, ICML.

[14]  Allan D. Jepson,et al.  Half-Lives of EigenFlows for Spectral Clustering , 2002, NIPS.

[15]  Claire Cardie,et al.  Proceedings of the Eighteenth International Conference on Machine Learning, 2001, p. 577–584. Constrained K-means Clustering with Background Knowledge , 2022 .

[16]  Jianbo Shi,et al.  Grouping with Bias , 2001, NIPS.

[17]  Charles A. Micchelli,et al.  On Spectral Learning , 2010, J. Mach. Learn. Res..

[18]  Hong Chang,et al.  Semisupervised metric learning by kernel matrix adaptation , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[19]  Tomer Hertz,et al.  Computing Gaussian Mixture Models with EM Using Equivalence Constraints , 2003, NIPS.