Two graph-regularized fuzzy subspace clustering methods

Abstract This paper presents a new fuzzy subspace clustering (FSC) method which finds some subspaces as clusters such that each point belongs to the nearest subspace with a certain weight or probability. Then we propose two graph-regularized versions for it, in which two points are more likely to be assigned to the same cluster if they are close spatially or with the same labels. In the proposed two graph regularizations, one encodes the weight (or probability) of a point assigned to a cluster and the other encodes the projection coefficients of a point on a subspace. We develop iterative solutions for these methods through constructing a surrogate, which monotonically decrease the cost function with a simple structure. The experimental results, using both synthetic and real-world databases, demonstrate the effectiveness and flexibility of the proposed methods.

[1]  Zhaohong Deng,et al.  Transfer Prototype-Based Fuzzy Clustering , 2014, IEEE Transactions on Fuzzy Systems.

[2]  Michael I. Jordan,et al.  On Convergence Properties of the EM Algorithm for Gaussian Mixtures , 1996, Neural Computation.

[3]  Xuelong Li,et al.  Constrained Nonnegative Matrix Factorization for Image Representation , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  N. Sundararajan,et al.  An efficient Meta-cognitive Fuzzy C-Means clustering approach , 2019, Appl. Soft Comput..

[5]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[6]  Paul S. Bradley,et al.  k-Plane Clustering , 2000, J. Glob. Optim..

[7]  Jinwen Ma,et al.  Asymptotic Convergence Rate of the EM Algorithm for Gaussian Mixtures , 2000, Neural Computation.

[8]  A Boudraa,et al.  Fuzzy clustering-based segmented attenuation correction in whole-body PET imaging. , 2002, Physics in medicine and biology.

[9]  Daoqiang Zhang,et al.  Semi-supervised Kernel-Based Fuzzy C-Means , 2004, ICONIP.

[10]  Daniel D. Lee,et al.  Bayesian regularization and nonnegative deconvolution for room impulse response estimation , 2006, IEEE Transactions on Signal Processing.

[11]  Jiawei Han,et al.  Document clustering using locality preserving indexing , 2005, IEEE Transactions on Knowledge and Data Engineering.

[12]  René Vidal,et al.  Subspace Clustering , 2011, IEEE Signal Processing Magazine.

[13]  Jianhong Wu,et al.  A convergence theorem for the fuzzy subspace clustering (FSC) algorithm , 2008, Pattern Recognit..

[14]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[15]  Zhaohong Deng,et al.  Enhanced soft subspace clustering integrating within-cluster and between-cluster information , 2010, Pattern Recognit..

[16]  Zhaohong Deng,et al.  A survey on soft subspace clustering , 2014, Inf. Sci..

[17]  Tie Zhang,et al.  Generalized EM-Type Reconstruction Algorithms for Emission Tomography , 2012, IEEE Transactions on Medical Imaging.

[18]  Chris H. Q. Ding,et al.  Convex and Semi-Nonnegative Matrix Factorizations , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  James C. Bezdek,et al.  A Convergence Theorem for the Fuzzy ISODATA Clustering Algorithms , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Boudewijn P. F. Lelieveldt,et al.  A multiresolution image segmentation technique based on pyramidal segmentation and fuzzy clustering , 2000, IEEE Trans. Image Process..

[21]  Michael W. Berry,et al.  Document clustering using nonnegative matrix factorization , 2006, Inf. Process. Manag..

[22]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Jens Jäkel,et al.  A New Convergence Proof of Fuzzy c-Means , 2005, IEEE Trans. Fuzzy Syst..

[24]  Tossapon Boongoen,et al.  Extending Data Reliability Measure to a Filter Approach for Soft Subspace Clustering , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Tzong-Jer Chen,et al.  Fuzzy c-means clustering with spatial information for image segmentation , 2006, Comput. Medical Imaging Graph..

[26]  Hujun Bao,et al.  Laplacian Regularized Gaussian Mixture Model for Data Clustering , 2011, IEEE Transactions on Knowledge and Data Engineering.

[27]  Thomas S. Huang,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation. , 2011, IEEE transactions on pattern analysis and machine intelligence.

[28]  Ling Guan,et al.  Application of Laplacian Mixture Model to Image and Video Retrieval , 2007, IEEE Transactions on Multimedia.

[29]  W. T. Tucker,et al.  Convergence theory for fuzzy c-means: Counterexamples and repairs , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[30]  Biao Hou,et al.  Discriminative Transformation Learning for Fuzzy Sparse Subspace Clustering , 2017, IEEE Transactions on Cybernetics.

[31]  D. Hunter,et al.  Optimization Transfer Using Surrogate Objective Functions , 2000 .

[32]  Meena Mahajan,et al.  The Planar k-means Problem is NP-hard I , 2009 .

[33]  Michael I. Jordan,et al.  Convergence results for the EM approach to mixtures of experts architectures , 1995, Neural Networks.

[34]  Wei Qian,et al.  Semi-supervised Nonnegative Matrix Factorization with Commonness Extraction , 2016, Neural Processing Letters.

[35]  Yueyang Teng,et al.  A convergent non-negative deconvolution algorithm with Tikhonov regularization , 2015 .

[36]  S. Odewahn,et al.  Automated star/galaxy discrimination with neural networks , 1992 .

[37]  B. S. Harish,et al.  A Novel Method of Clustering ECG Arrhythmia data using Robust Spatial Kernel Fuzzy C-Means , 2018 .