Fuzzy relational kernel clustering with Local Scaling Parameter Learning

We introduce a new fuzzy relational clustering technique with Local Scaling Parameter Learning (LSPL). The proposed approach learns the underlying cluster dependent dissimilarity measure while finding compact clusters in the given data set. The learned measure is a Gaussian similarity function defined with respect to each cluster that allows to control the scaling of the clusters and thus, improve the final partition. We minimize one objective function for both the optimal partition and for the cluster dependent scaling parameter. This optimization is done iteratively by dynamically updating the partition and the scaling parameter in each iteration. This makes the proposed algorithm simple and fast. Moreover, as we assume that the data is available in a relational form, the proposed approach is applicable even when only the degree to which pairs of objects in the data are related is available. It is also more practical when similar objects cannot be represented by a single prototype.

[1]  W. Peizhuang Pattern Recognition with Fuzzy Objective Function Algorithms (James C. Bezdek) , 1983 .

[2]  James C. Bezdek,et al.  Relational duals of the c-means clustering algorithms , 1989, Pattern Recognit..

[3]  Pietro Perona,et al.  A Factorization Approach to Grouping , 1998, ECCV.

[4]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[5]  Colin Fyfe,et al.  The kernel self-organising map , 2000, KES'2000. Fourth International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies. Proceedings (Cat. No.00TH8516).

[6]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[7]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[8]  Mark A. Girolami,et al.  Mercer kernel-based clustering in feature space , 2002, IEEE Trans. Neural Networks.

[9]  Meng Joo Er,et al.  Face recognition with radial basis function (RBF) neural networks , 2002, IEEE Trans. Neural Networks.

[10]  Daoqiang Zhang,et al.  Fuzzy clustering using kernel method , 2002 .

[11]  Zhongdong Wu,et al.  Fuzzy C-means clustering algorithm based on kernel method , 2003, Proceedings Fifth International Conference on Computational Intelligence and Multimedia Applications. ICCIMA 2003.

[12]  A. Kai Qin,et al.  Kernel neural gas algorithms with application to cluster analysis , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[13]  Sadaaki Miyamoto,et al.  LVQ clustering and SOM using a kernel function , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[14]  A. K. Qin,et al.  Kernel neural gas algorithms with application to cluster analysis , 2004, ICPR 2004.

[15]  Pietro Perona,et al.  Self-Tuning Spectral Clustering , 2004, NIPS.

[16]  Inderjit S. Dhillon,et al.  Kernel k-means: spectral clustering and normalized cuts , 2004, KDD.

[17]  R.J. Hathaway,et al.  Kernelized Non-Euclidean Relational Fuzzy c-Means Algorithm , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[18]  E. Frias-martinez,et al.  Survey of Data Mining Approaches to User Modeling for Adaptive Hypermedia , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[19]  Christian Borgelt,et al.  Finding the Number of Fuzzy Clusters by Resampling , 2006, 2006 IEEE International Conference on Fuzzy Systems.

[20]  Barbara Hammer,et al.  Relational Neural Gas , 2007, KI.

[21]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..