A New Kernel-Based Algorithm for Online Clustering

This paper presents a kernel-based clustering algorithm called SAKM (Self-Adaptive Kernel Machine) that is developed to learn continuously evolving clusters from non-stationary data. Dedicated to online clustering in multi-class environment, this algorithm is based on an unsupervised learning process with self-adaptive abilities. This process is achieved through three main stages: clusters creation (with an initialization procedure), online clusters adaptation and clusters fusion. Thanks to a new specific kernel-induced similarity measure, the SAKM algorithm is attractive to be very computationally efficient in online applications. At the end, some experiments illustrate the capacities of our algorithm in non-stationary environment.

[1]  Arthur Gretton,et al.  On-line one-class support vector machines. An application to signal segmentation , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[2]  Erkki Oja,et al.  Artificial Neural Networks and Neural Information Processing — ICANN/ICONIP 2003 , 2003, Lecture Notes in Computer Science.

[3]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[4]  Nikola K. Kasabov,et al.  On-line pattern analysis by evolving self-organizing maps , 2003, Neurocomputing.

[5]  Alexander J. Smola,et al.  Online learning with kernels , 2001, IEEE Transactions on Signal Processing.

[6]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[7]  S. Maouche,et al.  Self-adaptive kernel machine: online clustering in RKHS , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[8]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[9]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[10]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[11]  Rui J. P. de Figueiredo,et al.  A new neural network for cluster-detection-and-labeling , 1998, IEEE Trans. Neural Networks.

[12]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[13]  Stéphane Lecoeuche,et al.  Auto-adaptive and Dynamical Clustering Neural Network , 2003, ICANN.

[14]  Soo-Young Lee,et al.  Support Vector Machines with Binary Tree Architecture for Multi-Class Classification , 2004 .