Self-learning Procedures for a Kernel Fuzzy Clustering System

The paper exemplifies several self-learning methods through the prism of diverse objective functions used for training a kernel fuzzy clustering system. A self-learning process for synaptic weights is implemented in terms of the competitive learning concept and the probabilistic fuzzy clustering approach. The main feature of the introduced fuzzy clustering system is its capability to cluster data in an online way under conditions when clusters are rather likely to be of an arbitrary shape (which cannot usually be separated in a linear manner) and to be mutually intersecting. Generally speaking, the offered system’s topology is mainly based on both the fuzzy clustering neural network by Kohonen and the general regression neural network. When it comes to training this hybrid system, it is grounded on both the lazy and optimization-based learning concepts.

[1]  Oleksii K. Tyshchenko,et al.  Fuzzy Clustering Data Given in the Ordinal Scale , 2017, ArXiv.

[2]  Oleksii K. Tyshchenko,et al.  Fuzzy Clustering Data Arrays with Omitted Observations , 2017 .

[3]  Dao-Qiang Zhang,et al.  A novel kernelized fuzzy C-means algorithm with application in medical image segmentation , 2004, Artif. Intell. Medicine.

[4]  Oleksii K. Tyshchenko,et al.  A cascade deep neuro-fuzzy system for high-dimensional online possibilistic fuzzy clustering , 2016, 2016 XIth International Scientific and Technical Conference Computer Sciences and Information Technologies (CSIT).

[5]  Yevgeniy Bodyanskiy,et al.  An evolving neuro-fuzzy system for online fuzzy clustering , 2015, 2015 Xth International Scientific and Technical Conference "Computer Sciences and Information Technologies" (CSIT).

[6]  Francesco Masulli,et al.  A survey of kernel and spectral methods for clustering , 2008, Pattern Recognit..

[7]  Kohei Inoue,et al.  Robust Kernel Fuzzy Clustering , 2005, FSKD.

[8]  Mark A. Girolami,et al.  Mercer kernel-based clustering in feature space , 2002, IEEE Trans. Neural Networks.

[9]  Sergii Babichev,et al.  Inductive model of data clustering based on the agglomerative hierarchical algorithm , 2016, 2016 IEEE First International Conference on Data Stream Mining & Processing (DSMP).

[10]  James M. Keller,et al.  The possibilistic C-means algorithm: insights and recommendations , 1996, IEEE Trans. Fuzzy Syst..

[11]  S. Babichev,et al.  Implementation of the objective clustering inductive technology based on DBSCAN clustering algorithm , 2017, 2017 12th International Scientific and Technical Conference on Computer Sciences and Information Technologies (CSIT).

[12]  Marimuthu Palaniswami,et al.  Incremental Kernel Fuzzy c-Means , 2010, IJCCI.

[13]  Doheon Lee,et al.  Evaluation of the performance of clustering algorithms in kernel-induced feature space , 2005, Pattern Recognit..

[14]  Oleksii K. Tyshchenko,et al.  Possibilistic Fuzzy Clustering for Categorical Data Arrays Based on Frequency Prototypes and Dissimilarity Measures , 2017 .

[15]  Oleksii K. Tyshchenko,et al.  A neuro-fuzzy Kohonen network for data stream possibilistic clustering and its online self-learning procedure , 2017, Appl. Soft Comput..

[16]  Ivan Izonin,et al.  Adaptive moving object segmentation algorithms in cluttered environments , 2015, The Experience of Designing and Application of CAD Systems in Microelectronics.

[17]  Frank Klawonn,et al.  What Is Fuzzy about Fuzzy Clustering? Understanding and Improving the Concept of the Fuzzifier , 2003, IDA.

[18]  Volodymyr Lytvynenko,et al.  Objective Clustering Inductive Technology of Gene Expression Sequences Features , 2017, BDAS.

[19]  Frank Klawonn,et al.  Computational Intelligence: A Methodological Introduction , 2015, Texts in Computer Science.

[20]  Farzin Yaghmaee,et al.  Application of GRNN neural network in non-texture image inpainting and restoration , 2015, Pattern Recognit. Lett..

[21]  Anjana Gosain,et al.  Performance Analysis of Various Fuzzy Clustering Algorithms: A Review , 2016 .

[22]  Daoqiang Zhang,et al.  Fuzzy clustering using kernel method , 2002 .

[23]  Oleksii K. Tyshchenko,et al.  A deep cascade neuro-fuzzy system for high-dimensional online fuzzy clustering , 2016, 2016 IEEE First International Conference on Data Stream Mining & Processing (DSMP).

[24]  Tara Saikumar,et al.  Optimized kernel fuzzy c means (OKFCM) clustering algorithm on level set method for noisy images , 2013, 2013 IEEE International Conference on Computational Intelligence and Computing Research.

[25]  Charu C. Aggarwal,et al.  Data Mining: The Textbook , 2015 .

[26]  Francesco Camastra,et al.  A Novel Kernel Method for Clustering , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Reza Rooki,et al.  Application of general regression neural network (GRNN) for indirect measuring pressure loss of Herschel–Bulkley drilling fluids in oil drilling , 2016 .

[28]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[29]  Piotr Jędrzejowicz,et al.  Kernel-Based Fuzzy C-Means Clustering Algorithm for RBF Network Initialization , 2016, KES-IDT.

[30]  Charu C. Aggarwal,et al.  Data Clustering , 2013 .

[31]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[32]  Dong-Chul Park,et al.  Gradient based fuzzy c-means (GBFCM) algorithm , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[33]  Volodymyr Lytvynenko,et al.  Computational analysis of microarray gene expression profiles of lung cancer , 2016 .

[34]  Ivan Izonin,et al.  Learning-based image super-resolution using weight coefficients of synaptic connections , 2015, 2015 Xth International Scientific and Technical Conference "Computer Sciences and Information Technologies" (CSIT).

[35]  Miin-Shen Yang,et al.  Alternative c-means clustering algorithms , 2002, Pattern Recognit..

[36]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[37]  Fu-Lai Chung,et al.  Unsupervised fuzzy competitive learning with monotonically decreasing fuzziness , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[38]  Colin Fyfe,et al.  Clustering in data space and feature space , 2002, ESANN.

[39]  Sadaaki Miyamoto,et al.  Fuzzy Multiset Space and c-Means Clustering Using Kernles with Applications to Information Retrieval , 2003, IFSA.

[40]  James M. Keller,et al.  A possibilistic approach to clustering , 1993, IEEE Trans. Fuzzy Syst..

[41]  Oleksii K. Tyshchenko,et al.  Fuzzy Clustering Data Given on the Ordinal Scale Based on Membership and Likelihood Functions Sharing , 2017, ArXiv.

[42]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[43]  Dursun Delen,et al.  Real-World Data Mining: Applied Business Analytics and Decision Making , 2014 .

[44]  Timothy C. Havens,et al.  Scalable approximation of kernel fuzzy c-means , 2013, 2013 IEEE International Conference on Big Data.

[45]  Miin-Shen Yang,et al.  An unsupervised clustering algorithm for data on the unit hypersphere , 2016, Appl. Soft Comput..

[46]  Yevgeniy V. Bodyanskiy Computational Intelligence Techniques for Data Analysis , 2005, Leipziger Informatik-Tage.

[47]  Oleksii K. Tyshchenko,et al.  An evolving connectionist system for data stream fuzzy clustering and its online learning , 2017, Neurocomputing.

[48]  Pavlo Mulesa,et al.  Hybrid clustering-classification neural network in the medical diagnostics of reactive arthritis , 2016, ArXiv.

[49]  Ye. Bodyanskiy,et al.  Adaptive fuzzy clustering with a variable fuzzifier , 2013 .

[50]  Daniel T. Larose,et al.  Discovering Knowledge in Data: An Introduction to Data Mining , 2005 .

[51]  Charu C. Aggarwal,et al.  Data Streams - Models and Algorithms , 2014, Advances in Database Systems.

[52]  Lakhmi C. Jain,et al.  Intelligent Decision Technologies 2016 , 2016 .

[53]  Donald F. Specht,et al.  A general regression neural network , 1991, IEEE Trans. Neural Networks.

[54]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[55]  S. Kung Kernel Methods and Machine Learning , 2014 .

[56]  Albert Bifet,et al.  Adaptive Stream Mining: Pattern Learning and Mining from Evolving Data Streams , 2010, Frontiers in Artificial Intelligence and Applications.