Evolving clustering, classification and regression with TEDA

In this article the novel clustering and regression methods TEDACluster and TEDAPredict methods are described additionally to recently proposed evolving classifier TEDAClass. The algorithms for classification, clustering and regression are based on the recently proposed AnYa type fuzzy rule based system. The novel methods use the recently proposed TEDA framework capable of recursive processing of large amounts of data. The framework is capable of computationally cheap exact update of data per sample, and can be used for training `from scratch'. All three algorithms are evolving that is they are capable of changing its own structure during the update stage, which allows to follow the changes within the model pattern.

[1]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[2]  Plamen Angelov,et al.  Autonomously evolving classifier TEDAClass , 2016, Inf. Sci..

[3]  Andreas Holzinger,et al.  Data Mining with Decision Trees: Theory and Applications , 2015, Online Inf. Rev..

[4]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[5]  Plamen Angelov,et al.  Evolving Takagi-Sugeno fuzzy systems from data streams (eTS+). , 2010 .

[6]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[7]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[8]  Plamen P. Angelov,et al.  Recursive SVM Based on TEDA , 2015, SLDS.

[9]  P. Mahalanobis.  On the generalized distance in statistics , 1936 .

[10]  Ping Zhang.  Model Selection Via Multifold Cross Validation , 1993 .

[11]  Stefan Schliebs,et al.  Evolving spiking neural network—a survey , 2013, Evolving Systems.

[12]  Lotfi A. Zadeh,et al.  Outline of a New Approach to the Analysis of Complex Systems and Decision Processes , 1973, IEEE Trans. Syst. Man Cybern..

[13]  Paulo Cortez,et al.  Modeling wine preferences by data mining from physicochemical properties , 2009, Decis. Support Syst..

[14]  Edwin Lughofer,et al.  FLEXFIS: A Variant for Incremental Learning of Takagi-Sugeno Fuzzy Systems , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[15]  Plamen P. Angelov,et al.  Symbol recognition with a new autonomously evolving classifier autoclass , 2014, 2014 IEEE Conference on Evolving and Adaptive Intelligent Systems (EAIS).

[16]  P. Deb.  Finite Mixture Models , 2008 .

[17]  Plamen P. Angelov,et al.  A new type of simplified fuzzy rule-based system , 2012, Int. J. Gen. Syst..

[18]  M. Sugeno,et al.  Multi-dimensional fuzzy reasoning , 1983 .

[19]  Paulo Cortez,et al.  Using Data Mining for Wine Quality Assessment , 2009, Discovery Science.

[20]  Plamen P. Angelov,et al.  Autonomous novelty detection and object tracking in video streams using evolving clustering and Takagi-Sugeno type neuro-fuzzy system , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[21]  Plamen Angelov,et al.  Evolving Intelligent Systems: Methodology and Applications , 2010 .

[22]  Plamen P. Angelov,et al.  Dynamically evolving fuzzy classifier for real-time classification of data streams , 2014, 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[23]  Ebrahim H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Hum. Comput. Stud..

[24]  Plamen P. Angelov,et al.  Online learning and prediction of data streams using dynamically evolving fuzzy approach , 2013, 2013 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[25]  Plamen P. Angelov,et al.  Evolving fuzzy systems , 2008, Scholarpedia.

[26]  Plamen P. Angelov,et al.  On line learning fuzzy rule-based system structure from data streams , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[27]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[28]  Plamen P. Angelov,et al.  Evolving Fuzzy-Rule-Based Classifiers From Data Streams , 2008, IEEE Transactions on Fuzzy Systems.

[29]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.