Dynamically evolving fuzzy classifier for real-time classification of data streams

In this paper, a novel evolving fuzzy rule-based classifier is presented. The proposed classifier addresses the three fundamental issues of data stream learning, viz., computational efficiency in terms of processing time and memory requirements, adaptive to changes, and robustness to noise. Though, there are several online classifiers available, most of them do not take into account all the three issues simultaneously. The newly proposed classifier is inherently adaptive and can attend to any minute changes as it learns the rules in online manner by considering each incoming example. However, it should be emphasized that it can easily distinguish noise from new concepts and automatically handles noise. The performance of the classifier is evaluated using real-life data with evolving characteristic and compared with state-of-the-art adaptive classifiers. The experimental results show that the classifier attains a simple model in terms of number of rules. Further, the memory requirements and processing time per sample does not increase linearly with the progress of the stream. Thus, the classifier is capable of performing both prediction and model update in real-time in a streaming environment.

[1]  João Gama,et al.  A survey on concept drift adaptation , 2014, ACM Comput. Surv..

[2]  Edwin Lughofer,et al.  Extensions of vector quantization for incremental clustering , 2008, Pattern Recognit..

[3]  Plamen P. Angelov,et al.  Evolving Single- And Multi-Model Fuzzy Classifiers with FLEXFIS-Class , 2007, 2007 IEEE International Fuzzy Systems Conference.

[4]  Éric Anquetil,et al.  Improving premise structure in evolving Takagi–Sugeno neuro-fuzzy classifiers , 2010, 2010 Ninth International Conference on Machine Learning and Applications.

[5]  Gerhard Widmer,et al.  Learning in the presence of concept drift and hidden contexts , 2004, Machine Learning.

[6]  Jack Ritter,et al.  An efficient bounding sphere , 1990 .

[7]  Plamen P. Angelov,et al.  DEC: Dynamically Evolving Clustering and Its Application to Structure Identification of Evolving Fuzzy Models , 2014, IEEE Transactions on Cybernetics.

[8]  Plamen Angelov,et al.  Evolving Intelligent Systems: Methodology and Applications , 2010 .

[9]  Eyke Hüllermeier,et al.  Evolving fuzzy pattern trees for binary classification on data streams , 2013, Inf. Sci..

[10]  Jesús S. Aguilar-Ruiz,et al.  Knowledge discovery from data streams , 2009, Intell. Data Anal..

[11]  Robert Babuška,et al.  An overview of fuzzy modeling for control , 1996 .

[12]  Plamen P. Angelov,et al.  Simpl_eClass: Simplified potential-free evolving fuzzy rule-based classifiers , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[13]  Plamen P. Angelov,et al.  Online learning and prediction of data streams using dynamically evolving fuzzy approach , 2013, 2013 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[14]  Philip S. Yu,et al.  A Framework for Clustering Evolving Data Streams , 2003, VLDB.

[15]  Sudipto Guha,et al.  Clustering Data Streams: Theory and Practice , 2003, IEEE Trans. Knowl. Data Eng..

[16]  Plamen Angelov Autonomous Learning Systems:From Data to Knowledge in Real Time , 2012 .

[17]  Edwin Lughofer,et al.  On-line evolving image classifiers and their application to surface inspection , 2010, Image Vis. Comput..

[18]  Ricard Gavaldà,et al.  Adaptive Learning from Evolving Data Streams , 2009, IDA.

[19]  Plamen P. Angelov,et al.  Evolving Fuzzy-Rule-Based Classifiers From Data Streams , 2008, IEEE Transactions on Fuzzy Systems.

[20]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Abdelhamid Bouchachia,et al.  An evolving classification cascade with self-learning , 2010, Evol. Syst..

[22]  Carlo Zaniolo,et al.  An adaptive learning approach for noisy data streams , 2004, Fourth IEEE International Conference on Data Mining (ICDM'04).

[23]  P. Angelov,et al.  Evolving Fuzzy Systems from Data Streams in Real-Time , 2006, 2006 International Symposium on Evolving Fuzzy Systems.

[24]  Edwin Lughofer,et al.  FLEXFIS: A Robust Incremental Learning Approach for Evolving Takagi–Sugeno Fuzzy Models , 2008, IEEE Transactions on Fuzzy Systems.

[25]  Edwin Lughofer,et al.  Evolving Fuzzy Systems - Methodologies, Advanced Concepts and Applications , 2011, Studies in Fuzziness and Soft Computing.