Evolving fuzzy rule-based classifier based on GENEFIS

This paper presents a novel evolving fuzzy rule-based classifier stemming from our recently developed algorithm for regression problem termed generic evolving neuro-fuzzy system (GENEFIS). On the one hand, the novel classifier namely GENEFIS-class is composed of two different architectures specifically zero and first orders which are dependent on the type of consequent used. On the other hand, GENEFIS-class refurbishes GENEFIS algorithm as the main learning engine to conform classification requirement. The interesting property of GENEFIS is its fully flexible rule base and its computationally efficient algorithm. GENEFIS can initiate its learning process from scratch with an empty rule base and highly narrow expert knowledge. The fuzzy rules are then flourished based on the novelty of streaming data via their statistical contribution. Conversely, the fuzzy rules, which contribute little during their lifespan, can be pruned by virtue of their contributions up to the end of training process. Meanwhile, the fuzzy rules and fuzzy sets, which are redundant, can be merged to purpose a transparent rule base. Online feature selection process coupled during the training process can be undertaken to cope with possible combinatorial rule explosion drawback. All of these are fruitful to grant significant reduction of rule base load while retaining the classification accuracy which is in line with online real-time necessity. The efficacy of GENEFIS-class was numerically validated exploiting real world and synthetic problems and compared with state-of-the-art algorithms where it generally speaking outperforms other algorithms in terms of classification performance and rule-base complexity.

[1]  Ronald R. Yager,et al.  A model of participatory learning , 1990, IEEE Trans. Syst. Man Cybern..

[2]  Edwin Lughofer,et al.  On-line incremental feature weighting in evolving fuzzy classifiers , 2011, Fuzzy Sets Syst..

[3]  Hiok Chai Quek,et al.  eFSM—A Novel Online Neural-Fuzzy Semantic Memory Model , 2010, IEEE Transactions on Neural Networks.

[4]  Lotfi A. Zadeh,et al.  Soft computing and fuzzy logic , 1994, IEEE Software.

[5]  James M. Keller,et al.  Fuzzy Models and Algorithms for Pattern Recognition and Image Processing , 1999 .

[6]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[7]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[8]  Frank Klawonn,et al.  Obtaining interpretable fuzzy models from fuzzy clustering and fuzzy regression , 2000, KES'2000. Fourth International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies. Proceedings (Cat. No.00TH8516).

[9]  T. Martin McGinnity,et al.  An on-line algorithm for creating self-organizing fuzzy neural networks , 2004, Neural Networks.

[10]  Geoff Holmes,et al.  MOA: Massive Online Analysis , 2010, J. Mach. Learn. Res..

[11]  Mahardhika Pratama,et al.  GENEFIS: Toward an Effective Localist Network , 2014, IEEE Transactions on Fuzzy Systems.

[12]  Xiang Li,et al.  Bayesian ART-based fuzzy inference system: A new approach to prognosis of machining processes , 2011, 2011 IEEE Conference on Prognostics and Health Management.

[13]  Walmir M. Caminhas,et al.  Fuzzy Multivariable Gaussian Evolving Approach for Fault Detection and Diagnosis , 2010, IPMU.

[14]  Nikola K. Kasabov,et al.  Evolving fuzzy neural networks for supervised/unsupervised online knowledge-based learning , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[15]  Francisco Herrera,et al.  Ten years of genetic fuzzy systems: current framework and new trends , 2004, Fuzzy Sets Syst..

[16]  Hisao Ishibuchi,et al.  Classification and modeling with linguistic information granules - advanced approaches to linguistic data mining , 2004, Advanced information processing.

[17]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  Edwin Lughofer,et al.  On-line elimination of local redundancies in evolving fuzzy systems , 2011, Evol. Syst..

[19]  Plamen P. Angelov,et al.  Evolving Fuzzy-Rule-Based Classifiers From Data Streams , 2008, IEEE Transactions on Fuzzy Systems.

[20]  Plamen Angelov,et al.  Evolving Fuzzy Modeling Using Participatory Learning , 2010 .

[21]  M. Stone Cross‐Validatory Choice and Assessment of Statistical Predictions , 1976 .

[22]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[23]  Plamen P. Angelov,et al.  Fuzzily Connected Multimodel Systems Evolving Autonomously From Data Streams , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Ludmila I. Kuncheva,et al.  How good are fuzzy If-Then classifiers? , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[25]  Edwin Lughofer,et al.  FLEXFIS: A Robust Incremental Learning Approach for Evolving Takagi–Sugeno Fuzzy Models , 2008, IEEE Transactions on Fuzzy Systems.

[26]  Edwin Lughofer A dynamic split-and-merge approach for evolving cluster models , 2012, Evol. Syst..

[27]  Plamen P. Angelov,et al.  Simpl_eClass: Simplified potential-free evolving fuzzy rule-based classifiers , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[28]  Rudolf Kruse,et al.  A neuro-fuzzy method to learn fuzzy classification rules from data , 1997, Fuzzy Sets Syst..

[29]  Edwin Lughofer,et al.  Reliable All-Pairs Evolving Fuzzy Classifiers , 2013, IEEE Transactions on Fuzzy Systems.

[30]  Kwok-Wo Wong,et al.  Generalized RLS approach to the training of neural networks , 2006, IEEE Trans. Neural Networks.

[31]  E. Lughofer,et al.  Evolving fuzzy classifiers using different model architectures , 2008, Fuzzy Sets Syst..

[32]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[33]  Edwin Lughofer,et al.  Single-pass active learning with conflict and ignorance , 2012, Evolving Systems.