An ensemble of logical-type neuro-fuzzy systems

Neuro-fuzzy classifiers are characterized by incorporation of the expert knowledge into their construction. The most popular neuro-fuzzy systems are Mamdani-type systems. The main groups of neuro-fuzzy systems are also Takagi-Sugeno and logical-type systems. The latter were very rarely studied in the literature, however it was shown that logical-type reasoning transpired to be better suited for classification tasks whereas Mamdani-type reasoning for approximation problems (Rutkowska & Nowicki, 2000; Rutkowski & Cpalka, 2003, 2005). It is well known that an ensemble of several classifiers improves classification accuracy. Many ensembling methods are meta-learning techniques, thus they can be used to design ensembles of various member classifiers. In the paper an ensemble of logical-type neuro-fuzzy systems, based on S-implications, is proposed. The design of such an ensemble, and fuzzy ensemble in general, is a challenging task and encounters technical difficulties. The major problem is that such an ensemble contains separate rule bases which cannot be directly merged. As systems are separate, we cannot treat fuzzy rules coming from different systems as rules from the same (single) system. In the paper, the problem is addressed by a novel design of fuzzy systems constituting the ensemble, resulting in normalization of individual rule bases during learning. Several experiments illustrate the idea presented in the paper.

[1]  Magne Setnes,et al.  Fuzzy relational classifier trained by fuzzy clustering , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[2]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[3]  D. Rutkowska,et al.  Implication-Based Neuro-Fuzzy Architectures , 2000 .

[4]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[5]  David G. Stork,et al.  Pattern Classification , 1973 .

[6]  W. Pedrycz,et al.  An introduction to fuzzy sets : analysis and design , 1998 .

[7]  Gunnar Rätsch,et al.  An Introduction to Boosting and Leveraging , 2002, Machine Learning Summer School.

[8]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[9]  Robert E. Schapire,et al.  A Brief Introduction to Boosting , 1999, IJCAI.

[10]  James M. Keller,et al.  Fuzzy Models and Algorithms for Pattern Recognition and Image Processing , 1999 .

[11]  Leszek Rutkowski,et al.  Designing and learning of adjustable quasi-triangular norms with applications to neuro-fuzzy systems , 2005, IEEE Transactions on Fuzzy Systems.

[12]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[13]  Li-Xin Wang,et al.  Adaptive fuzzy systems and control , 1994 .

[14]  Detlef Nauck,et al.  Foundations Of Neuro-Fuzzy Systems , 1997 .

[15]  Rafal Scherer.  Boosting Ensemble of Relational Neuro-fuzzy Systems , 2006, ICAISC.

[16]  Ludmila I. Kuncheva,et al.  Fuzzy Classifier Design , 2000, Studies in Fuzziness and Soft Computing.

[17]  Leszek Rutkowski,et al.  Flexible neuro-fuzzy systems , 2003, IEEE Trans. Neural Networks.