Parallel Fuzzy Reasoning Models with Ensemble Learning

This paper proposes a new learning algorithm and a parallel model for fuzzy reasoning systems. The proposed learning algorithm, which is based on an ensemble learning algorithm AdaBoost, sequentially trains a series of weak learners, each of which is a fuzzy reasoning system. In the algorithm, each weak learner is trained with the learning data set that contains more data misclassified by the previous weak one than the others. The output of the ensemble system is a majority vote weighted by weak learner accuracy. Further, the parallel model is proposed in order to enhance the ensemble effect. The model is made up of more than one ensemble system, each of which consists of weak learners. In order to show the effectiveness of the proposed methods, numerical simulations are performed. The simulation result shows that the proposed parallel model with fuzzy reasoning systems constructed by AdaBoost is superior in terms of accuracy among all the methods.

[1]  L X Wang,et al.  Fuzzy basis functions, universal approximation, and orthogonal least-squares learning , 1992, IEEE Trans. Neural Networks.

[2]  G. Zocchi,et al.  Local cooperativity mechanism in the DNA melting transition. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Masato Okada,et al.  Analysis of ensemble learning using simple perceptrons based on online learning theory. , 2005 .

[4]  J. Mendel Fuzzy logic systems for engineering: a tutorial , 1995, Proc. IEEE.

[5]  Madan M. Gupta,et al.  Static and Dynamic Neural Networks: From Fundamentals to Advanced Theory , 2003 .

[6]  Isao Hayashi,et al.  A Self-Tuning Method of Fuzzy Reasoning by Delta Rule and Its Application to a Moving Obstacle Avoidance , 1992 .

[7]  Tsong-Yi Chen,et al.  An Effective Authenticating Method On The Compressed Image Data , 2006, First International Conference on Innovative Computing, Information and Control - Volume I (ICICIC'06).

[8]  Robert E. Schapire,et al.  A Brief Introduction to Boosting , 1999, IJCAI.

[9]  Shinya Fukumoto,et al.  A Learning Algorithm with Boosting for Fuzzy Reasoning Model , 2007, Fourth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007).

[10]  Hiromi Miyajima,et al.  A Learning Method of Fuzzy Inference Rules Using Vector Quantization , 1998 .

[11]  Isao Hayashi,et al.  A Fuzzy Modelling with Iterative Generation Mechanism of Fuzzy Inference Rules , 1992 .

[12]  Shinya Fukumoto,et al.  A destructive learning method of fuzzy inference rules , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[13]  H. Nomura,et al.  A Self-Tuning Method of Fuzzy Reasoning By Genetic Algorithm , 1993 .

[14]  Chin-Teng Lin,et al.  Neural fuzzy systems , 1994 .