Robust extraction of fuzzy rules with artificial neural network based on fuzzy inference system

The paper presents a method of parameters estimation for artificial neural network based on fuzzy inference system (ANNBFIS). It is based on deterministic annealing, e-insensitive learning by solving a system of linear inequalities and robust fuzzy c-means clustering. The proposed algorithm allows to improve the neuro-fuzzy modelling quality by increasing the generalisation ability and outliers robustness. To find the unknown number of fuzzy rules we proposed the procedure of robust clusters merging. The performance of the learning method is demonstrated through the benchmark sunspot prediction problem.

[1]  Janusz Jezewski,et al.  Robust Prediction with ANNBFIS System , 2010, ACIIDS.

[2]  Robert Czabanski,et al.  Neuro-fuzzy modelling based on a deterministic annealing approach , 2005 .

[3]  Steve R. Waterhouse,et al.  Non-linear Prediction of Acoustic Vectors Using Hierarchical Mixtures of Experts , 1994, NIPS.

[4]  J. S. Verdi,et al.  Segmenting SAR images using fuzzy clustering , 2000, PeachFuzz 2000. 19th International Conference of the North American Fuzzy Information Processing Society - NAFIPS (Cat. No.00TH8500).

[5]  R. Czabanski,et al.  Fuzzy If-Then Rules Extraction by Means of ε-Insensitive Learning Techniques Integrated with Deterministic Annealing Optimization Method , 2005 .

[6]  Lijuan Cao,et al.  Support vector machines experts for time series forecasting , 2003, Neurocomputing.

[7]  Sushmita Mitra,et al.  Neuro-fuzzy rule generation: survey in soft computing framework , 2000, IEEE Trans. Neural Networks Learn. Syst..

[8]  R. Tong.  The evaluation of fuzzy models derived from experimental data , 1980 .

[9]  Robert Czabanski.  Extraction of fuzzy rules using deterministic annealing integrated with ε-insensitive learning , 2006 .

[10]  R. Krishnapuram,et al.  Fuzzy and robust formulations of maximum-likelihood-based Gaussian mixture decomposition , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[11]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[12]  Geoffrey E. Hinton,et al.  Simplifying Neural Networks by Soft Weight-Sharing , 1992, Neural Computation.

[13]  Jacek M. Leski,et al.  Fuzzy and Neuro-Fuzzy Intelligent Systems , 2000, Studies in Fuzziness and Soft Computing.

[14]  David E. Rumelhart,et al.  Predicting the Future: a Connectionist Approach , 1990, Int. J. Neural Syst..

[15]  Gerardo Beni,et al.  A Validity Measure for Fuzzy Clustering , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[17]  K. Rose.  Deterministic annealing for clustering, compression, classification, regression, and related optimization problems , 1998, Proc. IEEE.