GenSoFNN: a generic self-organizing fuzzy neural network

Existing neural fuzzy (neuro-fuzzy) networks proposed in the literature can be broadly classified into two groups. The first group is essentially fuzzy systems with self-tuning capabilities and requires an initial rule base to be specified prior to training. The second group of neural fuzzy networks, on the other hand, is able to automatically formulate the fuzzy rules from the numerical training data. No initial rule base needs to be specified prior to training. A cluster analysis is first performed on the training data and the fuzzy rules are subsequently derived through the proper connections of these computed clusters. However, most existing neural fuzzy systems (whether they belong to the first or second group) encountered one or more of the following major problems. They are (1) inconsistent rule-base; (2) heuristically defined node operations; (3) susceptibility to noisy training data and the stability-plasticity dilemma; and (4) needs for prior knowledge such as the number of clusters to be computed. Hence, a novel neural fuzzy system that is immune to the above-mentioned deficiencies is proposed in this paper. This new neural fuzzy system is named the generic self-organizing fuzzy neural network (GenSoFNN). The GenSoFNN network has strong noise tolerance capability by employing a new clustering technique known as discrete incremental clustering (DIC). The fuzzy rule base of the GenSoFNN network is consistent and compact as GenSoFNN has built-in mechanisms to identify and prune redundant and/or obsolete rules. Extensive simulations were conducted using the proposed GenSoFNN network and its performance is encouraging when benchmarked against other neural and neural fuzzy systems.

[1]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[2]  Chai Quek,et al.  PACL-FNNS: A Novel Class of Falcon-Like Fuzzy Neural Networks Based on Positive and Negative Exemplars , 2002 .

[3]  I. Turksen,et al.  An approximate analogical reasoning schema based on similarity measures and interval-valued fuzzy sets , 1990 .

[4]  Ruowei Zhou,et al.  POPFNN: A Pseudo Outer-product Based Fuzzy Neural Network , 1996, Neural Networks.

[5]  Detlef Nauck,et al.  Foundations Of Neuro-Fuzzy Systems , 1997 .

[6]  A. Weigend,et al.  Time Series Prediction: Forecasting the Future and Understanding the Past. Proceedings of the NATO Advanced Research Workshop on a Comparative Time Series Analysis Held in Santa Fe, New Mexico, 14-17 May 1992. , 1994 .

[7]  E. H. Mamdani,et al.  Application of Fuzzy Logic to Approximate Reasoning Using Linguistic Synthesis , 1976, IEEE Transactions on Computers.

[8]  Stephen Grossberg,et al.  Adaptive pattern classification and universal recoding: II. Feedback, expectation, olfaction, illusions , 1976, Biological Cybernetics.

[9]  C. S. George Lee,et al.  Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems , 1996 .

[10]  Chin-Teng Lin,et al.  An ART-based fuzzy adaptive learning control network , 1997, IEEE Trans. Fuzzy Syst..

[11]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[12]  K. Lang,et al.  Learning to tell two spirals apart , 1988 .

[13]  Hübner,et al.  Dimensions and entropies of chaotic intensity pulsations in a single-mode far-infrared NH3 laser. , 1989, Physical review. A, General physics.

[14]  L. Zadeh Calculus of fuzzy restrictions , 1996 .

[15]  M. Ait Kbir,et al.  Hierarchical fuzzy partition for pattern classification with fuzzy if-then rules , 2000, Pattern Recognit. Lett..

[16]  S. Grossberg,et al.  Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors , 1976, Biological Cybernetics.

[17]  Ramon López de Mántaras,et al.  Approximate Reasoning Models , 1990 .

[18]  S. Schor STATISTICS: AN INTRODUCTION. , 1965, The Journal of trauma.

[19]  Ruowei Zhou,et al.  A pseudo outer-product based fuzzy neural network , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[20]  Ruowei Zhou,et al.  POPFNN-AAR(S): a pseudo outer-product based fuzzy neural network , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[21]  Michel Pasquier,et al.  POPFNN-CRI(S): pseudo outer product based fuzzy neural network using the compositional rule of inference and singleton fuzzifier , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[22]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[23]  S. C. Shin,et al.  GA-based predictive control for nonlinear processes , 1998 .

[24]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[25]  M. Ait Kbir,et al.  Hierarchical fuzzy partition for pattern classification with fuzzy if-then rules , 2000, Pattern Recognit. Lett..

[26]  S. C. Johnson Hierarchical clustering schemes , 1967, Psychometrika.

[27]  Hamid R. Berenji,et al.  Learning and tuning fuzzy logic controllers through reinforcements , 1992, IEEE Trans. Neural Networks.

[28]  Roger E. Kirk,et al.  Statistics: An Introduction , 1998 .

[29]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[30]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[31]  J. Gower,et al.  Minimum Spanning Trees and Single Linkage Cluster Analysis , 1969 .

[32]  Hichem Frigui,et al.  A Robust Competitive Clustering Algorithm With Applications in Computer Vision , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Hiok Chai Quek,et al.  A novel approach to the derivation of fuzzy membership functions using the Falcon-MART architecture , 2001, Pattern Recognit. Lett..

[34]  Andreas S. Weigend,et al.  Time Series Prediction: Forecasting the Future and Understanding the Past , 1994 .

[35]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .