Subsethood-product fuzzy neural inference system (SuPFuNIS)

A new subsethood-product fuzzy neural inference system (SuPFuNIS) is presented in this paper. It has the flexibility to handle both numeric and linguistic inputs simultaneously. Numeric inputs are fuzzified by input nodes which act as tunable feature fuzzifiers. Rule based knowledge is easily translated directly into a network architecture. Connections in the network are represented by Gaussian fuzzy sets. The novelty of the model lies in a combination of tunable input feature fuzzifiers; fuzzy mutual subsethood-based activation spread in the network; use of the product operator to compute the extent of firing of a rule; and a volume-defuzzification process to produce a numeric output. Supervised gradient descent is employed to train the centers and spreads of individual fuzzy connections. A subsethood-based method for rule generation from the trained network is also suggested. SuPFuNIS can be applied in a variety of application domains. The model has been tested on Mackey-Glass time series prediction, Iris data classification, Hepatitis medical diagnosis, and function approximation benchmark problems. We also use a standard truck backer-upper control problem to demonstrate how expert knowledge can be used to augment the network. The performance of SuPFuNIS compares excellently with other various existing models.

[1]  Frank Klawonn,et al.  Constructing a fuzzy controller from data , 1997, Fuzzy Sets Syst..

[2]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[3]  Tzung-Pei Hong,et al.  Integrating fuzzy knowledge by genetic algorithms , 1998, IEEE Trans. Evol. Comput..

[4]  H. Ishibuchi,et al.  A learning algorithm of fuzzy neural networks with triangular fuzzy weights , 1995 .

[5]  Y. J. Chen,et al.  Simplification of fuzzy-neural systems using similarity analysis , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[6]  Richard S. Sutton,et al.  The Truck Backer-Upper: An Example of Self-Learning in Neural Networks , 1995 .

[7]  Sankar K. Pal,et al.  Neuro-Fuzzy Pattern Recognition: Methods in Soft Computing , 1999 .

[8]  Sankar K. Pal,et al.  Fuzzy multi-layer perceptron, inferencing and rule generation , 1995, IEEE Trans. Neural Networks.

[9]  Jyh-Yeong Chang,et al.  Fuzzy perceptron neural networks for classifiers with numerical data and linguistic rules as inputs , 2000, IEEE Trans. Fuzzy Syst..

[10]  Hon Keung Kwan,et al.  Fuzzy classifications using fuzzy inference networks , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[11]  Rudolf Kruse,et al.  NEFCON-I: an X-Window based simulator for neural fuzzy controllers , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[12]  James C. Bezdek,et al.  Repairs to GLVQ: a new family of competitive learning schemes , 1996, IEEE Trans. Neural Networks.

[13]  Sushmita Mitra,et al.  Neuro-fuzzy rule generation: survey in soft computing framework , 2000, IEEE Trans. Neural Networks Learn. Syst..

[14]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[15]  Chin-Teng Lin,et al.  An On-Line Self-Constructing Neural Fuzzy Inference Network and Its Applications , 1998 .

[16]  Anca L. Ralescu,et al.  An improved synthesis method for multilayered neural networks using qualitative knowledge , 1993, IEEE Trans. Fuzzy Syst..

[17]  Satish Kumar,et al.  Subsethood based adaptive linguistic networks for pattern classification , 2003, IEEE Trans. Syst. Man Cybern. Part C.

[18]  Bernhard Sendhoff,et al.  On generating FC3 fuzzy rule systems from data using evolution strategies , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[19]  Meng Joo Er,et al.  Dynamic fuzzy neural networks-a novel approach to function approximation , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[20]  Thomas A. Runkler,et al.  Some issues in system identification using clustering , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[21]  Yinghua Lin,et al.  Using fuzzy partitions to create fuzzy systems from input-output data and set the initial weights in a fuzzy neural network , 1997, IEEE Trans. Fuzzy Syst..

[22]  Bart Kosko,et al.  Fuzzy Engineering , 1996 .

[23]  James J. Buckley,et al.  Fuzzy and Neural: Interactions and Applications , 1999 .

[24]  Peter Clark,et al.  The CN2 Induction Algorithm , 1989, Machine Learning.

[25]  Marco Russo,et al.  Genetic fuzzy learning , 2000, IEEE Trans. Evol. Comput..

[26]  Yaochu Jin,et al.  Fuzzy modeling of high-dimensional systems: complexity reduction and interpretability improvement , 2000, IEEE Trans. Fuzzy Syst..

[27]  Rudolf Kruse,et al.  A neuro-fuzzy method to learn fuzzy classification rules from data , 1997, Fuzzy Sets Syst..

[28]  Marco Russo,et al.  FuGeNeSys-a fuzzy genetic neural system for fuzzy modeling , 1998, IEEE Trans. Fuzzy Syst..

[29]  James J. Buckley,et al.  Fuzzy neural network with fuzzy signals and weights , 1993, Int. J. Intell. Syst..

[30]  John Yen,et al.  Extracting fuzzy rules for system modeling using a hybrid of genetic algorithms and Kalman filter , 1999, Fuzzy Sets Syst..

[31]  C. S. George Lee,et al.  Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems , 1996 .

[32]  Yuan Yan Chen,et al.  Fuzzy analysis of statistical evidence , 2000, IEEE Trans. Fuzzy Syst..

[33]  Wlodzislaw Duch,et al.  A new methodology of extraction, optimization and application of crisp and fuzzy logical rules , 2001, IEEE Trans. Neural Networks.

[34]  Yu-Geng Xi,et al.  Nonlinear system modeling by competitive learning and adaptive fuzzy inference system , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[35]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[36]  Sankar K. Pal,et al.  Knowledge-based fuzzy MLP for classification and rule generation , 1997, IEEE Trans. Neural Networks.

[37]  Chulhyun Kim,et al.  Forecasting time series with genetic fuzzy predictor ensemble , 1997, IEEE Trans. Fuzzy Syst..

[38]  野崎 賢,et al.  Generating Fuzzy Rules from Numerical Data , 1995 .

[39]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[40]  Isao Hayashi,et al.  NN-driven fuzzy reasoning , 1991, Int. J. Approx. Reason..

[41]  Bart Kosko,et al.  Adaptive fuzzy systems for backing up a truck-and-trailer , 1992, IEEE Trans. Neural Networks.

[42]  James C. Bezdek,et al.  Nearest prototype classification: clustering, genetic algorithms, or random search? , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[43]  Hisao Ishibuchi,et al.  Neural networks that learn from fuzzy if-then rules , 1993, IEEE Trans. Fuzzy Syst..

[44]  Nikhil R. Pal,et al.  On rule pruning using fuzzy neural networks , 1999, Fuzzy Sets Syst..

[45]  Chin-Teng Lin,et al.  Neural-Network-Based Fuzzy Logic Control and Decision System , 1991, IEEE Trans. Computers.

[46]  Ai Wu,et al.  A fuzzy neural network based on fuzzy hierarchy error approach , 2000, IEEE Trans. Fuzzy Syst..

[47]  Sankar K. Pal,et al.  Multilayer perceptron, fuzzy sets, and classification , 1992, IEEE Trans. Neural Networks.

[48]  Ivan Bratko,et al.  ASSISTANT 86: A Knowledge-Elicitation Tool for Sophisticated Users , 1987, EWSL.

[49]  C. J. Kim,et al.  An algorithmic approach for fuzzy inference , 1997, IEEE Trans. Fuzzy Syst..

[50]  Saman K. Halgamuge,et al.  Neural networks in designing fuzzy systems for real world applications , 1994 .

[51]  James M. Keller,et al.  Fuzzy Models and Algorithms for Pattern Recognition and Image Processing , 1999 .

[52]  Hamid R. Berenji,et al.  Learning and tuning fuzzy logic controllers through reinforcements , 1992, IEEE Trans. Neural Networks.

[53]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[54]  B. Widrow,et al.  The truck backer-upper: an example of self-learning in neural networks , 1989, International 1989 Joint Conference on Neural Networks.

[55]  Sankar K. Pal,et al.  Logical operation based fuzzy MLP for classification and rule generation , 1994, Neural Networks.

[56]  Gerardo Beni,et al.  A Validity Measure for Fuzzy Clustering , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  Yinghua Lin,et al.  A new approach to fuzzy-neural system modeling , 1995, IEEE Trans. Fuzzy Syst..

[58]  Nikola Kasabov,et al.  Dynamic evolving fuzzy neural networks with `m-out-of-n' activation nodes for on-line adaptive systems , 1999 .

[59]  T. Feuring,et al.  A gradient descent learning algorithm for fuzzy neural networks , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[60]  Derrick H. Nguyen,et al.  Truck backer-upper: an example of self-learning in neural networks , 1990, Defense, Security, and Sensing.

[61]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[62]  Jacek M. Leski,et al.  A new artificial neural network based fuzzy inference system with moving consequents in if-then rules and selected applications , 1999, Fuzzy Sets Syst..

[63]  Rudolf Kruse,et al.  Obtaining interpretable fuzzy classification rules from medical data , 1999, Artif. Intell. Medicine.

[64]  LiMin Fu Learning capacity and sample complexity on expert networks , 1996, IEEE Trans. Neural Networks.

[65]  Xin Yao,et al.  A new evolutionary system for evolving artificial neural networks , 1997, IEEE Trans. Neural Networks.

[66]  Rudolf Kruse,et al.  A neuro-fuzzy approach to obtain interpretable fuzzy systems for function approximation , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[67]  Nikola K. Kasabov,et al.  Learning fuzzy rules and approximate reasoning in fuzzy neural networks and hybrid systems , 1996, Fuzzy Sets Syst..

[68]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[69]  Sankar K. Pal,et al.  Neuro-Fuzzy Pattern Recognition , 1999 .

[70]  Nikola K. Kasabov,et al.  HyFIS: adaptive neuro-fuzzy inference systems and their application to nonlinear dynamical systems , 1999, Neural Networks.

[71]  Sankar K. Pal,et al.  Fuzzy self-organization, inferencing, and rule generation , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[72]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[73]  N. Kasabov,et al.  Rule insertion and rule extraction from evolving fuzzy neural networks: algorithms and applications for building adaptive, intelligent expert systems , 1999, FUZZ-IEEE'99. 1999 IEEE International Fuzzy Systems. Conference Proceedings (Cat. No.99CH36315).