Construction of fuzzy systems using least-squares method and genetic algorithm

The fuzzy basis function network which was proposed in Wang and Mendel (IEEE Trans. Neural Networks 3(5) (1992b) 807) provides a way of representing fuzzy inference systems in a simple structure similar to those of radial basis function networks. In this paper, two new algorithms based on the least-squares method and genetic algorithm are proposed for autonomous learning and construction of fuzzy basis function networks when training data are available. The proposed algorithms add a significant fuzzy basis function node at each iteration during training, based on error reduction measures. The first, a least-squares algorithm, provides a way of sequentially constructing meaningful fuzzy systems which are not possible to achieve with the orthogonal least-squares algorithm, while the second, an adaptive least-squares algorithm based on the combined least-squares and genetic algorithm, realizes hybrid structure-parameter learning without human intervention. Simulation studies are performed with numerical examples for comparison of its performance against the orthogonal least-squares algorithm, backpropagation algorithm, and conventional genetic algorithm. The adaptive least-squares algorithm is also applied to a real world problem to construct a fuzzy basis function network model for surface roughness in a grinding process using experimental data.

[1]  S. S. Melsheimer,et al.  Using genetic algorithms to estimate the optimum width parameter in radial basis function networks , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[2]  B. K. Natarajan,et al.  Genetic Evolution of Radial Basis Function Coverage Using Orthogonal Niches , 1996 .

[3]  Stephen Malkin,et al.  Grinding Technology: Theory and Applications of Machining with Abrasives , 1989 .

[4]  Derek A. Linkens,et al.  Evolutionary learning in neural fuzzy control systems , 1997 .

[5]  T.-K.J. Koo Construction of fuzzy linguistic model , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[6]  S. Chen,et al.  A two-layer learning method for radial basis function networks using combined genetic and regularised OLS algorithms , 1995 .

[7]  Antonio González Muñoz,et al.  SLAVE: a genetic learning system based on an iterative approach , 1999, IEEE Trans. Fuzzy Syst..

[8]  Nikola K. Kasabov,et al.  Adaptive Training of Radial Basis Function Networks Based on Cooperative Evolution and Evolutionary Programming , 1997, ICONIP.

[9]  L X Wang,et al.  Fuzzy basis functions, universal approximation, and orthogonal least-squares learning , 1992, IEEE Trans. Neural Networks.

[10]  Marzuki Khalid,et al.  Tuning of a neuro-fuzzy controller by genetic algorithm , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[11]  Derek A. Linkens,et al.  Learning control using fuzzified self-organizing radial basis function network , 1993, IEEE Trans. Fuzzy Syst..

[12]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[13]  M. Lozano,et al.  MOGUL: A methodology to obtain genetic fuzzy rule‐based systems under the iterative rule learning approach , 1999 .

[14]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[15]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[16]  V. Klema LINPACK user's guide , 1980 .

[17]  Abraham Kandel,et al.  Fuzzy Control Systems , 1993 .

[18]  Brian Carse,et al.  Fast Evolutionary Learning of Minimal Radial Basis Function Neural Networks Using a Genetic Algorithm , 1996, Evolutionary Computing, AISB Workshop.

[19]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[20]  C. S. George Lee,et al.  Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems , 1996 .

[21]  T. Fukuda,et al.  RBF-fuzzy system with GA based unsupervised/supervised learning method , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[22]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[23]  M. MendelJ.,et al.  Fuzzy basis functions , 1995 .

[24]  Yung C. Shin,et al.  Intelligent modeling and optimization of grinding processes , 2000 .