Temporal problems solved by dynamic fuzzy network based on genetic algorithm with variable-length chromosomes

Abstract In this paper, a dynamic fuzzy network and its design based on genetic algorithm with variable-length chromosomes is proposed. First, the dynamic fuzzy network constituted from a series of dynamic fuzzy if–then rules is proposed. One characteristic of this network is its ability to deal with temporal problems. Then, the proposed genetic algorithm with variable-length chromosomes is adopted into the design process as a means of allowing the application of the network in situations where the actual desired output is unavailable. In the proposed genetic algorithm, the length of each chromosome varies with the number of rules coded in it. Using this algorithm, no pre-assignment of the number of rules in the dynamic fuzzy network is required, since it can always help to find the most suitable number of rules. All free parameters in the network, including the spatial input partition, consequent parameters and feedback connection weights, are tuned concurrently. To further promote the design performance, genetic algorithm with variable-length chromosomes and relative-based mutated reproduction operation is proposed. In this algorithm, the elite individuals are directly reproduced to the next generation only when their averaged similarity value is smaller than a similarity threshold; otherwise, the elites are mutated to the next generation. To show the efficiency of this dynamic fuzzy network designed by genetic algorithm with variable-length chromosomes and relative-based mutated reproduction operation, two temporal problems are simulated. The simulated results and comparisons with recurrent neural and fuzzy networks verify the efficacy and efficiency of the proposed approach.

[1]  Chin-Teng Lin,et al.  Neural fuzzy systems , 1994 .

[2]  Karvel K. Thornber,et al.  Representation of fuzzy finite state automata in continuous recurrent, neural networks , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[3]  M. Gupta,et al.  Approximation of discrete-time state-space trajectories using dynamic recurrent neural networks , 1995, IEEE Trans. Autom. Control..

[4]  Kumpati S. Narendra,et al.  Neural Networks In Dynamical Systems , 1990, Other Conferences.

[5]  Jan Torreele,et al.  Temporal Processing with Recurrent Networks: An Evolutionary Approach , 1991, ICGA.

[6]  Inman Harvey,et al.  The SAGA Cross: The Mechanics of Recombination for Species with Variable Length Genotypes , 1992, PPSN.

[7]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[8]  Peter J. Angeline,et al.  An evolutionary algorithm that constructs recurrent neural networks , 1994, IEEE Trans. Neural Networks.

[9]  Florin Fagarasan.  A genetic-based method applied in fuzzy modeling , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[10]  George Vachtsevanos,et al.  Recursive learning algorithms for training fuzzy recurrent models , 1996 .

[11]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[12]  Abdollah Homaifar,et al.  Simultaneous design of membership functions and rule sets for fuzzy controllers using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[13]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[14]  George C. Mouzouris,et al.  Dynamic non-Singleton fuzzy logic systems for nonlinear modeling , 1997, IEEE Trans. Fuzzy Syst..

[15]  Risto Miikkulainen,et al.  Efficient Reinforcement Learning through Symbiotic Evolution , 1996, Machine Learning.

[16]  Zbigniew Michalewicz,et al.  GAVaPS-a genetic algorithm with varying population size , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[17]  Reiko Tanese,et al.  Distributed Genetic Algorithms , 1989, ICGA.

[18]  Jie Zhang.  Recurrent neuro-fuzzy networks for the modelling and optimal control of batch processes , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[19]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[20]  Jie Zhang,et al.  Recurrent neuro-fuzzy networks for nonlinear process modeling , 1999, IEEE Trans. Neural Networks.

[21]  David E. Goldberg,et al.  Simplex crossover and linkage identification: single-stage evolution vs. multi-stage evolution , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[22]  Chris J. Harris,et al.  Support vector recurrent neurofuzzy networks in modeling nonlinear systems with correlated noise , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[23]  Paris A. Mastorocostas,et al.  A recurrent fuzzy-neural model for dynamic system identification , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[24]  Michael I. Jordan.  Attractor dynamics and parallelism in a connectionist sequential machine , 1990 .

[25]  A. PearlmutterB..  Gradient calculations for dynamic recurrent neural networks , 1995 .

[26]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[27]  P. S. Sastry,et al.  Memory neuron networks for identification and control of dynamical systems , 1994, IEEE Trans. Neural Networks.

[28]  Ching-Hung Lee,et al.  Identification and control of dynamic systems using recurrent fuzzy neural networks , 2000, IEEE Trans. Fuzzy Syst..

[29]  L. Darrell Whitley,et al.  Genetic Reinforcement Learning for Neurocontrol Problems , 2004, Machine Learning.

[30]  Barak A. Pearlmutter.  Gradient calculations for dynamic recurrent neural networks: a survey , 1995, IEEE Trans. Neural Networks.

[31]  Chin-Teng Lin,et al.  An On-Line Self-Constructing Neural Fuzzy Inference Network and Its Applications , 1998 .

[32]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[33]  Kiyoshi Tanaka,et al.  Mutation strategy improves GAs performance on epistatic problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[34]  Stephen F. Smith,et al.  A learning system based on genetic adaptive algorithms , 1980 .

[35]  Secundino Soares,et al.  A recurrent neuro-fuzzy network structure and learning procedure , 2001, 10th IEEE International Conference on Fuzzy Systems. (Cat. No.01CH37297).

[36]  David R. Jefferson,et al.  Selection in Massively Parallel Genetic Algorithms , 1991, ICGA.

[37]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[38]  Hugues Bersini,et al.  Recurrent fuzzy systems , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[39]  Kwang Y. Lee,et al.  Diagonal recurrent neural networks for dynamic systems control , 1995, IEEE Trans. Neural Networks.

[40]  Stephen A. Billings,et al.  Recurrent radial basis function networks for adaptive noise cancellation , 1995, Neural Networks.

[41]  Barak A. Pearlmutter.  Learning State Space Trajectories in Recurrent Neural Networks , 1989, Neural Computation.

[42]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[43]  C. S. George Lee,et al.  Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems , 1996 .

[44]  Yuichi Nakamura,et al.  Approximation of dynamical systems by continuous time recurrent neural networks , 1993, Neural Networks.

[45]  Chia-Feng Juang,et al.  A recurrent self-organizing neural fuzzy inference network , 1997, Proceedings of 6th International Fuzzy Systems Conference.

[46]  D. Thierens.  Adaptive mutation rate control schemes in genetic algorithms , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[47]  S. Thomas Alexander,et al.  Adaptive Signal Processing , 1986, Texts and Monographs in Computer Science.