Combination of Breeding Swarm Optimization and Backpropagation Algorithm for Training Recurrent Fuzzy Neural Network

The usage of recurrent fuzzy neural network has been increased recently. These networks can approximate the behaviour of the dynamical systems because of their feedback structure. The Backpropagation of error has usually been used for training this network. In this paper, a novel approach for learning the parameters of RFNN is proposed using combination of the backpropagation and breeding particle swarm optimization. A comparison of this approach with previous methods is also made to demonstrate the effectiveness of this algorithm. Particle swarm is a derivative free, globally optimizing approach that makes the training of the network easier. These can solve the problems of gradient based method, which are instability, local minima and complexity of differentiating.

[1]  Ching-Hung Lee,et al.  Identification and control of dynamic systems using recurrent fuzzy neural networks , 2000, IEEE Trans. Fuzzy Syst..

[2]  Terence Soule,et al.  Evolving a strongly recurrent neural network to simulate biological neurons , 2002, IEEE 2002 28th Annual Conference of the Industrial Electronics Society. IECON 02.

[3]  Terence Soule,et al.  Breeding swarms: a new approach to recurrent neural network training , 2005, GECCO '05.

[4]  Kwang Y. Lee,et al.  Diagonal recurrent neural networks for dynamic systems control , 1995, IEEE Trans. Neural Networks.

[5]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[6]  Hartmut Surmann,et al.  Learning feed-forward and recurrent fuzzy systems: A genetic approach , 2001, J. Syst. Archit..

[7]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[8]  Peter J. Angeline,et al.  An evolutionary algorithm that constructs recurrent neural networks , 1994, IEEE Trans. Neural Networks.