A Dual layered PSO Algorithm for evolving an Artificial Neural Network controller

This paper introduces a dual layered particle swarm optimization algorithm (DLPSO), an evolutionary algorithm proposed to design an artificial neural network (ANN). The algorithm evolves the architecture of the ANN and trains its weights simultaneously. Different from the other techniques previously used, the proposed algorithm evolves the architecture along with the weights in two different layers. Tested on a non-linear system, typically a boost converter, the DLPSO evolves an optimal ANN controller to produce more efficient and robust results than the conventional control techniques used. The performance of the DLPSO based ANN controller is compared to that of a conventional PI controller at different operating points of the non-linear system. The tests show that the evolved controller performs equal to or better than the conventional techniques in terms of overshoot voltages and settling times for small and large signal input transients. Also, a comparison between the applicability of a PSO and a real-valued genetic algorithm for the training of weights is presented which shows that the PSO is faster and more efficient as a learning algorithm. Moreover, the proposed approach fully automates the neural network generation process, thus removing the need for time consuming manual design.

[1]  Yuan-bin Mo,et al.  The Design of Neural Network Direct Inverse Controller Based on Complex Particle Swarm Optimization Algorithm , 2006, SYNASC.

[2]  Teresa Bernarda Ludermir,et al.  An Analysis Of PSO Hybrid Algorithms For Feed-Forward Neural Networks Training , 2006, 2006 Ninth Brazilian Symposium on Neural Networks (SBRN'06).

[3]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[4]  Russell Reed,et al.  Pruning algorithms-a survey , 1993, IEEE Trans. Neural Networks.

[5]  Dipti Srinivasan,et al.  A novel tri-state boost converter with fast dynamics , 2002 .

[6]  Peter M. Todd,et al.  Designing Neural Networks using Genetic Algorithms , 1989, ICGA.

[7]  Kiyotaka Izumi,et al.  A particle-swarm-optimized fuzzy-neural network for voice-controlled robot systems , 2005, IEEE Transactions on Industrial Electronics.

[8]  Tore Undeland,et al.  Power Electronics: Converters, Applications and Design , 1989 .

[9]  Jian-Wei Ma,et al.  An improved artificial fish-swarm algorithm and its application in feed-forward neural networks , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[10]  Li Yu,et al.  A new evolved artificial neural network and its application , 2000, Proceedings of the 3rd World Congress on Intelligent Control and Automation (Cat. No.00EX393).

[11]  C.K. Mohan,et al.  Training feedforward neural networks using multi-phase particle swarm optimization , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[12]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.