Improved Opposition-Based PSO for Feedforward Neural Network Training

In this study we present an improved opposition- based PSO and apply it to feedforward neural network training. The improved opposition-based PSO utilizes opposition-based initialization, opposition-based generation jumping and opposition-based velocity calculation. The opposition-based PSO is first tested on some unimodal and multimodal problems and its performance is compared with standard PSO. We then test the performance of the improved opposition-based PSO for training feedforward neural network and also present a comparison with standard PSO.

[1]  Hamid R. Tizhoosh,et al.  Opposition-Based Reinforcement Learning , 2006, J. Adv. Comput. Intell. Intell. Informatics.

[2]  Hui Wang,et al.  Opposition-based particle swarm algorithm with cauchy mutation , 2007, 2007 IEEE Congress on Evolutionary Computation.

[3]  Hamid R. Tizhoosh,et al.  Opposition-Based Learning: A New Scheme for Machine Intelligence , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[4]  Shahryar Rahnamayan,et al.  Opposition-Based Differential Evolution for Optimization of Noisy Problems , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[5]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[6]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[7]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[8]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[9]  Shahryar Rahnamayan,et al.  Opposition-Based Differential Evolution Algorithms , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[10]  Mahamed G.H. Omran.  Using Opposition-based Learning with Particle Swarm Optimization and Barebones Differential Evolution , 2009 .

[11]  James Kennedy,et al.  The particle swarm: social adaptation of knowledge , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[12]  Andries Petrus Engelbrecht,et al.  Cooperative learning in neural networks using particle swarm optimizers , 2000, South Afr. Comput. J..

[13]  Zhiwei Ni,et al.  Opposition based comprehensive learning particle swarm optimization , 2008, 2008 3rd International Conference on Intelligent System and Knowledge Engineering.

[14]  Lin Han,et al.  A Novel Opposition-Based Particle Swarm Optimization for Noisy Problems , 2007, Third International Conference on Natural Computation (ICNC 2007).

[15]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[16]  Paulo Cortez,et al.  Particle swarms for feedforward neural network training , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[17]  Hamid R. Tizhoosh,et al.  Reinforcement Learning Based on Actions and Opposite Actions , 2005 .

[18]  C.K. Mohan,et al.  Training feedforward neural networks using multi-phase particle swarm optimization , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..