Particle swarm optimization for function optimization in noisy environment

As a novel evolutionary searching technique, particle swarm optimization (PSO) has gained wide research and effective applications in the field of function optimization. However, to the best of our knowledge, most studies based on PSO are aimed at deterministic optimization problems. In this paper, the performance of PSO for function optimization in noisy environment is investigated, and an effective hybrid PSO approach named PSOOHT is proposed. In the PSOOHT, the population-based search mechanism of PSO is applied for well exploration and exploitation, and the optimal computing budget allocation (OCBA) technique is used to allocate limited sampling budgets to provide reliable evaluation and identification for good particles. Meanwhile, hypothesis test (HT) is also applied in the hybrid approach to reserve good particles and to maintain the diversity of the swarm as well. Numerical simulations based on several well-known function benchmarks with noise are carried out, and the effect of noise magnitude is also investigated as well. The results and comparisons demonstrate the superiority of PSOOHT in terms of searching quality and robustness.

[1]  Huang Dexian,et al.  Advances in Particle Swarm Optimization Algorithm , 2005 .

[2]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[3]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[4]  Chun-Hung Chen,et al.  Simulation Budget Allocation for Further Enhancing the Efficiency of Ordinal Optimization , 2000, Discret. Event Dyn. Syst..

[5]  Liang Zhang,et al.  A class of hypothesis-test-based genetic algorithms for flow shop scheduling with stochastic processing time , 2005 .

[6]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[7]  Loo Hay Lee,et al.  Explanation of goal softening in ordinal optimization , 1999, IEEE Trans. Autom. Control..

[8]  V. S. Pugachev,et al.  Probability Theory and Mathematical Statistics for Engineers , 1984 .

[9]  Ling Wang,et al.  Genetic ordinal optimisation for stochastic flow shop scheduling , 2005 .

[10]  L. Dai Convergence properties of ordinal comparison in the simulation of discrete event dynamic systems , 1995 .

[11]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[12]  Yu-Chi Ho,et al.  Ordinal optimization of DEDS , 1992, Discret. Event Dyn. Syst..

[13]  Dexian Huang,et al.  Designing Neural Networks Using Hybrid Particle Swarm Optimization , 2005, ISNN.