An Effective Adjustment to the Integration of Optimal Computing Budget Allocation for Particle Swarm Optimization in Stochastic Environments

Although particle swarm optimization (PSO) is a powerful evolutionary algorithm for solving nonlinear optimization problems in deterministic environments, many practical problems have some stochastic noise. The optimal computing budget allocation (OCBA) has been integrated into PSO in various ways to cope with this. The OCBA can mitigate the effect of noise on PSO by selecting the best solution under a limited evaluation budget. Recently, with the increasing complexity of PSO applications, the evaluation costs are also increasing rapidly, which has sparked the need for more efficient PSO in stochastic environments. This article proposes a simple yet effective adjustment to the integration of OCBA to further improve the efficiency of PSO. The proposed adjustment allows OCBA to expand its search space to find the global best position more correctly such that the entire swarm can move on a better direction under stochastic noise. The experimental results on various benchmarks demonstrate the improved performance of PSO by the proposed adjustment under a limited budget compared with the latest studies. In addition, the results regarding fighters’ evasion flight optimization emphasize the practical need for the proposed adjustment.

[1]  Loo Hay Lee,et al.  Optimal Computing Budget Allocation for Particle Swarm Optimization in Stochastic Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[2]  Chukwudi Anyakoha,et al.  A review of particle swarm optimization. Part I: background and development , 2007, Natural Computing.

[3]  Ala I. Al-Fuqaha,et al.  A survey on particle swarm optimization with emphasis on engineering and network applications , 2019, Evolutionary Intelligence.

[4]  Mark Johnston,et al.  Population statistics for particle swarm optimization: Single-evaluation methods in noisy optimization problems , 2015, Soft Comput..

[5]  Chukwudi Anyakoha,et al.  A review of particle swarm optimization. Part II: hybridisation, combinatorial, multicriteria and constrained optimization, and indicative applications , 2008, Natural Computing.

[6]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[7]  Tag Gon Kim,et al.  Efficient Ranking and Selection for Stochastic Simulation Model Based on Hypothesis Test , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[8]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[9]  Hui Xiao,et al.  Optimal Computing Budget Allocation for Complete Ranking , 2014, IEEE Transactions on Automation Science and Engineering.

[10]  Luca Fumagalli,et al.  Flexible Automation and Intelligent Manufacturing , FAIM 2017 , 27-30 June 2017 , Modena , Italy A review of the roles of Digital Twin in CPS-based production systems , 2017 .

[11]  Mengjie Zhang,et al.  Population statistics for particle swarm optimization: Resampling methods in noisy optimization problems , 2014, Swarm Evol. Comput..

[12]  Swagatam Das,et al.  A Modified Differential Evolution With Distance-based Selection for Continuous Optimization in Presence of Noise , 2017, IEEE Access.

[13]  Shih-Cheng Horng,et al.  Applying PSO and OCBA to Minimize the Overkills and Re-Probes in Wafer Probe Testing , 2012, IEEE Transactions on Semiconductor Manufacturing.

[14]  Yu Xue,et al.  Large-Scale Feedforward Neural Network Optimization by a Self-Adaptive Strategy and Parameter Based Particle Swarm Optimization , 2019, IEEE Access.

[15]  Jie Xu,et al.  A new particle swarm optimization algorithm for noisy optimization problems , 2016, Swarm Intelligence.

[16]  Mark Johnston,et al.  Population statistics for particle swarm optimization: Hybrid methods in noisy optimization problems , 2015, Swarm Evol. Comput..

[17]  Jose Luis Fernandez-Marquez,et al.  An evaporation mechanism for dynamic and noisy multimodal optimization , 2009, GECCO.

[18]  Mark Johnston,et al.  Optimal computing budget allocation in particle swarm optimization , 2013, GECCO '13.

[19]  Tag Gon Kim,et al.  6 dof aircraft simulation model capable of handling maneuver events (WIP) , 2016, SummerSim.

[20]  Thomas Bartz-Beielstein,et al.  Particle Swarm Optimization and Sequential Sampling in Noisy Environments , 2007, Metaheuristics.

[21]  Xin-She Yang,et al.  A literature survey of benchmark functions for global optimisation problems , 2013, Int. J. Math. Model. Numer. Optimisation.

[22]  Barry L. Nelson,et al.  A fully sequential procedure for indifference-zone selection in simulation , 2001, TOMC.

[23]  Ling Wang,et al.  Particle swarm optimization for function optimization in noisy environment , 2006, Appl. Math. Comput..

[24]  Jose Luis Fernandez-Marquez,et al.  Adapting Particle Swarm Optimization in dynamic and noisy environments , 2010, IEEE Congress on Evolutionary Computation.

[25]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..