Novel hybrid approach with elite group optimal computing budget allocation for the stochastic multimodal problem

Abstract The stochastic multimodal problem commonly arises in the search for efficiency and solution quality in practice. In this study, a hybrid approach is developed for the stochastic multimodal problem. The proposed approach comprises particle swarm optimization (PSO), constriction factor PSO (CPSO), and elite group optimal computing budget allocation (EGOCBA). CPSO or PSO is applied to determine the correct direction in the design space, and EGOCBA is adopted to allocate the appropriate number of samples to each alternative and provide reliable evaluations and identifications to rank particles in the CPSO or PSO procedure. This work improves the searching efficiency of optimal computing budget allocation (OCBA) in the stochastic multimodal problem. Several alternatives referred to as the “elite group,” the performance of which is close to that of the current best solution in each swarm, absorb most of the computing budget of OCBA. However, distinguishing the best solution from the elite group is time consuming because of the various local and global optima in the stochastic multimodal problem. Therefore, this study proposes EGOCBA that avoids extra computing costs for the elite group by implementing a new selection procedure. This EGOCBA reserves all the solutions of the elite group and filters them to form an optimal set that contains all the best solutions having an equal mean performance without a significant difference. These tasks are achieved through a confidence interval test in the end of the algorithm. The optimal set can provide more than one best solution to support multiple decisions depending on different decision variables. Two experiments are conducted on stochastic multimodal optimization problem and stochastic resource allocation problem. Experimental results reveal the efficiency and effectiveness of the proposed approach in deriving multiple optimal solutions in a multimodal class and stochastic environment.

[1]  Xiaodong Li,et al.  A dynamic archive niching differential evolution algorithm for multimodal optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[2]  Talal M. Alkhamis,et al.  Simulation optimization for an emergency department healthcare unit in Kuwait , 2009, Eur. J. Oper. Res..

[3]  A. Tamhane.  Design and Analysis of Experiments for Statistical Selection, Screening, and Multiple Comparisons , 1995 .

[4]  Peng-Yeng Yin,et al.  A particle swarm optimization approach to the nonlinear resource allocation problem , 2006, Appl. Math. Comput..

[5]  Winston Khoon Guan Seah,et al.  A performance study on the effects of noise and evaporation in Particle Swarm Optimization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[6]  Jun Tang,et al.  A Hybrid Particle Swarm Optimization with Adaptive Local Search , 2010, J. Networks.

[7]  Mahdi Eftekhari,et al.  Using a self-adaptive neighborhood scheme with crowding replacement memory in genetic algorithm for multimodal optimization , 2013, Swarm Evol. Comput..

[8]  H. T. Papadopoulos,et al.  A heuristic algorithm for the buffer allocation in unreliable unbalanced production lines , 2001 .

[9]  Hong Wang,et al.  Adaptive comprehensive learning bacterial foraging optimization and its application on vehicle routing problem with time windows , 2015, Neurocomputing.

[10]  S. Dalal,et al.  ALLOCATION OF OBSERVATIONS IN RANKING AND SELECTION WITH UNEQUAL VARIANCES , 1971 .

[11]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[12]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[13]  Loo Hay Lee,et al.  Simulation optimization using the cross-entropy method with optimal computing budget allocation , 2010, TOMC.

[14]  Chun-Hung Chen,et al.  A Review of Optimal Computing Budget Allocation Algorithms for Simulation Optimization Problem , 2010 .

[15]  James T. Lin,et al.  Simulation optimization approach for hybrid flow shop scheduling problem in semiconductor back-end manufacturing , 2015, Simul. Model. Pract. Theory.

[16]  Shudong Sun,et al.  Optimal Computing Budget Allocation for Ordinal Optimization in Solving Stochastic Job Shop Scheduling Problems , 2014 .

[17]  James Kennedy,et al.  Bare bones particle swarms , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[18]  Loo Hay Lee,et al.  Stochastic Simulation Optimization - An Optimal Computing Budget Allocation , 2010, System Engineering and Operations Research.

[19]  Jürgen Branke,et al.  Selecting a Selection Procedure , 2007, Manag. Sci..

[20]  Swagatam Das,et al.  Multimodal optimization by artificial weed colonies enhanced with localized group search optimizers , 2013, Appl. Soft Comput..

[21]  Ling Wang,et al.  Particle swarm optimization for function optimization in noisy environment , 2006, Appl. Math. Comput..

[22]  Stephen E. Chick,et al.  New Two-Stage and Sequential Procedures for Selecting the Best Simulated System , 2001, Oper. Res..

[23]  Hossein Nezamabadi-pour,et al.  A gravitational search algorithm for multimodal optimization , 2014, Swarm Evol. Comput..

[24]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[25]  Jing J. Liang,et al.  Niching particle swarm optimization with local search for multi-modal optimization , 2012, Inf. Sci..

[26]  Jin Liu,et al.  A particle swarm optimization using local stochastic search and enhancing diversity for continuous optimization , 2014, Neurocomputing.

[27]  James T. Lin,et al.  A simulation-based optimization approach for a semiconductor photobay with automated material handling system , 2014, Simul. Model. Pract. Theory.

[28]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[29]  Hao Yin,et al.  Crisscross optimization algorithm and its application , 2014, Knowl. Based Syst..

[30]  Mark Johnston,et al.  Population statistics for particle swarm optimization: Single-evaluation methods in noisy optimization problems , 2015, Soft Comput..

[31]  Y. Rinott.  On two-stage selection procedures and related probability-inequalities , 1978 .

[32]  Barry L. Nelson,et al.  Selecting the best system: theory and methods , 2003, Proceedings of the 2003 Winter Simulation Conference, 2003..

[33]  Chien-Ming Chen,et al.  Simulation optimization with PSO and OCBA for semiconductor back-end assembly , 2013 .

[34]  James T. Lin,et al.  A hybrid particle swarm optimization with local search for stochastic resource allocation problem , 2018, J. Intell. Manuf..

[35]  Mark Johnston,et al.  Optimal computing budget allocation in particle swarm optimization , 2013, GECCO '13.

[36]  Erik Valdemar Cuevas Jiménez,et al.  An optimization algorithm for multimodal functions inspired by collective animal behavior , 2013, Soft Comput..

[37]  Swagatam Das,et al.  An improved particle swarm optimizer with difference mean based perturbation , 2014, Neurocomputing.

[38]  Leyuan Shi,et al.  Stochastic discrete resource allocation optimization , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[39]  Shengxiang Yang,et al.  A memetic particle swarm optimization algorithm for multimodal optimization problems , 2011, 2011 Chinese Control and Decision Conference (CCDC).

[40]  Jing J. Liang,et al.  Differential evolution based on fitness Euclidean-distance ratio for multimodal optimization , 2014, Neurocomputing.

[41]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..