Robust optimization using Bayesian optimization algorithm: Early detection of non-robust solutions

Abstract Probabilistic robustness evaluation is a promising approach to evolutionary robust optimization; however, high computational time arises. In this paper, we apply this approach to the Bayesian optimization algorithm (BOA) with a view to improving its computational time. To this end, we analyze the Bayesian networks constructed in BOA in order to extract the patterns of non-robust solutions. In each generation, the solutions that match the extracted patterns are detected and then discarded from the process of evaluation; therefore, the computational time in discovering the robust solutions decreases. The experimental results demonstrate that our proposed method reduces computational time, while increasing the robustness of solutions.

[1]  Jürgen Branke,et al.  Creating Robust Solutions by Means of Evolutionary Algorithms , 1998, PPSN.

[2]  Peter J. Fleming,et al.  Active Robust Optimization: Enhancing Robustness to Uncertain Environments , 2014, IEEE Transactions on Cybernetics.

[3]  Tapabrata Ray,et al.  Practical Robust Design Optimization Using Evolutionary Algorithms , 2011 .

[4]  Marjan Kaedi,et al.  Holographic memory-based Bayesian optimization algorithm (HM-BOA) in dynamic environments , 2013, Science China Information Sciences.

[5]  Kay Chen Tan,et al.  Evolving the Tradeoffs between Pareto-Optimality and Robustness in Multi-Objective Evolutionary Algorithms , 2007, Evolutionary Computation in Dynamic and Uncertain Environments.

[6]  Kalyanmoy Deb,et al.  Multimodal Deceptive Functions , 1993, Complex Syst..

[7]  G. Hommel.  A stagewise rejective multiple test procedure based on a modified Bonferroni test , 1988 .

[8]  Jürgen Branke,et al.  Embedded evolutionary multi-objective optimization for worst case robustness , 2008, GECCO '08.

[9]  Yaochu Jin,et al.  Surrogate-assisted evolutionary computation: Recent advances and future challenges , 2011, Swarm Evol. Comput..

[10]  António Gaspar-Cunha,et al.  Evolutionary robustness analysis for multi-objective optimization: benchmark problems , 2013, Structural and Multidisciplinary Optimization.

[11]  Qing Ling,et al.  Deterministic Robust Optimal Design Based on Standard Crowding Genetic Algorithm , 2007, Evolutionary Computation in Dynamic and Uncertain Environments.

[12]  Thomas Bäck,et al.  Robust design of multilayer optical coatings by means of evolutionary algorithms , 1998, IEEE Trans. Evol. Comput..

[13]  Tapabrata Ray,et al.  Towards practical evolutionary robust multi-objective optimization , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[14]  Shapour Azarm,et al.  New Approximation Assisted Multi-objective collaborative Robust Optimization (new AA-McRO) under interval uncertainty , 2013 .

[15]  Peter J. F. Lucas,et al.  Advances in Probabilistic Graphical Models , 2008 .

[16]  Andy J. Keane,et al.  Robust-Optimal Design of a Lightweight Space Structure Using a Genetic Algorithm , 2003 .

[17]  Bernhard Sendhoff,et al.  Evolution by Adapting Surrogates , 2013, Evolutionary Computation.

[18]  Marjan Kaedi,et al.  Biasing the transition of Bayesian optimization algorithm between Markov chain states in dynamic environments , 2016, Inf. Sci..

[19]  Carlos M. Fonseca,et al.  Evolutionary Multi-Objective Robust Optimization , 2008 .

[20]  S. Azarm,et al.  Multi-Objective Robust Optimization Under Interval Uncertainty Using Online Approximation and Constraint Cuts , 2011 .

[21]  Kay Chen Tan,et al.  Evolving Robust Routes , 2009 .

[22]  Jürgen Branke,et al.  Multi-objective worst case optimization by means of evolutionary algorithms , 2013 .

[23]  Adrian Thompson,et al.  On the Automatic Design of Robust Electronics Through Artificial Evolution , 1998, ICES.

[24]  S. Ranji Ranjithan,et al.  Chance-Constrained Optimization Using Genetic Algorithms: An Application in Air Quality Management , 2001 .

[25]  Carlos Henggeler Antunes,et al.  An Evolutionary Approach for Assessing the Degree of Robustness of Solutions to Multi-Objective Models , 2007, Evolutionary Computation in Dynamic and Uncertain Environments.

[26]  Raymond Chiong,et al.  Evolutionary Optimization: Pitfalls and Booby Traps , 2012, Journal of Computer Science and Technology.

[27]  Jürgen Branke.  Searching for Robust Solutions , 2002 .

[28]  Martin Pelikan,et al.  Hierarchical Bayesian optimization algorithm: toward a new generation of evolutionary algorithms , 2010, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[29]  Jorge Maturana,et al.  Robust Optimization by Means of Vegetative Reproduction , 2011, ICAIS.

[30]  Yaochu Jin,et al.  Single/Multi-objective Inverse Robust Evolutionary Design Methodology in the Presence of Uncertainty , 2007, Evolutionary Computation in Dynamic and Uncertain Environments.

[31]  Shengxiang Yang,et al.  Evolutionary Computation in Dynamic and Uncertain Environments , 2007, Studies in Computational Intelligence.

[32]  Shengxiang Yang,et al.  Environment identification-based memory scheme for estimation of distribution algorithms in dynamic environments , 2011, Soft Comput..

[33]  Jürgen Branke,et al.  Efficient search for robust solutions by means of evolutionary algorithms and fitness approximation , 2006, IEEE Transactions on Evolutionary Computation.

[34]  G. Hommel.  Multiple test procedures for arbitrary dependence structures , 1986 .

[35]  Dmytro Rostyslavovych Ushakov.  Saturation influence of the induction motor magnetic system on the current spectrum powered by a pulsed voltage source , 2016 .

[36]  Xin Yao,et al.  A framework for finding robust optimal solutions over time , 2013, Memetic Comput..

[37]  H. Greiner.  Robust optical coating design with evolutionary strategies. , 1996, Applied optics.

[38]  S. L. Ho,et al.  A Fast Robust Optimization Methodology Based on Polynomial Chaos and Evolutionary Algorithm for Inverse Problems , 2012, IEEE Transactions on Magnetics.

[39]  David E. Goldberg,et al.  Bayesian Optimization Algorithm: From Single Level to Hierarchy , 2002 .

[40]  S. Ranji Ranjithan,et al.  Chance-constrained genetic algorithms , 1999 .