Multi-Objective Particle Swarm Optimization for robust optimization and its hybridization with gradient search

This paper proposes an algorithm using Multi-objective Particle Swarm Optimization (MOPSO) for finding robust solutions against small perturbations of design variables. If an optimal solution is sensitive to small perturbations of variables, it may be inappropriate or risky for practical use. Robust optimization finds solutions which are moderately good in terms of optimality and also good in terms of robustness against small perturbations of variables. The proposed algorithm formulates robust optimization as a bi-objective optimization problem, and finds robust solutions by searching for Pareto solutions of the bi-objective problem. This paper also proposes a hybridization of MOPSO and quasi-Newton method as an attempt to design effective memetic algorithm for robust optimization. Experimental results have shown that the proposed algorithms could find robust solutions effectively. The advantage and drawback of the hybridization were also clarified by the experiments, helping design an effective memetic algorithm for robust optimization.

[1]  Benjamin W. Wah,et al.  Scheduling of Genetic Algorithms in a Noisy Environment , 1994, Evolutionary Computation.

[2]  Riccardo Poli,et al.  New ideas in optimization , 1999 .

[3]  Carlos A. Coello Coello,et al.  A particle swarm optimizer for multi-objective optimization , 2005 .

[4]  James Smith,et al.  A tutorial for competent memetic algorithms: model, taxonomy, and design issues , 2005, IEEE Transactions on Evolutionary Computation.

[5]  Michael N. Vrahatis,et al.  Memetic particle swarm optimization , 2007, Ann. Oper. Res..

[6]  Duško Pavletić,et al.  Application of Six Sigma methodology for process design , 2005 .

[7]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[8]  Min Gui,et al.  Adding Local Search to Particle Swarm Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[9]  Jürgen Branke,et al.  Evolutionary Optimization in Dynamic Environments , 2001, Genetic Algorithms and Evolutionary Computation.

[10]  Kazuyuki Mori,et al.  Application of an immune algorithm to multi-optimization problems , 1998 .

[11]  Hisao Ishibuchi,et al.  Balance between genetic search and local search in memetic algorithms for multiobjective permutation flowshop scheduling , 2003, IEEE Trans. Evol. Comput..

[12]  Shigenobu Kobayashi,et al.  GA Based on the UV-Structure Hypothesis and Its Application to JSP , 2000, PPSN.

[13]  Jürgen Branke,et al.  Creating Robust Solutions by Means of Evolutionary Algorithms , 1998, PPSN.

[14]  Hartmut Schmeck,et al.  Designing evolutionary algorithms for dynamic optimization problems , 2003 .

[15]  J. Fieldsend.  Multi-Objective Particle Swarm Optimisation Methods , 2004 .

[16]  Wu Li,et al.  Aerospace applications of optimization under uncertainity , 2003, Fourth International Symposium on Uncertainty Modeling and Analysis, 2003. ISUMA 2003..

[17]  J. Fitzpatrick,et al.  Genetic Algorithms in Noisy Environments , 2005, Machine Learning.

[18]  Shigeru Nakayama,et al.  Multiple solution search based on hybridization of real-coded evolutionary algorithm and quasi-newton method , 2007, 2007 IEEE Congress on Evolutionary Computation.

[19]  Jim Smith,et al.  A Memetic Algorithm With Self-Adaptive Local Search: TSP as a case study , 2000, GECCO.

[20]  Peter Stagge,et al.  Averaging Efficiently in the Presence of Noise , 1998, PPSN.

[21]  Zoran Filipi,et al.  Robust Optimization of an Automotive Valvetrain Using a Multiobjective Genetic Algorithm , 2003, DAC 2003.

[22]  Kay Chen Tan,et al.  A Multiobjective Memetic Algorithm Based on Particle Swarm Optimization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  Carlos A. Coello Coello,et al.  Use of Emulations of the Immune System to Handle Constraints in Evolutionary Algorithms , 2001 .

[24]  Masao Fukushima,et al.  Robust portfolio selection with uncertain exit time using worst-case VaR strategy , 2007, Oper. Res. Lett..

[25]  下山 幸治,et al.  Robust Aerodynamic Design of Mars Exploratory Airplane Wing: With a New Optimization Method , 2010 .

[26]  T. Ray.  Constrained robust optimal design using a multiobjective evolutionary algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[27]  Hiroaki Kobayashi,et al.  Development of realistic optimization method of TSTO spaceplane - Multi-objective and robust optimization , 2004 .

[28]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[29]  Hajime Kita,et al.  Optimization of Noisy Fitness Functions by Means of Genetic Algorithms Using History of Search , 2000, PPSN.

[30]  R. K. Ursem.  Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[31]  Bernhard Sendhoff,et al.  Trade-Off between Performance and Robustness: An Evolutionary Multiobjective Approach , 2003, EMO.

[32]  Hajime Kita,et al.  Optimization of noisy fitness functions by means of genetic algorithms using history of search with test of estimation , 2000, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[33]  Hisao Ishibuchi,et al.  Use of biased neighborhood structures in multiobjective memetic algorithms , 2009, Soft Comput..

[34]  Sharon L. Padula,et al.  Aerospace applications of optimization under uncertainty , 2006 .

[35]  Patrick N. Koch,et al.  PROBABILISTIC DESIGN: OPTIMIZING FOR SIX SIGMA QUALITY , 2002 .

[36]  Thomas Bäck,et al.  Evolution Strategies on Noisy Functions: How to Improve Convergence Properties , 1994, PPSN.

[37]  Konstantinos G. Margaritis,et al.  Performance comparison of memetic algorithms , 2004, Appl. Math. Comput..

[38]  M. Fukushima,et al.  Minimizing multimodal functions by simplex coding genetic algorithm , 2003 .

[39]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[40]  Greg Brue,et al.  Design for Six Sigma , 2005 .

[41]  Manoj Kumar Tiwari,et al.  Multiobjective Particle Swarm Algorithm With Fuzzy Clustering for Electrical Power Dispatch , 2008, IEEE Transactions on Evolutionary Computation.

[42]  S. Nakayama,et al.  A Hybrid Algorithm of Immune Algorithm and Gradient Search for Multiple Solution Search , 2007, Second International Conference on Innovative Computing, Informatio and Control (ICICIC 2007).

[43]  John J. Grefenstette,et al.  Genetic Algorithms for Changing Environments , 1992, PPSN.