Local search for multiobjective function optimization: pareto descent method

Genetic Algorithm (GA) is known as a potent multiobjective optimization method, and the effectiveness of hybridizing it with local search (LS) has recently been reported in the literature. However, there is a relatively small number of studies on LS methods for multiobjective function optimization. Although each of the existing LS methods has some strong points, they have respective drawbacks such as high computational cost and inefficiency in improving objective functions. Hence, a more effective and efficient LS method is being sought, which can be used to enhance the performance of the hybridization.Defining Pareto descent directions as descent directions to which no other descent directions are superior in improving all objective functions, this paper proposes a new LS method, Pareto Descent Method (PDM), which finds Pareto descent directions and moves solutions in such directions thereby improving all objective functions simultaneously. In the case part or all of them are infeasible, it finds feasible Pareto descent directions or descent directions as appropriate. PDM finds these directions by solving linear programming problems, which is computationally inexpensive. Experiments have shown PDM's superiority over existing methods.

[1]  Enrique Alba,et al.  AbYSS: Adapting Scatter Search to Multiobjective Optimization , 2008, IEEE Transactions on Evolutionary Computation.

[2]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[3]  Lothar Thiele,et al.  A Tutorial on the Performance Assessment of Stochastic Multiobjective Optimizers , 2006 .

[4]  Peter A. N. Bosman,et al.  Exploiting gradient information in numerical multi--objective evolutionary optimization , 2005, GECCO '05.

[5]  Martin Brown,et al.  Directed Multi-Objective Optimization , 2005, Int. J. Comput. Syst. Signals.

[6]  Manuel López-Ibáñez,et al.  On the design and analysis of SLS algorithms for multiobjective combinatorial optimization problems , 2005 .

[7]  Marc Schoenauer,et al.  Dominance Based Crossover Operator for Evolutionary Multi-objective Algorithms , 2004, PPSN.

[8]  G. Winter,et al.  Single and multiobjective frame optimization by evolutionary algorithms and the auto-adaptive rebirth operator , 2004 .

[9]  Hisao Ishibuchi,et al.  Some Issues on the Implementation of Local Search in Evolutionary Multiobjective Optimization , 2004, GECCO.

[10]  Joshua D. Knowles,et al.  Memetic Algorithms for Multiobjective Optimization: Issues, Methods and Prospects , 2004 .

[11]  Proceedings Seventh International Conference on Document Analysis and Recognition , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[12]  Luiz Eduardo Soares de Oliveira,et al.  Automatic Recognition of Handwritten Numerical Strings: A Recognition and Verification Strategy , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Marc Parizeau,et al.  Genetic engineering of handwriting representations , 2002, Proceedings Eighth International Workshop on Frontiers in Handwriting Recognition.

[14]  K. Deb,et al.  Hybrid methods for multi-objective evolutionary algorithms , 2002 .

[15]  Marco Laumanns,et al.  Mutation Control and Convergence in Evolutionary Multi-Object Optimization , 2001 .

[16]  Venu Govindaraju,et al.  Active Handwritten Character Recognition Using Genetic Programming , 2001, EuroGP.

[17]  Kalyanmoy Deb,et al.  Controlled Elitist Non-dominated Sorting Genetic Algorithms for Better Convergence , 2001, EMO.

[18]  Erick Cantú-Paz,et al.  Efficient and Accurate Parallel Genetic Algorithms , 2000, Genetic Algorithms and Evolutionary Computation.

[19]  Clifford Stein,et al.  Introduction to Algorithms, 2nd edition. , 2001 .

[20]  Jörg Fliege,et al.  Steepest descent methods for multicriteria optimization , 2000, Math. Methods Oper. Res..

[21]  Joshua D. Knowles,et al.  M-PAES: a memetic algorithm for multiobjective optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[22]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[23]  David Greiner,et al.  MULTIOBJECTIVE OPTIMIZATION OF BAR STRUCTURES BY PARETO-GA , 2000 .

[24]  D. V,et al.  ZONING DESIGN FOR HAND­WRITTEN NUMERAL RECOGNITION , 1997 .

[25]  Anil K. Jain,et al.  Feature extraction methods for character recognition-A survey , 1996, Pattern Recognit..

[26]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[27]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[28]  W. Gellert,et al.  The VNR concise encyclopedia of mathematics , 1977 .