Reduced Jacobian Method

In this paper, we present the Wolfe’s reduced gradient method for multiobjective (multicriteria) optimization. We precisely deal with the problem of minimizing nonlinear objectives under linear constraints and propose a reduced Jacobian method, namely a reduced gradient-like method that does not scalarize those programs. As long as there are nondominated solutions, the principle is to determine a direction that decreases all goals at the same time to achieve one of them. Following the reduction strategy, only a reduced search direction is to be found. We show that this latter can be obtained by solving a simple differentiable and convex program at each iteration. Moreover, this method is conceived to recover both the discontinuous and continuous schemes of Wolfe for the single-objective programs. The resulting algorithm is proved to be (globally) convergent to a Pareto KKT-stationary (Pareto critical) point under classical hypotheses and a multiobjective Armijo line search condition. Finally, experiment results over test problems show a net performance of the proposed algorithm and its superiority against a classical scalarization approach, both in the quality of the approximated Pareto front and in the computational effort.

[1]  Phillipp Kaestner,et al.  Linear And Nonlinear Programming , 2016 .

[2]  Matthias Ehrgott,et al.  Multiple criteria decision analysis: state of the art surveys , 2005 .

[3]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[4]  Juan C. Burguillo,et al.  Explicit gradient information in multiobjective optimization , 2008, Oper. Res. Lett..

[5]  Alfredo N. Iusem,et al.  A Projected Gradient Method for Vector Optimization Problems , 2004, Comput. Optim. Appl..

[6]  B. Bernoussi,et al.  Pareto Optimizing and Kuhn–Tucker Stationary Sequences , 2007 .

[7]  P. Huard CONVERGENCE OF THE REDUCED GRADIENT METHOD , 1975 .

[8]  Christiane Tammer,et al.  Scalarization in Geometric and Functional Vector Optimization Revisited , 2013, J. Optim. Theory Appl..

[9]  L. Armijo Minimization of functions having Lipschitz continuous first partial derivatives. , 1966 .

[10]  Jörg Fliege,et al.  Newton's Method for Multiobjective Optimization , 2009, SIAM J. Optim..

[11]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[12]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[13]  Jörg Fliege,et al.  Steepest descent methods for multicriteria optimization , 2000, Math. Methods Oper. Res..

[14]  P. Siarry,et al.  Multiobjective Optimization: Principles and Case Studies , 2004 .

[15]  Matthias Ehrgott,et al.  Multicriteria Optimization , 2005 .

[16]  João X. da Cruz Neto,et al.  The self regulation problem as an inexact steepest descent method for multicriteria optimization , 2012, European Journal of Operational Research.

[17]  Olvi L. Mangasarian,et al.  Nonlinear Programming , 1969 .

[18]  S. Sinha Methods of nonlinear programming , 2006 .

[19]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[20]  J. Ponstein,et al.  Seven kinds of convexity , 1967 .

[21]  S. Bolintinéanu,et al.  Second-Order Efficiency Conditions and Sensitivity of Efficient Points , 1998 .

[22]  Alfredo N. Iusem,et al.  Proximal Methods in Vector Optimization , 2005, SIAM J. Optim..

[23]  Glaydston de Carvalho Bento,et al.  An Inexact Steepest Descent Method for Multicriteria Optimization on Riemannian Manifolds , 2013, J. Optim. Theory Appl..

[24]  Gabriele Eichfelder,et al.  An Adaptive Scalarization Method in Multiobjective Optimization , 2008, SIAM J. Optim..

[25]  Xiaoqi Yang,et al.  Duality in optimization and variational inequalities , 2002 .

[26]  Jörg Fliege An Efficient Interior-Point Method for Convex Multicriteria Optimization Problems , 2006, Math. Oper. Res..

[27]  S. Bolintinéanu,et al.  Pénalisation dans l'optimisation sur l'ensemble faiblement efficient , 1997 .