An Augmented Lagrangian Method for a Class of Inverse Quadratic Programming Problems

AbstractWe consider an inverse quadratic programming (QP) problem in which the parameters in the objective function of a given QP problem are adjusted as little as possible so that a known feasible solution becomes the optimal one. We formulate this problem as a minimization problem with a positive semidefinite cone constraint and its dual is a linearly constrained semismoothly differentiable (SC1) convex programming problem with fewer variables than the original one. We demonstrate the global convergence of the augmented Lagrangian method for the dual problem and prove that the convergence rate of primal iterates, generated by the augmented Lagrange method, is proportional to 1/r, and the rate of multiplier iterates is proportional to  $1/\sqrt{r}$ , where r is the penalty parameter in the augmented Lagrangian. As the objective function of the dual problem is a SC1 function involving the projection operator onto the cone of symmetrically semi-definite matrices, the analysis requires extensive tools such as the singular value decomposition of matrices, an implicit function theorem for semismooth functions, and properties of the projection operator in the symmetric-matrix space. Furthermore, the semismooth Newton method with Armijo line search is applied to solve the subproblems in the augmented Lagrange approach, which is proven to have global convergence and local quadratic rate. Finally numerical results, implemented by the augmented Lagrangian method, are reported.

[1]  Ravindra K. Ahuja,et al.  Inverse Optimization , 2001, Oper. Res..

[2]  Kim-Chuan Toh,et al.  A Newton-CG Augmented Lagrangian Method for Semidefinite Programming , 2010, SIAM J. Optim..

[3]  R. Tyrrell Rockafellar,et al.  A dual approach to solving nonlinear programming problems by unconstrained optimization , 1973, Math. Program..

[4]  J. Hiriart-Urruty,et al.  Convex analysis and minimization algorithms , 1993 .

[5]  Clemens Heuberger,et al.  Inverse Combinatorial Optimization: A Survey on Problems, Methods, and Results , 2004, J. Comb. Optim..

[6]  Dan Rosen,et al.  The practice of portfolio replication. A practical overview of forward and inverse problems , 1999, Ann. Oper. Res..

[7]  Defeng Sun,et al.  The rate of convergence of the augmented Lagrangian method for nonlinear semidefinite programming , 2008, Math. Program..

[8]  Philippe L. Toint,et al.  On an instance of the inverse shortest paths problem , 1992, Math. Program..

[9]  R. Rockafellar The multiplier method of Hestenes and Powell applied to convex programming , 1973 .

[10]  A. Shapiro On concepts of directional differentiability , 1990 .

[11]  Ravindra K. Ahuja,et al.  Combinatorial algorithms for inverse network flow problems , 2002, Networks.

[12]  Jianzhong Zhang,et al.  Solution Structure of Some Inverse Combinatorial Optimization Problems , 1999, J. Comb. Optim..

[13]  Jérôme Malick,et al.  A Dual Approach to Semidefinite Least-Squares Problems , 2004, SIAM J. Matrix Anal. Appl..

[14]  J. Hiriart-Urruty,et al.  Generalized Hessian matrix and second-order optimality conditions for problems withC1,1 data , 1984 .

[15]  Jianzhon Zhang,et al.  A further study on inverse linear programming problems , 1999 .

[16]  Scott M. Carr,et al.  The Inverse Newsvendor Problem: Choosing an Optimal Demand Portfolio for Capacitated Resources , 2000 .

[17]  E. G. Golʹshteĭn,et al.  Modified Lagrangians and monotone maps in optimization , 1996 .

[18]  R. Rockafellar Conjugate Duality and Optimization , 1987 .

[19]  Defeng Sun,et al.  Semismooth Matrix-Valued Functions , 2002, Math. Oper. Res..

[20]  F. Clarke Optimization And Nonsmooth Analysis , 1983 .

[21]  R. Mifflin Semismooth and Semiconvex Functions in Constrained Optimization , 1977 .

[22]  Francisco Facchinei,et al.  Minimization of SC1 functions and the Maratos effect , 1995, Oper. Res. Lett..

[23]  Rainer E. Burkard,et al.  Weight reduction problems with certain bottleneck objectives , 2004, Eur. J. Oper. Res..

[24]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[25]  Liqun Qi,et al.  A nonsmooth version of Newton's method , 1993, Math. Program..

[26]  Jianzhon Zhang,et al.  Calculating some inverse linear programming problems , 1996 .

[27]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[28]  Garud Iyengar,et al.  Inverse conic programming with applications , 2005, Oper. Res. Lett..

[29]  Mao-cheng Cai,et al.  The Complexity Analysis of the Inverse Center Location Problem , 1999, J. Glob. Optim..