Numerical Experience with a Reduced Hessian Method for Large Scale Constrained Optimization

The reduced Hessian SQP algorithm presented in Biegler et al. [SIAM J. Optimization, Vol. 5, no. 2, pp. 314–347, 1995.] is developed in this paper into a practical method for large-scale optimization. The novelty of the algorithm lies in the incorporation of a correction vector that approximates the cross term ZTWYpY. This improves the stability and robustness of the algorithm without increasing its computational cost. The paper studies how to implement the algorithm efficiently, and presents a set of tests illustrating its numerical performance. An analytic example, showing the benefits of the correction term, is also presented.

[1]  A. Conn.  Constrained Optimization Using a Nondifferentiable Penalty Function , 1973 .

[2]  Roger Fletcher,et al.  An exact penalty function for nonlinear programming with inequalities , 1973, Math. Program..

[3]  J. J. Moré,et al.  A Characterization of Superlinear Convergence and its Application to Quasi-Newton Methods , 1973 .

[4]  Shih-Ping Han.  A globally convergent method for nonlinear programming , 1975 .

[5]  M. J. D. Powell,et al.  THE CONVERGENCE OF VARIABLE METRIC METHODS FOR NONLINEARLY CONSTRAINED OPTIMIZATION CALCULATIONS , 1978 .

[6]  Klaus Schittkowski,et al.  Test examples for nonlinear programming codes , 1980 .

[7]  Klaus Schittkowski,et al.  More test examples for nonlinear programming codes , 1981 .

[8]  Philip E. Gill,et al.  Practical optimization , 1981 .

[9]  P. Boggs,et al.  On the Local Convergence of Quasi-Newton Methods for Constrained Optimization , 1982 .

[10]  D. Gabay.  Reduced quasi-Newton methods with feasibility improvement for nonlinearly constrained optimization , 1982 .

[11]  Andrew R. Conn,et al.  Nonlinear programming via an exact penalty function: Asymptotic analysis , 1982, Math. Program..

[12]  C. Lemaréchal,et al.  The watchdog technique for forcing convergence in algorithms for constrained optimization , 1982 .

[13]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[14]  T. Coleman,et al.  On the Local Convergence of a Quasi-Newton Method for the Nonlinear Programming Problem , 1984 .

[15]  Richard H Byrd,et al.  On the convergence of constrained optimization methods with accurate Hessian information on a subspace , 1990 .

[16]  Richard H. Byrd,et al.  An example of irregular convergence in some constrained optimization methods that use the projected hessian , 1985, Math. Program..

[17]  Ya-Xiang Yuan,et al.  An only 2-step Q-superlinear convergence example for some algorithms that use reduced hessian approximations , 1985, Math. Program..

[18]  Anderas Griewank.  The “global” convergence of Broyden-like methods with suitable line search , 1986, The Journal of the Australian Mathematical Society. Series B. Applied Mathematics.

[19]  J. Nocedal,et al.  Global Convergence of a Class of Quasi-newton Methods on Convex Problems, Siam Some Global Convergence Properties of a Variable Metric Algorithm for Minimization without Exact Line Searches, Nonlinear Programming, Edited , 1996 .

[20]  I. Duff,et al.  Direct Methods for Sparse Matrices , 1987 .

[21]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[22]  L. Biegler,et al.  Large-scale decomposition for successive quadratic programming , 1988 .

[23]  Jean Charles Gilbert,et al.  On the local and global convergence of a reduced Quasi-Newton method1 , 1989 .

[24]  J. Nocedal,et al.  A tool for the analysis of Quasi-Newton methods with application to unconstrained minimization , 1989 .

[25]  E. Omojokun.  Trust region algorithms for optimization with nonlinear equality and inequality constraints , 1990 .

[26]  Jean Charles Gilbert.  Maintaining the positive definiteness of the matrices in reduced secant methods for equality constrained optimization , 1991, Math. Program..

[27]  Jorge Nocedal,et al.  An analysis of reduced Hessian methods for constrained optimization , 1991, Math. Program..

[28]  S. K. Eldersveld.  Large-scale sequential quadratic programming algorithms , 1992 .

[29]  Thomas F. Coleman,et al.  Partitioned quasi-Newton methods for nonlinear equality constrained optimization , 1992, Math. Program..

[30]  L. Biegler.  Optimization Strategies for Complex Process Models , 1992 .

[31]  Yuanfu Xie.  Reduced Hessian algorithms for solving large-scale equality constrained optimization problems , 1992 .

[32]  L. Biegler,et al.  Quadratic programming methods for tailored reduced Hessian SQP , 1993 .

[33]  André L. Tits,et al.  On combining feasibility, descent and superlinear convergence in inequality constrained optimization , 1993, Math. Program..

[34]  J. Betts,et al.  A sparse nonlinear optimization algorithm , 1994 .

[35]  Chaya Gurwitz.  Local Convergence of a Two-Piece Update of a Projected Hessian Matrix , 1994, SIAM J. Optim..

[36]  L. Biegler,et al.  Quadratic programming methods for reduced Hessian SQP , 1994 .

[37]  Jorge Nocedal,et al.  Representations of quasi-Newton matrices and their use in limited memory methods , 1994, Math. Program..

[38]  Francisco J. Prieto,et al.  A Sequential Quadratic Programming Algorithm Using an Incomplete Solution of the Subproblem , 1995, SIAM J. Optim..

[39]  Jorge Nocedal,et al.  A Reduced Hessian Method for Large-Scale Constrained Optimization , 1995, SIAM J. Optim..

[40]  L. Biegler,et al.  Stable Decomposition for Dynamic Optimization , 1995 .

[41]  Nicholas I. M. Gould,et al.  CUTE: constrained and unconstrained testing environment , 1995, TOMS.

[42]  Philippe L. Toint,et al.  An Assessment of Nonmonotone Linesearch Techniques for Unconstrained Optimization , 1996, SIAM J. Sci. Comput..

[43]  Jorge Nocedal,et al.  On the Implementation of an Algorithm for Large-Scale Equality Constrained Optimization , 1998, SIAM J. Optim..

[44]  L. Biegler,et al.  Recent improvements to a multiplier-free reduced Hessian successive quadratic programming algorithm , 1998 .

[45]  Paul T. Boggs,et al.  A Practical Algorithm for General Large Scale Nonlinear Optimization Problems , 1999, SIAM J. Optim..