Exact Penalty Methods

Exact penalty methods for the solution of constrained optimization problems are based on the construction of a function whose unconstrained minilnizing points are also solution of the constrained problem. In the first part of this paper we recall some definitions concerning exactness properties of penalty functions, of barrier functions, of augmented Lagrangian functions, and discuss under which assumptions on the constrained problem these properties can be ensured. In the second part of the paper we consider algorithmic aspects of exact penalty methods; in particular we show that, by making use of continuously differentiable functions that possess exactness properties, it is possible to define implementable algorithms that are globally convergent with superlinear convergence rate towards KKT points of the constrained problem.

[1]  James V. Burke,et al.  Calmness and exact penalization , 1991 .

[2]  Masao Fukushima,et al.  A successive quadratic programming algorithm with global and superlinear convergence properties , 1986, Math. Program..

[3]  Andrew R. Conn,et al.  Nonlinear programming via an exact penalty function: Asymptotic analysis , 1982, Math. Program..

[4]  Stefano Lucidi,et al.  An exact penalty-lagrangian approach for a class of constrained optimization problems with bounded variables , 1993 .

[5]  N. Maratos,et al.  Exact penalty function algorithms for finite dimensional and control optimization problems , 1978 .

[6]  L. Grippo,et al.  A New Class of Augmented Lagrangians in Nonlinear Programming , 1979 .

[7]  T. Steihaug,et al.  A Convergence Theory for a Class of Quasi-Newton Methods for Constrained Optimization , 1987 .

[8]  James V. Burke,et al.  A robust sequential quadratic programming method , 1989, Math. Program..

[9]  Jon W. Tolle,et al.  Exact penalty functions in nonlinear programming , 1973, Math. Program..

[10]  Torkel Glad,et al.  A multiplier method with automatic limitation of penalty growth , 1979, Math. Program..

[11]  Stefano Lucidi,et al.  New Results on a Continuously Differentiable Exact Penalty Function , 1992, SIAM J. Optim..

[12]  L. Grippo,et al.  A class of methods for the solution of optimization problems with inequalities , 1982 .

[13]  W. Zangwill.  Non-Linear Programming Via Penalty Functions , 1967 .

[14]  R. Fletcher.  NUMERICAL EXPERIMENTS WITH AN EXACT L1 PENALTY FUNCTION METHOD , 1981 .

[15]  Eric Rosenberg,et al.  Exact penalty functions and stability in locally Lipschitz programming , 1984, Math. Program..

[16]  Elijah Polak,et al.  On the global stabilization of locally convergent algorithms , 1976, Autom..

[17]  J. F. Bonnans.  Théorie de la pénalisation exacte , 1990 .

[18]  Luigi Grippo,et al.  On the exactness of a class of nondifferentiable penalty functions , 1988 .

[19]  J. Burke.  An exact penalization viewpoint of constrained optimization , 1991 .

[20]  S. Lucidi,et al.  A Class of penalty functions for optimization problema with bound constraints , 1992 .

[21]  G. Contaldi,et al.  A continuously differentiable exact penalty function for nonlinear programming problems with unbounded feasible set , 1993, Oper. Res. Lett..

[22]  Ya-Xiang Yuan,et al.  A trust region algorithm for equality constrained optimization , 1990, Math. Program..

[23]  Martin Grötschel,et al.  Mathematical Programming The State of the Art, XIth International Symposium on Mathematical Programming, Bonn, Germany, August 23-27, 1982 , 1983, ISMP.

[24]  A. Conn.  Constrained Optimization Using a Nondifferentiable Penalty Function , 1973 .

[25]  L. Grippo,et al.  Exact penalty functions in constrained optimization , 1989 .

[26]  D. Gabay.  Reduced quasi-Newton methods with feasibility improvement for nonlinearly constrained optimization , 1982 .

[27]  Stefano Lucidi.  On the role of continuously differentiable exact penalty functions in constrained global optimization , 1994, J. Glob. Optim..

[28]  Francisco Facchinei,et al.  An RQP algorithm using a differentiable exact penalty function for inequality constrained problems , 1992, Math. Program..

[29]  J. Henry,et al.  System Modelling and Optimization: Proceedings of the 16th IFIP-TC7 Conference, Compiègne, France, July 5-9, 1993 , 1994, System Modelling and Optimization.

[30]  F. Facchinei,et al.  Exact barrier function methods for Lipschitz programs , 1995 .

[31]  T. Pietrzykowski,et al.  A Penalty Function Method Converging Directly to a Constrained Optimum , 1977 .

[32]  E. Polak.  On The Global Stabilization of Locally Convergent Algorithms for Optimization and Root Finding , 1975 .

[33]  Luigi Grippo,et al.  A smooth method for the finite minimax problem , 1993, Math. Program..

[34]  T. Pietrzykowski.  An Exact Potential Method for Constrained Maxima , 1969 .

[35]  M. Bazaraa,et al.  Sufficient conditions for a globally exact penalty function without convexity , 1982 .

[36]  Dimitri P. Bertsekas,et al.  Necessary and sufficient conditions for a penalty method to be exact , 1975, Math. Program..

[37]  Shih-Ping Han.  A globally convergent method for nonlinear programming , 1975 .

[38]  Luigi Grippo,et al.  Globally convergent exact penalty algorithms for constrained optimization , 1986 .

[39]  B. N. Pshenichnyi,et al.  Numerical Methods in Extremal Problems. , 1978 .

[40]  F. Clarke.  Optimization And Nonsmooth Analysis , 1983 .

[41]  Salvador Pintos,et al.  On differentiable exact penalty functions , 1986 .

[42]  D. Bertsekas.  Enlarging the region of convergence of Newton's method for constrained optimization , 1982 .

[43]  K. Schittkowski.  The nonlinear programming method of Wilson, Han, and Powell with an augmented Lagrangian type line search function , 1982 .

[44]  G. Golub.  Studies in numerical analysis , 1984 .

[45]  Francisco Facchinei,et al.  EXACT PENALTY FUNCTIONS FOR NONDIFFERENTIABLE PROGRAMMING PROBLEMS , 1989 .

[46]  L. Grippo,et al.  A Continuously Differentiable Exact Penalty Function for Nonlinear Programming Problems with Inequality Constraints , 1985 .

[47]  S. Lucidi.  New results on a class of exact augmented Lagrangians , 1988 .

[48]  L. Grippo,et al.  A class of continuously differentiable exact penalty function algorithms for nonlinear programming problems , 1984 .

[49]  L. Grippo,et al.  An exact penalty function method with global convergence properties for nonlinear programming problems , 1986, Math. Program..

[50]  Andrew R. Conn,et al.  Nonlinear programming via an exact penalty function: Global analysis , 1982, Math. Program..

[51]  F. Facchinei.  Exact penalty functions and Lagrange multipliers , 1991 .

[52]  V. G. Zhadan,et al.  Exact auxiliary functions in optimization problems , 1991 .

[53]  Elijah Polak,et al.  A quadratically convergent primal-dual algorithm with global convergence properties for solving optimization problems with equality constraints , 1975, Math. Program..

[54]  J. J. Moré,et al.  Newton's Method , 1982 .

[55]  B. V. Shah,et al.  Integer and Nonlinear Programming , 1971 .

[56]  L. Grippo,et al.  A new augmented Lagrangian function for inequality constraints in nonlinear programming problems , 1982 .

[57]  J. Burke.  A sequential quadratic programming method for potentially infeasible mathematical programs , 1989 .

[58]  Olvi L. Mangasarian,et al.  Exact penalty functions in nonlinear programming , 1979, Math. Program..

[59]  S. Lucidi,et al.  Recursive quadratic programming algorithm that uses an exact augmented Lagrangian function , 1990 .

[60]  Luigi Grippo,et al.  A method for solving equality constrained optimization problems by unconstrained minimization , 1980 .

[61]  Ya-Xiang Yuan,et al.  A recursive quadratic programming algorithm that uses differentiable exact penalty functions , 1986, Math. Program..

[62]  D. E. Ward.  Exact penalties and sufficient conditions for optimality in nonsmooth optimization , 1988 .

[63]  M. C. Biggs.  On the Convergence of Some Constrained Minimization Algorithms Based on Recursive Quadratic Programming , 1978 .

[64]  V. F. Demʹi︠a︡nov,et al.  Nonsmooth optimization and related topics , 1989 .

[65]  T. Pietrzykowski.  The potential method for conditional maxima in the locally compact metric spaces , 1970 .

[66]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.