Constrained NLP via gradient flow penalty continuation: Towards self-tuning robust penalty schemes

Abstract This work presents a new numerical solution approach to nonlinear constrained optimization problems based on a gradient flow reformulation. The proposed solution schemes use self-tuning penalty parameters where the updating of the penalty parameter is directly embedded in the system of ODEs used in the reformulation, and its growth rate is linked to the violation of the constraints and variable bounds. The convergence properties of these schemes are analyzed, and it is shown that they converge to a local minimum asymptotically. Numerical experiments using a set of test problems, ranging from a few to several hundred variables, show that the proposed schemes are robust and converge to feasible points and local minima. Moreover, results suggest that the GF formulations were able to find the optimal solution to problems where conventional NLP solvers fail, and in less integration steps and time compared to a previously reported GF formulation.

[1]  Theodore J. Williams,et al.  A generalized chemical processing model for the investigation of computer control , 1960, Transactions of the American Institute of Electrical Engineers, Part I: Communication and Electronics.

[2]  Ignacio E. Grossmann,et al.  Advances in mathematical programming models for enterprise-wide optimization , 2012, Comput. Chem. Eng..

[3]  J. B. Rosen The Gradient Projection Method for Nonlinear Programming. Part I. Linear Constraints , 1960 .

[4]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[5]  M. C. Bartholomew-Biggs,et al.  ODE versus SQP methods for constrained optimization , 1989 .

[6]  J. Schropp,et al.  A dynamical systems approach to constrained minimization , 2000 .

[7]  Marcel Roelofs,et al.  AIMMS - Language Reference , 2006 .

[8]  Vitali G. Zhadan,et al.  Stable Barrier-Projection and Barrier-Newton Methods for Linear and Nonlinear Programming , 1994 .

[9]  Lorenz T. Biegler,et al.  Optimizing process economics online using model predictive control , 2013, Comput. Chem. Eng..

[10]  Z. Michalewicz,et al.  A modified genetic algorithm for optimal control problems , 1992 .

[11]  J. B. Rosen The gradient projection method for nonlinear programming: Part II , 1961 .

[12]  Germán Aroca,et al.  Selection of process alternatives for lignocellulosic bioethanol production using a MILP approach. , 2013, Bioresource technology.

[13]  M. Hestenes Multiplier and gradient methods , 1969 .

[14]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[15]  Jorge Nocedal,et al.  An Interior Point Algorithm for Large-Scale Nonlinear Programming , 1999, SIAM J. Optim..

[16]  Michael R. Bussieck,et al.  General Algebraic Modeling System (GAMS) , 2004 .

[17]  M. Bartholomew-Biggs,et al.  Some effective methods for unconstrained optimization based on the solution of systems of ordinary differential equations , 1989 .

[18]  Fengqi You,et al.  Design of Sustainable Product Systems and Supply Chains with Life Cycle Optimization Based on Functional Unit: General Modeling Framework, Mixed-Integer Nonlinear Programming Algorithms and Case Study on Hydrocarbon Biofuels , 2013 .

[19]  Alexandre K. W. Navarro,et al.  Computer algebra systems coming of age: Dynamic simulation and optimization of DAE systems in Mathematica™ , 2014, Comput. Chem. Eng..

[20]  K. Tanabe AN ALGORITHM FOR THE CONSTRAINED MAXIMIZATION IN NONLINEAR PROGRAMMING , 1974 .

[21]  Convergence of Barrier-projection methods of optimization via vector Lyapunov functions , 1994 .

[22]  Arne Stolbjerg Drud,et al.  CONOPT - A Large-Scale GRG Code , 1994, INFORMS J. Comput..

[23]  Christodoulos A. Floudas,et al.  Biomass to liquid transportation fuels (BTL) systems: process synthesis and global optimization framework , 2013 .

[24]  A Dynamical Systems Analysis of Semidefinite Programming with Application to Quadratic Optimization with Pure Quadratic Equality Constraints , 1999 .

[25]  Oliver Stein,et al.  Constrained Optimization: Projected Gradient Flows , 2009 .

[26]  Lorenz T. Biegler,et al.  Nonlinear Waves in Integrable and Nonintegrable Systems , 2018 .

[27]  X. Q. Yang,et al.  A Unified Gradient Flow Approach to Constrained Nonlinear Optimization Problems , 2003, Comput. Optim. Appl..

[28]  F. Verhulst Nonlinear Differential Equations and Dynamical Systems , 1989 .

[29]  A. Westerberg,et al.  A new approach to optimization of chemical processes , 1980 .

[30]  Robert J. Vanderbei,et al.  An Interior-Point Algorithm for Nonconvex Nonlinear Programming , 1999, Comput. Optim. Appl..

[31]  Michael A. Saunders,et al.  SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization , 2005, SIAM Rev..

[32]  C. Botsaris Differential gradient methods , 1978 .

[33]  Hiroshi Yamashita,et al.  A differential equation approach to nonlinear programming , 1980, Math. Program..