Optimal sensitivity based on IPOPT

We introduce a flexible, open source implementation that provides the optimal sensitivity of solutions of nonlinear programming (NLP) problems, and is adapted to a fast solver based on a barrier NLP method. The program, called sIPOPT evaluates the sensitivity of the Karush–Kuhn–Tucker (KKT) system with respect to perturbation parameters. It is paired with the open-source IPOPT NLP solver and reuses matrix factorizations from the solver, so that sensitivities to parameters are determined with minimal computational cost. Aside from estimating sensitivities for parametric NLPs, the program provides approximate NLP solutions for nonlinear model predictive control and state estimation. These are enabled by pre-factored KKT matrices and a fix-relax strategy based on Schur complements. In addition, reduced Hessians are obtained at minimal cost and these are particularly effective to approximate covariance matrices in parameter and state estimation problems. The sIPOPT program is demonstrated on four case studies to illustrate all of these features.

[1]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[2]  Anders Forsgren,et al.  Interior Methods for Nonlinear Optimization , 2002, SIAM Rev..

[3]  Moritz Diehl,et al.  Real-Time Optimization for Large Scale Nonlinear Processes , 2001 .

[4]  Anthony V. Fiacco,et al.  A User's Manual for SENSUMT: A Penalty Function Computer Program for Solution, Sensitivity Analysis, and Optimal Value Bound Calculation in Parametric Nonlinear Programs. , 1980 .

[5]  Frank Allgöwer,et al.  A Stabilizing Real-time Implementation of Nonlinear Model Predictive Control , 2007 .

[6]  Martin Grötschel,et al.  Online optimization of large scale systems , 2001 .

[7]  T. Brubaker,et al.  Nonlinear Parameter Estimation , 1979 .

[8]  M. Mannan,et al.  A methodology for fault detection, isolation, and identification for nonlinear processes with parametric uncertainties , 2004 .

[9]  Wolfgang Marquardt,et al.  Sensitivity-Based Solution Updates in Closed-Loop Dynamic Optimization , 2004 .

[10]  Hubertus Th. Jongen,et al.  Optimization theory , 2004 .

[11]  G. A. Gabriele,et al.  AN INVESTIGATION OF NEW METHODS FOR ESTIMATING PARAMETER SENSITIVITIES , 1989 .

[12]  Lorenz T. Biegler,et al.  Flowsheet optimization and optimal sensitivity analysis using analytical derivatives , 1994 .

[13]  M. Heinkenschloss,et al.  Real-Time PDE-Constrained Optimization , 2007 .

[14]  Jerzy Kyparisis,et al.  Sensitivity Analysis for Nonlinear Programs and Variational Inequalities with Nonunique Multipliers , 1990, Math. Oper. Res..

[15]  Tamás Terlaky,et al.  Interior Point Methods for Nonlinear Optimization , 2010 .

[16]  Thomas E. Marlin,et al.  Design cost: a systematic approach to technology selection for model-based real-time optimization systems , 1996 .

[17]  A. Fiacco,et al.  Sensitivity and stability analysis for nonlinear programming , 1991 .

[18]  Hubertus Th. Jongen,et al.  Nonlinear Optimization in Finite Dimensions - Morse Theory, Chebyshev Approximation, Transversality, Flows, Parametric Aspects , 2000 .

[19]  A. Mayne.  Parametric Optimization: Singularities, Pathfollowing and Jumps , 1990 .

[20]  L. Biegler,et al.  QPSchur: A dual, active-set, Schur-complement method for large-scale and structured convex quadratic programming , 2006 .

[21]  M. Kojima.  Strongly Stable Stationary Solutions in Nonlinear Programs. , 1980 .

[22]  Victor M. Zavala,et al.  Computational strategies for the optimal operation of large-scale chemical processes , 2008 .

[23]  Anthony V. Fiacco,et al.  Introduction to Sensitivity and Stability Analysis in Nonlinear Programming , 2012 .

[24]  H. Maurer,et al.  Sensitivity Analysis and Real-Time Optimization of Parametric Nonlinear Programming Problems , 2001 .

[25]  L. Biegler,et al.  Large‐scale DAE optimization using a simultaneous NLP formulation , 1998 .

[26]  M. Kojima,et al.  Continuous deformation of nonlinear programs , 1984 .

[27]  Rodrigo Lopez-Negrete De La Fuente,et al.  Optimal Start-Up and Product Transition Policies of a Reactive Distillation Column , 2007 .

[28]  S. M. Robinson.  Analysis and computation of fixed points , 1980 .

[29]  L. Biegler,et al.  A reduced hessian strategy for sensitivity analysis of optimal flowsheets , 1987 .

[30]  Yonathan Bard,et al.  Nonlinear parameter estimation , 1974 .

[31]  Brian W. Kernighan,et al.  AMPL: A Modeling Language for Mathematical Programming , 1993 .

[32]  H. Jongen,et al.  Nonlinear Optimization in Finite Dimensions , 2001 .

[33]  W. Ames.  Mathematics in Science and Engineering , 1999 .

[34]  Victor M. Zavala,et al.  The advanced-step NMPC controller: Optimality, stability and robustness , 2009, Autom..

[35]  Lorenz T. Biegler,et al.  Nonlinear Waves in Integrable and Nonintegrable Systems , 2018 .

[36]  S. M. Robinson.  Generalized equations and their solutions, part II: Applications to nonlinear programming , 1982 .