Global minimization using an Augmented Lagrangian method with variable lower-level constraints

A novel global optimization method based on an Augmented Lagrangian framework is introduced for continuous constrained nonlinear optimization problems. At each outer iteration k the method requires the $${\varepsilon_{k}}$$ -global minimization of the Augmented Lagrangian with simple constraints, where $${\varepsilon_k \to \varepsilon}$$ . Global convergence to an $${\varepsilon}$$ -global minimizer of the original problem is proved. The subproblems are solved using the αBB method. Numerical experiments are presented.

[1]  Vasilios Manousiouthakis,et al.  A GLOBAL OPTIMIZATION APPROACH TO RATIONALLY CONSTRAINED RATIONAL PROGRAMMING , 1992 .

[2]  Christodoulos A. Floudas,et al.  Computational Experience with a New Class of Convex Underestimators: Box-constrained NLP Problems , 2004, J. Glob. Optim..

[3]  R. Rockafellar Augmented Lagrange Multiplier Functions and Duality in Nonconvex Programming , 1974 .

[4]  A MeyerClifford,et al.  Trilinear Monomials with Mixed Sign Domains , 2004 .

[5]  Christodoulos A. Floudas,et al.  Deterministic global optimization in isothermal reactor network synthesis , 2002, J. Glob. Optim..

[6]  Christodoulos A. Floudas,et al.  Deterministic global optimization - theory, methods and applications , 2010, Nonconvex optimization and its applications.

[7]  Chenyi Hu,et al.  Algorithm 737: INTLIB—a portable Fortran 77 interval standard-function library , 1994, TOMS.

[8]  Christodoulos A. Floudas,et al.  A retrofit approach for heat exchanger networks , 1989 .

[9]  W. Press,et al.  Numerical Recipes in Fortran: The Art of Scientific Computing.@@@Numerical Recipes in C: The Art of Scientific Computing. , 1994 .

[10]  C. Floudas,et al.  A global optimization algorithm (GOP) for certain classes of nonconvex NLPs—I. Theory , 1990 .

[11]  Nikolaos V. Sahinidis,et al.  BARON: A general purpose global optimization software package , 1996, J. Glob. Optim..

[12]  Z. Shen Integrated supply chain design models: a survey and future research directions , 2007 .

[13]  Arthur W. Westerberg,et al.  Assuring a global optimum by the use of an upper bound on the lower (dual) bound , 1978 .

[14]  Christodoulos A. Floudas,et al.  Convex Underestimation of Twice Continuously Differentiable Functions by Piecewise Quadratic Perturbation: Spline αBB Underestimators , 2005, J. Glob. Optim..

[15]  David Yang Gao Duality Principles in Nonconvex Systems: Theory , 2000 .

[16]  Leo Liberti,et al.  An Exact Reformulation Algorithm for Large Nonconvex NLPs Involving Bilinear Terms , 2006, J. Glob. Optim..

[17]  John L. Klepeis,et al.  Free energy calculations for peptides via deterministic global optimization , 1999 .

[18]  C. Floudas,et al.  Synthesis of general distillation sequences : nonsharp separations , 1990 .

[19]  P. Toint,et al.  Global convergence of a class of trust region algorithms for optimization with simple bounds , 1988 .

[20]  Costas D. Maranas,et al.  Global Optimization in Generalized Geometric Programming , 1997, Encyclopedia of Optimization.

[21]  Hanif D. Sherali,et al.  On Finitely Terminating Branch-and-Bound Algorithms for Some Global Optimization Problems , 1999, SIAM J. Optim..

[22]  A. Neumaier,et al.  A global optimization method, αBB, for general twice-differentiable constrained NLPs — I. Theoretical advances , 1998 .

[23]  Hanif D. Sherali,et al.  A Global Optimization RLT-based Approach for Solving the Fuzzy Clustering Problem , 2005, J. Glob. Optim..

[24]  Aimo A. Törn,et al.  Global Optimization , 1999, Science.

[25]  Christodoulos A. Floudas,et al.  Two results on bounding the roots of interval polynomials , 1999 .

[26]  Christodoulos A. Floudas,et al.  A global optimization method, αBB, for process design , 1996 .

[27]  S. T. Harding,et al.  Locating all homogeneous azeotropes in multicomponent mixtures , 1997 .

[28]  Christodoulos A. Floudas,et al.  Deterministic Global Optimization: Theory, Methods and (NONCONVEX OPTIMIZATION AND ITS APPLICATIONS Volume 37) (Nonconvex Optimization and Its Applications) , 2005 .

[29]  D. Gao Solutions and optimality criteria to box constrained nonconvex minimization problems , 2007 .

[30]  Hanif D. Sherali,et al.  A Global Optimization RLT-based Approach for Solving the Hard Clustering Problem , 2005, J. Glob. Optim..

[31]  Christodoulos A. Floudas,et al.  Optimization of complex reactor networks—I. Isothermal operation , 1990 .

[32]  John L. Klepeis,et al.  A new class of hybrid global optimization algorithms for peptide structure prediction: integrated hybrids , 2003 .

[33]  Jonathan F. Bard,et al.  Practical Bilevel Optimization: Algorithms and Applications (Nonconvex Optimization and Its Applications) , 2006 .

[34]  Warren P. Adams,et al.  A Reformulation-Linearization Technique for Solving Discrete and Continuous Nonconvex Problems , 1998 .

[35]  N. Sahinidis,et al.  Global optimization of nonconvex NLPs and MINLPs with applications in process design , 1995 .

[36]  Christodoulos A. Floudas,et al.  Deterministic Global Optimization in Nonlinear Optimal Control Problems , 2000, J. Glob. Optim..

[37]  Arnold Neumaier,et al.  Benchmarking global optimization and constraint satisfaction codes , 2003 .

[38]  John L. Klepeis,et al.  Ab initio Tertiary Structure Prediction of Proteins , 2003, J. Glob. Optim..

[39]  William H. Press,et al.  Book-Review - Numerical Recipes in Pascal - the Art of Scientific Computing , 1989 .

[40]  D. Gao Perfect duality theory and complete solutions to a class of global optimization problems , 2003 .

[41]  G. Stephanopoulos,et al.  The use of Hestenes' method of multipliers to resolve dual gaps in engineering system optimization , 1975 .

[42]  José Mario Martínez,et al.  Large-Scale Active-Set Box-Constrained Optimization Method with Spectral Projected Gradients , 2002, Comput. Optim. Appl..

[43]  Christodoulos A. Floudas,et al.  Trilinear Monomials with Mixed Sign Domains: Facets of the Convex and Concave Envelopes , 2004, J. Glob. Optim..

[44]  Leo Liberti,et al.  Reduction constraints for the global optimization of NLPs , 2004 .

[45]  N. Sahinidis,et al.  Convexification and Global Optimization in Continuous And , 2002 .

[46]  Christodoulos A. Floudas,et al.  Rigorous convex underestimators for general twice-differentiable problems , 1996, J. Glob. Optim..

[47]  C. Adjiman,et al.  A global optimization method, αBB, for general twice-differentiable constrained NLPs—II. Implementation and computational results , 1998 .

[48]  William R. Esposito,et al.  Global Optimization in Parameter Estimation of Nonlinear Algebraic Models via the Error-in-Variables Approach , 1998 .

[49]  Samir Adly,et al.  Well-positioned Closed Convex Sets and Well-positioned Closed Convex Functions , 2004, J. Glob. Optim..

[50]  A. Neumaier Acta Numerica 2004: Complete search in continuous global optimization and constraint satisfaction , 2004 .

[51]  H. Tuy Convex analysis and global optimization , 1998 .

[52]  Nikolaos V. Sahinidis,et al.  A branch-and-reduce approach to global optimization , 1996, J. Glob. Optim..

[53]  C. Floudas,et al.  ASTRO-FOLD: a combinatorial and global optimization framework for Ab initio prediction of three-dimensional structures of proteins from the amino acid sequence. , 2003, Biophysical journal.

[54]  C. Floudas,et al.  Locating All Heterogeneous and Reactive Azeotropes in Multicomponent Mixtures , 2000 .

[55]  Christodoulos A. Floudas,et al.  Trigonometric Convex Underestimator for the Base Functions in Fourier Space , 2005 .

[56]  José Mario Martínez,et al.  Partial spectral projected gradient method with active-set strategy for linearly constrained optimization , 2009, Numerical Algorithms.

[57]  Graziella Pacelli,et al.  An interior point algorithm for global optimal solutions and KKT points , 2001 .

[58]  Nicholas I. M. Gould,et al.  Trust Region Methods , 2000, MOS-SIAM Series on Optimization.

[59]  Christodoulos A. Floudas,et al.  Convex envelopes for edge-concave functions , 2005, Math. Program..

[60]  Nils Tönshoff,et al.  Implementation and Computational Results , 1997 .

[61]  Lonnie Hamm,et al.  GLOBAL OPTIMIZATION METHODS , 2002 .

[62]  S. T. Harding,et al.  Phase stability with cubic equations of state: Global optimization approach , 2000 .

[63]  Jonathan F. Bard,et al.  Practical Bilevel Optimization: Algorithms and Applications , 1998 .

[64]  C. Adjiman,et al.  Global optimization of mixed‐integer nonlinear problems , 2000 .

[65]  Nikolaos V. Sahinidis,et al.  Convexification and Global Optimization in Continuous and Mixed-Integer Nonlinear Programming , 2002 .

[66]  Jorge J. Moré,et al.  Digital Object Identifier (DOI) 10.1007/s101070100263 , 2001 .

[67]  Zelda B. Zabinsky,et al.  Stochastic Adaptive Search for Global Optimization , 2003 .

[68]  David Yang Gao Canonical Dual Transformation Method and Generalized Triality Theory in Nonsmooth Global Optimization* , 2000 .

[69]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[70]  Jonathan F. Bard,et al.  Practical Bilevel Optimization , 1998 .

[71]  R. Andreani,et al.  On the Relation between Constant Positive Linear Dependence Condition and Quasinormality Constraint Qualification , 2005 .

[72]  José Mario Martínez,et al.  Augmented Lagrangian methods under the constant positive linear dependence constraint qualification , 2007, Math. Program..

[73]  Christodoulos A. Floudas,et al.  Global optimization of MINLP problems in Process Synthesis and Design , 1997 .

[74]  V. Visweswaran,et al.  A global optimization algorithm (GOP) for certain classes of nonconvex NLPs—II. Application of theory and test problems , 1990 .

[75]  Duan Li,et al.  On the Convergence of Augmented Lagrangian Methods for Constrained Global Optimization , 2007, SIAM J. Optim..

[76]  J. Rodriguez,et al.  Problem (1) , 1994 .

[77]  C. Floudas,et al.  A deterministic global optimization approach for molecular structure determination , 1994 .

[78]  Christodoulos A. Floudas,et al.  Locating all transition states and studying the reaction pathways of potential energy surfaces , 1999 .

[79]  Hanif D. Sherali,et al.  New reformulation linearization/convexification relaxations for univariate and multivariate polynomial programming problems , 1997, Oper. Res. Lett..

[80]  H. Sherali,et al.  Biconvex Models and Algorithms for Risk Management Problems , 1994 .

[81]  C. Floudas,et al.  Global optimization in the 21st century: Advances and challenges , 2005, Computers and Chemical Engineering.

[82]  Christodoulos A. Floudas,et al.  A New Class of Improved Convex Underestimators for Twice Continuously Differentiable Constrained NLPs , 2004, J. Glob. Optim..

[83]  Hanif D. Sherali,et al.  Global optimization of nonconvex factorable programming problems , 2001, Math. Program..

[84]  Christodoulos A. Floudas,et al.  Trilinear Monomials with Positive or Negative Domains: Facets of the Convex and Concave Envelopes , 2004 .

[85]  M. Hestenes Multiplier and gradient methods , 1969 .

[86]  Christodoulos A. Floudas,et al.  Global optimization for the phase stability problem , 1995 .

[87]  José Mario Martínez,et al.  Numerical Comparison of Augmented Lagrangian Algorithms for Nonconvex Problems , 2005, Comput. Optim. Appl..

[88]  J L Klepeis,et al.  Hybrid global optimization algorithms for protein structure prediction: alternating hybrids. , 2003, Biophysical journal.

[89]  Christodoulos A. Floudas,et al.  Global Optimization and Analysis for the Gibbs Free Energy Function Using the UNIFAC, Wilson, and ASOG Equations , 1995 .

[90]  M. J. D. Powell,et al.  A method for nonlinear constraints in minimization problems , 1969 .

[91]  J. Skilling,et al.  Algorithms and Applications , 1985 .

[92]  Christodoulos A. Floudas,et al.  αBB: A global optimization method for general constrained nonconvex problems , 1995, J. Glob. Optim..

[93]  David Yang Gao,et al.  Canonical Duality Theory and Solutions to Constrained Nonconvex Quadratic Programming , 2004, J. Glob. Optim..

[94]  D. Gao Duality Principles in Nonconvex Systems: Theory, Methods and Applications , 2000 .

[95]  J. L. Klepeis,et al.  Predicting peptide structures using NMR data and deterministic global optimization , 1999 .

[96]  Linus Schrage,et al.  Modeling and Optimization With Gino , 1986 .

[97]  Christodoulos A. Floudas,et al.  Prediction of Oligopeptide Conformations via Deterministic Global Optimization , 1997, J. Glob. Optim..

[98]  Panos M. Pardalos,et al.  Introduction to Global Optimization , 2000, Introduction to Global Optimization.

[99]  Nikolaos V. Sahinidis,et al.  Reformulation of the Multiperiod MILP Model for Capacity Expansion of Chemical Processes , 1992, Oper. Res..

[100]  José Mario Martínez,et al.  On Augmented Lagrangian Methods with General Lower-Level Constraints , 2007, SIAM J. Optim..

[101]  Reiner Horst,et al.  Introduction to Global Optimization (Nonconvex Optimization and Its Applications) , 2002 .

[102]  Christodoulos A. Floudas,et al.  Finding all solutions of nonlinearly constrained systems of equations , 1995, J. Glob. Optim..

[103]  Hanif D. Sherali,et al.  A global optimization algorithm for polynomial programming problems using a Reformulation-Linearization Technique , 1992, J. Glob. Optim..

[104]  Miroslav Fikar,et al.  Global optimization for parameter estimation of differential-algebraic systems , 2009 .

[105]  Christodoulos A. Floudas,et al.  Synthesis of flexible heat exchanger networks with uncertain flowrates and temperatures , 1987 .

[106]  Christodoulos A Floudas,et al.  Global minimum potential energy conformations of small molecules , 1994, J. Glob. Optim..

[107]  William H. Press,et al.  Numerical recipes in C. The art of scientific computing , 1987 .

[108]  Arnold Neumaier,et al.  Benchmarking Global Optimization and Constraint Satisfaction Codes , 2002, COCOS.

[109]  C. Floudas,et al.  Global Optimization for the Parameter Estimation of Differential-Algebraic Systems , 2000 .

[110]  David Yang Gao Complete Solutions and Extremality Criteria to Polynomial Optimization Problems , 2006, J. Glob. Optim..

[111]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[112]  Tamás Vinkó,et al.  A comparison of complete global optimization solvers , 2005, Math. Program..