Improving solver success in reaching feasibility for sets of nonlinear constraints

Whether a given nonlinear solver can reach a feasible point for a set of nonlinear constraints depends heavily on the initial point provided. We develop a range of computationally cheap constraint consensus algorithms that move from a given initial point to a better final point that is then passed to the nonlinear solver. Empirical tests show that this added step greatly improves the success rate of various nonlinear solvers in reaching feasibility, and reduces the effort they expend in doing so. We also develop a new initial point placement heuristic for use when an initial point is not provided by the modeller. Empirical tests show much improved performance for this new heuristic, both alone and in conjunction with the constraint consensus algorithms.

[1]  Nicholas I. M. Gould,et al.  A Multidimensional Filter Algorithm for Nonlinear Equations and Nonlinear Least-Squares , 2004, SIAM J. Optim..

[2]  Craig T. Lawrence,et al.  A Computationally Efficient Feasible Sequential Quadratic Programming Algorithm , 2000, SIAM J. Optim..

[3]  John W. Chinneck The Constraint Consensus Method for Finding Approximately Feasible Points in Nonlinear Programs , 2004, INFORMS J. Comput..

[4]  Jasbir S. Arora,et al.  Methods for finding feasible points in constrained optimization , 1995 .

[5]  Leon S. Lasdon,et al.  Optimization Theory of Large Systems , 1970 .

[6]  Andrzej Stachurski,et al.  Parallel Optimization: Theory, Algorithms and Applications , 2000, Parallel Distributed Comput. Pract..

[7]  Stephen J. Wright Primal-Dual Interior-Point Methods , 1997, Other Titles in Applied Mathematics.

[8]  Brian W. Kernighan,et al.  AMPL: A Modeling Language for Mathematical Programming , 1993 .

[9]  Arne Stolbjerg Drud,et al.  CONOPT - A Large-Scale GRG Code , 1994, INFORMS J. Comput..

[10]  Peter Spellucci,et al.  An SQP method for general nonlinear programs using only equality constrained subproblems , 1998, Math. Program..

[11]  Jorge Nocedal,et al.  A starting point strategy for nonlinear interior methods , 2004, Appl. Math. Lett..

[12]  M. M. Kostreva,et al.  Global Convergence Analysis of Algorithms for Finding Feasible Points in Norm-Relaxed MFD , 1999 .

[13]  Yair Censor,et al.  Component averaging: An efficient iterative parallel algorithm for large and sparse unstructured problems , 2001, Parallel Comput..

[14]  Michael A. Saunders,et al.  SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization , 2002, SIAM J. Optim..

[15]  Nicholas I. M. Gould,et al.  CUTE: constrained and unconstrained testing environment , 1995, TOMS.