A Multidimensional Filter Algorithm for Nonlinear Equations and Nonlinear Least-Squares

We introduce a new algorithm for the solution of systems of nonlinear equations and nonlinear least-squares problems that attempts to combine the efficiency of filter techniques and the robustness of trust-region methods. The algorithm is shown, under reasonable assumptions, to globally converge to zeros of the system, or to first-order stationary points of the Euclidean norm of its residual. Preliminary numerical experience is presented that shows substantial gains in efficiency over the traditional monotone trust-region approach.

[1]  John E. Dennis,et al.  An Adaptive Nonlinear Least-Squares Algorithm , 1977, TOMS.

[2]  Jorge J. Moré,et al.  Computing a Trust Region Step , 1983 .

[3]  P. Toint,et al.  On Large Scale Nonlinear Least Squares Calculations , 1987 .

[4]  P. Toint,et al.  Lancelot: A FORTRAN Package for Large-Scale Nonlinear Optimization (Release A) , 1992 .

[5]  Nicholas I. M. Gould,et al.  CUTE: constrained and unconstrained testing environment , 1995, TOMS.

[6]  L. Luksan.  Hybrid methods for large sparse nonlinear least squares , 1996 .

[7]  Philippe L. Toint,et al.  Non-monotone trust-region algorithms for nonlinear optimization subject to convex constraints , 1997, Math. Program..

[8]  Homer F. Walker,et al.  NITSOL: A Newton Iterative Solver for Nonlinear Systems , 1998, SIAM J. Sci. Comput..

[9]  Jiye Han,et al.  A class of nonmonotone trust region algorithms for unconstrained optimization problems , 1998 .

[10]  Nicholas I. M. Gould,et al.  Solving the Trust-Region Subproblem using the Lanczos Method , 1999, SIAM J. Optim..

[11]  L. Vicente,et al.  A Globally Convergent Primal-Dual Interior-Point Filter Method for Nonconvex Nonlinear Programming , 2000 .

[12]  Nicholas I. M. Gould,et al.  Global Convergence of a Hybrid Trust-Region SQP-Filter Algorithm for General Nonlinear Programming , 2001, System Modelling and Optimization.

[13]  Sven Leyffer,et al.  Nonlinear programming without a penalty function , 2002, Math. Program..

[14]  Sven Leyffer,et al.  On the Global Convergence of a Filter--SQP Algorithm , 2002, SIAM J. Optim..

[15]  Jorge J. Moré,et al.  Digital Object Identifier (DOI) 10.1007/s101070100263 , 2001 .

[16]  Nicholas I. M. Gould,et al.  Global Convergence of a Trust-Region SQP-Filter Algorithm for General Nonlinear Programming , 2002, SIAM J. Optim..

[17]  Lorenz T. Biegler,et al.  Global and Local Convergence of Line Search Filter Methods for Nonlinear Programming , 2002 .

[18]  R. Fletcher,et al.  Filter-type Algorithms for Solving Systems of Algebraic Equations and Inequalities , 2003 .

[19]  Nicholas I. M. Gould,et al.  GALAHAD, a library of thread-safe Fortran 90 packages for large-scale nonlinear optimization , 2003, TOMS.

[20]  Nicholas I. M. Gould,et al.  CUTEr and SifDec: A constrained and unconstrained testing environment, revisited , 2003, TOMS.

[21]  Clóvis C. Gonzaga,et al.  A Globally Convergent Filter Method for Nonlinear Programming , 2003, SIAM J. Optim..

[22]  P. Toint,et al.  Global Convergence of a Non-monotone Trust-Region Filter Algorithm for Nonlinear Programming , 2006 .