Quasi-Newton methods for constrained nonlinear systems: complexity analysis and applications

We address the solution of constrained nonlinear systems by new linesearch quasi-Newton methods. These methods are based on a proper use of the projection map onto the convex constraint set and on a derivative-free and nonmonotone linesearch strategy. The convergence properties of the proposed methods are presented along with a worst-case iteration complexity bound. Several implementations of the proposed scheme are discussed and validated on bound-constrained problems including gas distribution network models. The results reported show that the new methods are very efficient and competitive with an existing affine-scaling procedure.

[1]  C. G. Broyden,et al.  The convergence of an algorithm for solving sparse nonlinear systems , 1971 .

[2]  J. D. Perkins,et al.  A New Sparsity Preserving Quasi-Newton Update for Solving Nonlinear Equations , 1990, SIAM J. Sci. Comput..

[3]  M. Powell,et al.  On the Estimation of Sparse Jacobian Matrices , 1974 .

[4]  Benedetta Morini,et al.  Trust-region quadratic methods for nonlinear systems of mixed equalities and inequalities , 2009 .

[5]  José Mario Martínez,et al.  Spectral residual method without gradient information for solving large-scale nonlinear systems of equations , 2006, Math. Comput..

[6]  Detong Zhu,et al.  An affine scaling trust-region algorithm with interior backtracking technique for solving bound-constrained nonlinear systems , 2005 .

[7]  M. Fukushima,et al.  Erratum to Levenberg-Marquardt methods with strong local convergence properties for solving nonlinear equations with convex constraints , 2005 .

[8]  M. Gonçalves,et al.  An inexact Newton-like conditional gradient method for constrained nonlinear systems , 2017, Applied Numerical Mathematics.

[9]  José Mario Martínez,et al.  Practical quasi-Newton methods for solving nonlinear systems , 2000 .

[10]  Mário C. Zambaldi,et al.  An inverse column-updating method for solving large–scale nonlinear systems of equations , 1992 .

[11]  Jan Vlček,et al.  Computational experience with globally convergent descent methods for large sparse systems of nonlinear equations , 1998 .

[12]  José Mario Martínez,et al.  Globally Convergent Inexact Quasi-Newton Methods for Solving Nonlinear Systems , 2003, Numerical Algorithms.

[13]  Wenyu Sun,et al.  A Conic Affine Scaling Dogleg Method for nonlinear Optimization with Bound Constraints , 2013, Asia Pac. J. Oper. Res..

[14]  이정호,et al.  Fundamentals of Fluid Mechanics, 6th Edition , 2009 .

[15]  B. R. Munson.  Fundamentals of fluid mechanics / Bruce R. Mucnson, Donald F. Young, Theodore H. Okiishi , 2002 .

[16]  Hans Bruun Nielsen.  UCTP - Test Problems for Unconstrained Optimization , 2000 .

[17]  J. J. Moré,et al.  A Characterization of Superlinear Convergence and its Application to Quasi-Newton Methods , 1973 .

[18]  William La Cruz.  A projected derivative-free algorithm for nonlinear equations with convex constraints , 2014, Optim. Methods Softw..

[19]  Stefania Bellavia,et al.  On affine-scaling inexact dogleg methods for bound-constrained nonlinear systems , 2015, Optim. Methods Softw..

[20]  M. Fukushima,et al.  A derivative-free line search and global convergence of Broyden-like method for nonlinear equations , 2000 .

[21]  Lenhart K. Schubert.  Modification of a quasi-Newton method for nonlinear equations with a sparse Jacobian , 1970 .

[22]  C. Kanzow,et al.  An Active Set-Type Newton Method for Constrained Nonlinear Systems , 2001 .

[23]  Marcos Raydan,et al.  Nonmonotone Spectral Methods for Large-Scale Nonlinear Systems , 2003, Optim. Methods Softw..

[24]  Benedetta Morini,et al.  Approximate norm descent methods for constrained nonlinear systems , 2018, Math. Comput..

[25]  Benedetta Morini,et al.  A new modular procedure for industrial plant simulations and its reliable implementation , 2016 .

[26]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[27]  Margherita Porcelli,et al.  On the convergence of an inexact Gauss–Newton trust-region method for nonlinear least-squares problems with simple bounds , 2013, Optim. Lett..

[28]  Jorge J. Moré,et al.  Digital Object Identifier (DOI) 10.1007/s101070100263 , 2001 .

[29]  C. Kanzow.  Levenberg-Marquardt methods for constrained nonlinear equations with strong local convergence properties , 2004 .

[30]  Jefferson G. Melo,et al.  A Newton conditional gradient method for constrained nonlinear systems , 2016, J. Comput. Appl. Math..

[31]  李幼升,et al.  Ph , 1989 .

[32]  Benedetta MORINlt,et al.  SUBSPACE TRUST-REGION METHODS FOR LARGE BOUND-CONSTRAINED NONLINEAR EQUATIONS* , 2006 .

[33]  Stefania Bellavia,et al.  An affine scaling trust-region approach to bound-constrained nonlinear systems , 2003 .

[34]  Benedetta Morini,et al.  TRESNEI, a Matlab trust-region solver for systems of nonlinear equalities and inequalities , 2012, Comput. Optim. Appl..

[35]  Anderas Griewank.  The “global” convergence of Broyden-like methods with suitable line search , 1986, The Journal of the Australian Mathematical Society. Series B. Applied Mathematics.

[36]  Philippe L. Toint,et al.  BFO, A Trainable Derivative-free Brute Force Optimizer for Nonlinear Bound-constrained Optimization and Equilibrium Computations with Continuous and Discrete Variables , 2017, ACM Trans. Math. Softw..

[37]  Thomas F. Coleman,et al.  An Interior Trust Region Approach for Nonlinear Minimization Subject to Bounds , 1993, SIAM J. Optim..