Global Convergence of Damped Newton's Method for Nonsmooth Equations via the Path Search

A natural damping of Newton's method for nonsmooth equations is presented. This damping, via the path search instead of the traditional line search, enlarges the domain of convergence of Newton's method and therefore is said to be globally convergent. Convergence behavior is like that of line search damped Newton's method for smooth equations, including Q -quadratic convergence rates under appropriate conditions.Applications of the path search include damping Robinson-Newton's method for nonsmooth normal equations corresponding to nonlinear complementarity problems and variational inequalities, hence damping both Wilson's method (sequential quadratic programming) for nonlinear programming and Josephy-Newton's method for generalized equations. Computational examples from nonlinear programming are given.

[1]  G. Dantzig,et al.  COMPLEMENTARY PIVOT THEORY OF MATHEMATICAL PROGRAMMING , 1968 .

[2]  W. Rheinboldt.  Local mapping relations and global implicit function theorems , 1969 .

[3]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[4]  J. L. Webb.  OPERATEURS MAXIMAUX MONOTONES ET SEMI‐GROUPES DE CONTRACTIONS DANS LES ESPACES DE HILBERT , 1974 .

[5]  S. M. Robinson.  Generalized equations and their solutions, Part I: Basic theory , 1979 .

[6]  N. Josephy.  Newton's Method for Generalized Equations. , 1979 .

[7]  Stephen M. Robinson,et al.  Strongly Regular Generalized Equations , 1980, Math. Oper. Res..

[8]  O. Burdakov.  Some globally convergent modifications of Newton's method for solving systems of nonlinear equations , 1980 .

[9]  M. Kojima.  Strongly Stable Stationary Solutions in Nonlinear Programs. , 1980 .

[10]  Philip E. Gill,et al.  Practical optimization , 1981 .

[11]  S. M. Robinson.  Local structure of feasible sets in nonlinear programming , 1983 .

[12]  F. Clarke.  Optimization And Nonsmooth Analysis , 1983 .

[13]  G. McCormick.  Nonlinear Programming: Theory, Algorithms and Applications , 1983 .

[14]  L. Grippo,et al.  A nonmonotone line search technique for Newton's method , 1986 .

[15]  P. Marcotte,et al.  A note on a globally convergent Newton method for solving monotone variational inequalities , 1986 .

[16]  Roger Fletcher,et al.  Practical methods of optimization; (2nd ed.) , 1987 .

[17]  S. M. Robinson.  Local structure of feasible sets in nonlinear programming, Part III: Stability and sensitivity , 1987 .

[18]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[19]  Patrick T. Harker,et al.  Newton's method for the nonlinear complementarity problem: A B-differentiable equation approach , 1990, Math. Program..

[20]  M. Ferris.  Iterative linear programming solution of convex programs , 1990 .

[21]  Patrick T. Harker,et al.  Finite-dimensional variational inequality and nonlinear complementarity problems: A survey of theory, algorithms and applications , 1990, Math. Program..

[22]  Jong-Shi Pang,et al.  Newton's Method for B-Differentiable Equations , 1990, Math. Oper. Res..

[23]  Jong-Shi Pang,et al.  Minimization of Locally Lipschitzian Functions , 1991, SIAM J. Optim..

[24]  Jong-Shi Pang,et al.  A B-differentiable equation-based, globally and locally quadratically convergent algorithm for nonlinear programs, complementarity and variational inequality problems , 1991, Math. Program..

[25]  Pierre Falzon,et al.  Institut national de recherche en informatique et en automatique , 1992 .

[26]  Masao Fukushima,et al.  Equivalent differentiable optimization problems and descent methods for asymmetric variational inequality problems , 1992, Math. Program..

[27]  Jong-Shi Pang,et al.  Globally Convergent Newton Methods for Nonsmooth Equations , 1992, Math. Oper. Res..

[28]  Stephen M. Robinson,et al.  Normal Maps Induced by Linear Transformations , 1992, Math. Oper. Res..

[29]  Masao Fukushima,et al.  A globally convergent Newton method for solving strongly monotone variational inequalities , 1993, Math. Program..

[30]  Jong-Shi Pang,et al.  Convergence of splitting and Newton methods for complementarity problems: An application of some sensitivity results , 1993, Math. Program..

[31]  Jong-Shi Pang,et al.  NE/SQP: A robust algorithm for the nonlinear complementarity problem , 1993, Math. Program..

[32]  Jia Hao Wu,et al.  A general descent framework for the monotone variational inequality problem , 1990, Math. Program..

[33]  Liqun Qi,et al.  Convergence Analysis of Some Algorithms for Solving Nonsmooth Equations , 1993, Math. Oper. Res..

[34]  D. Ralph.  A new proof of Robinson's homeomorphism theorem for pl-normal maps , 1993 .

[35]  M. Ferris,et al.  Nonmonotone stabilization methods for nonlinear equations , 1994 .

[36]  S. M. Robinson.  Newton's method for a class of nonsmooth functions , 1994 .

[37]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .