Global and Local Superlinear Convergence Analysis of Newton-Type Methods for Semismooth Equations with Smooth Least Squares

The local superlinear convergence of the generalized Newton method for solving systems of nonsmooth equations has been proved by Qi and Sun under the semismooth condition and nonsingularity of the generalized Jacobian at the solution. Unlike the Newton method for systems of smooth equations, globalization of the generalized Newton method seems difficult to achieve in general. However, we show that global convergence analysis of various traditional Newton-type methods for systems of smooth equations can be extended to systems of nonsmooth equations with semismooth operators whose least squares objective is smooth. The value of these methods is demonstrated from their applications to various semismooth equation reformulations of nonlinear complementarity and related problems.

[1]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[2]  R. Mifflin.  Semismooth and Semiconvex Functions in Constrained Optimization , 1977 .

[3]  Martin Grötschel,et al.  Mathematical Programming The State of the Art, XIth International Symposium on Mathematical Programming, Bonn, Germany, August 23-27, 1982 , 1983, ISMP.

[4]  F. Clarke.  Optimization And Nonsmooth Analysis , 1983 .

[5]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[6]  Patrick T. Harker,et al.  Finite-dimensional variational inequality and nonlinear complementarity problems: A survey of theory, algorithms and applications , 1990, Math. Program..

[7]  Jong-Shi Pang,et al.  Newton's Method for B-Differentiable Equations , 1990, Math. Oper. Res..

[8]  Jong-Shi Pang,et al.  A B-differentiable equation-based, globally and locally quadratically convergent algorithm for nonlinear programs, complementarity and variational inequality problems , 1991, Math. Program..

[9]  W. Oettli,et al.  Advances in Optimization , 1992 .

[10]  G. Isac.  Complementarity Problems , 1992 .

[11]  Jong-Shi Pang,et al.  Globally Convergent Newton Methods for Nonsmooth Equations , 1992, Math. Oper. Res..

[12]  B. Kummer.  Newton’s Method Based on Generalized Derivatives for Nonsmooth Functions: Convergence Analysis , 1992 .

[13]  A. Fischer.  A special newton-type optimization method , 1992 .

[14]  Jong-Shi Pang,et al.  Nonsmooth Equations: Motivation and Algorithms , 1993, SIAM J. Optim..

[15]  Liqun Qi,et al.  A nonsmooth version of Newton's method , 1993, Math. Program..

[16]  Liqun Qi,et al.  Convergence Analysis of Some Algorithms for Solving Nonsmooth Equations , 1993, Math. Oper. Res..

[17]  Daniel Ralph,et al.  Global Convergence of Damped Newton's Method for Nonsmooth Equations via the Path Search , 1994, Math. Oper. Res..

[18]  S. M. Robinson.  Newton's method for a class of nonsmooth functions , 1994 .

[19]  P. Pardalos,et al.  Handbook of global optimization , 1995 .

[20]  A. Fischer.  A Newton-type method for positive-semidefinite linear complementarity problems , 1995 .

[21]  S. Dirkse,et al.  The path solver: a nommonotone stabilization scheme for mixed complementarity problems , 1995 .

[22]  L. Qi,et al.  A Globally Convergent Successive Approximation Method for Severely Nonsmooth Equations , 1995 .

[23]  Masao Fukushima,et al.  Modified Newton methods for solving a semismooth reformulation of monotone complementarity problems , 1996, Math. Program..

[24]  Andreas Fischer,et al.  Solution of monotone complementarity problems with locally Lipschitzian functions , 1997, Math. Program..

[25]  Francisco Facchinei,et al.  A semismooth equation approach to the solution of nonlinear complementarity problems , 1996, Math. Program..

[26]  Houyuan Jiang,et al.  Semismoothness and Superlinear Convergence in Nonsmooth Optimization and Nonsmooth Equations , 1996 .

[27]  F. Giannessi,et al.  Nonlinear Optimization and Applications , 1996, Springer US.

[28]  Christian Kanzow,et al.  Some Noninterior Continuation Methods for Linear Complementarity Problems , 1996, SIAM J. Matrix Anal. Appl..

[29]  C. Kanzow,et al.  A Penalized Fischer-Burmeister Ncp-Function: Theoretical Investigation And Numerical Results , 1997 .

[30]  Houyuan Jiang,et al.  A New Nonsmooth Equations Approach to Nonlinear Complementarity Problems , 1997 .

[31]  M. Fukushima,et al.  New NCP-Functions and Their Properties , 1997 .

[32]  Houyuan Jiang,et al.  Semismooth Karush-Kuhn-Tucker Equations and Convergence Analysis of Newton and Quasi-Newton Methods for Solving these Equations , 1997, Math. Oper. Res..

[33]  M. Fukushima,et al.  A New Merit Function and a Descent Method for Semidefinite Complementarity Problems , 1998 .

[34]  Masao Fukushima,et al.  A Trust Region Method for Solving Generalized Complementarity Problems , 1998, SIAM J. Optim..

[35]  Christian Kanzow,et al.  An inexactQP-based method for nonlinear complementarity problems , 1998, Numerische Mathematik.

[36]  P. W. Christensen,et al.  Frictional Contact Algorithms Based on Semismooth Newton Methods , 1998 .

[37]  Helmut Kleinmichel,et al.  A New Class of Semismooth Newton-Type Methods for Nonlinear Complementarity Problems , 1998, Comput. Optim. Appl..

[38]  F. Facchinei,et al.  A Simply Constrained Optimization Reformulation of KKT Systems Arising from Variational Inequalities , 1999 .

[39]  Defeng Sun,et al.  A New Unconstrained Differentiable Merit Function for Box Constrained Variational Inequality Problems and a Damped Gauss-Newton Method , 1999, SIAM J. Optim..

[40]  Houyuan Jiang.  Global Convergence Analysis of the Generalized Newton and Gauss-Newton Methods of the Fischer Burmeister Equation for the Complementarity Problem , 1999 .

[41]  L. Qi.  Regular Pseudo-Smooth NCP and BVIP Functions and Globally and Quadratically Convergent Generalized Newton Methods for Complementarity and Variational Inequality Problems , 1999 .