An accelerated Newton method for equations with semismooth Jacobians and nonlinear complementarity problems

We discuss local convergence of Newton’s method to a singular solution x* of the nonlinear equations F(x) =  0, for $$F:{\mathbb{R}}^n \rightarrow {\mathbb{R}}^n$$ . It is shown that an existing proof of Griewank, concerning linear convergence to a singular solution x* from a starlike domain around x* for F twice Lipschitz continuously differentiable and x* satisfying a particular regularity condition, can be adapted to the case in which F′ is only strongly semismooth at the solution. Further, Newton’s method can be accelerated to produce fast linear convergence to a singular solution by overrelaxing every second Newton step. These results are applied to a nonlinear-equations reformulation of the nonlinear complementarity problem (NCP) whose derivative is strongly semismooth when the function f arising in the NCP is sufficiently smooth. Conditions on f are derived that ensure that the appropriate regularity conditions are satisfied for the nonlinear-equations reformulation of the NCP at x*.

[1]  G. Reddien On Newton’s Method for Singular Problems , 1978 .

[2]  G. Reddien Newton's method and high order singularities , 1979 .

[3]  N. Josephy Newton's Method for Generalized Equations. , 1979 .

[4]  A. Griewank Starlike domains of convergence for Newton's method at singularities , 1980 .

[5]  C. Kelley,et al.  Newton’s Method at Singular Points. I , 1980 .

[6]  M. R. Osborne,et al.  Newton’s Method for Singular Problems when the Dimension of the Null Space is $>1$ , 1981 .

[7]  C. Kelley,et al.  Convergence Acceleration for Newton’s Method at Singular Points , 1982 .

[8]  H. Keller,et al.  CONVERGENCE RATES FOR NEWTON'S METHOD AT SINGULAR POINTS* , 1983 .

[9]  C. Kelley,et al.  A New Acceleration Method for Newton’s Method at Singular Points , 1983 .

[10]  A. Griewank On Solving Nonlinear Equations with Simple Singularities or Nearly Singular Solutions , 1985 .

[11]  Liqun Qi,et al.  A nonsmooth version of Newton's method , 1993, Math. Program..

[12]  C. Kanzow Some equation-based methods for the nonlinear complementarity problem , 1994 .

[13]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[14]  Alexey F. Izmailov,et al.  Error bounds for 2-regular mappings with Lipschitzian derivatives and their applications , 2001, Math. Program..

[15]  Alexey F. Izmailov,et al.  Superlinearly Convergent Algorithms for Solving Singular Equations and Smooth Reformulations of Complementarity Problems , 2002, SIAM J. Optim..

[16]  Alexey F. Izmailov,et al.  The Theory of 2-Regularity for Mappings with Lipschitzian Deriatives and its Applications to Optimality Conditions , 2002, Math. Oper. Res..

[17]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[18]  Alexey F. Izmailov,et al.  A Class of Active-Set Newton Methods for Mixed ComplementarityProblems , 2005, SIAM J. Optim..

[19]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.