Generalized equations and the generalized Newton method

We give some convergence results on the generalized Newton method (referred to by some authors as Newton's method) and the chord method when applied to generalized equations. The main results of the paper extend the classical Kantorovich results on Newton's method to (nonsmooth) generalized equations. Our results also extend earlier results on nonsmooth equations due to Eaves, Robinson, Josephy, Pang and Chan.We also propose inner-iterative schemes for the computation of the generalized Newton iterates. These schemes generalize popular iterative methods (Richardson's method, Jacobi's method and the Gauss-Seidel method) for the solution of linear equations and linear complementarity problems and are shown to be convergent under natural generalizations of classical convergence criteria.Our results are applicable to equations involving single-valued functions and also to a class of generalized equations which includes variational inequalities, nonlinear complementarity problems and some nonsmooth convex minimization problems.

[1]  S. M. Robinson.  Generalized equations and their solutions, Part I: Basic theory , 1979 .

[2]  Patrick T. Harker,et al.  Finite-dimensional variational inequality and nonlinear complementarity problems: A survey of theory, algorithms and applications , 1990, Math. Program..

[3]  Jong-Shi Pang,et al.  Newton's Method for B-Differentiable Equations , 1990, Math. Oper. Res..

[4]  Jong-Shi Pang,et al.  Iterative methods for variational and complementarity problems , 1982, Math. Program..

[5]  F. Browder.  Nonlinear maximal monotone operators in Banach space , 1968 .

[6]  A. Ostrowski.  Solution of equations in Euclidean and Banach spaces , 1973 .

[7]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[8]  Richard A. Tapia,et al.  The Kantorovich Theorem for Newton's Method , 1971 .

[9]  G. Minty.  Monotone (nonlinear) operators in Hilbert space , 1962 .

[10]  M. Kojima,et al.  EXTENSION OF NEWTON AND QUASI-NEWTON METHODS TO SYSTEMS OF PC^1 EQUATIONS , 1986 .

[11]  S. Karamardian,et al.  The complementarity problem , 1972, Math. Program..

[12]  N. Josephy.  A Newton Method for the Pies Energy Model. , 1979 .

[13]  N. Josephy.  Newton's Method for Generalized Equations. , 1979 .

[14]  G. Cohen.  Auxiliary problem principle and decomposition of optimization problems , 1980 .

[15]  C. Cryer.  The Solution of a Quadratic Programming Problem Using Systematic Overrelaxation , 1971 .

[16]  M. Chipot.  Variational Inequalities and Flow in Porous Media , 1984 .

[17]  J. Ortega.  Introduction to Parallel and Vector Solution of Linear Systems , 1988, Frontiers of Computer Science.

[18]  C. Baiocchi,et al.  Variational and quasivariational inequalities: Applications to free boundary problems , 1983 .

[19]  H. Brezis.  Opérateurs maximaux monotones et semi-groupes de contractions dans les espaces de Hilbert , 1973 .

[20]  O. Mangasarian.  Solution of symmetric linear complementarity problems by iterative methods , 1977 .

[21]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[22]  Liqun Qi,et al.  Convergence Analysis of Some Algorithms for Solving Nonsmooth Equations , 1993, Math. Oper. Res..

[23]  Stephen M. Robinson,et al.  Strongly Regular Generalized Equations , 1980, Math. Oper. Res..

[24]  G. Minty.  On the monotonicity of the gradient of a convex function. , 1964 .

[25]  Livinus Ugochukwu Uko.  Remarks on the generalized Newton method , 1993, Math. Program..

[26]  Jerzy Kyparisis,et al.  Local convergence of quasi-Newton methods for B-differentiable equations , 1992, Math. Program..

[27]  Jong-Shi Pang,et al.  Nonsmooth Equations: Motivation and Algorithms , 1993, SIAM J. Optim..