Newton's Method for B-Differentiable Equations

In this paper, we extend the classical Newton method for solving continuously differentiable systems of nonlinear equations to B -differentiable systems. Such B -differentiable systems of equations provide a unified framework for the nonlinear complementarity, variational inequality and nonlinear programming problems. We establish the local and quadratic convergence of the method and propose a modification for global convergence. Applications of the theory to complementarity, variational inequality and optimization will be explained. In each of these contexts, the resulting method resembles the known Newton methods derived from Robinson's generalized equation formulation, but with a computational advantage. Namely, the new method incorporates a kind of active-set strategy in defining the subproblems. Unlike the previous methods which are only locally convergent, the modified version of the new method provides a descent algorithm which is globally convergent under some mild assumptions.

[1]  M. Fiedler,et al.  On matrices with non-positive off-diagonal elements and positive principal minors , 1962 .

[2]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[3]  O. Mangasarian Equivalence of the Complementarity Problem to a System of Nonlinear Equations , 1976 .

[4]  J. Gwinner Generalized Stirling-Newton Methods , 1976 .

[5]  S. M. Robinson Generalized equations and their solutions, Part I: Basic theory , 1979 .

[6]  N. Josephy Newton's Method for Generalized Equations. , 1979 .

[7]  J. Pang THE IMPLICIT COMPLEMENTARITY PROBLEM , 1981 .

[8]  Philip E. Gill,et al.  Practical optimization , 1981 .

[9]  Jong-Shi Pang,et al.  Iterative methods for variational and complementarity problems , 1982, Math. Program..

[10]  R. Dembo,et al.  INEXACT NEWTON METHODS , 1982 .

[11]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[12]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[13]  K. Jittorntrum Solution point differentiability without strict complementarity in nonlinear programming , 1984 .

[14]  P. Subramanian Gauss-Newton Methods for the Nonlinear Complementarity Problem. , 1985 .

[15]  P. Marcotte,et al.  A modified Newton method for solving variational inequalities , 1985, 1985 24th IEEE Conference on Decision and Control.

[16]  Patrice Marcotte,et al.  A new algorithm for solving variational inequalities with application to the traffic assignment problem , 1985, Math. Program..

[17]  T. Rutherford Implementational Issues and Computational Performance Solving Applied General Equilibrium Models with SLCP , 1987 .

[18]  O. Mangasarian,et al.  Lipschitz continuity of solutions of linear inequalities, programs and complementarity problems , 1987 .

[19]  B. Kummer NEWTON's METHOD FOR NON-DIFFERENTIABLE FUNCTIONS , 1988, Advances in Mathematical Optimization.

[20]  Katta G. Murty,et al.  Linear complementarity, linear and nonlinear programming , 1988 .

[21]  Patrick T. Harker,et al.  Finite-dimensional variational inequality and nonlinear complementarity problems: A survey of theory, algorithms and applications , 1990, Math. Program..

[22]  J. Pang,et al.  Error bounds for the linear complementarity problem with a P-matrix , 1990 .

[23]  A. Shapiro On concepts of directional differentiability , 1990 .