Convergent regions of the Newton homotopy method for nonlinear systems: theory and computational applications

This paper introduces the concept of the convergent region of a solution of a general nonlinear equation using the Newton homotopy method. The question of whether an initial guess converges to the solution of our interest using the Newton homotopy method is investigated. It is shown that convergent regions of the Newton homotopy method are equal to stability regions of a corresponding Newton dynamic system. A necessary and sufficient condition for the adjacency of two solutions using the Newton homotopy method is derived. An algebraic characterization of a convergent region and its boundary for a large class of nonlinear systems is derived. This characterization is explicit and computationally feasible. A numerical method to determine the convergent region and to establish simple criteria to avoid revisits of the same solutions from different initial guesses is developed. It is shown that for general nonlinear systems or gradient systems, it is computationally infeasible to construct a set of initial guesses which converge to the set of all type-one equilibrium points on the stability boundary of a stable equilibrium point x/sub s/ from a finite number of function values and derivatives near x/sub s/ using the Newton homotopy method. Several examples are applied to illustrate the theoretical developments.

[1]  L. T. Watson,et al.  Globally convergent homotopy methods: a tutorial , 1989, Conference on Numerical Ordinary Differential Equations.

[2]  E. Allgower,et al.  Numerical Continuation Methods , 1990 .

[3]  H. Chiang,et al.  A systematic search method for obtaining multiple local optimal solutions of nonlinear programming problems , 1996 .

[4]  Robert Schaback,et al.  An extended continuous Newton method , 1990 .

[5]  G. Barkema,et al.  Traveling through potential energy landscapes of disordered materials: The activation-relaxation technique , 1997, cond-mat/9710023.

[6]  S. Smale.  Convergent process of price adjust-ment and global newton methods , 1976 .

[7]  P. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[8]  F. J. Gould,et al.  Relations Between Several Path Following Algorithms and Local and Global Newton Methods , 1980 .

[9]  W. Miller,et al.  ON FINDING TRANSITION STATES , 1981 .

[10]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[11]  Colin M. Smith.  How to find a saddle point , 1990 .

[12]  S. Smale.  Differentiable dynamical systems , 1967 .

[13]  P. Pardalos,et al.  Handbook of global optimization , 1995 .

[14]  Roberto Genesio,et al.  New techniques for constructing asymptotic stability regions for nonlinear systems , 1984 .

[15]  V. Arnold,et al.  Ordinary Differential Equations , 1973 .

[16]  C. B. García,et al.  A Theorem on Homotopy Paths , 1978, Math. Oper. Res..

[17]  Shigehiro Ushiki,et al.  Analytic expressions of unstable manifolds , 1980 .

[18]  A. Mayne.  Parametric Optimization: Singularities, Pathfollowing and Jumps , 1990 .

[19]  H. Chiang,et al.  Quasi-stability regions of nonlinear dynamical systems: theory , 1996 .

[20]  M. Hirsch,et al.  Differential Equations, Dynamical Systems, and Linear Algebra , 1974 .

[21]  D. Liotard.  Algorithmic tools in the study of semiempirical potential surfaces , 1992 .

[22]  J. Zaborszky,et al.  On the phase portrait of a class of large nonlinear dynamic systems such as the power system , 1988 .

[23]  Immo Diener.  On the global convergence of path-following methods to determine all solutions to a system of nonlinear equations , 1987, Math. Program..

[24]  Immo Diener,et al.  Trajectory Methods in Global Optimization , 1995 .

[25]  H. Th. Jongen,et al.  The index-k-stabilizing differential equation , 1981 .

[26]  Josep Maria Bofill,et al.  On the restricted step method coupled with the augmented Hessian for the search of stationary points of any continuous function , 1997 .

[27]  S. Wiggins.  Introduction to Applied Nonlinear Dynamical Systems and Chaos , 1989 .

[28]  Chia-Chi Chu,et al.  Direct stability analysis of electric power systems using energy functions: theory, applications, and perspective , 1995, Proc. IEEE.

[29]  M. Kuno,et al.  Computing all real solutions to systems of nonlinear equations with a global fixed-point homotopy , 1988 .

[30]  J. Palis,et al.  Geometric theory of dynamical systems : an introduction , 1984 .

[31]  L. Chua,et al.  A switching-parameter algorithm for finding multiple solutions of nonlinear resistive circuits , 1976 .

[32]  E. Allgower,et al.  Introduction to Numerical Continuation Methods , 1987 .

[33]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[34]  A. Vicino,et al.  On the estimation of asymptotic stability regions: State of the art and new proposals , 1985 .

[35]  F. H. Branin.  Widely convergent method for finding multiple solutions of simultaneous nonlinear equations , 1972 .

[36]  Felix F. Wu,et al.  Stability regions of nonlinear autonomous dynamical systems , 1988 .

[37]  J. E. Sinclair,et al.  A new method of saddle-point location for the calculation of defect migration energies , 1974 .

[38]  J. Zaborszky,et al.  A counterexample of a theorem by Tsolas et al. and an independent result by Zaborszky et al. (with reply) , 1988 .