Asymptotic Convergence Analysis of the Forward-Backward Splitting Algorithm

The asymptotic convergence of the forward-backward splitting algorithm for solving equations of type 0 ∈ T(z) is analyzed, where T is a multivalued maximal monotone operator in the n-dimensional Euclidean space. When the problem has a nonempty solution set, and T is split in the form T = ℱ + h with ℱ being maximal monotone and h being co-coercive with modulus greater than ½, convergence rates are shown, under mild conditions, to be linear, superlinear or sublinear depending on how rapidly ℱ−1 and h−1 grow in the neighborhoods of certain specific points. As a special case, when both ℱ and h are polyhedral functions, we get R-linear convergence and 2-step Q-linear convergence without any further assumptions on the strict monotonicity on T or on the uniqueness of the solution. As another special case when h = 0, the splitting algorithm reduces to the proximal point algorithm, and we get new results, which complement R. T. Rockafellar's and F. J. Luque's earlier results on the proximal point algorithm.

[1]  Jong-Shi Pang,et al.  Asymmetric variational inequality problems over product sets: Applications and iterative methods , 1985, Math. Program..

[2]  G. Minty Monotone (nonlinear) operators in Hilbert space , 1962 .

[3]  B. Lemaire Coupling optimization methods and variational convergence , 1988 .

[4]  S. M. Robinson Some continuity properties of polyhedral multifunctions , 1981 .

[5]  Jong-Shi Pang,et al.  Iterative methods for variational and complementarity problems , 1982, Math. Program..

[6]  P. Tseng Applications of splitting algorithm to decomposition in convex programming and variational inequalities , 1991 .

[7]  F. Luque Asymptotic convergence analysis of the proximal point algorithm , 1984 .

[8]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[9]  E. Zeidler Nonlinear functional analysis and its applications , 1988 .

[10]  Paul Tseng,et al.  Further applications of a splitting algorithm to decomposition in variational inequalities and convex programming , 1990, Math. Program..

[11]  R. Rockafellar Monotone Operators and the Proximal Point Algorithm , 1976 .

[12]  J. Pang Necessary and sufficient conditions for the convergence of iterative methods for the linear complementarity problem , 1984 .

[13]  J. J. Moré,et al.  On the identification of active constraints , 1988 .

[14]  Gregory B. Passty Ergodic convergence to a zero of the sum of monotone operators in Hilbert space , 1979 .

[15]  Ronald E. Bruck An iterative solution of a variational inequality for certain monotone operators in Hilbert space , 1975 .

[16]  A. Goldstein Convex programming in Hilbert space , 1964 .

[17]  R. Rockafellar,et al.  A Lagrangian Finite Generation Technique for Solving Linear-Quadratic Problems in Stochastic Programming , 1986 .

[18]  R. Tyrrell Rockafellar,et al.  Primal-Dual Projected Gradient Algorithms for Extended Linear-Quadratic Programming , 1993, SIAM J. Optim..