Continuous Gradient Projection Method in Hilbert Spaces

This paper is concerned with the asymptotic analysis of the trajectories of some dynamical systems built upon the gradient projection method in Hilbert spaces. For a convex function with locally Lipschitz gradient, it is proved that the orbits converge weakly to a constrained minimizer whenever it exists. This result remains valid even if the initial condition is chosen out of the feasible set and it can be extended in some sense to quasiconvex functions. An asymptotic control result, involving a Tykhonov-like regularization, shows that the orbits can be forced to converge strongly toward a well-specified minimizer. In the finite-dimensional framework, we study the differential inclusion obtained by replacing the classical gradient by the subdifferential of a continuous convex function. We prove the existence of a solution whose asymptotic properties are the same as in the smooth case.

[1]  Z. Opial Weak convergence of the sequence of successive approximations for nonexpansive mappings , 1967 .

[2]  G. McCormick,et al.  The Gradient Projection Method under Mild Differentiability Conditions , 1972 .

[3]  Ronald E. Bruck Asymptotic convergence of nonlinear contraction semigroups in Hilbert space , 1975 .

[4]  B. Martinet Perturbation des méthodes d'optimisation. Applications , 1978 .

[5]  J. Baillon,et al.  Un exemple concernant le comportement asymptotique de la solution du problème dudt + ∂ϑ(μ) ∋ 0 , 1978 .

[6]  M. Schatzman A class of nonlinear differential equations of second order in time , 1978 .

[7]  Y. Censor,et al.  Strong underrelaxation in Kaczmarz's method for inconsistent systems , 1983 .

[8]  Gian-Carlo Rota Opérateurs maximaux monotones: H. Brézis, North-Holland, 1983, 183 pp. , 1985 .

[9]  R. Phelps The gradient projection method using Curry's steplength , 1986 .

[10]  A. Visintin,et al.  On A Class Of Doubly Nonlinear Evolution Equations , 1990 .

[11]  B. Lemaire An asymptotical variational principle associated with the steepest descent method for a convex function. , 1996 .

[12]  K. G. Murty,et al.  Convergence of the steepest descent method for minimizing quasiconvex functions , 1996 .

[13]  H. Attouch,et al.  A Dynamical Approach to Convex Minimization Coupling Approximation with the Steepest Descent Method , 1996 .

[14]  O. Nelles,et al.  An Introduction to Optimization , 1996, IEEE Antennas and Propagation Magazine.

[15]  Alfredo N. Iusem,et al.  On the projected subgradient method for nonsmooth convex optimization in a Hilbert space , 1998, Math. Program..

[16]  H. Attouch,et al.  The heavy ball with friction dynamical system for convex constrained minimization problems , 2000 .

[17]  Felipe Alvarez,et al.  On the Minimizing Property of a Second Order Dissipative System in Hilbert Spaces , 2000, SIAM J. Control. Optim..

[18]  H. Attouch,et al.  Asymptotic Control and Stabilization of Nonlinear Oscillators with Non-isolated Equilibria , 2002 .