Nesterov’s accelerated gradient method for nonlinear ill-posed problems with a locally convex residual functional

In this paper, we consider Nesterov's Accelerated Gradient method for solving Nonlinear Inverse and Ill-Posed Problems. Known to be a fast gradient-based iterative method for solving well-posed convex optimization problems, this method also leads to promising results for ill-posed problems. Here, we provide a convergence analysis for ill-posed problems of this method based on the assumption of a locally convex residual functional. Furthermore, we demonstrate the usefulness of the method on a number of numerical examples based on a nonlinear diagonal operator and on an inverse problem in auto-convolution.

[1]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[2]  Bernd Hofmann,et al.  Variational regularization of complex deautoconvolution and phase retrieval in ultrashort laser pulse characterization , 2016 .

[3]  S. Kindermann.  Convergence of the gradient method for ill-posed problems , 2016, 1606.00274.

[4]  Bernd Hofmann,et al.  On inversion rates for the autoconvolution equation , 1996 .

[5]  Qinian Jin,et al.  On the discrepancy principle for some Newton type methods for solving nonlinear inverse problems , 2008, Numerische Mathematik.

[6]  Hedy Attouch,et al.  The Rate of Convergence of Nesterov's Accelerated Forward-Backward Method is Actually Faster Than 1/k2 , 2015, SIAM J. Optim..

[7]  B. Hofmann,et al.  Phase retrieval via regularization in self-diffraction based spectral interferometry , 2014, 1412.2965.

[8]  A. Neubauer,et al.  On convergence rates for the Iteratively regularized Gauss-Newton method , 1997 .

[9]  Bernd Hofmann,et al.  About a deficit in low-order convergence rates on the example of autoconvolution , 2015 .

[10]  Qinian Jin,et al.  Landweber-Kaczmarz method in Banach spaces with inexact inner solvers , 2016, 1603.07490.

[11]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[12]  Qinian Jin.  On a regularized Levenberg–Marquardt method for solving nonlinear inverse problems , 2010, Numerische Mathematik.

[13]  M. Hanke,et al.  A convergence analysis of the Landweber iteration for nonlinear ill-posed problems , 1995 .

[14]  Bernd Hofmann,et al.  Regularization of an autoconvolution problem in ultrashort laser pulse characterization , 2013, 1301.6061.

[15]  Lea Fleischer,et al.  Regularization of Inverse Problems , 1996 .

[16]  R. Ramlau.  A modified landweber method for inverse problems , 1999 .

[17]  M. Hanke.  A regularizing Levenberg - Marquardt scheme, with applications to inverse groundwater filtration problems , 1997 .

[18]  Bernd Hofmann,et al.  On autoconvolution and regularization , 1994 .

[19]  Andreas Neubauer,et al.  On Nesterov acceleration for Landweber iteration of linear ill-posed problems , 2016 .

[20]  Otmar Scherzer,et al.  Lamé Parameter Estimation from Static Displacement Field Measurements in the Framework of Nonlinear Inverse Problems , 2017, SIAM J. Imaging Sci..

[21]  M. Hanke.  Accelerated Landweber iterations for the solution of ill-posed equations , 1991 .

[22]  Andreas Neubauer,et al.  On the parameter estimation problem of magnetic resonance advection imaging , 2018 .

[23]  Otmar Scherzer,et al.  Local ill-posedness and source conditions of operator equations in Hilbert spaces , 1998 .

[24]  Otmar Scherzer,et al.  Convergence Criteria of Iterative Methods Based on Landweber Iteration for Solving Nonlinear Problems , 1995 .

[25]  Barbara Kaltenbacher,et al.  Iterative Regularization Methods for Nonlinear Ill-Posed Problems , 2008, Radon Series on Computational and Applied Mathematics.

[26]  Andreas Neubauer,et al.  On Landweber iteration for nonlinear ill-posed problems in Hilbert scales , 2000, Numerische Mathematik.

[27]  A. Neubauer.  Some generalizations for Landweber iteration for nonlinear ill-posed problems in Hilbert scales , 2016 .

[28]  Ronny Ramlau,et al.  Convergence analysis of a two-point gradient method for nonlinear ill-posed problems , 2017 .

[29]  Jens Flemming,et al.  On complex-valued deautoconvolution of compactly supported functions with sparse Fourier representation , 2016 .

[30]  Ronny Ramlau,et al.  TIGRA—an iterative algorithm for regularizing nonlinear ill-posed problems , 2003 .

[31]  Y. Nesterov.  A method for solving the convex programming problem with convergence rate O(1/k^2) , 1983 .