Maximum efficiency for a family of Newton-like methods with frozen derivatives and some applications

A generalized k-step iterative application of Newton's method with frozen derivative is studied and used to solve a system of nonlinear equations. The maximum computational efficiency is computed. A sequence that approximates the order of convergence is generated for the examples, and it numerically confirms the calculation of the order of the method and computational efficiency. This type of method appears in many applications where the authors have heuristically chosen a given number of steps with frozen derivatives. An example is shown in which the total variation (TV) minimization model is approximated using the schemes described in this paper.

[1]  Sergio Amat,et al.  Fast Multiresolution Algorithms and Their Related Variational Problems for Image Denoising , 2010, J. Sci. Comput..

[2]  Sunethra Weerakoon,et al.  A variant of Newton's method with accelerated third-order convergence , 2000, Appl. Math. Lett..

[3]  Stanley Osher,et al.  Modeling Textures with Total Variation Minimization and Oscillating Patterns in Image Processing , 2003, J. Sci. Comput..

[4]  Stanley Osher,et al.  Image Decomposition and Restoration Using Total Variation Minimization and the H1 , 2003, Multiscale Model. Simul..

[5]  George Biros,et al.  Parallel Lagrange-Newton-Krylov-Schur Methods for PDE-Constrained Optimization. Part II: The Lagrange-Newton Solver and Its Application to Optimal Control of Steady Viscous Flows , 2005, SIAM J. Sci. Comput..

[6]  Jacques Liandrat,et al.  Analysis of a New Nonlinear Subdivision Scheme. Applications in Image Processing , 2006, Found. Comput. Math..

[7]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[8]  Miquel Grau-Sánchez,et al.  On some computational orders of convergence , 2010, Appl. Math. Lett..

[9]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[10]  Nikos Paragios,et al.  Handbook of Mathematical Models in Computer Vision , 2005 .

[11]  Gene H. Golub,et al.  A Nonlinear Primal-Dual Method for Total Variation-Based Image Restoration , 1999, SIAM J. Sci. Comput..

[12]  T Ha-Duong,et al.  A modified frozen Newton method to identify a cavity by means of boundary measurements , 2004, Math. Comput. Simul..

[13]  F. Potra,et al.  Nondiscrete induction and iterative processes , 1984 .

[14]  S. Osher,et al.  IMAGE DECOMPOSITION AND RESTORATION USING TOTAL VARIATION MINIMIZATION AND THE H−1 NORM∗ , 2002 .

[15]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[16]  Andy M. Yip,et al.  Total Variation Image Restoration: Overview and Recent Developments , 2006, Handbook of Mathematical Models in Computer Vision.

[17]  J. Traub.  Iterative Methods for the Solution of Equations , 1982 .

[18]  M. Thamban Nair,et al.  A simplified generalized Gauss-Newton method for nonlinear ill-posed problems , 2009, Math. Comput..

[19]  I. Daubechiesa,et al.  Variational image restoration by means of wavelets : Simultaneous decomposition , deblurring , and denoising , 2005 .

[20]  Miquel Grau-Sánchez,et al.  Accelerated iterative methods for finding solutions of a system of nonlinear equations , 2007, Appl. Math. Comput..

[21]  Ingrid Daubechies,et al.  Variational image restoration by means of wavelets: simultaneous decomposition , 2005 .

[22]  Y. Meyer,et al.  Image decompositions using bounded variation and generalized homogeneous Besov spaces , 2007 .

[23]  Karl Kunisch,et al.  Second Order Methods for Optimal Control of Time-Dependent Fluid Flow , 2001, SIAM J. Control. Optim..

[24]  Manfred Laumen.  Newton's Method for a Class of Optimal Shape Design Problems , 1996, SIAM J. Optim..

[25]  Relaxing the convergence conditions for Newton-like methods , 2006 .

[26]  Stanley Osher,et al.  Explicit Algorithms for a New Time Dependent Model Based on Level Set Motion for Nonlinear Deblurring and Noise Removal , 2000, SIAM J. Sci. Comput..

[27]  P. Lions,et al.  Image recovery via total variation minimization and related problems , 1997 .

[28]  Qinian Jin.  On a class of frozen regularized Gauss-Newton methods for nonlinear inverse problems , 2010, Math. Comput..

[29]  Bernard Rougé,et al.  TV Based Image Restoration with Local Constraints , 2003, J. Sci. Comput..

[30]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[31]  R. DeVore,et al.  Fast wavelet techniques for near-optimal image processing , 1992, MILCOM 92 Conference Record.