On the Convergence of the IRLS Algorithm in Non-Local Patch Regression

Recently, it was demonstrated in , that the robustness of the classical Non-Local Means (NLM) algorithm can be improved by incorporating lp (0 <; p ≤ 2) regression into the NLM framework. This general optimization framework, called Non-Local Patch Regression (NLPR), contains NLM as a special case. Denoising results on synthetic and natural images show that NLPR consistently performs better than NLM beyond a moderate noise level, and significantly so when p is close to zero. An iteratively reweighted least-squares (IRLS) algorithm was proposed for solving the regression problem in NLPR, where the NLM output was used to initialize the iterations. Based on exhaustive numerical experiments, we observe that the IRLS algorithm is globally convergent (for arbitrary initialization) in the convex regime 1 ≤ p ≤ 2, and locally convergent (e.g., fails rarely using NLM initialization) in the non-convex regime 0 <; p <; 1. In this letter, we study the cost associated with the IRLS updates, and this, along with the framework of bounded optimization, is used to analyze the convergence of the algorithm.

[1]  Amit Singer,et al.  Non-Local Euclidean Medians , 2012, IEEE Signal Processing Letters.

[2]  Songcan Chen,et al.  Analysis of Non-Local Euclidean Medians and Its Improvement , 2013, IEEE Signal Processing Letters.

[3]  I. Daubechies,et al.  Iteratively reweighted least squares minimization for sparse recovery , 2008, 0807.0575.

[4]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[5]  Wotao Yin,et al.  Iteratively reweighted algorithms for compressive sensing , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Ulrich Eckhardt,et al.  Linear convergence of generalized Weiszfeld's method , 1980, Computing.

[7]  Peyman Milanfar,et al.  A Tour of Modern Image Filtering , 2013 .

[8]  Peyman Milanfar,et al.  A Tour of Modern Image Filtering: New Insights and Methods, Both Practical and Theoretical , 2013, IEEE Signal Processing Magazine.

[9]  Amit Singer,et al.  Non-local patch regression: Robust image denoising in patch space , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  M. Shirosaki Another proof of the defect relation for moving targets , 1991 .

[11]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..