A primal-dual line search method and applications in image processing

Operator splitting algorithms are enjoying wide acceptance in signal processing for their ability to solve generic convex optimization problems exploiting their structure and leading to efficient implementations. These algorithms are instances of the Krasnosel'skil-Mann scheme for finding fixed points of averaged operators. Despite their popularity, however, operator splitting algorithms are sensitive to ill conditioning and often converge slowly. In this paper we propose a line search primal-dual method to accelerate and robustify the Chambolle-Pock algorithm based on SuperMann: a recent extension of the Kras-nosel'skil-Mann algorithmic scheme. We discuss the convergence properties of this new algorithm and we showcase its strengths on the problem of image denoising using the anisotropic total variation regularization.

[1]  Bastian Goldlücke,et al.  Variational Analysis , 2014, Computer Vision, A Reference Guide.

[2]  M. Grasmair,et al.  Anisotropic Total Variation Filtering , 2010 .

[3]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[4]  丸山 徹.  Convex Analysisの二,三の進展について , 1977 .

[5]  Panagiotis Patrinos,et al.  Asymmetric forward–backward–adjoint splitting for solving monotone inclusions involving three operators , 2016, Comput. Optim. Appl..

[6]  M. Nikolova.  An Algorithm for Total Variation Minimization and Applications , 2004 .

[7]  Iuri Frosio,et al.  Optimal Choice of Regularization Parameter in Image Denoising , 2011, ICIAP.

[8]  Alberto Bemporad,et al.  GPU-Accelerated Stochastic Predictive Control of Drinking Water Networks , 2016, IEEE Transactions on Control Systems Technology.

[9]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[10]  Mohamed-Jalal Fadili,et al.  Monotone operator splitting for optimization problems in sparse recovery , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[11]  Panagiotis Patrinos,et al.  SuperMann: A Superlinearly Convergent Algorithm for Finding Fixed Points of Nonexpansive Operators , 2016, IEEE Transactions on Automatic Control.

[12]  Pantelis Sopasakis,et al.  Accelerated reconstruction of a compressively sampled data stream , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[13]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[14]  R. Rockafellar,et al.  Implicit Functions and Solution Mappings: A View from Variational Analysis , 2009 .

[15]  Stephen P. Boyd,et al.  A Primer on Monotone Operator Methods , 2015 .

[16]  A. Bemporad,et al.  Forward-backward truncated Newton methods for convex composite optimization , 2014, 1402.6655.

[17]  Patrick L. Combettes,et al.  Signal Recovery by Proximal Forward-Backward Splitting , 2005, Multiscale Model. Simul..

[18]  Patrick L. Combettes,et al.  Proximal Splitting Methods in Signal Processing , 2009, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.