Generalized Intersection Algorithms with Fixpoints for Image Decomposition Learning

In image processing, classical methods minimize a suitable functional that balances between computational feasibility (convexity of the functional is ideal) and suitable penalties reflecting the desired image decomposition. The fact that algorithms derived from such minimization problems can be used to construct (deep) learning architectures has spurred the development of algorithms that can be trained for a specifically desired image decomposition, e.g. into cartoon and texture. While many such methods are very successful, theoretical guarantees are only scarcely available. To this end, in this contribution, we formalize a general class of intersection point problems encompassing a wide range of (learned) image decomposition models, and we give an existence result for a large subclass of such problems, i.e. giving the existence of a fixpoint of the corresponding algorithm. This class generalizes classical model-based variational problems, such as the TV-l2 -model or the more general TV-Hilbert model. To illustrate the potential for learned algorithms, novel (non learned) choices within our class show comparable results in denoising and texture removal.

[1]  Guan Gui,et al.  Co-Robust-ADMM-Net: Joint ADMM Framework and DNN for Robust Sparse Composite Regularization , 2018, IEEE Access.

[2]  S. Mallat A wavelet tour of signal processing , 1998 .

[3]  Thierry Blu,et al.  Isotropic polyharmonic B-splines: scaling functions and wavelets , 2005, IEEE Transactions on Image Processing.

[4]  Robin Richter,et al.  Cartoon-Residual Image Decompositions with Application in Fingerprint Recognition , 2019 .

[5]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[6]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[7]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..

[8]  Antonin Chambolle,et al.  Total Variation in Imaging , 2015, Handbook of Mathematical Methods in Imaging.

[9]  Dimitri Van De Ville,et al.  Wavelet Steerability and the Higher-Order Riesz Transform , 2010, IEEE Transactions on Image Processing.

[10]  M. Bergounioux,et al.  A Second-Order Model for Image Denoising , 2010 .

[11]  Enrique Outerelo Domínguez,et al.  Mapping Degree Theory , 2009 .

[12]  Yves Meyer,et al.  Oscillating Patterns in Image Processing and Nonlinear Evolution Equations: The Fifteenth Dean Jacqueline B. Lewis Memorial Lectures , 2001 .

[13]  T. Chan,et al.  Edge-preserving and scale-dependent properties of total variation regularization , 2003 .

[14]  Guy Gilboa,et al.  Constrained and SNR-Based Solutions for TV-Hilbert Space Image Denoising , 2006, Journal of Mathematical Imaging and Vision.

[15]  Otmar Scherzer,et al.  Variational Methods in Imaging , 2008, Applied mathematical sciences.

[16]  Jonas Adler,et al.  Learned Primal-Dual Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[17]  Arrigo Cellina,et al.  Approximation of set valued functions and fixed point theorems , 1969 .

[18]  R. Glowinski,et al.  Augmented Lagrangian and Operator-Splitting Methods in Nonlinear Mechanics , 1987 .

[19]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[20]  Yunjin Chen,et al.  Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  S. Osher,et al.  Image restoration: Total variation, wavelet frames, and beyond , 2012 .

[22]  Jonas Adler,et al.  Solving ill-posed inverse problems using iterative deep neural networks , 2017, ArXiv.

[23]  Jian Sun,et al.  Deep ADMM-Net for Compressive Sensing MRI , 2016, NIPS.

[24]  D. Gabay Applications of the method of multipliers to variational inequalities , 1983 .

[25]  François Malgouyres,et al.  Minimizing the total variation under a general convex constraint for image restoration , 2002, IEEE Trans. Image Process..

[26]  Wei Yu,et al.  On learning optimized reaction diffusion processes for effective image restoration , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Stanley Osher,et al.  Modeling Textures with Total Variation Minimization and Oscillating Patterns in Image Processing , 2003, J. Sci. Comput..

[28]  Stanley Osher,et al.  Image Decomposition and Restoration Using Total Variation Minimization and the H1 , 2003, Multiscale Model. Simul..

[29]  Thomas Brox,et al.  On the Equivalence of Soft Wavelet Shrinkage, Total Variation Diffusion, Total Variation Regularization, and SIDEs , 2004, SIAM J. Numer. Anal..

[30]  Dimitri Van De Ville,et al.  Multiresolution Monogenic Signal Analysis Using the Riesz–Laplace Wavelet Transform , 2009, IEEE Transactions on Image Processing.

[31]  Ge Wang,et al.  A Perspective on Deep Imaging , 2016, IEEE Access.

[32]  T. Pock,et al.  Second order total generalized variation (TGV) for MRI , 2011, Magnetic resonance in medicine.

[33]  Y. Meyer,et al.  Image decompositions using bounded variation and generalized homogeneous Besov spaces , 2007 .

[34]  Jean-Michel Morel,et al.  Fast Cartoon + Texture Image Filters , 2010, IEEE Transactions on Image Processing.

[35]  Michael Unser,et al.  Convolutional Neural Networks for Inverse Problems in Imaging: A Review , 2017, IEEE Signal Processing Magazine.

[36]  S. Osher,et al.  IMAGE DECOMPOSITION AND RESTORATION USING TOTAL VARIATION MINIMIZATION AND THE H−1 NORM∗ , 2002 .

[37]  Johannes R. Sveinsson,et al.  Combined wavelet and curvelet denoising of SAR images using TV segmentation , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[38]  C. Jordan Essai sur la géométrie à $n$ dimensions , 1875 .

[39]  Dimitri P. Bertsekas,et al.  On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators , 1992, Math. Program..

[40]  Benjamin Berkels,et al.  Cartoon Extraction Based on Anisotropic Image Classification Vision , Modeling , and Visualization Proceedings , 2006 .

[41]  Stanley Osher,et al.  Image Denoising and Decomposition with Total Variation Minimization and Oscillatory Functions , 2004, Journal of Mathematical Imaging and Vision.

[42]  Xue-Cheng Tai,et al.  Augmented Lagrangian Method, Dual Methods, and Split Bregman Iteration for ROF, Vectorial TV, and High Order Models , 2010, SIAM J. Imaging Sci..

[43]  F. Moldoveanu,et al.  Image segmentation based on active contours without edges , 2012, 2012 IEEE 8th International Conference on Intelligent Computer Communication and Processing.