On the Implementation of Collaborative TV Regularization: Application to Cartoon+Texture Decomposition

This paper deals with the analysis, implementation, and comparison of several vector-valued total variation (TV) methods that extend the Rudin-Osher-Fatemi variational model to color images. By considering the discrete gradient of a multichannel image as a 3D structure with dimensions corresponding to the spatial extent, the differences to other pixels, and the color channels, we introduce in [J. Duran, M. Moeller, C. Sbert, and D. Cremers, “Collaborative Total Variation: A General Framework for Vectorial TV Models”, SIAM Journal on Imaging Sciences, 9(1), pp. 116–151, 2016] collaborative sparsity enforcing norms for penalizing the resulting tensor. We call this class of regularizations collaborative total variation (CTV). We first analyze the denoising properties of each collaborative norm for suppressing color artifacts while preserving image features and aligning edges. We then describe the primal-dual hybrid gradient method for solving the minimization problem in detail. The resulting CTV–L2 variational model can successfully be applied to many image processing tasks. On the one hand, an extensive performance comparison of several collaborative norms for color image denoising is provided. On the other hand, we analyze the ability of different CTV methods for decomposing a multichannel image into a cartoon and a textural part. Finally, we also include a short discussion on alternative minimization methods and compare their computational efficiency. Source Code ANSI C source code to produce the same results as the demo is accessible at the IPOL web part of this article1.

[1]  L. Mirsky SYMMETRIC GAUGE FUNCTIONS AND UNITARILY INVARIANT NORMS , 1960 .

[2]  Yoram Singer,et al.  Efficient projections onto the l1-ball for learning in high dimensions , 2008, ICML '08.

[3]  Tony F. Chan,et al.  Color TV: total variation methods for restoration of vector-valued images , 1998, IEEE Trans. Image Process..

[4]  Giorgio C. Buttazzo,et al.  Variational Analysis in Sobolev and BV Spaces - Applications to PDEs and Optimization, Second Edition , 2014, MPS-SIAM series on optimization.

[5]  Jean-Michel Morel,et al.  Fast Cartoon + Texture Image Filters , 2010, IEEE Transactions on Image Processing.

[6]  Daniel Cremers,et al.  A convex relaxation approach for computing minimal partitions , 2009, CVPR.

[7]  Mingqiang Zhu,et al.  An Efficient Primal-Dual Hybrid Gradient Algorithm For Total Variation Image Restoration , 2008 .

[8]  Daniel Cremers,et al.  An approach to vectorial total variation based on geometric measure theory , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Yves Meyer,et al.  Oscillating Patterns in Image Processing and Nonlinear Evolution Equations: The Fifteenth Dean Jacqueline B. Lewis Memorial Lectures , 2001 .

[10]  T. Chan,et al.  Fast dual minimization of the vectorial total variation norm and applications to color image processing , 2008 .

[11]  L. Ambrosio,et al.  Functions of Bounded Variation and Free Discontinuity Problems , 2000 .

[12]  Antoni Buades,et al.  Analysis and Extension of the Ponomarenko et al. Method, Estimating a Noise Curve from a Single Image , 2013, Image Process. Line.

[13]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[14]  Gabriele Steidl,et al.  First order algorithms in variational image processing , 2014, ArXiv.

[15]  V. Ivanov,et al.  Conditions for well-posedness in the Hadamard sense in spaces of generalized functions , 1987 .

[16]  Tony F. Chan,et al.  A General Framework for a Class of First Order Primal-Dual Algorithms for Convex Optimization in Imaging Science , 2010, SIAM J. Imaging Sci..

[17]  R. Tyrrell Rockafellar,et al.  Convex Analysis , 1970, Princeton Landmarks in Mathematics and Physics.

[18]  Stanley Osher,et al.  Modeling Textures with Total Variation Minimization and Oscillating Patterns in Image Processing , 2003, J. Sci. Comput..

[19]  Antonin Chambolle,et al.  How to make sure the iterates of FISTA converge , 2014 .

[20]  Y. Nesterov A method for solving the convex programming problem with convergence rate O(1/k^2) , 1983 .

[21]  Petros Maragos,et al.  Convex Generalizations of Total Variation Based on the Structure Tensor with Applications to Inverse Problems , 2013, SSVM.

[22]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[23]  J. Hiriart-Urruty,et al.  Convex analysis and minimization algorithms , 1993 .

[24]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[25]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Xiaoming Yuan,et al.  Adaptive Primal-Dual Hybrid Gradient Methods for Saddle-Point Problems , 2013, 1305.0546.

[27]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[28]  Guillermo Sapiro,et al.  Anisotropic diffusion of multivalued images with applications to color filtering , 1996, IEEE Trans. Image Process..

[29]  Michael Möller,et al.  A Novel Framework for Nonlocal Vectorial Total Variation Based on ℓ p, q, r -norms , 2015, EMMCVPR.

[30]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[31]  Guillermo Sapiro,et al.  Vector-valued active contours , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Tamara Seybold,et al.  Beyond the Kodak image set: A new reference set of color image sequences , 2013, 2013 IEEE International Conference on Image Processing.

[33]  Mila Nikolova,et al.  Local Strong Homogeneity of a Regularized Estimator , 2000, SIAM J. Appl. Math..

[34]  Lei Zhang,et al.  Image demosaicing: a systematic survey , 2008, Electronic Imaging.