Fast dual minimization of the vectorial total variation norm and applications to color image processing

We propose a regularization algorithm for color/vectorial images which is fast, easy to code and mathematically well-posed. More precisely, the regularization model is based on the dual formulation of the vectorial Total Variation (VTV) norm and it may be regarded as the vectorial extension of the dual approach defined by Chambolle in [13] for gray-scale/scalar images. The proposed model offers several advantages. First, it minimizes the exact VTV norm whereas standard approaches use a regularized norm. Then, the numerical scheme of minimization is straightforward to implement and finally, the number of iterations to reach the solution is low, which gives a fast regularization algorithm. Finally, and maybe more importantly, the proposed VTV minimization scheme can be easily extended to many standard applications. We apply this $L^1$ vectorial regularization algorithm to the following problems: color inverse scale space, color denoising with the chromaticity-brightness color representation, color image inpainting, color wavelet shrinkage, color image decomposition, color image deblurring, and color denoising on manifolds. Generally speaking, this VTV minimization scheme can be used in problems that required vector field (color, other feature vector) regularization while preserving discontinuities.

[1]  J. Neumann Zur Theorie der Gesellschaftsspiele , 1928 .

[2]  M. Sion On general minimax theorems , 1958 .

[3]  I. Ekeland,et al.  Convex analysis and variational problems , 1976 .

[4]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[5]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[6]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[7]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[8]  On a Problem of Bethuel, Brezis and Helein Concerning the Ginzburg-Landau Functional , 1995 .

[9]  Guillermo Sapiro,et al.  Anisotropic diffusion of multivalued images with applications to color filtering , 1996, IEEE Trans. Image Process..

[10]  Ron Kimmel,et al.  A general framework for low level vision , 1998, IEEE Trans. Image Process..

[11]  Tony F. Chan,et al.  Total variation blind deconvolution , 1998, IEEE Trans. Image Process..

[12]  Antonin Chambolle,et al.  Nonlinear wavelet image processing: variational problems, compression, and noise removal through wavelet shrinkage , 1998, IEEE Trans. Image Process..

[13]  Tony F. Chan,et al.  Color TV: total variation methods for restoration of vector-valued images , 1998, IEEE Trans. Image Process..

[14]  Gene H. Golub,et al.  A Nonlinear Primal-Dual Method for Total Variation-Based Image Restoration , 1999, SIAM J. Sci. Comput..

[15]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[16]  L. Ambrosio,et al.  Functions of Bounded Variation and Free Discontinuity Problems , 2000 .

[17]  Tony F. Chan,et al.  Total Variation Denoising and Enhancement of Color Images Based on the CB and HSV Color Models , 2001, J. Vis. Commun. Image Represent..

[18]  Yves Meyer,et al.  Oscillating Patterns in Image Processing and Nonlinear Evolution Equations: The Fifteenth Dean Jacqueline B. Lewis Memorial Lectures , 2001 .

[19]  Guillermo Sapiro,et al.  Variational Problems and Partial Differential Equations on Implicit Surfaces: Bye Bye Triangulated Surfaces? , 2003 .

[20]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[21]  Antonin Chambolle,et al.  A l1-Unified Variational Framework for Image Restoration , 2004, ECCV.

[22]  M. Nikolova An Algorithm for Total Variation Minimization and Applications , 2004 .

[23]  Antonin Chambolle,et al.  Dual Norms and Image Decomposition Models , 2005, International Journal of Computer Vision.

[24]  Jérôme Darbon,et al.  A Vectorial Self-dual Morphological Filter Based on Total Variation Minimization , 2005, ISVC.

[25]  Lin He,et al.  Blind deconvolution using TV regularization and Bregman iteration , 2005, Int. J. Imaging Syst. Technol..

[26]  Wotao Yin,et al.  An Iterative Regularization Method for Total Variation-Based Image Restoration , 2005, Multiscale Model. Simul..

[27]  T. Chan,et al.  Variational image inpainting , 2005 .

[28]  Stanley Osher,et al.  Color Texture Modeling and Color Image Decomposition in a Variational-PDE Approach , 2006, 2006 Eighth International Symposium on Symbolic and Numeric Algorithms for Scientific Computing.

[29]  Jérôme Darbon,et al.  Image Restoration with Discrete Constrained Total Variation Part I: Fast and Exact Optimization , 2006, Journal of Mathematical Imaging and Vision.

[30]  Xavier Bresson,et al.  Image Segmentation Model using Active Contour and Image Decomposition , 2006, 2006 International Conference on Image Processing.

[31]  Jean-François Aujol,et al.  Color image decomposition and restoration , 2006, J. Vis. Commun. Image Represent..

[32]  Massimo Fornasier,et al.  Restoration of Color Images by Vector Valued BV Functions and Variational Calculus , 2007, SIAM J. Appl. Math..

[33]  Xavier Bresson,et al.  Scale Space Analysis and Active Contours for Omnidirectional Images , 2007, IEEE Transactions on Image Processing.

[34]  Xue-Cheng Tai,et al.  Image Inpainting Using a TV-Stokes Equation , 2007 .

[35]  Riccardo March,et al.  Variational Models for Image Colorization via Chromaticity and Brightness Decomposition , 2007, IEEE Transactions on Image Processing.

[36]  L. Vese,et al.  MULTISCALE HIERARCHICAL DECOMPOSITION OF IMAGES WITH APPLICATIONS TO DEBLURRING, DENOISING AND SEGMENTATION ∗ , 2008 .