A Novel Framework for Nonlocal Vectorial Total Variation Based on ℓ p, q, r -norms

In this paper, we propose a novel framework for restoring color images using nonlocal total variation (NLTV) regularization. We observe that the discrete local and nonlocal gradient of a color image can be viewed as a 3D matrix/or tensor with dimensions corresponding to the spatial extend, the differences to other pixels, and the color channels. Based on this observation we obtain a new class of NLTV methods by penalizing the l p,q,r norm of this 3D tensor. Interestingly, this unifies several local color total variation (TV) methods in a single framework. We show in several numerical experiments on image denoising and deblurring that a stronger coupling of different color channels – particularly, a coupling with the l ∞ norm – yields superior reconstruction results.

[1]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[2]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[3]  Stanley Osher,et al.  Deblurring and Denoising of Images by Nonlocal Functionals , 2005, Multiscale Model. Simul..

[4]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[5]  Stanley Osher,et al.  Image Recovery via Nonlocal Operators , 2010, J. Sci. Comput..

[6]  Xuecheng Tai,et al.  Fast algorithm for color texture image inpainting using the non-local CTV model , 2013, Journal of Global Optimization.

[7]  Guillermo Sapiro,et al.  Anisotropic diffusion of multivalued images with applications to color filtering , 1996, IEEE Trans. Image Process..

[8]  Yves Meyer,et al.  Oscillating Patterns in Image Processing and Nonlinear Evolution Equations: The Fifteenth Dean Jacqueline B. Lewis Memorial Lectures , 2001 .

[9]  P. Lions,et al.  Image recovery via total variation minimization and related problems , 1997 .

[10]  Laurent D. Cohen,et al.  Non-local Regularization of Inverse Problems , 2008, ECCV.

[11]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[12]  Petros Maragos,et al.  Convex Generalizations of Total Variation Based on the Structure Tensor with Applications to Inverse Problems , 2013, SSVM.

[13]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[14]  Tony F. Chan,et al.  A General Framework for a Class of First Order Primal-Dual Algorithms for Convex Optimization in Imaging Science , 2010, SIAM J. Imaging Sci..

[15]  Yoram Singer,et al.  Efficient projections onto the l1-ball for learning in high dimensions , 2008, ICML '08.

[16]  Jahn Müller,et al.  Higher-Order TV Methods—Enhancement via Bregman Iteration , 2012, Journal of Scientific Computing.

[17]  Guy Gilboa,et al.  Nonlocal Linear Image Regularization and Supervised Segmentation , 2007, Multiscale Model. Simul..

[18]  Daniel Cremers,et al.  An approach to vectorial total variation based on geometric measure theory , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Yoshinori Sakai,et al.  Vectorized total variation defined by weighted L infinity norm for utilizing inter channel dependency , 2012, 2012 19th IEEE International Conference on Image Processing.

[20]  Leonid P. Yaroslavsky,et al.  Digital Picture Processing , 1985 .

[21]  Tony F. Chan,et al.  Color TV: total variation methods for restoration of vector-valued images , 1998, IEEE Trans. Image Process..

[22]  Andrew J. Davison,et al.  Active Matching , 2008, ECCV.

[23]  Xavier Bresson,et al.  Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction , 2010, SIAM J. Imaging Sci..

[24]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[25]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[26]  R. Rockafellar.  Convex Analysis: (pms-28) , 1970 .

[27]  T. Chan,et al.  Fast dual minimization of the vectorial total variation norm and applications to color image processing , 2008 .

[28]  Giorgio C. Buttazzo,et al.  Variational Analysis in Sobolev and BV Spaces - Applications to PDEs and Optimization, Second Edition , 2014, MPS-SIAM series on optimization.

[29]  Jean-Michel Morel,et al.  Fast Cartoon + Texture Image Filters , 2010, IEEE Transactions on Image Processing.

[30]  Daniel Cremers,et al.  A convex relaxation approach for computing minimal partitions , 2009, CVPR.