A coupled total variation model with curvature driven for image colorization

In this paper, we study the problem of image colorization based on the propagation from given color pixels to the other grey-level pixels in grayscale images. We propose to use a coupled total variation model with curvature information of luminance channel to control the colorization process. There are two distinct advantages of the proposed model: (i) the involved optimization problem is convex and it is not sensitive to initial guess of colorization procedure; (ii) the proposed model makes use of curvature information to control the color diffusion process which is more effectively than that by using the gradient information. The existence of the minimizer of the proposed model can be shown, and the numerical solver based on convex programming techniques can be developed to solve the resulting model very efficiently. Experimental results are reported to demonstrate that the performance of the proposed model is better than those of the other color propagation models, especially when we deal with large regions of grayscale images for colorization.

[1]  R. Hunter Photoelectric Color Difference Meter , 1958 .

[2]  B. Mercier,et al.  A dual algorithm for the solution of nonlinear variational problems via finite element approximation , 1976 .

[3]  Kazufumi Ito,et al.  An augmented Lagrangian technique for variational inequalities , 1990 .

[4]  Dimitri P. Bertsekas,et al.  On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators , 1992, Math. Program..

[5]  L. Ambrosio,et al.  Functions of Bounded Variation and Free Discontinuity Problems , 2000 .

[6]  G. Sapiro,et al.  Geometric partial differential equations and image analysis [Book Reviews] , 2001, IEEE Transactions on Medical Imaging.

[7]  Yunmei Chen,et al.  Adaptive total variation for image restoration in BV space , 2002 .

[8]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[9]  Dani Lischinski,et al.  Colorization using optimization , 2004, SIGGRAPH 2004.

[10]  Guillermo Sapiro,et al.  Inpainting the colors , 2005, IEEE International Conference on Image Processing 2005.

[11]  Guillermo Sapiro,et al.  Fast image and video colorization using chrominance blending , 2006, IEEE Transactions on Image Processing.

[12]  Riccardo March,et al.  Variational Models for Image Colorization via Chromaticity and Brightness Decomposition , 2007, IEEE Transactions on Image Processing.

[13]  T. Chan,et al.  Fast dual minimization of the vectorial total variation norm and applications to color image processing , 2008 .

[14]  Enric Meinhardt,et al.  Anisotropic Cheeger Sets and Applications , 2009, SIAM J. Imaging Sci..

[15]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[16]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[17]  Xuelong Li,et al.  Color to Gray: Visual Cue Preservation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Michael K. Ng,et al.  Solving Constrained Total-variation Image Restoration and Reconstruction Problems via Alternating Direction Methods , 2010, SIAM J. Sci. Comput..

[19]  Sung Ha Kang,et al.  Image and Video Colorization Using Vector-Valued Reproducing Kernel Hilbert Spaces , 2010, Journal of Mathematical Imaging and Vision.

[20]  Raymond H. Chan,et al.  Alternating Direction Method for Image Inpainting in Wavelet Domains , 2011, SIAM J. Imaging Sci..

[21]  Christof Koch,et al.  Image Signature: Highlighting Sparse Salient Regions , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Aurélie Bugeau,et al.  Variational Exemplar-Based Image Colorization , 2014, IEEE Transactions on Image Processing.

[23]  Michael K. Ng,et al.  A Variational Approach for Image Decolorization by Variance Maximization , 2014, SIAM J. Imaging Sci..

[24]  Aurélie Bugeau,et al.  Luminance-Chrominance Model for Image Colorization , 2015, SIAM J. Imaging Sci..