Image colorization based on ADMM with fast singular value thresholding by Chebyshev polynomial approximation

We propose an image colorization method using fast soft-thresholding of singular values (singular value thresholding). An image colorization method with nuclear norm minimization (NNM) has been proposed and brings good results. NNM usually requires iterative application of singular value decomposition (SVD) for singular value thresholding. However, the computational cost of SVD in the colorization method becomes too expensive to handle high-resolution images. In this paper, we reduce its computational cost by using Chebyshev polynomial approximation (CPA). Singular value thresholding is expressed by a multiplication of certain matrices derived from the characteristic of CPA. As a result, our CPA-based technique makes the image colorization method much more efficient. In addition, we replace the optimization method used in the image colorization method by alternating direction method of multipliers, which further accelerates the computation. Experimental results verify the effectiveness of our method with respect to the computation time and the approximation precision.

[1]  Pascal Frossard,et al.  Chebyshev polynomial approximation for distributed signal processing , 2011, 2011 International Conference on Distributed Computing in Sensor Systems and Workshops (DCOSS).

[2]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[3]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[4]  Tien-Tsin Wong,et al.  Manga colorization , 2006, SIGGRAPH 2006.

[5]  Yi Ma,et al.  The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices , 2010, Journal of structural biology.

[6]  B. Mercier,et al.  A dual algorithm for the solution of nonlinear variational problems via finite element approximation , 1976 .

[7]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[8]  G. Phillips Interpolation and Approximation by Polynomials , 2003 .

[9]  Massimo Fornasier,et al.  Nonlinear Projection Recovery in Digital Inpainting for Color Image Restoration , 2006, Journal of Mathematical Imaging and Vision.

[10]  Guillermo Sapiro,et al.  Fast image and video colorization using chrominance blending , 2006, IEEE Transactions on Image Processing.

[11]  Shunsuke Ono,et al.  Non-local/local image filters using fast eigenvalue filtering , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[12]  Jian Guan,et al.  Color by linear neighborhood embedding , 2005, IEEE International Conference on Image Processing 2005.

[13]  Stephen Lin,et al.  Intrinsic colorization , 2008, SIGGRAPH 2008.

[14]  Emmanuel J. Candès,et al.  The Power of Convex Relaxation: Near-Optimal Matrix Completion , 2009, IEEE Transactions on Information Theory.

[15]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[16]  Guillermo Sapiro,et al.  Inpainting the colors , 2005, IEEE International Conference on Image Processing 2005.

[17]  Shunsuke Ono,et al.  Colorization-based coding by focusing on characteristics of colorization bases , 2010, 28th Picture Coding Symposium.

[18]  Peyman Milanfar,et al.  A Tour of Modern Image Filtering: New Insights and Methods, Both Practical and Theoretical , 2013, IEEE Signal Processing Magazine.

[19]  G. Sapiro,et al.  A collaborative framework for 3D alignment and classification of heterogeneous subvolumes in cryo-electron tomography. , 2013, Journal of structural biology.

[20]  Zhihua Zhang,et al.  Colorization by Matrix Completion , 2012, AAAI.

[21]  Massimo Fornasier,et al.  Inpainting of Ancient Austrian frescoes , 2008 .

[22]  Xiang Zhu,et al.  How to SAIF-ly Boost Denoising Performance , 2013, IEEE Transactions on Image Processing.

[23]  Suk Ho Lee,et al.  Colorization-Based Compression Using Optimization , 2013, IEEE Transactions on Image Processing.

[24]  J. Moreau Fonctions convexes duales et points proximaux dans un espace hilbertien , 1962 .

[25]  Peyman Milanfar,et al.  Global Image Denoising , 2014, IEEE Transactions on Image Processing.

[26]  Yuichi Tanaka,et al.  Globalized BM3D using fast eigenvalue filtering , 2015, 2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[27]  Dimitri P. Bertsekas,et al.  On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators , 1992, Math. Program..

[28]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[29]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.