A New Smoothing Based Image Recolorization Method

Image recolorization is a process of generating new synthetic images for given reference images and input images. Color characteristics and geometrical structure details of the synthetic images are transferred from reference images and input images, respectively. In classical image recolorization models, the total variation (TV) regularizer is usually used to suppress noise and graininess during the process of estimating synthetic images. However, the TV regularizer usually produces pseudo contours known as staircase-like artifacts and cannot preserve some important structure details well. To solve these problems, in this paper a new smoothing based image recolorization model is proposed, in which a fractional-order TV regularizer is designed. Moreover, an edge protection process is also proposed which can further improve the preservation performance of image tiny details. Numerical results demonstrate that our proposed model can effectively protect image tiny details of image recolorization results, while the staircase-like artifacts are avoided.

[1]  László Neumann,et al.  Color Style Transfer Techniques using Hue, Lightness and Saturation Histogram Matching , 2005, CAe.

[2]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[3]  Dani Lischinski,et al.  Colorization by example , 2005, EGSR '05.

[4]  Tao Mei,et al.  Tree-Based Visualization and Optimization for Image Collection , 2015, IEEE Transactions on Cybernetics.

[5]  Jiashu Zhang,et al.  Robust Kronecker product video denoising based on fractional-order total variation model , 2016, Signal Process..

[6]  Julien Rabin,et al.  Wasserstein regularization of imaging problem , 2011, 2011 18th IEEE International Conference on Image Processing.

[7]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[8]  Yu Han,et al.  Color Transfer Using Adaptive Second-Order Total Generalized Variation Regularizer , 2018, IEEE Access.

[9]  Jirí Zára,et al.  Colorization of black-and-white cartoons , 2005, Image Vis. Comput..

[10]  Dianhui Wang,et al.  A fractional-order adaptive regularization primal-dual algorithm for image denoising , 2015, Inf. Sci..

[11]  Sheng-Jyh Wang,et al.  Image recolorization for the colorblind , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  A.C. Kokaram,et al.  N-dimensional probability density function transfer and its application to color transfer , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[13]  José M. Bioucas-Dias,et al.  An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems , 2009, IEEE Transactions on Image Processing.

[14]  Nicolas Papadakis,et al.  A Variational Model for Histogram Transfer of Color Images , 2011, IEEE Transactions on Image Processing.

[15]  Qing Zhang,et al.  Palette-Based Image Recoloring Using Color Decomposition Optimization. , 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[16]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[17]  Riccardo March,et al.  Variational Models for Image Colorization via Chromaticity and Brightness Decomposition , 2007, IEEE Transactions on Image Processing.

[18]  Bing-Yu Chen,et al.  Example‐based Multiple Local Color Transfer by Strokes , 2008, Comput. Graph. Forum.

[19]  Yu Han,et al.  Cartoon and Texture Decomposition-Based Color Transfer for Fabric Images , 2017, IEEE Transactions on Multimedia.