Style-aware robust color transfer

Transferring features, such as light and colors, between input and reference images is the main objective of color transfer methods. Current state-of-the-art methods focus mainly on the complete transfer of the light and color distributions. However, they do not successfully grasp specific light and color variations in image styles. In this paper, we propose a local method for carrying out a transfer of style between two images. Our method partitions both images to Gaussian distributed clusters by considering their main style features. These features are automatically determined by the classification step of our algorithm. Moreover, we present several novel policies for input/reference cluster mapping, which have not been tackled so far by previous methods. To complete the style transfer, for each pair of corresponding clusters, we apply a parametric color transfer method and a local chromatic adaptation transform. Results, subjective user evaluation as well as objective evaluation show that the proposed method obtains visually pleasing and artifact-free images, respecting the reference style.

[1]  Youngbae Hwang,et al.  Color Transfer Using Probabilistic Moving Least Squares , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Maureen C. Stone,et al.  A field guide to digital color , 2003 .

[3]  Michael S. Brown,et al.  Illuminant Aware Gamut‐Based Color Transfer , 2014, Comput. Graph. Forum.

[4]  Lizhuang Ma,et al.  Gradient‐Preserving Color Transfer , 2009, Comput. Graph. Forum.

[5]  D. Dowson,et al.  The Fréchet distance between multivariate normal distributions , 1982 .

[6]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[7]  Frank Nielsen,et al.  On weighting clustering , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[9]  A.C. Kokaram,et al.  N-dimensional probability density function transfer and its application to color transfer , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[10]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[11]  D. Massart,et al.  The Mahalanobis distance , 2000 .

[12]  Mark D. Fairchild,et al.  iCAM06: A refined image appearance model for HDR image rendering , 2007, J. Vis. Commun. Image Represent..

[13]  Sylvain Paris,et al.  Example-based video color grading , 2013, ACM Trans. Graph..

[14]  Erik Reinhard,et al.  A Survey of Color Mapping and its Applications , 2014, Eurographics.

[15]  Frédo Durand,et al.  Data-driven hallucination of different times of day from a single outdoor photo , 2013, ACM Trans. Graph..

[16]  Jing Wang,et al.  Robust automatic white balance algorithm using gray color points in images , 2006, IEEE Transactions on Consumer Electronics.

[17]  Erik Reinhard,et al.  Progressive color transfer for images of arbitrary dynamic range , 2011, Comput. Graph..

[18]  L. Evans Partial Differential Equations and Monge-Kantorovich Mass Transfer , 1997 .

[19]  Neil A. Thacker,et al.  The Bhattacharyya metric as an absolute similarity measure for frequency coded data , 1998, Kybernetika.

[20]  Neus Sabater,et al.  Optimal Transportation for Example-Guided Color Transfer , 2014, ACCV.

[21]  Xing Mei,et al.  Content‐Based Colour Transfer , 2013, Comput. Graph. Forum.

[22]  Erik Reinhard,et al.  Progressive histogram reshaping for creative color transfer and tone reproduction , 2010, NPAR.

[23]  Chi-Keung Tang,et al.  Local color transfer via probabilistic segmentation by expectation-maximization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[24]  François Pitié,et al.  Automated colour grading using colour distribution transfer , 2007, Comput. Vis. Image Underst..

[25]  Svetlozar T. Rachev,et al.  Maximum submatrix traces for positive definite matrices , 1993 .

[26]  Miin-Shen Yang A survey of fuzzy clustering , 1993 .