Content‐Based Colour Transfer

This paper presents a novel content‐based method for transferring the colour patterns between images. Unlike previous methods that rely on image colour statistics, our method puts an emphasis on high‐level scene content analysis. We first automatically extract the foreground subject areas and background scene layout from the scene. The semantic correspondences of the regions between source and target images are established. In the second step, the source image is re‐coloured in a novel optimization framework, which incorporates the extracted content information and the spatial distributions of the target colour styles. A new progressive transfer scheme is proposed to integrate the advantages of both global and local transfer algorithms, as well as avoid the over‐segmentation artefact in the result. Experiments show that with a better understanding of the scene contents, our method well preserves the spatial layout, the colour distribution and the visual coherence in the transfer process. As an interesting extension, our method can also be used to re‐colour video clips with spatially‐varied colour effects.

[1]  Yizhou Yu,et al.  Data-driven image color theme enhancement , 2010, ACM Trans. Graph..

[2]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[3]  Fabio Pellacini,et al.  User‐Controllable Color Transfer , 2010, Comput. Graph. Forum.

[4]  Bing-Yu Chen,et al.  Example‐based Multiple Local Color Transfer by Strokes , 2008, Comput. Graph. Forum.

[5]  Stephen Lin,et al.  Semantic colorization with internet images , 2011, ACM Trans. Graph..

[6]  Xiang Zhang,et al.  Selective color transferring via ellipsoid color mixture map , 2012, J. Vis. Commun. Image Represent..

[7]  Qing Luan,et al.  Color Transfer Brush , 2007 .

[8]  Daniel Freedman,et al.  Computing Color Transforms with Applications to Image Editing , 2010, Journal of Mathematical Imaging and Vision.

[9]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[10]  Alexei A. Efros,et al.  Recovering Surface Layout from an Image , 2007, International Journal of Computer Vision.

[11]  Heung-Yeung Shum,et al.  Paint selection , 2009, SIGGRAPH 2009.

[12]  László Neumann,et al.  Color Style Transfer Techniques using Hue, Lightness and Saturation Histogram Matching , 2005, CAe.

[13]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[14]  Erik Reinhard,et al.  Progressive color transfer for images of arbitrary dynamic range , 2011, Comput. Graph..

[15]  Baining Guo,et al.  Image‐based Material Weathering , 2008, Comput. Graph. Forum.

[16]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Chuan-Kai Yang,et al.  Automatic Mood-Transferring between Color Images , 2008, IEEE Computer Graphics and Applications.

[18]  Harry Shum,et al.  Paint selection , 2009, ACM Trans. Graph..

[19]  Guanbo Bao,et al.  Fast local color transfer via dominant colors mapping , 2010, SIGGRAPH ASIA.

[20]  Lizhuang Ma,et al.  Gradient‐Preserving Color Transfer , 2009, Comput. Graph. Forum.

[21]  Xiaoou Tang,et al.  Photo and Video Quality Evaluation: Focusing on the Subject , 2008, ECCV.

[22]  Masayuki Nakajima,et al.  Example-Based Color Stylization of Images , 2005, TAP.

[23]  Masayuki Nakajima,et al.  Example-Based Color Transformation of Image and Video Using Basic Color Categories , 2007, IEEE Transactions on Image Processing.

[24]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[25]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[26]  Alexei A. Efros,et al.  Using Color Compatibility for Assessing Image Realism , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[27]  Rong Xiao,et al.  Dynamic Cascades for Face Detection , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[29]  Wei Xu,et al.  Performance evaluation of color correction approaches for automatic multi-view image and video stitching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Chi-Keung Tang,et al.  Local color transfer via probabilistic segmentation by expectation-maximization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[31]  François Pitié,et al.  Automated colour grading using colour distribution transfer , 2007, Comput. Vis. Image Underst..

[32]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[33]  Naila Murray,et al.  Towards automatic concept transfer , 2011, NPAR '11.

[34]  Jian Sun,et al.  Salient object detection by composition , 2011, 2011 International Conference on Computer Vision.

[35]  Dani Lischinski,et al.  Non-rigid dense correspondence with applications for image enhancement , 2011, ACM Trans. Graph..