Example‐based Multiple Local Color Transfer by Strokes

This paper investigates a new approach for color transfer. Rather than transferring color from one image to another globally, we propose a system with a stroke‐based user interface to provide a direct indication mechanism. We further present a multiple local color transfer method. Through our system the user can easily enhance a defect (source) photo by referring to some other good quality (target) images by simply drawing some strokes. Then, the system will perform the multiple local color transfer automatically. The system consists of two major steps. First, the user draws some strokes on the source and target images to indicate corresponding regions and also the regions he or she wants to preserve. The regions to be preserved which will be masked out based on an improved graph cuts algorithm. Second, a multiple local color transfer method is presented to transfer the color from the target image(s) to the source image through gradient‐guided pixel‐wise color transfer functions. Finally, the defect (source) image can be enhanced seamlessly by multiple local color transfer based on some good quality (target) examples through an interactive and intuitive stroke‐based user interface.

[1]  Frédo Durand,et al.  Flash photography enhancement via intrinsic relighting , 2004, SIGGRAPH 2004.

[2]  Michael S. Brown,et al.  ShapePalettes: interactive normal transfer via sketching , 2007, SIGGRAPH 2007.

[3]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[4]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[5]  Masayuki Nakajima,et al.  Example-Based Color Transformation of Image and Video Using Basic Color Categories , 2007, IEEE Transactions on Image Processing.

[6]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[7]  Dani Lischinski,et al.  Colorization using optimization , 2004, SIGGRAPH 2004.

[8]  Zeev Farbman,et al.  Interactive local adjustment of tonal values , 2006, ACM Trans. Graph..

[9]  F. Durand,et al.  Flash photography enhancement via intrinsic relighting , 2004, ACM Trans. Graph..

[10]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[11]  Jian Sun,et al.  Video object cut and paste , 2005, SIGGRAPH 2005.

[12]  Chi-Keung Tang,et al.  Local color transfer via probabilistic segmentation by expectation-maximization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Dani Lischinski,et al.  Joint bilateral upsampling , 2007, SIGGRAPH 2007.

[14]  Ramesh Raskar,et al.  Removing photography artifacts using gradient projection and flash-exposure sampling , 2005, SIGGRAPH 2005.

[15]  Frédo Durand,et al.  Two-scale tone management for photographic look , 2006, SIGGRAPH 2006.

[16]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[17]  Dani Lischinski,et al.  Joint bilateral upsampling , 2007, ACM Trans. Graph..

[18]  Harry Shum,et al.  Video object cut and paste , 2005, ACM Trans. Graph..

[19]  David Salesin,et al.  Interactive digital photomontage , 2004, ACM Trans. Graph..

[20]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[21]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[22]  Ramesh Raskar,et al.  Removing photography artifacts using gradient projection and flash-exposure sampling , 2005, ACM Trans. Graph..

[23]  Richard Szeliski,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[24]  Harry Shum,et al.  Bayesian Correction of Image Intensity with Spatial Consideration , 2004, ECCV.

[25]  Harry Shum,et al.  ShapePalettes: interactive normal transfer via sketching , 2007, ACM Trans. Graph..

[26]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[27]  Frédo Durand,et al.  Two-scale tone management for photographic look , 2006, ACM Trans. Graph..