Selective color transfer with multi-source images

A novel method is proposed to transfer selective colors from a set of source images to a target image. An improved EM method is presented to model regional color distribution of the target image by Gaussian Mixture Model (GMM), then, trained by this model, appropriate reference colors are automatically selected from the given source images to color each target region. The generated compelling results prove that our proposed method is applicable to colorize grayscale images and color transfer between chromatic images. A new objective metric considering colorfulness and structural similarity is also proposed to evaluate the quality of the transferred image, which verifies good performance of our method.

[1]  Sabine Süsstrunk,et al.  Measuring colorfulness in natural images , 2003, IS&T/SPIE Electronic Imaging.

[2]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[3]  D. Ruderman,et al.  Statistics of cone responses to natural images: implications for visual coding , 1998 .

[4]  Dongdong Nie,et al.  Optimization based grayscale image colorization , 2007, Pattern Recognit. Lett..

[5]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Chi-Keung Tang,et al.  Local color transfer via probabilistic segmentation by expectation-maximization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Uri Lipowezky,et al.  Grayscale aerial and space image colorization using texture classification , 2006, Pattern Recognit. Lett..

[8]  Guillermo Sapiro,et al.  Fast image and video colorization using chrominance blending , 2006, IEEE Transactions on Image Processing.

[9]  Hideki Noda,et al.  Colorization in YCbCr color space and its application to JPEG images , 2007, Pattern Recognit..

[10]  Chun-Ling Yang,et al.  Gradient-Based Structural Similarity for Image Quality Assessment , 2006, 2006 International Conference on Image Processing.

[11]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[12]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[13]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[14]  Dani Lischinski,et al.  Colorization using optimization , 2004, SIGGRAPH 2004.

[15]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[16]  Silvano Di Zenzo,et al.  A note on the gradient of a multi-image , 1986, Comput. Vis. Graph. Image Process..

[17]  Harry Shum,et al.  Natural Image Colorization , 2007, Rendering Techniques.