Color sketch generation

In this paper, we introduce an NPR system to generate color sketches in a free-hand drawing style. From observation, we found out that in a free-hand style both shape and color of image regions are stylized, which contributes cooperatively to the visual effect of a sketch. With the color regions obtained by our interactive segmentation algorithm, we create a stylized color sketch in two steps. First, in order to manifest the lighting and shading of each region, we shrink the boundary of the color regions with a luminance-based algorithm emphasizing the highlight parts, which enforces consistency with the free-hand artist style of the sketch. Second, the proposed color shift algorithm is applied to image regions to emphasize the main content of the sketch and acquires a visually pleasing combination of color. We choose the optimal combination by minimizing the energy function based on an artist drawn color database, artistic drawing rules and input image colors. The generated results show that our system can produce aesthetically pleasing sketches.

[1]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[2]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[3]  Yair Weiss,et al.  Interpreting Images by Propagating Bayesian Beliefs , 1996, NIPS.

[4]  Paul Haeberli,et al.  Paint by numbers: abstract image representations , 1990, SIGGRAPH.

[5]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[6]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Bruce Gooch,et al.  Color2Gray: salience-preserving color removal , 2005, SIGGRAPH 2005.

[8]  James T. Enns,et al.  Perceptually based brush strokes for nonphotorealistic visualization , 2004, TOGS.

[9]  Bruce Gooch,et al.  Color2Gray: salience-preserving color removal , 2005, ACM Trans. Graph..

[10]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[11]  Aaron Hertzmann,et al.  Painterly rendering with curved brush strokes of multiple sizes , 1998, SIGGRAPH.

[12]  Anne Morgan Spalter,et al.  Interactive color palette tools , 2004, IEEE Computer Graphics and Applications.

[13]  Aaron Hertzmann,et al.  Paint by relaxation , 2001, Proceedings. Computer Graphics International 2001.

[14]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[15]  Owen Carmichael,et al.  Learning Low-level Vision Learning Low-level Vision , 2000 .

[16]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[17]  Harry Shum,et al.  Lazy snapping , 2004, ACM Trans. Graph..

[18]  Jian Sun,et al.  Lazy snapping , 2004, SIGGRAPH 2004.

[19]  William A. Barrett,et al.  Object-based image editing , 2002, ACM Trans. Graph..

[20]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[21]  Michio Shiraishi,et al.  An algorithm for automatic painterly rendering based on local source image approximation , 2000, NPAR '00.

[22]  Peter Litwinowicz,et al.  Processing images and video for an impressionist effect , 1997, SIGGRAPH.