Example-based color stylization based on categorical perception

We describe a new computational approach to stylize the colors of an image by using a reference image. During processing, we take characteristics of human color perception into account to generate more appealing results. Our system starts by classifying each pixel value into one of a set of the basic color categories, derived from our psycho-physiological experiments. The basic color categories are perceptual categories that are universal to everyone, regardless of nationality or cultural background. These categories provide restrictions on the color transformations to avoid generating unnatural results. Our system then renders a new image by transferring colors from a reference image to the input image, based on this categorizations. To avoid artifacts due to the explicit clustering, our system defines fuzzy categorization when pseudo-contours appear in the resulting image. We present a variety of results and show that our color transformation performs a large, yet natural color transformation without any sense of incongruity, and that the resulting images automatically capture the characteristics of the color use of the reference image.

[1]  Mahdi Nezamabadi,et al.  Color Appearance Models , 2014, J. Electronic Imaging.

[2]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[3]  Masayuki Nakajima,et al.  A framework for transfer colors based on the basic color categories , 2003, Proceedings Computer Graphics International 2003.

[4]  Peter Litwinowicz,et al.  Processing images and video for an impressionist effect , 1997, SIGGRAPH.

[5]  Keiji Uchikawa,et al.  Expression of Color Appearance in Aperture and Surface Color Modes with A Category Rating Estimation Method , 1994 .

[6]  Paul Haeberli,et al.  Paint by numbers: abstract image representations , 1990, SIGGRAPH.

[7]  R. M. Boynton,et al.  Categorical color perception of Japanese observers: Comparison with that of Americans , 1987, Vision Research.

[8]  P. Kay Basic Color Terms: Their Universality and Evolution , 1969 .

[9]  Barbara J. Meier Painterly rendering for animation , 1996, SIGGRAPH.

[10]  Masayuki Nakajima,et al.  New Image/Video Media and It's Application. Automatic Production of Hand-Painted Images. , 1996 .

[11]  E. R. Heider Universals in color naming and memory. , 1972, Journal of experimental psychology.

[12]  Masayuki Nakajima,et al.  Color transformation based on the basic color categories of a painting , 2002, SIGGRAPH '02.

[13]  Mario Costa Sousa,et al.  Computer‐Generated Graphite Pencil Rendering of 3D Polygonal Models , 1999, Comput. Graph. Forum.

[14]  Michael H. Brill,et al.  Color appearance models , 1998 .

[15]  Bruce Gooch,et al.  Non-photorealistic rendering , 2001 .

[16]  Mario Costa Sousa,et al.  Observational Models of Graphite Pencil Materials , 2000, Comput. Graph. Forum.

[17]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[18]  Aaron Hertzmann,et al.  Painterly rendering with curved brush strokes of multiple sizes , 1998, SIGGRAPH.

[19]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[20]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  David Salesin,et al.  Computer-generated watercolor , 1997, SIGGRAPH.