ColorArt: Suggesting Colorizations For Graphic Arts Using Optimal Color-Graph Matching

Colorization is a complex task of selecting a combination of colors and arriving at an appropriate spatial arrangement of the colors in an image. In this paper, we propose a novel approach for automatic colorization of graphic arts like graphic patterns, info-graphics and cartoons. Our approach uses the artist’s colored graphics as a reference to color a template image. We also propose a retrieval system for selecting a relevant reference image corresponding to the given template from a dataset of reference images colored by different artists. Finally, we formulate the problem of colorization as a optimal graph matching problem over color groups in the reference and the template image. We demonstrate results on a variety of coloring tasks and evaluate our model through multiple perceptual studies. The studies show that the results generated through our model are significantly preferred by the participants over other automatic colorization methods.

[1]  Arthur Karp,et al.  The Elements of Color , 1970 .

[2]  J. Itten The art of color : the subjective experience and objective rationale of color , 1973 .

[3]  Shinji Umeyama,et al.  An Eigendecomposition Approach to Weighted Graph Matching Problems , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  K. Burchett Color Harmony , 2001 .

[5]  Endika Bengoetxea,et al.  Inexact Graph Matching Using Estimation of Distribution Algorithms , 2002 .

[6]  Anne Morgan Spalter,et al.  Interactive color palette tools , 2004, IEEE Computer Graphics and Applications.

[7]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[8]  Harry Shum,et al.  Natural Image Colorization , 2007, Rendering Techniques.

[9]  R. Parker “Ken” , 2008 .

[10]  Xin Guo Ming,et al.  A Color Harmony Measure Model with Shape Information , 2009, 2009 International Joint Conference on Computational Sciences and Optimization.

[11]  Aaron Hertzmann,et al.  Color compatibility from large datasets , 2011, ACM Trans. Graph..

[12]  Karen B. Schloss,et al.  Aesthetic response to color combinations: preference, harmony, and similarity , 2010, Attention, perception & psychophysics.

[13]  Pat Hanrahan,et al.  Probabilistic color-by-numbers , 2013, ACM Trans. Graph..

[14]  Ken Ishibashi,et al.  Color Scheme Search: A Statistics-Based IEC Method , 2014 .

[15]  Aurélie Bugeau,et al.  Exemplar-based colorization in RGB color space , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[16]  In-Kwon Lee,et al.  Perceptually‐based Color Assignment , 2014, Comput. Graph. Forum.

[17]  Nicu Sebe,et al.  Who's Afraid of Itten: Using the Art Theory of Color Combination to Analyze Emotions in Abstract Paintings , 2015, ACM Multimedia.

[18]  Ken Ishibashi,et al.  Statistics-Based Interactive Evolutionary Computation for Color Scheme Search , 2015 .

[19]  Alexei A. Efros,et al.  Colorful Image Colorization , 2016, ECCV.

[20]  Erik Reinhard,et al.  Colour Mapping: A Review of Recent Methods, Extensions and Applications , 2016, Comput. Graph. Forum.

[21]  Kazunori Miyata,et al.  Aesthetic Rating and Color Suggestion for Color Palettes , 2016, Comput. Graph. Forum.

[22]  Sidonie Christophe,et al.  Constrained palette-space exploration , 2017, ACM Trans. Graph..

[23]  Chunxia Xiao,et al.  Palette-Based Image Recoloring Using Color Decomposition Optimization , 2017, IEEE Transactions on Image Processing.