Probabilistic color-by-numbers

We present a probabilistic factor graph model for automatically coloring 2D patterns. The model is trained on example patterns to statistically capture their stylistic properties. It incorporates terms for enforcing both color compatibility and spatial arrangements of colors that are consistent with the training examples. Using Markov Chain Monte Carlo, the model can be sampled to generate a diverse set of new colorings for a target pattern. This general probabilistic framework allows users to guide the generated suggestions via conditional inference or additional soft constraints. We demonstrate results on a variety of coloring tasks, and we evaluate the model through a perceptual study in which participants judged sampled colorings to be significantly preferable to other automatic baselines.

[1]  Pat Hanrahan,et al.  Synthesizing open worlds with constraints using locally annealed reversible jump MCMC , 2012, ACM Trans. Graph..

[2]  Aaron Hertzmann,et al.  Color compatibility from large datasets , 2011, SIGGRAPH 2011.

[3]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[4]  Marc Alexa,et al.  How do humans sketch objects? , 2012, ACM Trans. Graph..

[5]  Jeffrey S. Rosenthal,et al.  Optimal Proposal Distributions and Adaptive MCMC , 2011 .

[6]  Bernhard Schölkopf,et al.  Automatic Image Colorization Via Multimodal Predictions , 2008, ECCV.

[7]  Pat Hanrahan,et al.  Modeling how people extract color themes from images , 2013, CHI.

[8]  Karen B. Schloss,et al.  An ecological valence theory of human color preference , 2010, Proceedings of the National Academy of Sciences.

[9]  Yizhou Yu,et al.  Data-driven image color theme enhancement , 2010, ACM Trans. Graph..

[10]  O. Sorkine,et al.  Color harmonization , 2006, SIGGRAPH 2006.

[11]  W. Chu Studying Aesthetics in Photographic Images Using a Computational Approach , 2013 .

[12]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[13]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[14]  Pat Hanrahan,et al.  Synthesis of tiled patterns using factor graphs , 2013, ACM Trans. Graph..

[15]  J. Itten The art of color : the subjective experience and objective rationale of color , 1973 .

[16]  A. Munsell,et al.  A grammar of color : a basic treatise on the color system of Albert H. Munsell , 1969 .

[17]  Andrew McCallum,et al.  FACTORIE: Probabilistic Programming via Imperatively Defined Factor Graphs , 2009, NIPS.

[18]  J. Albers,et al.  Interaction of Color , 1971 .

[19]  Hans-Peter Seidel,et al.  Material memex , 2012, ACM Trans. Graph..

[20]  Wencheng Wu,et al.  The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations , 2005 .

[21]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[22]  C. Geyer Markov Chain Monte Carlo Maximum Likelihood , 1991 .

[23]  Radford M. Neal MCMC Using Hamiltonian Dynamics , 2011, 1206.1901.

[24]  Jean-Noël Vittaut,et al.  Segmented Images Colorization Using Harmony , 2010, 2010 Sixth International Conference on Signal-Image Technology and Internet Based Systems.

[25]  Roberto Scopigno,et al.  Computer Graphics forum , 2003, Computer Graphics Forum.

[26]  Anne Morgan Spalter,et al.  Interactive color palette tools , 2004, IEEE Computer Graphics and Applications.

[27]  Jeffrey Heer,et al.  Color naming models for color selection, image editing and palette design , 2012, CHI.

[28]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[29]  Hans-Peter Seidel,et al.  3D Material Style Transfer , 2012, Comput. Graph. Forum.

[30]  E. Bribiesca Measuring 2D shape compactness using the contact perimeter , 1997 .

[31]  Karen B. Schloss,et al.  An ecological valence theory of human color preferences , 2010 .

[32]  Jade Goldstein-Stewart,et al.  The use of MMR, diversity-based reranking for reordering documents and producing summaries , 1998, SIGIR '98.

[33]  C. Robert Simulation of truncated normal variables , 2009, 0907.4010.

[34]  Maneesh Agrawala,et al.  Interactive furniture layout using interior design guidelines , 2011, SIGGRAPH 2011.