Modeling how people extract color themes from images

Color choice plays an important role in works of graphic art and design. However, it can be difficult to choose a compelling set of colors, or color theme, from scratch. In this work, we present a method for extracting color themes from images using a regression model trained on themes created by people. We collect 1600 themes from Mechanical Turk as well as from artists. We find that themes extracted by Turk participants were similar to ones extracted by artists. In addition, people tended to select diverse colors and focus on colors in salient image regions. We show that our model can match human-extracted themes more closely compared to previous work. Themes extracted by our model were also rated higher as representing the image than previous approaches in a Mechanical Turk study.

[1]  Aaron Hertzmann,et al.  Color compatibility from large datasets , 2011, SIGGRAPH 2011.

[2]  Marc Alexa,et al.  How do humans sketch objects? , 2012, ACM Trans. Graph..

[3]  Johannes Itten,et al.  The art of color , 1961 .

[4]  Arthur Robert Weeks,et al.  Color segmentation in the HSI color space using the K-means algorithm , 1997, Electronic Imaging.

[5]  Qing Xia,et al.  Image-Based Color Schemes , 2007, 2007 IEEE International Conference on Image Processing.

[6]  Pat Hanrahan,et al.  A Probabilistic Model of the Categorical Association Between Colors , 2008, CIC.

[7]  Anne Morgan Spalter,et al.  Interactive color palette tools , 2004, IEEE Computer Graphics and Applications.

[8]  Jeffrey Heer,et al.  Crowdsourcing graphical perception: using mechanical turk to assess visualization design , 2010, CHI.

[9]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[10]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[11]  P. Kay,et al.  Basic Color Terms: Their Universality and Evolution , 1973 .

[12]  Yizhou Yu,et al.  Data-driven image color theme enhancement , 2010, ACM Trans. Graph..

[13]  Pere Obrador.  Automatic color scheme picker for document templates based on image analysis and dual problem , 2006, Electronic Imaging.

[14]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[15]  Frédo Durand,et al.  Learning to predict where humans look , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[16]  Donald H. House,et al.  Image Recoloring Induced by Palette Color Associations , 2003, WSCG.

[17]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[18]  Julie Delon,et al.  Automatic color palette , 2005, IEEE International Conference on Image Processing 2005.

[19]  Jeffrey Heer,et al.  Color naming models for color selection, image editing and palette design , 2012, CHI.