Key Color Generation for Affective Multimedia Production: An Initial Method and Its Application

In this paper, we introduce a method that generates a key color to construct an aesthetic and affective harmony with visual content. Given an image and an affective term, our method creates a key color by combining a dominant hue of the image and a unique tone associated with the affective word. To match each affective term with a specific tone, we collected color themes from a crowd-sourced database and identified the most popular tone of color themes that are relevant to each affective term. The results of a user test showed that the method generates satisfactory key colors as much as designers do. Finally, as a prospective application, we employed our method to a promotional video editing prototype. Our method automatically generates a key color based on a frame of an input video and apply the color to a shape that delivers a promotional message. A second user study verifies that the video editing prototype with our method can effectively deliver the desired affective state with a satisfactory quality.

[1]  Charles E. Osgood,et al.  A Cross-Cultural Study of the Affective Meanings of Color , 1973 .

[2]  Parry Moon,et al.  Aesthetic Measure Applied to Color Harmony , 1944 .

[3]  Jian Chen,et al.  An Interactive Method for Generating Harmonious Color Schemes , 2014 .

[4]  Anne Morgan Spalter,et al.  Interactive color palette tools , 2004, IEEE Computer Graphics and Applications.

[5]  Lianhong Cai,et al.  Affective image adjustment with a single word , 2013, The Visual Computer.

[6]  J. Russell.  A circumplex model of affect. , 1980 .

[7]  P. Valdez,et al.  Effects of color on emotions. , 1994, Journal of experimental psychology. General.

[8]  Emi Myodo,et al.  A color transformation method based on color theme that takes constraints on color ratio and spatial coherence into consideration , 2013, 2013 IEEE International Conference on Image Processing.

[9]  R. Plutchik.  Emotion, a psychoevolutionary synthesis , 1980 .

[10]  Yuzhen Niu,et al.  What Makes a Professional Video? A Computational Aesthetics Approach , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Paul Lyons,et al.  Computational production of colour harmony. Part 2: Experimental evaluation of a tool for gui colour scheme creation , 2013 .

[12]  Reiner Lenz,et al.  Color Semantics for Image Indexing , 2010, CGIV/MCS.

[13]  Giovanni Moretti,et al.  Computational production of colour harmony. Part 1: A prototype colour harmonization tool , 2013 .

[14]  Shigenobu Kobayashi,et al.  The aim and method of the color image scale , 2009 .

[15]  Jürgen Döllner,et al.  Image Abstraction by Structure Adaptive Filtering , 2008, TPCG.

[16]  Shih-Wen Hsiao,et al.  Transforming the natural colors of an image into product design: A computer-aided color planning system based on fuzzy pattern recognition , 2015 .

[17]  Pat Hanrahan,et al.  Modeling how people extract color themes from images , 2013, CHI.

[18]  Nor Ashidi Mat Isa,et al.  Adaptive fuzzy-K-means clustering algorithm for image segmentation , 2010, IEEE Transactions on Consumer Electronics.

[19]  Eun Yi Kim,et al.  Affective prediction in photographic images using probabilistic affective model , 2010, CIVR '10.

[20]  J. Xin,et al.  Investigation of human's emotional responses on colors , 2006 .

[21]  Stephen DiVerdi,et al.  Palette-based photo recoloring , 2015, ACM Trans. Graph..

[22]  Donna R. Pawlowski,et al.  Effects of Metaphors on Children's Comprehension and Perception of Print Advertisements , 1998 .

[23]  J. Itten.  The art of color : the subjective experience and objective rationale of color , 1973 .

[24]  Liquan Shen,et al.  Saliency detection using regional histograms. , 2013, Optics letters.

[25]  L. Rainwater,et al.  The meanings of color. , 1962, The Journal of general psychology.

[26]  Shigenobu Kobayashi,et al.  Color Image Scale , 1992 .

[27]  U EBBECKE,et al.  [Goethe's color theory]. , 1949, Experientia.

[28]  L. Ou,et al.  A study of colour emotion and colour preference. Part I: Colour emotions for single colours , 2004 .

[29]  Hyeon-Jeong Suk,et al.  Emotional Response to Color Across Media , 2010 .

[30]  Xilin Chen,et al.  Advertisement evaluation using visual saliency based on foveated image , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[31]  Chaobing Huang,et al.  Regions of interest extraction from color image based on visual saliency , 2011, The Journal of Supercomputing.

[32]  Yu-Chen Hu,et al.  K-means-based color palette design scheme with the use of stable flags , 2007, J. Electronic Imaging.

[33]  Nuria Oliver,et al.  Towards Computational Models of the Visual Aesthetic Appeal of Consumer Videos , 2010, ECCV.

[34]  Shiguang Liu,et al.  Hierarchical emotional color theme extraction , 2016 .

[35]  Shamik Sural,et al.  Segmentation and histogram generation using the HSV color space for image retrieval , 2002, Proceedings. International Conference on Image Processing.

[36]  Nor Ashidi Mat Isa,et al.  Color image segmentation using histogram thresholding - Fuzzy C-means hybrid approach , 2011, Pattern Recognit..

[37]  Reiner Lenz,et al.  Color harmony for image indexing , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[38]  Chun Chen,et al.  Data-driven image color theme enhancement , 2010, SIGGRAPH 2010.

[39]  L. Ou,et al.  A study of colour emotion and colour preference. Part II: Colour emotions for two‐colour combinations , 2004 .

[40]  Jong-Seok Lee,et al.  Automated Video Editing for Aesthetic Quality Improvement , 2015, ACM Multimedia.

[41]  J. M. Kittross.  The measurement of meaning , 1959 .