Emotion transfer for images based on color combinations

In this paper, a color transfer framework to evoke different emotions for images based on color combinations is proposed. The purpose of this color transfer is to change the “look and feel” of images, i.e., evoking different emotions. Colors are confirmed as the most attractive factor in images. In addition, various studies in both art and science areas have concluded that other than single color, color combinations are necessary to evoke specific emotions. Therefore, we propose a novel framework to transfer color of images based on color combinations, using a predefined color emotion model. The contribution of this new framework is threefold. First, users do not need to provide reference images as used in traditional color transfer algorithms. In most situations, users may not have enough esthetic knowledge or path to choose desired reference images. Second, because of the usage of color combinations instead of single color for emotions, a new color transfer algorithm that does not require an image library is proposed. Third, again because of the usage of color combinations, artifacts that are normally seen in traditional frameworks using single color are avoided. We present encouraging results generated from this new framework and its potential in several possible applications including color transfer of photos and paintings.

[1]  Chiou-Ting Hsu,et al.  Color transfer for complex content images based on intrinsic component , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[2]  L. Ou,et al.  A study of colour emotion and colour preference. Part II: Colour emotions for two‐colour combinations , 2004 .

[3]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[4]  J William,et al.  IEEE Computer Graphics and Applications , 2019, Computer.

[5]  Jorge Nocedal,et al.  An interior algorithm for nonlinear optimization that combines line search and trust region steps , 2006, Math. Program..

[6]  Roberto Scopigno,et al.  Computer Graphics forum , 2003, Computer Graphics Forum.

[7]  W. A. Scott,et al.  Color and Affect: A Review and Semantic Evaluation , 1952 .

[8]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[9]  Chi-Keung Tang,et al.  Local color transfer via probabilistic segmentation by expectation-maximization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Bin Chen,et al.  Affective property of image and fractal dimension , 2003 .

[11]  Lizhuang Ma,et al.  Color transfer in correlated color space , 2006, VRCIA '06.

[12]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[13]  Hong Li,et al.  Selective color transfer with multi-source images , 2009, Pattern Recognit. Lett..

[14]  Keiji Uchikawa,et al.  Example-based color stylization based on categorical perception , 2004, APGV '04.

[15]  Fabio Pellacini,et al.  User‐Controllable Color Transfer , 2010, Comput. Graph. Forum.

[16]  Bing-Yu Chen,et al.  Example‐based Multiple Local Color Transfer by Strokes , 2008, Comput. Graph. Forum.

[17]  Gabriela Csurka,et al.  Learning moods and emotions from color combinations , 2010, ICVGIP '10.

[18]  Mateu Sbert,et al.  06221 Dagstuhl Report - Computational Aesthetics in Graphics, Visualization and Imaging , 2006, Computational Aesthetics in Graphics, Visualization and Imaging.

[19]  A.C. Kokaram,et al.  N-dimensional probability density function transfer and its application to color transfer , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[20]  D. Ruderman,et al.  Statistics of cone responses to natural images: implications for visual coding , 1998 .

[21]  Leatrice Eiseman.  Pantone Guide to Communicating with Color , 2000 .

[22]  Donald H. House,et al.  Image Recoloring Induced by Palette Color Associations , 2003, WSCG.

[23]  Hua Huang,et al.  Example-based painting guided by color features , 2010, The Visual Computer.

[24]  H. Eysenck.  A critical and experimental study of colour preferences , 1941 .

[25]  Hwann-Tzong Chen,et al.  Landmark-based sparse color representations for color transfer , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[26]  Lizhuang Ma,et al.  Gradient‐Preserving Color Transfer , 2009, Comput. Graph. Forum.

[27]  E. Titchener,et al.  The Journal of General Psychology , .

[28]  Bride M. Whelan,et al.  Color Harmony: A Guide to Creative Color Combinations , 1987 .

[29]  Shigenobu Kobayashi,et al.  Color Image Scale , 1992 .

[30]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[31]  Chung-Ming Wang,et al.  Example-based color alternation for images , 2010, 2010 2nd International Conference on Computer Engineering and Technology.

[32]  Guanbo Bao,et al.  Fast local color transfer via dominant colors mapping , 2010, SIGGRAPH ASIA.

[33]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[34]  Journal of the Optical Society of America , 1950, Nature.

[35]  L. Ou,et al.  A study of colour emotion and colour preference. Part I: Colour emotions for single colours , 2004 .

[36]  Neil A. Dodgson,et al.  Decolorize: Fast, contrast enhancing, color to grayscale conversion , 2007, Pattern Recognit..

[37]  John M. Hancock,et al.  K -Means Clustering. , 2010 .

[38]  Seiji Inokuchi,et al.  An attractiveness evaluation model based on the physical features of image regions , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[39]  Chuan-Kai Yang,et al.  Automatic Mood-Transferring between Color Images , 2008, IEEE Computer Graphics and Applications.

[40]  Joonwhoan Lee,et al.  Emotional Evaluation of Color Patterns Based on Rough Sets , 2007, 2007 International Symposium on Information Technology Convergence (ISITC 2007).

[41]  Michel Jacobs,et al.  The art of colour , 1923 .

[42]  Yu Ying-lin,et al.  Image Retrieval by Emotional Semantics: A Study of Emotional Space and Feature Extraction , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[43]  Nihon Shikisai Gakkai,et al.  Color research & application , 1976 .

[44]  László Neumann,et al.  Color Style Transfer Techniques using Hue, Lightness and Saturation Histogram Matching , 2005, CAe.

[45]  Erik Reinhard,et al.  Progressive color transfer for images of arbitrary dynamic range , 2011, Comput. Graph..