Evolving Expression of Emotions Through Color in Virtual Humans Using Genetic Algorithms

For centuries artists have been exploring the formal elements of art (lines, space, mass, light, color, sound, etc.) to express emotions. This paper takes this insight to explore new forms of expression for virtual humans which go beyond the usual bodily, facial and vocal expression channels. In particular, the paper focuses on how to use color to influence the perception of emotions in virtual humans. First, a lighting model and filters are used to manipulate color. Next, an evolutionary model, based on genetic algorithms, is developed to learn novel associations between emotions and color. An experiment is then conducted where non-experts evolve mappings for joy and sadness, without being aware that genetic algorithms are used. In a second experiment, the mappings are analyzed with respect to its features and how general they are. Results indicate that the average fitness increases with each new generation, thus suggesting that people are succeeding in creating novel and useful mappings for the emotions. Moreover, the results show consistent differences between the evolved images of joy and the evolved images of sadness.

[1]  Bruce Blumberg,et al.  Expressive autonomous cinematography for interactive virtual environments , 2000, AGENTS '00.

[2]  Jonathan Gratch,et al.  The effect of color on expression of joy and sadness in virtual humans , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[3]  Magy Seif El-Nasr,et al.  Automating Lighting Design for Interactive Entertainment , 2004, CIE.

[4]  Gerald Millerson Lighting for television and film , 1999 .

[5]  A. Philip McMahon,et al.  The Principles of Art , 1939 .

[6]  Gustavo Patow,et al.  A Survey of Inverse Rendering Problems , 2003, Comput. Graph. Forum.

[7]  Sebastien St-Laurent Shaders for Game Programmers and Artists , 2004 .

[8]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[9]  H. Zettl Sight, Sound, Motion: Applied Media Aesthetics , 1973 .

[10]  Norman I. Badler,et al.  Creating Interactive Virtual Humans: Some Assembly Required , 2002, IEEE Intell. Syst..

[11]  Blain Brown,et al.  Motion Picture and Video Lighting , 2007 .

[12]  Kevin G. Suffern,et al.  Painting with light , 2002, SIGGRAPH '02.

[13]  Ana Paiva,et al.  Expression of Emotions in Virtual Humans Using Lights, Shadows, Composition and Filters , 2007, ACII.

[14]  Jeremy Birn Digital Lighting and Rendering (2nd Edition) , 2005 .

[15]  Dipl.-Ing,et al.  Real-time Rendering , 2022 .

[16]  Adam Finkelstein,et al.  Lighting with paint , 2007, TOGS.

[17]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[18]  Craig Niederberger,et al.  What Is “ART”? , 2004 .

[19]  Adam Banks,et al.  Designer's Color Manual: The Complete Guide to Color Theory and Application , 2004 .

[20]  Ana Paiva,et al.  Evolutionary Expression of Emotions in Virtual Humans Using Lights and Pixels , 2009, Affective Information Processing.

[21]  Robert W. G. Hunt,et al.  The reproduction of colour , 1957 .

[22]  Christopher Janaway Aesthetics, Problems of , 1995 .

[23]  Jonathan Gratch,et al.  Evolving Expression of Emotions in Virtual Humans Using Lights and Pixels , 2008, IVA.

[24]  Jeremy Birn,et al.  Digital Lighting and Rendering , 2006 .

[25]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[26]  Robert W. G. Hunt,et al.  The Reproduction of Colour: Sixth Edition , 2004 .