Mood Swings: design and evaluation of affective interactive art

The field of affective computing is concerned with developing emphatic products, such as affective consumer products, affective games, and affective art. This paper describes Mood Swings, an affective interactive art system, which interprets and visualizes affect expressed by a person. Mood Swings consists of eight luminous orbs that react to movement. When a person experiences certain emotion, his/her movements are claimed to have certain characteristics. Based on the integration of a framework for affective movements and a color model, Mood Swings recognizes affective movement characteristics, and subsequently displays a color that matches the expressed emotion. Mood Swings was evaluated in a museum for contemporary art by 36 museum visitors. The Trajectory of Interaction (ToI) was applied to assess common phases in interacting with Mood Swings, i.e. response, control, contemplation, belonging, and disengagement. The visitors who interacted with Mood Swings were videotaped. Results showed that The ToI could be identified, although not all phases were experienced by everyone. Few participants reached the contemplation phase and none of them reached the belonging phase. All together, the introduction of the new affective interactive art system was a success.

[1]  J. Itten.  The art of color : the subjective experience and objective rationale of color , 1973 .

[2]  J. Stainer,et al.  The Emotions , 1922, Nature.

[3]  Richard Anderson,et al.  Proceedings of the 2005 conference on Designing for User eXperience , 2005 .

[4]  P. Ekman,et al.  Detecting deception from the body or face. , 1974 .

[5]  P. Kleinginna,et al.  A categorized list of emotion definitions, with suggestions for a consensual definition , 1981 .

[6]  Bernard McKenna,et al.  Information Arts: Intersections of Art, Science and Technology , 2004 .

[7]  Veronica Zammitto,et al.  The Expressions of Colours , 2005, DiGRA Conference.

[8]  Hatice Gunes,et al.  Affect recognition from face and body: early fusion vs. late fusion , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[9]  E. Edmonds,et al.  Understanding the experience of interactive art: Iamascope in Beta_space , 2005 .

[10]  Anton Nijholt,et al.  Motivations, Strategies, and Movement Patterns of Video Gamers Playing Nintendo Wii Boxing , 2008 .

[11]  Frank E. Pollick,et al.  The Features People Use to Recognize Human Movement Style , 2003, Gesture Workshop.

[12]  E. Edmonds,et al.  An embodied cognition framework for interactive experience , 2007 .

[13]  J. Cutting,et al.  Recognizing friends by their walk: Gait perception without familiarity cues , 1977 .

[14]  Egon L. van den Broek,et al.  Prerequisites for Affective Signal Processing (ASP) , 2009, BIOSIGNALS.

[15]  R. Dolan,et al.  Emotion, Cognition, and Behavior , 2002, Science.

[16]  J. Westerink,et al.  Considerations for emotion-aware consumer products. , 2009, Applied ergonomics.

[17]  Sidney S. Fels,et al.  Intimacy and embodiment: implications for art and technology , 2000, MULTIMEDIA '00.

[18]  T. Beardsworth,et al.  The ability to recognize oneself from a video recording of one’s movements without seeing one’s body , 1981 .

[19]  Kristina Höök,et al.  A foundation for emotional expressivity , 2005, DUX '05.

[20]  Petra Sundström,et al.  Exploring the Affective Loop , 2005 .

[21]  Ginevra Castellano,et al.  Expressive control of music and visual media by full-body movement , 2007, NIME '07.

[22]  Paul Dourish,et al.  How emotion is made and measured , 2007, Int. J. Hum. Comput. Stud..

[23]  Brigid Costello,et al.  Collaborative analysis framework for evaluating interactive art experience , 2006 .

[24]  J. Russell.  A circumplex model of affect. , 1980 .

[25]  Rosalind W. Picard.  Affective Computing , 1997 .

[26]  Ernest Edmonds,et al.  On creative engagement , 2006 .

[27]  Antonio Camurri,et al.  Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques , 2003, Int. J. Hum. Comput. Stud..

[28]  Stephen Wilson,et al.  Information Arts: Intersections of Art, Science, and Technology , 2001 .

[29]  Ernest A. Edmonds,et al.  Creating Affective Visualisations for a Physiologically Interactive Artwork , 2006, Tenth International Conference on Information Visualisation (IV'06).

[30]  Leslie Carlson Vaughan,et al.  Understanding movement , 1997, CHI.

[31]  Nadia Bianchi-Berthouze.  Using motion capture to recognize affective states in humans , 2008 .

[32]  Rosalind W. Picard.  Affective computing: (526112012-054) , 1997 .

[33]  D. Norman.  Emotional design : why we love (or hate) everyday things , 2004 .

[34]  Tek-Jin Nam,et al.  Emotional Interaction Through Physical Movement , 2007, HCI.

[35]  K. Scherer,et al.  Bodily expression of emotion , 2009 .

[36]  Kristina Höök,et al.  Sense and sensibility: evaluation and interactive art , 2003, CHI '03.