Affective Interaction in Smart Environments

Abstract We present a concept where the smart environments of the future will be able to provide ubiquitous affective communication. All the surfaces will become interactive and the furniture will display emotions. In particular, we present a first prototype that allows people to share their emotional states in a natural way. The input will be given through facial expressions and the output will be displayed in a context-aware multimodal way. Two novel output modalities are presented: a robotic painting that applies the concept of affective communication to the informative art and an RGB lamp that represents the emotions remaining in the user's peripheral attention. An observation study has been conducted during an interactive event and we report our preliminary findings in this paper.

[1]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[2]  Andrew Sears and Julie A. Jacko.  The human-computer interaction handbook , 2013 .

[3]  C. Nass,et al.  Emotion in human-computer interaction , 2002 .

[4]  Johan Redström,et al.  Informative art: using amplified artworks as information displays , 2000, DARE '00.

[5]  Sharon L. Oviatt,et al.  Multimodal Interfaces: A Survey of Principles, Models and Frameworks , 2009, Human Machine Interaction.

[6]  Ahmad Hoirul Basori,et al.  The effect of emotional colour on creating realistic expression of avatar , 2012, VRCAI '12.

[7]  Didier Perroud,et al.  Context-Based Generation of Multimodal Feedbacks for Natural Interaction in Smart Environments , 2012 .

[8]  Elena Mugellini,et al.  Context-Aware Multimodal Sharing of Emotions , 2013, HCI.

[9]  P. Wilson,et al.  The Nature of Emotions , 2012 .

[10]  Ewald Moser,et al.  Amygdala activation at 3T in response to human and avatar facial expressions of emotions , 2007, Journal of Neuroscience Methods.

[11]  Stéphane Pierroz,et al.  Generic Framework for Transforming Everyday Objects into Interactive Surfaces , 2009, HCI.

[12]  Sherry Turkle,et al.  The Tethered Self: Technology Reinvents Intimacy and Solitude , 2011 .

[13]  Orville Leverne Clubb.  Human-to-Computer-to-Human Interactions (HCHI) of the communications revolution , 2007, INTR.

[14]  Elena Mugellini,et al.  Ubiquitous Interaction for Computer Mediated Communication of Emotions , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[15]  Craig A. Smith,et al.  From appraisal to emotion: Differences among unpleasant feelings , 1988 .

[16]  Michael Schmitz,et al.  Concepts for life-like interactive objects , 2010, TEI.