Analysing emotional interaction through avatars. A generic architecture

This study proposes the use of avatars to generate nonverbal communication in a multimodal interactive system, mainly based on the affective or emotional aspects of this type of communication. The objective of this study is the use of avatars as an element for generating non-verbal communication, without taking a specific application in account, but rather analysing all their interaction possibilities. Therefore, all the aspects related with the emotional multimodal interaction through avatars have been analysed as (i) the main advantages and disadvantages of integrating a multimodal interactive system, (ii) the elements comprising the interactive system (the user, the avatar and the application) and (iii) their characteristics, (iv) the interaction levels that may occur among the elements and (v) the interaction types that have to be taken into account when generating an emotional multimodal interaction through avatars. Once all this information has been analysed, a general architecture is proposed that includes all these types of interaction that can occur in a system which includes avatars. This architecture can serve to formalise the development of emotional applications with and without avatars.

[1]  A. Sloman.  HOW MANY SEPARATELY EVOLVED EMOTIONAL BEASTIES LIVE WITHIN US , 2002 .

[2]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[3]  Juan David Velásquez,et al.  Modeling Emotions and Other Motivations in Synthetic Agents , 1997, AAAI/IAAI.

[4]  Mitsuru Ishizuka,et al.  Understanding the effect of life-like interface agents through users' eye movements , 2005, ICMI '05.

[5]  S. Demleitner.  [Communication without words]. , 1997, Pflege aktuell.

[6]  Maria del Puy Carretero,et al.  Virtual Characters as Emotional Interaction Element in the User Interfaces , 2006, AMDO.

[7]  R. Kinkead,et al.  Voice: technology searching for communication needs , 1986, CHI '87.

[8]  Marco Gillies,et al.  Affective interactions between expressive characters , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[9]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[10]  Fabio Pianesi,et al.  Synthetic characters as multichannel interfaces , 2005, ICMI '05.

[11]  Lee Sproull,et al.  Using a human face in an interface , 1994, CHI '94.

[12]  T. D. Bui,et al.  Creating Emotions and Facial Expressions for Embodied Agents , 2004 .

[13]  Juan David Velásquez,et al.  Cathexis--a computational model for the generation of emotions and their influence in the behavior of autonomous agents , 1996 .

[14]  Maria del Puy Carretero,et al.  Elderly Users in Ambient Intelligence: Does an Avatar Improve the Interaction? , 2006, Universal Access in Ambient Intelligence Environments.

[15]  Ido Iurgel,et al.  Adaptation of Mesh Morphing Techniques for Avatars Used in Web Applications , 2004, AMDO.

[16]  BatesJoseph.  The role of emotion in believable agents , 1994 .

[17]  Ira J. Roseman.  Appraisal Determinants of Emotions: Constructing a More Accurate and Comprehensive Theory , 1996 .

[18]  Yanghee Kim,et al.  Pedagogical agents as learning companions: the effects of agent affect and gender on student learning, interest, self-efficacy, and agent persona , 2004 .

[19]  K. Ducatel,et al.  Scenarios for Ambient Intelligence in 2010 Final Report , 2001 .

[20]  W. S. Reilly,et al.  Building Emotional Agents , 1992 .

[21]  Clifford Nass,et al.  Computers are social actors , 1994, CHI '94.

[22]  C. Elliott.  The affective reasoner: a process model of emotions in a multi-agent system , 1992 .

[23]  Daniel Thalmann,et al.  Autonomous actors in networked collaborative virtual environments , 1998, Proceedings 1998 MultiMedia Modeling. MMM'98 (Cat. No.98EX200).

[24]  Pattie Maes,et al.  Agents with Faces: The Effects of Personification of Agents , 1996 .

[25]  Alfred Kobsa,et al.  User Interfaces for All , 1999 .

[26]  W. S. Reilly,et al.  Believable Social and Emotional Agents. , 1996 .

[27]  P. Ekman.  Facial expression and emotion. , 1993, The American psychologist.

[28]  David Oyarzun,et al.  Three-dimensional whole body of virtual character animation for its behavior in a virtual environment using H-Anim and Inverse kinematics , 2004, Proceedings Computer Graphics International, 2004..

[29]  John Yen,et al.  FLAME—Fuzzy Logic Adaptive Model of Emotions , 2000, Autonomous Agents and Multi-Agent Systems.

[30]  Jiaxin Chen,et al.  Agent-based interaction model for collaborative virtual environments , 2005, Proceedings of the Ninth International Conference on Computer Supported Cooperative Work in Design, 2005..

[31]  Ana Susperregui,et al.  Interactive Mobile Assistants for Added-value Cultural Contents , 2006, VAST.

[32]  Marc Fabri,et al.  Emotionally expressive avatars for collaborative virtual environments , 2006 .

[33]  Michael Lewis,et al.  Attentional Effect of Animated Character , 2003, INTERACT.

[34]  David Oyarzun,et al.  Speech Driven Facial Animation Using HMMs in Basque , 2006, TSD.

[35]  Catherine Pelachaud,et al.  From Greta's mind to her face: modelling the dynamics of affective states in a conversational embodied agent , 2003, Int. J. Hum. Comput. Stud..

[36]  J. Noguez,et al.  Incorporating an Affective Model to an Intelligent Tutor for Mobile Robotics , 2006, Proceedings. Frontiers in Education. 36th Annual Conference.

[37]  Jonathan Gratch,et al.  Émile: Marshalling passions in training and education , 2000, AGENTS '00.

[38]  M.T. Linaza,et al.  Interactive Mobile Assistants for Added - value Digital Contents , 2005, EUROCON 2005 - The International Conference on "Computer as a Tool".

[39]  Thanh Giang,et al.  Real-Time Character Animation Techniques , 2000 .

[40]  Joseph Bates,et al.  The role of emotion in believable agents , 1994, CACM.

[41]  Christoph Bartneck,et al.  eMuu : an embodied emotional character for the ambient intelligent home , 2002 .

[42]  W. Lewis Johnson,et al.  Pedagogical agents on the Web , 1999, AGENTS '99.

[43]  Maria del Puy Carretero,et al.  Virtual characters facial and body animation through the edition and interpretation of mark-up languages , 2005, Comput. Graph..