Interactive Embodied Agents for Cultural Heritage and Archaeological presentations

In this paper, Maxine, a powerful engine to develop applications with embodied animated agents is presented. The engine, based on the use of open source libraries, enables multimodal real-time interaction with the user: via text, voice, images and gestures. Maxine virtual agents can establish emotional communication with the user through their facial expressions, the modulation of the voice and expressing the answers of the agents according to the information gathered by the system: noise level in the room, observer’s position, emotional state of the observer, etc. Moreover, the user’s emotions are considered and captured through images. For the moment, Maxine virtual agents have been used as virtual presenters for Cultural Heritage and Archaeological shows.

[1]  Stacy Marsella,et al.  Interactive pedagogical drama , 2000, AGENTS '00.

[2]  Christa Sommerer,et al.  Designing emotional, metaphoric, natural and intuitive interfaces for interactive art, edutainment and mobile communications , 2005, Comput. Graph..

[3]  S. Baldassarri,et al.  An open source engine for embodied animated agents , 2007 .

[4]  Nadia Magnenat-Thalmann,et al.  Intelligent virtual humans with autonomy and personality: State-of-the-art , 2007, Intell. Decis. Technol..

[5]  Mitsuru Ishizuka,et al.  THE EMPATHIC COMPANION: A CHARACTER-BASED INTERFACE THAT ADDRESSES USERS' AFFECTIVE STATES , 2005, Appl. Artif. Intell..

[6]  Arthur C. Graesser,et al.  AutoTutor: an intelligent tutoring system with mixed-initiative dialogue , 2005, IEEE Transactions on Education.

[7]  Xiang Yuan,et al.  Design and evaluation of Elva: an embodied tour guide in an interactive virtual art gallery , 2005, Comput. Animat. Virtual Worlds.

[8]  Francisco J. Serón,et al.  INTERACTIVE AGENTS FOR MULTIMODAL EMOTIONAL USER INTERACTION , 2007 .

[9]  Fiorella de Rosis,et al.  Evaluating a realistic agent in an advice-giving task , 2005, Int. J. Hum. Comput. Stud..

[10]  John Yen,et al.  PETEEI: a PET with evolving emotional intelligence , 1999, AGENTS '99.

[11]  Catherine Pelachaud,et al.  From Greta's mind to her face: modelling the dynamics of affective states in a conversational embodied agent , 2003, Int. J. Hum. Comput. Stud..

[12]  Ken Perlin,et al.  A platform for affective agent research , 2004 .