Multimodal Authoring Tool for Populating a Database of Emotional Reactive Animations

We aim to create a model of emotional reactive virtual humans. This model will help to define realistic behavior for virtual characters based on emotions and events in the Virtual Environment to which they react. A large set of pre-recorded animations will be used to obtain such model. We have defined a knowledge-based system to store animations of reflex movements taking into account personality and emotional state. Populating such a database is a complex task. In this paper we describe a multimodal authoring tool that provides a solution to this problem. Our multimodal tool makes use of motion capture equipment, a handheld device and a large projection screen.

[1]  Alexander H. Waibel,et al.  Multimodal interfaces , 1996, Artificial Intelligence Review.

[2]  Daniel Thalmann,et al.  The magic wand , 2003, SCCG '03.

[3]  Nadia Magnenat-Thalmann,et al.  Virtual humans personified , 2002, AAMAS '02.

[4]  Daniel Thalmann,et al.  Magic wand and the Enigma of the Sphinx , 2004, Comput. Graph..

[5]  Lakhmi C. Jain,et al.  Knowledge-Based Intelligent Information and Engineering Systems , 2004, Lecture Notes in Computer Science.

[6]  B. Prabhakaran,et al.  Interactive visual method for motion and model reuse , 2003, GRAPHITE '03.

[7]  Stacy Marsella,et al.  A step toward irrationality: using emotion to change belief , 2002, AAMAS '02.

[8]  Daniel Thalmann,et al.  Real-time animation and motion capture in Web human director (WHD) , 2000, VRML '00.

[9]  Jens Piesk,et al.  AMOBA: a database system for annotating captured human movements , 2002, Proceedings of Computer Animation 2002 (CA 2002).

[10]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[11]  Daniel Thalmann,et al.  A MAYA Exporting Plug-in for MPEG-4 FBA Human Characters , 2003 .

[12]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[13]  Daniel Thalmann,et al.  The mobile animator: interactive character animation in collaborative virtual environments , 2004, IEEE Virtual Reality 2004.

[14]  Daniel Thalmann,et al.  Conducting a virtual orchestra , 2004, IEEE MultiMedia.

[15]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[16]  Thomas Rist,et al.  Integrating Models of Personality and Emotions into Lifelike Characters , 1999, IWAI.

[17]  Nadia Magnenat-Thalmann,et al.  A Model for Personality and Emotion Simulation , 2003, KES.

[18]  Sumedha Kshirsagar,et al.  A multilayer personality model , 2002, SMARTGRAPH '02.

[19]  Patrick Doyle.  Believability through context using "knowledge in the world" to create intelligent characters , 2002, AAMAS '02.

[20]  P. Ekman.  Emotion in the human face , 1982 .

[21]  R. McCrae,et al.  An introduction to the five-factor model and its applications. , 1992, Journal of personality.