Creating Interactive Virtual Humans: Some Assembly Required

Discusses some of the key issues that must be addressed in creating virtual humans, or androids. As a first step, we overview the issues and available tools in three key areas of virtual human research: face-to-face conversation, emotions and personality, and human figure animation. Assembling a virtual human is still a daunting task, but the building blocks are getting bigger and better every day.

[1]  Jessica K. Hodgins,et al.  Animation of dynamic legged locomotion , 1991, SIGGRAPH.

[2]  Justine Cassell,et al.  BEAT: the Behavior Expression Animation Toolkit , 2001, Life-like characters.

[3]  Norman I. Badler,et al.  Real-Time Inverse Kinematics Techniques for Anthropomorphic Limbs , 2000, Graph. Model..

[4]  Mark T. Maybury,et al.  Intelligent multimedia interfaces , 1994, CHI Conference Companion.

[5]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[6]  Marilyn A. Walker,et al.  Improvising linguistic style: social and affective bases for agent personality , 1997, AGENTS '97.

[7]  John Yen,et al.  PETEEI: a PET with evolving emotional intelligence , 1999, AGENTS '99.

[8]  Marc Schröder,et al.  Emotional speech synthesis: a review , 2001, INTERSPEECH.

[9]  Jonathan Gratch,et al.  Émile: Marshalling passions in training and education , 2000, AGENTS '00.

[10]  Norman I. Badler,et al.  The EMOTE model for effort and shape , 2000, SIGGRAPH.

[11]  Dave Moffat,et al.  Personality Parameters and Programs , 1997, Creating Personalities for Synthetic Actors.

[12]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[13]  Peter-Pike J. Sloan,et al.  Shape by example , 2001, I3D '01.

[14]  Janet E. Cahn,et al.  Improvising Linguistic Style: Social and Affective Bases for Agents. , 1997 .

[15]  Sharon L. Oviatt,et al.  Unification-based Multimodal Integration , 1997, ACL.

[16]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[17]  J. E. Ball,et al.  Emotion and Personality in a Conversational Character , 1998 .

[18]  Catherine Pelachaud,et al.  Embodied contextual agent in information delivering application , 2002, AAMAS '02.

[19]  Thomas Rist,et al.  The automated design of believable dialogues for animated presentation teams , 2001 .

[20]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[21]  John P. Lewis,et al.  Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation , 2000, SIGGRAPH.

[22]  A. Bruce.  Emotional Expression , 1883, The American Naturalist.

[23]  James C. Lester,et al.  Deictic and emotive communication in animated pedagogical agents , 2001 .

[24]  Bruce Blumberg,et al.  Motivation driven learning for interactive synthetic characters , 2000, AGENTS '00.

[25]  Mitsuru Ishizuka,et al.  Social role awareness in animated agents , 2001, AGENTS '01.

[26]  Keith Waters,et al.  Computer facial animation , 1996 .

[27]  K HodginsJessica,et al.  Animation of dynamic legged locomotion , 1991 .

[28]  Jörn Ostermann,et al.  Efficient modeling of virtual humans in MPEG-4 , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[29]  Demetri Terzopoulos,et al.  Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  John E. Laird,et al.  It knows what you're going to do: adding anticipation to a Quakebot , 2001, AGENTS '01.

[31]  Michael Gleicher,et al.  Comparing Constraint-Based Motion Editing Methods , 2001, Graph. Model..

[32]  Jörn Ostermann,et al.  Very low bit rate coding of virtual human animation in MPEG-4 , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[33]  Justine Cassell,et al.  Human conversation as a system framework: designing embodied conversational agents , 2001 .

[34]  Stacy Marsella,et al.  Interactive pedagogical drama , 2000, AGENTS '00.

[35]  John Yen,et al.  Emotionally expressive agents , 1999, Proceedings Computer Animation 1999.

[36]  Eduard Hovy,et al.  Some Pragmatic Decision Criteria in Generation , 1987 .

[37]  James C. Lester,et al.  Animated Pedagogical Agents: Face-to-Face Interaction in Interactive Learning Environments , 2000 .

[38]  Nadia Magnenat-Thalmann,et al.  Dressing Virtual Humans , 1997, Creating Personalities for Synthetic Actors.

[39]  J. Cassell,et al.  Nudge nudge wink wink: elements of face-to-face conversation for embodied conversational agents , 2001 .

[40]  Norman I. Badler,et al.  FacEMOTE: qualitative parametric modifiers for facial animations , 2002, SCA '02.

[41]  Ken Perlin,et al.  Real Time Responsive Animation with Personality , 1995, IEEE Trans. Vis. Comput. Graph..

[42]  Stacy Marsella,et al.  Modeling the Interplay of Emotions and Plans in Multi-Agent Simulations , 2001 .

[43]  Tomaso Poggio,et al.  Trainable Videorealistic Speech Animation , 2004, FGR.

[44]  Hans Peter Graf,et al.  Photo-Realistic Talking-Heads from Image Samples , 2000, IEEE Trans. Multim..

[45]  Paul Taylor,et al.  The architecture of the Festival speech synthesis system , 1998, SSW.

[46]  Norman I. Badler,et al.  Simulating humans: computer graphics animation and control , 1993 .

[47]  Aaron Sloman,et al.  Motives, Mechanisms, and Emotions , 1987, The Philosophy of Artificial Intelligence.

[48]  Hao Yan,et al.  Coordination and context-dependence in the generation of embodied conversation , 2000, INLG.

[49]  J. Breese,et al.  Emotion and personality in a conversational agent , 2001 .

[50]  Stacy Marsella,et al.  A step toward irrationality: using emotion to change belief , 2002, AAMAS '02.