Architecture of an animation system for human characters

Virtual human characters are found in a broad range of applications, from movies, games and networked virtual environments to teleconferencing and tutoring applications. Such applications are available on a variety of platforms, from desktop and web to mobile devices. High-quality animation is an essential prerequisite for realistic and believable virtual characters. Though researchers and application developers have ample animation techniques for virtual characters at their disposal, implementation of these techniques into an existing application tends to be a daunting and time-consuming task. In this paper we present visage|SDK, a versatile framework for real-time character animation based on MPEG-4 FBA standard that offers a wide spectrum of features that includes animation playback, lip synchronization and facial motion tracking, while facilitating rapid production of art assets and easy integration with existing graphics engines.

[1]  Igor S. Pandzic,et al.  Facial motion cloning , 2003, Graph. Model..

[2]  David H. Eberly.  3D game engine architecture - engineering real-time applications with wild magic , 2005, The Morgan Kaufmann series in interactive 3D technology.

[3]  Algirdas Pakstas,et al.  MPEG-4 Facial Animation: The Standard,Implementation and Applications , 2002 .

[4]  Catherine Pelachaud.  Visual Text‐to‐Speech , 2003 .

[5]  Mariusz Wzorek,et al.  Towards Ubiquitous Production and Delivery of Face Animation , 2003 .

[6]  Stefan Kopp,et al.  Towards a Common Framework for Multimodal Generation: The Behavior Markup Language , 2006, IVA.

[7]  Hung-Hsuan Huang,et al.  Towards an Embodied Conversational Agent Talking in Croatian , 2007, 2007 9th International Conference on Telecommunications.

[8]  I.S. Pandzic,et al.  Animatable face models from uncalibrated input pictures , 2009, 2009 10th International Conference on Telecommunications.

[9]  Igor S. Pandzic,et al.  A Real-Time Lip SYNC System Using a Genetic Algorithm for Automatic Neural Network Configuration , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[10]  Stefan Zerbst,et al.  3D game engine programming , 2004 .

[11]  Igor S. Pandzic,et al.  Real-time language independent lip synchronization method using a genetic algorithm , 2006, Signal Process..

[12]  Stacy Marsella,et al.  SmartBody: behavior realization for embodied conversational agents , 2008, AAMAS.

[13]  M. Fratarcangeli,et al.  A Non-Invasive Approach for Driving Virtual Talking Heads from Real Facial Movements , 2007, 2007 3DTV Conference.