Virtual agents for the production of linear animations

Abstract In the last decade, a number of techniques from the new media practices have contributed to innovate the traditional production of entertainment, through the modularization and the automation of a number of phases. This paper proposes a novel approach to the automatic generation of character animations that draws inspiration from the techniques for the construction of the virtual agents. The pipeline for the production of animated scenes is based on the mapping between the authorial description of characters’ behavior and the actual animation data. The application context is the production of linear (non interactive) animations. Given the specification of a set of high level goals, the implemented system generates the animation through the generation of a sequence of actions, the translation of actions into animation commands, the display of an animated scene through a 3D graphic engine. The pipeline and the system are validated onto the production of a short animated movie, with the participation of a commercial company, Virtual Reality and Multi Media Park S.p.a. (www.vrmmp.it).

[1]  Andrew Stern,et al.  Integrating Plot, Character and Natural Language Processing in the Interactive Drama Façade , 2003 .

[2]  Guido Boella,et al.  A REPLANNING ALGORITHM FOR DECISION THEORETIC HIERARCHICAL PLANNING: PRINCIPLES AND EMPIRICAL EVALUATION , 2008, Appl. Artif. Intell..

[3]  Marc Cavazza,et al.  Interacting with virtual characters in interactive storytelling , 2002, AAMAS '02.

[4]  Richard E. Parent,et al.  Computer animation - algorithms and techniques , 2012 .

[5]  Frank Dignum,et al.  Games and Agents: Designing Intelligent Gameplay , 2009, Int. J. Comput. Games Technol..

[6]  Norman I. Badler,et al.  A Parameterized Action Representation for Virtual Human Agents , 1998 .

[7]  Jovan Popovic,et al.  Multiobjective control with frictional contacts , 2007, SCA '07.

[8]  James Skorupski Storyboard authoring of plan-based interactive dramas , 2009, FDG.

[9]  Simeon J. Simoff,et al.  AUTHENTIC INTERACTIVE REENACTMENT OF CULTURAL HERITAGE WITH 3D VIRTUAL WORLDS AND ARTIFICIAL INTELLIGENCE , 2010, Appl. Artif. Intell..

[10]  Isaac Kerlow,et al.  The Art of 3D Computer Animation and Effects , 2008 .

[11]  R. Michael Young,et al.  Bowyer: A Planning Tool for Bridging the Gap between Declarative and Procedural Domains , 2009, AIIDE.

[12]  Vincenzo Lombardo,et al.  A Virtual Interpreter for the Italian Sign Language , 2010, IVA.

[13]  W. Scott Neal Reilly,et al.  System for authoring highly interactive, personality-rich interactive characters , 2004, SCA '04.

[14]  Mathijs de Weerdt,et al.  Plan Repair as an Extension of Planning , 2005, ICAPS.

[15]  Stefan Kopp,et al.  Towards a Common Framework for Multimodal Generation: The Behavior Markup Language , 2006, IVA.

[16]  Anton Leuski,et al.  Ada and Grace: Toward Realistic and Engaging Virtual Museum Guides , 2010, IVA.

[17]  Ana Paiva,et al.  FearNot! - An Emergent Narrative Approach to Virtual Dramas for Anti-bullying Education , 2007, International Conference on Virtual Storytelling.

[18]  Justine Cassell,et al.  BEAT: the Behavior Expression Animation Toolkit , 2001, Life-like characters.

[19]  Luca Chittaro,et al.  Employing virtual humans for education and training in X3D/VRML worlds , 2007, Comput. Educ..

[20]  L. Manovich,et al.  The language of new media , 2001 .

[21]  Hector Muñoz-Avila,et al.  Applications of SHOP and SHOP2 , 2005, IEEE Intelligent Systems.

[22]  Dana S. Nau,et al.  SHOP2: An HTN Planning System , 2003, J. Artif. Intell. Res..

[23]  Stefan Kopp,et al.  A Conversational Agent as Museum Guide - Design and Evaluation of a Real-World Application , 2005, IVA.

[24]  John B. Lowe,et al.  The Berkeley FrameNet Project , 1998, ACL.

[25]  Radoslaw Niewiadomski,et al.  Greta: an interactive expressive ECA system , 2009, AAMAS.

[26]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[27]  Bruce Blumberg,et al.  A Layered Brain Architecture for Synthetic Creatures , 2001, IJCAI.

[28]  Andrew Stern,et al.  Writing Façade: a Case Study in Procedural Authorship , 2007 .

[29]  Alexis Héloir,et al.  EMBR: A realtime animation engine for interactive embodied agents , 2009, ACII.

[30]  Adam Pease,et al.  Mapping WordNet to the SUMO Ontology , 2003 .

[31]  Vincenzo Lombardo,et al.  Lexical Mediation for Ontology-Based Annotation of Multimedia , 2013, New Trends of Research in Ontologies and Lexical Resources.

[32]  Marc Cavazza,et al.  Interactive Storytelling with Literary Feelings , 2007, ACII.

[33]  Stefan Kopp,et al.  MURML: A Multimodal Utterance Representation Markup Language for Conversational Agents , 2002 .

[34]  Dana S. Nau,et al.  Translating HTNs to PDDL: A Small Amount of Domain Knowledge Can Go a Long Way , 2009, IJCAI.