Staging exhibitions: methods and tools for modelling narrative structure to produce interactive performances with virtual actors

CrossTalk is a self-explaining virtual character exhibition for public spaces. This paper presents the CrossTalk system, including its authoring tool SceneMaker and the CarSales exhibit. CrossTalk extends the commonplace human-to-screen interaction to an interaction triangle. The user faces two separated screens inhabited with virtual characters and interacts through a frontal touch screen. One screen features the exhibition’s hostess, an agent who explains exchangeable exhibits located in the opposing screen. The current exhibit is CarSales, a demonstration of automatically generated dialogue, performed by virtual actors. The physical presence of the characters is established through the separation of screens and intensified by inter-character conversations across screens, tying hostess and exhibit together. CrossTalk utilises a combination of both automatically generated and pre-scripted scenes, and a context memory to adapt to the user and the environment. CrossTalk’s authoring tool SceneMaker, in a strict separation of narrative structure and content, provides non-experts with a screenplay-like language to create installations for staging exhibitions.

[1]  Thomas Rist,et al.  The Interactive CrossTalk Installation: Meta-Theater with Animated Presentation Agents , 2002 .

[2]  Thomas Rist,et al.  Authoring scenes for adaptive, interactive performances , 2003, AAMAS '03.

[3]  F. Thomas,et al.  The illusion of life : Disney animation , 1981 .

[4]  Andrew Stern,et al.  Towards Integrating Plot and Character for Interactive Drama , 2002 .

[5]  W. Lewis Johnson,et al.  Animated Agents for Procedural Training in Virtual Reality: Perception, Cognition, and Motor Control , 1999, Appl. Artif. Intell..

[6]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[7]  Randall W. Hill,et al.  Toward the holodeck: integrating graphics, sound, character and story , 2001, AGENTS '01.

[8]  Mitsuru Ishizuka,et al.  SCREAM: scripting emotion-based agent minds , 2002, AAMAS '02.

[9]  Stacy Marsella,et al.  Interactive pedagogical drama , 2000, AGENTS '00.

[10]  Marcus J. Huber JAM: a BDI-theoretic mobile agent architecture , 1999, AGENTS '99.

[11]  Ana Paiva,et al.  Heroes, villians, magicians, …: dramatis personae in a virtual story creation environment , 2001, IUI '01.

[12]  Bruce Blumberg,et al.  Multiple conceptions of character-based interactive installations , 2001, Proceedings. Computer Graphics International 2001.

[13]  Joseph Bates,et al.  Guiding interactive drama , 1997 .

[14]  Nikitas M. Sgouros Dynamic Generation, Management and Resolution of Interactive Plots , 1999, Artif. Intell..

[15]  K. Chang,et al.  Embodiment in conversational interfaces: Rea , 1999, CHI '99.

[16]  A. Scheflen THE SIGNIFICANCE OF POSTURE IN COMMUNICATION SYSTEMS. , 1964, Psychiatry.

[17]  Thomas Rist,et al.  The automated design of believable dialogues for animated presentation teams , 2001 .

[18]  Norman I. Badler,et al.  Design of a Virtual Human Presenter , 2000, IEEE Computer Graphics and Applications.

[19]  Elisabeth André,et al.  WebPersona: A life-like presentation agent for the World-Wide Web , 1997, IJCAI 1997.

[20]  R. Andre,et al.  Presenting through Performing: On the Use of Multiple Animated Characters in Knowledge-Based Present , 2000 .

[21]  Ana Paiva,et al.  Papous: The Virtual Storyteller , 2001, IVA.

[22]  Christopher W. Geib,et al.  Planning and Parallel Transition Networks: Animation's New Frontiers , 1995 .

[23]  Mitsuru Ishizuka,et al.  MPML: A Multimodal Presentation Markup Language with Character Agent Control Functions , 2000, WebNet.

[24]  Michael Kipp,et al.  From Human Gesture to Synthetic Action , 2001 .

[25]  Michael Kipp,et al.  ANVIL - a generic annotation tool for multimodal dialogue , 2001, INTERSPEECH.

[26]  Brenda Laurel,et al.  Computers as theatre , 1991 .

[27]  J. Murray Hamlet on the Holodeck , 1997 .

[28]  J. van Leeuwen,et al.  Intelligent Virtual Agents , 2001, Lecture Notes in Computer Science.

[29]  Thomas Rist,et al.  WebPersona: a lifelike presentation agent for the World-Wide Web , 1998, Knowl. Based Syst..

[30]  R. Aylett Narrative in Virtual Environments - Towards Emergent Narrative , 1999 .