Eliza meets the wizard-of-oz: evaluating social acceptability

What authoring possibilities arise by blending machine and human control of live embodied character experiences? This paper explores two different "behind-the-scenes" roles for human operators during a three-month gallery installation of an embodied character experience. In the Transcription role, human operators type players' spoken utterances; then, algorithms interpret the player's intention, choose from pre-authored dialogue based on local and global narrative contexts, and procedurally animate two embodied characters. In the Discourse role, human operators select from semantic categories to interpret player intention; algorithms use this "discourse act" to automate character dialogue and animation. We compare these two methods of blending control using game logs and interviews, and document how the amateur operators initially resisted having to learn the Discourse version, but eventually preferred having the authorial control it afforded. This paper also outlines a design space for blending machine and human control in live character experiences.

[1]  Niels Ole Bernsen,et al.  Wizard-of-oz and the trade-off between naturalness and recogniser constraints , 1993, EUROSPEECH.

[2]  Blair MacIntyre,et al.  Presence and engagement in an interactive drama , 2007, CHI.

[3]  Justine Cassell,et al.  An Architecture for Embodied Conversational Characters , 1998 .

[4]  Joseph Weizenbaum,et al.  and Machine , 1977 .

[5]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[6]  Blair MacIntyre,et al.  Evaluating a conversation-centered interactive drama , 2007, AAMAS '07.

[7]  Ken Perlin,et al.  Creating Emotive Responsive Characters Within Virtual Worlds , 2000, Virtual Worlds.

[8]  Alex Pentland,et al.  Facial expression recognition using a dynamic model and motion energy , 1995, Proceedings of IEEE International Conference on Computer Vision.

[9]  Blair MacIntyre,et al.  Initial lessons from AR Façade, an interactive augmented reality drama , 2006, ACE '06.

[10]  Norman I. Badler,et al.  Representing and parameterizing agent behaviors , 2002, Proceedings of Computer Animation 2002 (CA 2002).

[11]  Joseph Bates,et al.  Dramatic Presence , 1993, Presence: Teleoperators & Virtual Environments.

[12]  Michael Mateas,et al.  A preliminary poetics for interactive drama and games , 2001, Digit. Creativity.

[13]  David Thue,et al.  PaSSAGE: A Demonstration of Player Modeling in Interactive Storytelling , 2008, AIIDE.

[14]  R. Schechner Performance Studies: An Introduction , 2002 .

[15]  Anoop K. Sinha,et al.  Suede: a Wizard of Oz prototyping tool for speech user interfaces , 2000, UIST '00.

[16]  James C. Lester,et al.  Animated Pedagogical Agents: Face-to-Face Interaction in Interactive Learning Environments , 2000 .

[17]  Ruth Aylett,et al.  Modeling game master-based story facilitation in multi-player role-playing games , 2009 .

[18]  Annika Wærn,et al.  The art of game-mastering pervasive games , 2008, ACE '08.

[19]  Perttu Hämäläinen,et al.  Wizard of Oz prototyping of computer vision based action games for children , 2004, IDC '04.

[20]  Andrew Stern,et al.  Natural Language Understanding in Façade: Surface-Text Processing , 2004, TIDSE.

[21]  Mitsuru Ishizuka,et al.  Let's talk! Socially intelligent agents for language conversation training , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[22]  Robert Michael Young,et al.  Integrating plan-based behavior generation with game environments , 2005, ACE '05.

[23]  James H. Martin,et al.  Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition, 2nd Edition , 2000, Prentice Hall series in artificial intelligence.

[24]  Andrew Stern,et al.  Façade: An Experiment in Building a Fully-Realized Interactive Drama , 2003 .

[25]  Niels Ole Bernsen,et al.  Animating an interactive conversational character for an educational game system , 2005, IUI.

[26]  David L. Roberts,et al.  Declarative optimization-based drama management in interactive fiction , 2006, IEEE Computer Graphics and Applications.

[27]  Michael Mateas,et al.  Agency Reconsidered , 2009, DiGRA Conference.

[28]  Arne Jönsson,et al.  Wizard of Oz studies: why and how , 1993, IUI '93.