Puppet Show : Intuitive Puppet Interfaces for Expressive Character Control

We argue that evolving game art like virtual performances and Machinima depend on better character control. That is why Puppet Show does not focus on new or optimized gameplay but aims to extend the expressive range of characters in an existing game world. Puppet Show is an interface plug-in for Epic’s Unreal Tournament 2004. Puppet Show uses an external Java program to feed visual input from a webcam onto the character animation of customized Unreal game avatars. It adds computer vision as another input device for physical puppeteering of the virtual game characters. Computer vision allows for an intuitive mapping of body movements onto virtual characters and gives human actors better access to an expressive virtual performance. We argue that this exemplifies an interface trend towards more expressive input options that support a higher level of expression in video games.

[1]  S. Joy Mountford,et al.  The Art of Human-Computer Interface Design , 1990 .

[2]  Colin Beardon,et al.  Play it again, Sam: film performance, virtual environments and game engines , 2005 .

[3]  Brenda Kay Laurel,et al.  Toward the design of a computer-based interactive fantasy system / , 1986 .

[4]  Brenda Laurel,et al.  Computers as theatre , 1991 .

[5]  Perttu Hämäläinen,et al.  Wizard of Oz prototyping of computer vision based action games for children , 2004, IDC '04.

[6]  William Michael Tomlinson Interactivity and emotion through cinematography , 1999 .

[7]  Sharon Springel,et al.  “The Virtual Theatre” immersive participatory drama research at the centre for communications systems research, Cambridge University , 1998, MULTIMEDIA '98.

[8]  Ryohei Nakatsu,et al.  Interactive movie system with multi-person participation and anytime interaction capabilities , 1998, MULTIMEDIA '98.

[9]  Hiroshi Ishii,et al.  Tangible User Interfaces (TUIs): A Novel Paradigm for GIS , 2004, Trans. GIS.

[10]  Colin Beardon,et al.  New Visions In Performance: The Impact of Digital Technologies , 2005 .

[11]  Paul Marino,et al.  3D geme-based filmmaking : the art of machinima , 2004 .

[12]  Toni Robertson,et al.  Labanotation for design of movement-based interaction , 2005 .

[13]  J. Howell,et al.  Acting in virtual reality , 2000, CVE '00.

[14]  N. Magnenat-Thalmann,et al.  Synthetic actors in computer-generated 3D films , 1990 .

[15]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[16]  Noah Wardrip-Fruin,et al.  First Person: New Media As Story, Performance, And Game , 2004 .

[17]  Gabriella Giannachi,et al.  Virtual Theatres: An Introduction , 2004 .

[18]  Brenda Danet,et al.  Curtain Time 20: 00 GMT: Experiments in Virtual Theater on Internet Relay Chat , 2006, J. Comput. Mediat. Commun..