“It/I”: a theater play featuring an autonomous computer graphics character

“It/I” IS a two-character theater play where the human character I IS taunted and played by an autonomous computer-graphics character It. We beheve that “It/I” IS the first play ever produced mvolvmg a character reactively controlled by a computer. Autonomous characters can bnng a new dlmenslon to the theater experience by enablmg the audience to go up on stage after the performance and interact directly with the characters, re-enacting the story of the play. This paper reports the expenence and examines techmcal developments needed for the successful productlon of “It/I”. In particular we descnbe the rntenjual scrrpr paradigm used to program the CGcharacter, the proposed SCD-architecture for story-based interactive systems, and the ACTSCRIF-T language for commumcatlon of actions and goals

[1]  Jugal Kalita,et al.  Natural language control of animation of task performance in a physical domain , 1990 .

[2]  Ken Perlin,et al.  Improv: a system for scripting interactive actors in virtual worlds , 1996, SIGGRAPH.

[3]  Claudio S. Pinhanez,et al.  Approximate World Models: Incorporating Qualitative and Linguistic Information into Vision Systems , 1996, AAAI/IAAI, Vol. 2.

[4]  N. Magnenat-Thalmann,et al.  Synthetic actors in computer-generated 3D films , 1990 .

[5]  James W. Davis,et al.  Virtual PAT: A Virtual Personal Aerobics Trainer , 1998 .

[6]  S. Langer.  Feeling and Form , 1953 .

[7]  James W. Davis,et al.  An appearance-based representation of action , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[8]  Ken Perlin,et al.  Real Time Responsive Animation with Personality , 1995, IEEE Trans. Vis. Comput. Graph..

[9]  Roger C. Schank,et al.  CONCEPTUAL DEPENDENCY THEORY , 1975 .

[10]  Y. Ivanov,et al.  Fast Lighting Independent Background Subtraction , 1998, Proceedings 1998 IEEE Workshop on Visual Surveillance.

[11]  James F. Allen.  Towards a General Theory of Action and Time , 1984, Artif. Intell..

[12]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[13]  James W. Davis,et al.  The KidsRoom: A Perceptually-Based Interactive and Immersive Story Environment , 1999, Presence.

[14]  Jun Rekimoto,et al.  Object Composition and Playback Models for Handling Multimedia Data , 1993, ACM Multimedia.

[15]  Claudio S. Pinhanez,et al.  Interval scripts: a design paradigm for story-based interactive systems , 1997, CHI.

[16]  J. Murray.  Hamlet on the Holodeck , 1997 .

[17]  Alex Pentland,et al.  The ALIVE system: full-body interaction with autonomous agents , 1995, Proceedings Computer Animation'95.

[18]  TheaterClaudio S. PinhanezPerceptual.  Computer Theater , 1997 .

[19]  Jun Rekimoto,et al.  Object composition and playback models for handling multimedia data , 1993, MULTIMEDIA '93.

[20]  Christa Sommerer,et al.  Art as Living System (人工生命特集号) , 1996 .

[21]  W. Scott Neal Reilly,et al.  An Architecture for Action, Emotion, and Social Behavior , 1992, MAAMAW.

[22]  Claudio S. Pinhanez,et al.  Computer Theater: Stage for Action Understanding , 1996 .

[23]  Polle Zellweger,et al.  Automatic temporal layout mechanisms , 1993, MULTIMEDIA '93.

[24]  James W. Davis,et al.  The representation and recognition of human movement using temporal templates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.