Computer Theater

The basic argument of this paper is that until recently theatrical performances involving human and computer actors were not possible due to the lack of appropriate computational models for action representation, recognition, and generation. This paper surveys and classiies some recent experiments in computerized performances, and uses this classiication as a framework to establish the importance of action as a foundation of computer theater. It also argues that computer theater has many characteristics which qualify it as a good domain for AI and computer vision research on action. Finally, an example of a script for a computer theater performance is provided and analyzed in terms of scientiic and technological challenges. Action is the basis of theater 1 and, as such, needs to be fully incorporated in whatever model a computer is running during a computer-based theatrical performance. I believe the lack of good models for action is the basic reason for the relative absence of experiments involving theater and computers. The attempts to wire up stages or performers were in general concerned with dance (for instance, 20]), depending solely on the detection of positional and spatial movements. Computer theater not only requires action representation and recognition but it is also an interesting domain for action research. To support this argument I begin by examining the multiple possibilities of making theater with computers, concerning both explored and unexplored developments. Some attempts to represent and recognize actions are examined in the second part of the paper, followed by the analysis of a very simple script written for a computer theater performance. 1 Computer Theater As much as museums and art galleries seem to depend on the physical presence of objects, a performance requires the sharing of a common physical space. Otherwise the fundamental relation, the suspension of disbelief, does not take place. In this paper I consider as computer theater only situations which involve human performers and audience in the same physical space, therefore excluding the idea of \dis-tributed theater" as proposed by Krueger ((17], pg. 221). 1 Langer, in 19], chapter 17, contains an interesting discussion about the basics of theater. By doing this I am not ruling out the importance of new theatrical forms of art and entertainment which do not require physical sharing of space. My objective is mostly to delimit the scope of computer theater to simplify the analysis and be able to draw generic conclusions. I also …

[1]  S. Langer Feeling and Form , 1953 .

[2]  Roger C. Schank,et al.  CONCEPTUAL DEPENDENCY THEORY , 1975 .

[3]  K. Johnstone IMPRO: Improvisation and Theatre , 1979 .

[4]  James F. Allen Towards a General Theory of Action and Time , 1984, Artif. Intell..

[5]  David Mamet,et al.  A Practical Handbook for the Actor , 1986 .

[6]  S. Pinker Learnability and Cognition: The Acquisition of Argument Structure , 1989 .

[7]  Janet E. Cahn Generating expression in synthesized speech , 1989 .

[8]  Jeff Pittam,et al.  The long-term spectrum and perceived emotion , 1990, Speech Commun..

[9]  Jugal Kalita,et al.  Natural language control of animation of task performance in a physical domain , 1990 .

[10]  N. Magnenat-Thalmann,et al.  Synthetic actors in computer-generated 3D films , 1990 .

[11]  David J. Israel,et al.  Actions and Movements , 1991, IJCAI.

[12]  Robert Rowe,et al.  Interactive Music Systems: Machine Listening and Composing , 1992 .

[13]  W. Scott Neal Reilly,et al.  An Architecture for Action, Emotion, and Social Behavior , 1992, MAAMAW.

[14]  Yasuo Kuniyoshi,et al.  Qualitative Recognition of Ongoing Human Action Sequences , 1993, IJCAI.

[15]  Elliott Schwartz,et al.  Music Since 1945: Issues, Materials, and Literature , 1993 .

[16]  Demetri Terzopoulos,et al.  Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  R. Nelson,et al.  Low level recognition of human motion (or how to get your man without finding his body parts) , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[18]  K. Rohr Towards model-based recognition of human movements in image sequences , 1994 .

[19]  Kenneth B. Russell,et al.  Unencumbered Virtual Environments , 1995 .

[20]  Claudio S. Pinhanez,et al.  Intelligent Studios: Using Computer Vision to Control TV Cameras , 1995 .

[21]  D. Gavrila,et al.  3-D model-based tracking of human upper body movement: a multi-view approach , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[22]  Glorianna Davenport,et al.  Narrative guidance of interactivity , 1995 .

[23]  Ken Perlin,et al.  Real Time Responsive Animation with Personality , 1995, IEEE Trans. Vis. Comput. Graph..

[24]  Y. Wong Temporal typography : characterization of time-varying typographic forms , 1995 .

[25]  Rosalind W. Picard Aaective Computing , 1995 .

[26]  Alex Pentland,et al.  The ALIVE system: full-body interaction with autonomous agents , 1995, Proceedings Computer Animation'95.

[27]  Claudio S. Pinhanez,et al.  Approximate World Models: Incorporating Qualitative and Linguistic Information into Vision Systems , 1996, AAAI/IAAI, Vol. 2.

[28]  James W. Davis,et al.  An appearance-based representation of action , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[29]  Alex Pentland,et al.  Modeling, tracking and interactive animation of faces and heads//using input from video , 1996, Proceedings Computer Animation '96.

[30]  Flavia Sparacino,et al.  DirectIVE-- choreographing media for interactive virtual environments , 1996 .