Production Tools for Electronic Arenas: Event Management and Content Production

This document comprises a combined deliverable made up of Deliverables D4.3 and D4.4 to the eRENA project. This document considers how the production of events in electronic arenas, might be supported. The concern is with the ‘behind-the-scenes’ activities which are necessary in staging an event and how those activities might be best supported technically. Basing our research on the practical experience accumulating in eRENA, and on the field studies of production work performed, we present novel technologies and orientations to the support of production process, these principally focus on technologies for supporting events as they occur in real-time and include: proposals and demonstrations of virtual cameras for capturing activity in electronic arenas, techniques for sonifying the activity of participants in an electronic arena to give an audible sense of the status of events, a physical environment containing tangible interfaces to production software to facilitate timely direction and production work, and a system for mapping data from participants to enable its flexible interpretation in media-rich environments. It also begins to consider how content for events might be developed both off-line as well as improvised in real-time. The document contains reports of public artistic events which have driven the developments here as well as stimulated novel cross-project collaborations. Throughout there is a concern to reflect critically on the status of the technologies and concepts explored, where possible through formal analysis, and how they might influence and learn from other developments in the eRENA project. Document eRENA – D4.3/4.4 Type Deliverable report with video material Status Final Version 1.0 Date September, 1999 Authors Sabine Hirtes, Michael Hoch, Bernd Lintermann and Sally Jane Norman Zentrum für Kunst und Medientechnologie (ZKM) John Bowers, Kai-Mikael Jää-Aro, Sten-Olof Hellström and Malin Carlzon Royal Institute of Technology (KTH) Task D4.3/D4.4 eRENA-D4.3/D4.4 Production Tools for Electronic Arenas August 1999 2 ESPRIT Project 2537 Table of

[1]  D. Gabor Acoustical Quanta and the Theory of Hearing , 1947, Nature.

[2]  H. Garfinkel Studies in Ethnomethodology , 1968 .

[3]  Robert C. Morrison,et al.  High technology laboratory aids for visually handicapped chemistry students , 1981 .

[4]  W. Buxton Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[5]  Abigail Sellen,et al.  A study in interactive 3-D rotation using 2-D control devices , 1988, SIGGRAPH.

[6]  James F. Blinn,et al.  Where am I? What am I looking at? (cinematography) , 1988, IEEE Computer Graphics and Applications.

[7]  Curtis Roads,et al.  Introduction to Granular Synthesis , 1988 .

[8]  Steven K. Feiner,et al.  Issues in the automated generation of animated presentations , 1990 .

[9]  Colin Ware,et al.  Exploration and virtual camera control in virtual three dimensional environments , 1990, I3D '90.

[10]  Jock D. Mackinlay,et al.  Rapid controlled movement through a virtual 3D workspace , 1990, SIGGRAPH.

[11]  Daniel Thalmann,et al.  Physically-based interactive camera motion control using 3D input devices , 1991 .

[12]  Steven K. Feiner,et al.  Automating the generation of coordinated multimedia explanations , 1991, Computer.

[13]  William W. Gaver,et al.  Effective sounds in complex systems: the ARKOLA simulation , 1991, CHI.

[14]  David Vernon,et al.  Machine vision - automated visual inspection and robot vision , 1991 .

[15]  Alan B. Craig,et al.  Using sound to extract meaning from complex data , 1991, Electronic Imaging.

[16]  Steven K. Feiner,et al.  Automated generation of intent-based 3D Illustrations , 1991, SIGGRAPH.

[17]  Dan Shapiro,et al.  Faltering from ethnography to design , 1992, CSCW '92.

[18]  Norman I. Badler,et al.  Automatic viewing control for 3D direct manipulation , 1992, I3D '92.

[19]  Michael Gleicher,et al.  Through-the-lens camera control , 1992, SIGGRAPH.

[20]  Steven M. Drucker,et al.  CINEMA: a system for procedural camera movements , 1992, I3D '92.

[21]  Sara A. Bly,et al.  Media spaces: bringing people together in a video, audio, and computing environment , 1993, CACM.

[22]  Ioannis Pitas,et al.  Digital Image Processing Algorithms , 1993 .

[23]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[24]  Christian Stary Interaktive Systeme - Software-Entwicklung und Software-Ergonomie , 1994, Vieweg Lehrbuch Informatik.

[25]  Gregory Kramer,et al.  Auditory Display: Sonification, Audification, And Auditory Interfaces , 1994 .

[26]  William Bricken,et al.  Efficient virtual collision detection for multiple users in large virtual spaces , 1994 .

[27]  Steven M. Drucker,et al.  Intelligent camera control for graphical environments , 1994 .

[28]  A. J. Bilson Get into the groove: designing for participation , 1995, INTR.

[29]  Jarke J. van Wijk,et al.  3D computational steering with parametrized geometric objects , 1995, Proceedings Visualization '95.

[30]  Thomas Strothotte,et al.  Computer Supported Staging of Photorealistic Animations , 1995 .

[31]  Steven M. Drucker,et al.  CamDroid: a system for implementing intelligent camera control , 1995, I3D '95.

[32]  Daniel Thalmann,et al.  The HUMANOID Environment for Interactive Animation of Multiple Deformable Human Characters , 1995, Comput. Graph. Forum.

[33]  Michael Zyda,et al.  Exploiting reality with multicast groups: a network architecture for large-scale virtual environments , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[34]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[35]  Daniel Thalmann,et al.  An Adaptive Spatial Subdivision of the Object Space for Fast Collision Detection of Animated Rigid Bodies , 1995, Comput. Graph. Forum.

[36]  Gareth Smith,et al.  Cooperative virtual environments: lessons from 2D multi user interfaces , 1996, CSCW '96.

[37]  Thomas A. Funkhouser,et al.  Network topologies for scalable multi-user virtual environments , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[38]  Tom Rodden,et al.  Populating the application: a model of awareness for cooperative applications , 1996, CSCW '96.

[39]  David Salesin,et al.  The virtual cinematographer: a paradigm for automatic real-time camera control and directing , 1996, SIGGRAPH.

[40]  John Bowers,et al.  Getting others to get it right: an ethnography of design work in the fashion industry , 1996, CSCW '96.

[41]  John Bowers,et al.  Talk and embodiment in collaborative virtual environments , 1996, CHI.

[42]  Daniel Thalmann,et al.  Virtual Human Representation and Communication in VLNET Networked Virtual Environment , 1997 .

[43]  Steve Benford,et al.  A Multicast Network Architecture for Large Scale Collaborative Virtual Environments , 1997, ECMAST.

[44]  Brian Christopher Smith,et al.  CU-SeeMe VR immersive desktop teleconferencing , 1997, MULTIMEDIA '96.

[45]  John H. Flowers,et al.  Cross-Modal Equivalence of Visual and Auditory Scatterplots for Exploring Bivariate Data Samples , 1997, Hum. Factors.

[46]  Oliver Deussen,et al.  Erzeugung komplexer botanischer Objekte in der Computergraphik , 1997, Informatik-Spektrum.

[47]  David B. Martin,et al.  The Interactional Affordances of Technology: An Ethnography of Human-Computer Interaction in an Ambulance Control Centre , 1997, BCS HCI.

[48]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[49]  Michael Hoch Object Oriented Design of the Intuitive Interface , 1997 .

[50]  Graham Walker,et al.  The mirror: reflections on inhabited TV , 1997, SIGGRAPH '97.

[51]  Bruce Damer Demonstration and guided tours of virtual worlds on the internet , 1997, CHI Extended Abstracts.

[52]  Cristian Bogdan,et al.  Aether: An Awareness Engine for CSCW , 1997, ECSCW.

[53]  S. Backhaus,et al.  Quantum oscillations between two weakly coupled reservoirs of superfluid 3He , 1997, Nature.

[54]  Steve Benford,et al.  Awareness driven video quality of service in collaborative virtual environments , 1998, CHI.

[55]  Hiroshi Ishii,et al.  mediaBlocks: physical containers, transports, and controls for online media , 1998, SIGGRAPH.

[56]  Roger J. Hubbold,et al.  Navigation guided by artificial force fields , 1998, CHI.

[57]  Thomas Elsaesser,et al.  Cinema Futures: Cain, Abel or Cable? , 1998 .

[58]  Thomas P. Moran,et al.  Embodied User Interfaces: Towards Invisible User Interfaces , 1998, EHCI.

[59]  Morten Fjeld,et al.  BUILD-IT: a planning tool for construction and design , 1998, CHI Conference Summary.

[60]  Radomír Mech,et al.  Realistic modeling and rendering of plant ecosystems , 1998, SIGGRAPH.

[61]  Steve Benford,et al.  Experiments in inhabited TV , 1998, CHI Conference Summary.

[62]  Michael Hoch,et al.  A prototype system for intuitive film planning , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[63]  M. Jessop,et al.  eTV: a mixed reality interface onto Inhabited TV , 1998 .

[64]  John G. Neuhoff,et al.  Sonification Report: Status of the Field and Research Agenda Prepared for the National Science Foundation by members of the International Community for Auditory Display , 1999 .

[65]  Steve Benford,et al.  Broadcasting on-line social interaction as inhabited television , 1999, ECSCW.

[66]  H. Ishii,et al.  Urp: a luminous-tangible workbench for urban planning and design , 1999, CHI '99.

[67]  Ian Taylor,et al.  Creating a live broadcast from a virtual environment , 1999, SIGGRAPH.

[68]  Steve Benford,et al.  What You See Is Not What I See: Subjectivity in Virtual Environments , 2000 .

[69]  A. Bregman Auditory Scene Analysis , 2001 .