User requirements in immersive mediated performance spaces

Vconect (http://www.vconect-project.eu/) is an EU Framework 7 research program. One of the aims is to support the area of mediated performance for the purpose of remote teaching, rehearsals and performances through videoconferencing technologies featuring automated editing and composition of multiple live audio-video streams onto multiple screens. The orchestration of the video and audio streams will take into account a variety of editing cues originating from directional audio, face detection and physiological sensors augmenting audience feedback. Over the last two decades performance artists have made use of videoconferencing systems for installations, joint performances and rehearsals; often negotiating costly and bespoke soft and hardware. More recently, pervasive and low-cost videoconferencing technology has successfully been applied in mediated installations, paving the way for the technology to be incorporated into the curriculum of performance colleges thereby creating a need for systematic user requirement research. We report on a series of studies in which theatre and dance students collaborated across a videoconferencing connection. The results highlighted different technology requirements for distributed theatre and dance practitioners and these findings help shape the the Vonect research agenda. We highlight theoretical perspectives relevant to telepresence in performance.

[1]  G. Rizzolatti,et al.  Speech listening specifically modulates the excitability of tongue muscles: a TMS study , 2002, The European journal of neuroscience.

[2]  Steve Whittaker,et al.  Conversations Over Video Conferences: An Evaluation of the Spoken Aspects of Video-Mediated Communication , 1993, Hum. Comput. Interact..

[3]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[4]  Celine Latulipe,et al.  Love, hate, arousal and engagement: exploring audience responses to performing arts , 2011, CHI.

[5]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[6]  Roger Copeland,et al.  Merce Cunningham: The Modernizing of Modern Dance , 2003 .

[7]  Matthew Causey,et al.  The Screen Test of the Double: The Uncanny Performer in the Space of Technology , 1999 .

[8]  Damien J. Williams,et al.  Effects of Latency on Telepresence , 2009 .

[9]  Pablo César,et al.  Video communication for networked communities: Challenges and opportunities , 2012, 2012 16th International Conference on Intelligence in Next Generation Networks.

[10]  Alexander Raake,et al.  The well-tempered conversation: interactivity, delay and perceptual VoIP quality , 2005, IEEE International Conference on Communications, 2005. ICC 2005. 2005.

[11]  Lisa Marie Naugle,et al.  Distributed Choreography: A Video-Conferencing Environment , 2002, PAJ: A Journal of Performance and Art.

[12]  E. T. Klemmer Subjective evaluation of transmission delay in telephone conversations , 1967 .

[13]  Abigail Sellen,et al.  Remote Conversations: The Effects of Mediating Talk With Technology , 1995, Hum. Comput. Interact..

[14]  Stuart Cheshire,et al.  Latency and the quest for interactivity , 1996 .

[15]  付伶俐 打磨Using Language,倡导新理念 , 2014 .

[16]  Scott T Grafton,et al.  Functional imaging of face and hand imitation: towards a motor theory of empathy , 2004, NeuroImage.

[17]  Chen Wang,et al.  Sensing Audience Response- Beyond One Way Streaming of Live Performances , 2013 .

[18]  R. Krauss,et al.  Effects of Transmission Delay and Access Delay on the Efficiency of Verbal Communication , 1967 .

[19]  Kathryn Farley,et al.  Digital Performance: A History of New Media in Theatre, Dance, Performance Art, and Installation (review) , 2008 .

[20]  Steve Whittaker,et al.  Rethinking video as a technology for interpersonal communications: theory and design implications , 1995, Int. J. Hum. Comput. Stud..

[21]  John C. Tang,et al.  What video can and cannot do for collaboration: A case study , 2005, Multimedia Systems.

[22]  Gregory M. P. O'Hare,et al.  Presence Equation: An Investigation into Cognitive Factors Underlying Presence , 2003, Presence: Teleoperators & Virtual Environments.

[23]  Karen Ruhleder,et al.  Meaning-making across remote sites: How delays in transmission affect interaction , 1999, ECSCW.

[24]  R. Singleton,et al.  Sensory Evaluation by Quantitative Descriptive Analysis , 2008 .

[25]  Margaret Wilson,et al.  An oscillator model of the timing of turn-taking , 2005, Psychonomic bulletin & review.

[26]  K. Shockley,et al.  Mutual interpersonal postural constraints are involved in cooperative conversation. , 2003, Journal of experimental psychology. Human perception and performance.

[27]  Susan Kozel,et al.  Closer: Performance, Technologies, Phenomenology , 2007 .

[28]  Erik Geelhoed,et al.  Extending the theatre experience: The potential for wearable and onstage cameras , 2012 .