Watching the footwork: second screen interaction at a dance and music performance

Interactive mobile technologies have become part of audience experiences of live performances in terms of both general media sharing and specific (sometimes official) extra content. At the same time, high bandwidth affords streaming of live events to mobile devices. We take advantage of these technologies in our high resolution, panoramic image video stream and study a scenario of audience members viewing the very same live event they are watching on a tablet. The video stream on the tablet is navigational and enables audience members to pan and zoom in the real-time video feed. We studied audience interaction and impressions in three performances of a dance and music show and found distinct uses of the second screen video stream. We emphasize that despite initial reluctance, the observed utilization of the technology opened up for new potential practices. Our study shows how working with perceived conflict in technology can still open up design space for interactive technologies.

[1]  Takuro Yonezawa,et al.  Enhancing communication and dramatic impact of online live performance with cooperative audience control , 2012, UbiComp '12.

[2]  Barry A. T. Brown,et al.  Into the wild: challenges and opportunities for field trial methods , 2011, CHI.

[3]  Igor D. D. Curcio,et al.  Video as memorabilia: user needs for collaborative automatic mobile video production , 2012, CHI.

[4]  Louise Barkhuus,et al.  Panoramic video: design challenges and implications for content interaction , 2013, EuroITV.

[5]  M. Lombard,et al.  Presence and Television: The Role of Screen Size. , 2000 .

[6]  J. Thompson.  The Media and Modernity: A Social Theory of the Media , 1995 .

[7]  Jean-François Macq,et al.  Demo: Omnidirectional video navigation on a tablet PC using a camera-based orientation tracker , 2011, 2011 Fifth ACM/IEEE International Conference on Distributed Smart Cameras.

[8]  Joe Marshall,et al.  Lessons from Touring a Location-Based Experience , 2011, Pervasive.

[9]  Roman Ganhör.  ProPane: fast and precise video browsing on mobile phones , 2012, MUM.

[10]  Louise Barkhuus,et al.  Engaging the crowd: studies of audience-performer interaction , 2008, CHI Extended Abstracts.

[11]  Martin Ludvigsen,et al.  Designing technology for active spectator experiences at sporting events , 2010, OZCHI '10.

[12]  Mor Naaman,et al.  Less talk, more rock: automated organization of community-contributed collections of concert videos , 2009, WWW '09.

[13]  Louise Barkhuus,et al.  Empowerment through seamfulness: smart phones in everyday life , 2011, Personal and Ubiquitous Computing.

[14]  Stefan Poslad,et al.  Personalized Coverage of Large Athletic Events , 2011, IEEE MultiMedia.

[15]  Jens Spille,et al.  Towards a format-agnostic approach for production, delivery and rendering of immersive media , 2013, MMSys.

[16]  Crysta J. Metcalf,et al.  FANFEEDS: evaluation of socially generated information feed on second screen as a TV show companion , 2012, EuroITV.

[17]  Igor D. D. Curcio,et al.  We want more: human-computer collaboration in mobile social video remixing of music concerts , 2011, CHI.

[18]  D. Saltz.  Live Media: Interactive Technology and Theatre , 2001 .

[19]  Evelien D'heer,et al.  Second screen applications and tablet users: constellation, awareness, experience, and interest , 2012, EuroITV.

[20]  Dan R. Olsen,et al.  Time warp sports for internet television , 2010, TCHI.

[21]  David A. Shamma,et al.  Live mobile collaboration for video production: design, guidelines, and requirements , 2013, Personal and Ubiquitous Computing.

[22]  Michael E. Holmes,et al.  Visual attention to television programs with a second-screen application , 2012, ETRA '12.

[23]  Steve Benford,et al.  In support of city exploration , 2009, CHI.

[24]  Matthew Chalmers,et al.  Seamful interweaving: heterogeneity in the theory and design of interactive systems , 2004, DIS '04.

[25]  Oskar Juhlin,et al.  Watching the cars go round and round: designing for active spectating , 2006, CHI.

[26]  Evelien D'heer,et al.  Everyday life in (front of) the screen: the consumption of multiple screen technologies in the living room context , 2012, EuroITV.

[27]  Antti Oulasvirta,et al.  Comedia: mobile group media for active spectatorship , 2007, CHI.

[28]  Jan O. Borchers,et al.  DRAGON: a direct manipulation interface for frame-accurate in-scene video navigation , 2008, CHI.

[29]  Joachim Köhler,et al.  LIVE: An Integrated Production and Feedback System for Intelligent and Interactive TV Broadcasting , 2011, IEEE Transactions on Broadcasting.

[30]  Jean-François Macq,et al.  Interactive omnidirectional video delivery: A bandwidth-effective approach , 2012, Bell Labs Technical Journal.

[31]  Crysta J. Metcalf,et al.  Field trial of a dual device user experience for iTV , 2011, EuroITV '11.

[32]  Klaus Schöffmann,et al.  Mobile video browsing with a 3D filmstrip , 2013, ICMR '13.

[33]  Susan Davis.  : Media Events: The Live Broadcasting of History , 1993 .