Enhancing Multimodal Interaction Between Performers and Audience Members During Live Music Performances

Live performance provides a good example of enthusiastic interaction between people gathered together in a large group and one or more performers. In this research, we focused on elucidating the mechanism of such enthusiastic group interaction (collective effervescence) and how technology can contribute to its enhancement. We propose a support system for co-experience and physical co-actions among participants to enhance enthusiastic interaction between performers and audiences during live performances. This system focuses on a physical synchronization between the performer and the audience as the key that generates enthusiastic interaction during a live performance. Also, it supports enhanced bidirectional communication of the performer's actions and the audience's cheering behaviors. An experiment in an actual live performance environment in which collective effervescence was already occurring demonstrated that the bidirectional communication and visualization of physical movements in the proposed system contributed to the further unification of the group.

[1]  Steven M. Seitz,et al.  Techniques for interactive audience participation , 2002, SIGGRAPH '02.

[2]  György Fazekas,et al.  Novel Methods in Facilitating Audience and Performer Interaction Using the Mood Conductor Framework , 2013, CMMR.

[3]  Asako Soga,et al.  A CG projection method of supporting to stage live performances , 2010, VRCAI '10.

[4]  Takashi Minato,et al.  Hugvie: A medium that fosters love , 2013, 2013 IEEE RO-MAN.

[5]  A. Chadwick,et al.  Dual Screening the Political: Media Events, Social Media, and Citizen Engagement , 2015 .

[6]  Julian Schaap,et al.  The ‘lonely raver’: music livestreams during COVID-19 as a hotline to collective consciousness? , 2020 .

[7]  Jeffrey T. Hancock,et al.  Emotional Amplification During Live-Streaming: Evidence from Comments During and After News Events , 2020, Proc. ACM Hum. Comput. Interact..

[8]  Joseph Kaye,et al.  Intimate objects , 2004, DIS '04.

[9]  E. Durkheim FROM THE ELEMENTARY FORMS OF THE RELIGIOUS LIFE , 1996, The New Economic Sociology.

[10]  H. McDonald,et al.  Managing co-creation in professional sports: The antecedents and consequences of ritualized spectator behavior , 2014 .

[11]  Jason Freeman,et al.  Handwaving: Gesture Recognition for Participatory Mobile Music , 2017, Audio Mostly Conference.

[12]  Robert E. Kraut,et al.  Shaping Pro and Anti-Social Behavior on Twitch Through Moderation and Example-Setting , 2017, CSCW.

[13]  Joseph A. Paradiso,et al.  An Interactive Music Environment for Large Groups with Giveaway Wireless Motion Sensors , 2007, Computer Music Journal.

[14]  Kazuaki Tanaka,et al.  Robotic Table and Bench Enhance Mirror Type Social Telepresence , 2017, Conference on Designing Interactive Systems.

[15]  Jason Freeman,et al.  Large Audience Participation, Technology, and Orchestral Performance , 2005, ICMC.

[16]  Jason Freeman,et al.  Technology, Real-Time Notation, and Audience Participation in Flock , 2008, ICMC.

[17]  Elena Márquez Segura,et al.  All the feels: designing a tool that reveals streamers' biometrics to spectators , 2017, FDG.

[18]  Jason Freeman,et al.  massMobile: towards a flexible framework for large-scale participatory collaborations in live performances , 2013 .

[19]  Hiroshi Ishii,et al.  Tangible interfaces for remote collaboration and communication , 1998, CSCW '98.

[20]  Louise Barkhuus,et al.  Engaging the crowd: studies of audience-performer interaction , 2008, CHI Extended Abstracts.

[21]  Elena Márquez Segura,et al.  The design space of body games: technological, physical, and social design , 2013, CHI.

[22]  Yongmeng Wu,et al.  Open Symphony: Creative Participation for Audiences of Live Music Performances , 2017, IEEE Multim..

[23]  Samuel B. Williams,et al.  ASSOCIATION FOR COMPUTING MACHINERY , 2000 .

[24]  Daniel J. Wigdor,et al.  You Watch, You Give, and You Engage: A Study of Live Streaming Practices in China , 2018, CHI.

[25]  Ansgar E. Depping,et al.  Designing and Evaluating 'In the Same Boat', A Game of Embodied Synchronization for Enhancing Social Play , 2020, CHI.

[26]  Katherine Isbister,et al.  How to stop being a buzzkill: designing yamove!, a mobile tech mash-up to truly augment social play , 2012, Mobile HCI.