Supporting the Sense of Unity between Remote Audiences in VR-Based Remote Live Music Support System KSA2

We are developing a system to support remote audiences of live music shows. At live shows of rock or popular music, audiences take actions responding to the music. This is a style of nonverbal communication between audiences to share emotion. The "sense of unity", which is often mentioned among music players and audiences, is a key of successful live performance. This research tries to enable remote audiences to exchange nonverbal communication with body actions between them in a VR environment. We have developed a prototype system and conducted evaluation sessions. Most of the participants of the sessions felt the sense of unity.

[1]  Daniel Thalmann,et al.  Conducting a virtual orchestra , 2004, IEEE MultiMedia.

[2]  Mel Slater,et al.  The Plausibility of a String Quartet Performance in Virtual Reality , 2017, IEEE Transactions on Visualization and Computer Graphics.

[3]  Jun-Dong Cho,et al.  WearLove: Affective Communication via Wearable Device with Gamification , 2015, CHI PLAY.

[4]  Kee Chang Lee,et al.  Virtual Stage: A Location-Based Karaoke System , 1998, IEEE Multim..

[5]  Kei Miyazaki,et al.  Comparison of Input Methods for Remote Audiences of Live Music Performances , 2016, CollabTech.

[6]  Kei Miyazaki,et al.  What Do Remote Music Performances Lack? , 2017, CollabTech.

[7]  Adrian David Cheok,et al.  Kissenger: Development of a Remote Kissing Device for Affective Communication , 2016, ACE.

[8]  Steve Benford,et al.  Towards an Extended Festival Viewing Experience , 2015, TVX.

[9]  Emilia Gómez,et al.  Immersive Orchestras: Audio Processing for Orchestral Music VR Content , 2016, 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES).