Audience-Participation Techniques Based on Social Mobile Computing

Mobile devices, such as smartphones and tablets, are becoming indispensable to everyday life, connecting us in a powerful network through services accessible via web browsers or mobile applications. In conjunction with recent explorations on physical interaction techniques for making music on mobile devices, the mobile platform can be regarded as an attractive solution for designing music performances based on audience participation. Using smartphones to enable audience participation not only offers convenience, but also tends to induce engaging and interactive social experience. In this paper, we first take a look at two separate phenomena of interest to us: the rise of mobile music and the design of audience participation performance paradigm. Then we present techniques for enabling audience participation based primarily on using smartphones, as experimented by the Stanford Mobile Phone Orchestra. We evaluate these techniques and consider the future of social music interactions aided by mobile technology.

[1]  Stefania Serafin,et al.  Proceedings of the International Computer Music Conference , 2007 .

[2]  Marcelo Soares Pimenta,et al.  Interfaces for musical activities and interfaces for musicians are not the same: the case for codes, a web-based environment for cooperative music prototyping , 2007, ICMI '07.

[3]  Ge Wang,et al.  MadPad: A Crowdsourcing System for Audiovisual Sampling , 2011, NIME.

[4]  Stephen McAdams,et al.  Influences of Large-Scale Form on Continuous Ratings in Response to a Contemporary Piece in a Live Concert Setting , 2004 .

[5]  Luke Dahl,et al.  TweetDreams: Making Music with the Audience and the World using Real-time Twitter Data , 2011, NIME.

[6]  Jason Freeman,et al.  Large Audience Participation, Technology, and Orchestral Performance , 2005, ICMC.

[7]  Joseph A. Paradiso,et al.  An Interactive Music Environment for Large Groups with Giveaway Wireless Motion Sensors , 2007, Computer Music Journal.

[8]  Steven M. Seitz,et al.  Techniques for interactive audience participation , 2002, SIGGRAPH '02.

[9]  Luke Dahl,et al.  Evolving The Mobile Phone Orchestra , 2010, NIME.

[10]  Chi Kim,et al.  Interactive Music Systems for the Web , 2009 .

[11]  A. Roda,et al.  Virtual performance, Actual gesture: A Web 2.0 system for expressive performance of music contents , 2009, 2009 2nd Conference on Human System Interactions.

[12]  Michael Rohs,et al.  Interactivity for Mobile Music-Making , 2009, Organised Sound.

[13]  Ge Wang,et al.  MoMu: A Mobile Music Toolkit , 2010, NIME.

[14]  Jeffrey Heer,et al.  Protovis: A Graphical Toolkit for Visualization , 2009, IEEE Transactions on Visualization and Computer Graphics.

[15]  Sidney Fels,et al.  Collaborative Musical Experiences for Novices , 2003 .

[16]  Luke Dahl,et al.  Sound Bounce: Physical Metaphors in Designing Mobile Music Performance , 2010, NIME.

[17]  Georg Essl,et al.  Designing Mobile Musical Instruments and Environments with urMus , 2010, NIME.

[18]  Raymond Migneco,et al.  Collaborative Online Activities for Acoustics Education and Psychoacoustic Data Collection , 2009, IEEE Transactions on Learning Technologies.

[19]  Michael Rohs,et al.  CaMus2: collaborative music performance with mobile camera phones , 2007, ACE '07.

[20]  Gil Weinberg,et al.  Interconnected Musical Networks: Toward a Theoretical Framework , 2005, Computer Music Journal.