World Stage: Crowdsourcing Paradigm for Expressive Social Mobile Music

The combination of powerful mobile devices and the connective potential of cloud-based computing are changing how, where, and when people use computers. No longer physically tethered, computers embedded in mobile phones and tablets freely roam in daily life alongside their human users while persistently connected to the network. At the same time, the pervasiveness of computing enables us to engage people to solve large-scale problems by leveraging human intelligence and the effect of large crowds. In this paper, we discuss a new model for crowdsourced musical interactions based on mobile devices. This model, which we call World Stage, is a pseudo-anonymous, location-aware ecosystem designed to connect hundreds of thousands of users in a social-musical game involving expressive musical performance and collaborative musical feedback. We describe the motivation and mechanics of the World Stage, and present a full implementation and case study around a commercial iPhone application: Smule’s Leaf Trombone: World Stage. We also present the experiential design and the technological infrastructure around the World Stage and discuss the unique social/musical possibilities it affords. This work is about exploring, perhaps for the very first time, a crowdsourcing eco-system that incorporates expressive music-making and with game-like elements, aimed at inciting a mass audience.

[1]  Robert Hamilton,et al.  Stanford Laptop Orchestra (SLOrk) , 2009, ICMC.

[2]  Ge Wang,et al.  MadPad: A Crowdsourcing System for Audiovisual Sampling , 2011, NIME.

[3]  Laura A. Dabbish,et al.  Labeling images with a computer game , 2004, AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors.

[4]  Demosthenes Akoumianakis,et al.  Exploring New Perspectives in Network Music Performance: The DIAMOUSES Framework , 2010, Computer Music Journal.

[5]  Perry R. Cook,et al.  The Synthesis ToolKit (STK) , 1999, ICMC.

[6]  Jason Freeman,et al.  Creative collaboration between audiences and musicians in Flock , 2010, Digit. Creativity.

[7]  Georg Hajdu,et al.  Quintet.net: An Environment for Composing and Performing Music on the Internet , 2005, Leonardo.

[8]  Marcelo Soares Pimenta,et al.  Cooperative mechanisms for networked music , 2011, Future Gener. Comput. Syst..

[9]  Michael Rohs,et al.  Interactivity for Mobile Music-Making , 2009, Organised Sound.

[10]  Jonathan Berger,et al.  Smule = Sonic Media: An Intersection of the Mobile, Musical, and Social , 2009, ICMC.

[11]  Michael Rohs,et al.  Shamus - a Sensor-Based Integrated Mobile phone Instrument , 2007, ICMC.

[12]  Atau Tanaka,et al.  Social Mobile Music Navigation Using The Compass , 2007 .

[13]  Günter Geiger.  PDa: Real Time Signal Processing and Sound Generation on Handheld Devices , 2003, ICMC.

[14]  Nicolas Makelberge,et al.  Rethinking Collaboration in Networked Music* , 2012, Organised Sound.

[15]  Scot Gresham-Lancaster.  The Aesthetics and History of the Hub: The Effects of Changing Technology on Network Computer Music , 1998 .

[16]  Michael Rohs,et al.  Mobile STK for Symbian OS , 2006, ICMC.

[17]  Atau Tanaka,et al.  Net_Dérive: Conceiving and Producing a Locative Media Artwork , 2009 .

[18]  Ge Wang,et al.  MoMu: A Mobile Music Toolkit , 2010, NIME.

[19]  David Kim-Boyle.  Network Musics: Play, Engagement and the Democratization of Performance , 2008, NIME.

[20]  Georg Essl,et al.  Designing Mobile Musical Instruments and Environments with urMus , 2010, NIME.

[21]  Ge Wang,et al.  Designing for the iPad: Magic Fiddle , 2011, NIME.

[22]  Chris Chafe,et al.  JackTrip: Under the Hood of an Engine for Network Audio , 2010, ICMC.

[23]  Mark Havryliv,et al.  Pocket Gamelan: tuneable trajectories for flying sources in Mandala 3 and Mandala 4 , 2006, NIME.

[24]  Perry R. Cook,et al.  Composing for Laptop Orchestra , 2008, Computer Music Journal.

[25]  Dan Trueman,et al.  Why a laptop orchestra? , 2007, Organised Sound.

[26]  Atau Tanaka.  Mobile Music Making , 2004, NIME.

[27]  Ge Wang,et al.  Ocarina: Designing the iPhone's Magic Flute , 2014, Computer Music Journal.

[28]  Robert Hamilton,et al.  Social Composition: Musical Data Systems for Expressive Mobile Music , 2011, Leonardo Music Journal.

[29]  M. Sile O'Modhrain,et al.  GpsTunes: controlling navigation via audio feedback , 2005, Mobile HCI.

[30]  Ajay Kapur,et al.  Interactive Network Performance: a dream worth dreaming? , 2005, Organised Sound.

[31]  Michael Rohs,et al.  CaMus2: collaborative music performance with mobile camera phones , 2007, ACE '07.

[32]  Atau Tanaka,et al.  A Framework for Spatial Interaction in Locative Media , 2006, NIME.

[33]  Ian Gibson.  Collaborative music software for mobile phones , 2010 .

[34]  Lars Erik Holmquist,et al.  Sonic City: The Urban Environment as a Musical Interface , 2003, NIME.

[35]  Ge Wang,et al.  The Mobile Phone Orchestra , 2014 .

[36]  Marianne Schüpbach,et al.  Extended Education in Switzerland: Values in Past, Present, and Future , 2015 .

[37]  Luke Dahl,et al.  Evolving The Mobile Phone Orchestra , 2010, NIME.

[38]  Jason Stanyek,et al.  The Oxford handbook of mobile music studies , 2014 .

[39]  Atau Tanaka,et al.  Mobile Music Technology: Report on an Emerging Community , 2006, NIME.