Computational Challenges of Co-Creation in Collaborative Music Live Coding : An Outline

Co-creation between a human agent (HA) and a virtual agent (VA) is an approach to collaboration that has been explored in different creative domains, particulary in computer music. With a few exceptions, there is little research on the use of virtual agents in collaborative music live coding (CMLC), a network music improvisational practice. This paper considers the benefits of CMLC both in education and in performance involving human agents, with or without virtual agents. We reflect on our previous work on, and lessons learned from, two studies of collaboration and live coding using EarSketch, an educational online platform for learning music via code based on audio clips. We speculate future scenarios, in particular, we envision a virtual agent that can help students to improve their programming and musical skills, and can help musicians to exploit computational creativity applied to music.

[1]  Diane Crawford,et al.  Editorial , 2000, CACM.

[2]  Robert Rowe,et al.  Machine Musicianship , 2001 .

[3]  François Pachet,et al.  The Continuator: Musical Interaction With Style , 2003, ICMC.

[4]  Todd Lubart,et al.  How can computers be partners in the creative process: Classification and commentary on the Special Issue , 2005, Int. J. Hum. Comput. Stud..

[5]  Stephen Chan,et al.  Instant messaging bots: accountability and peripheral participation for textual user interfaces , 2005, GROUP '05.

[6]  E. D. Paolo,et al.  Participatory sense-making , 2007 .

[7]  H. D. Jaegher,et al.  Enactive intersubjectivity: Participatory sense-making and mutual incorporation , 2009 .

[8]  Margaret A. Boden,et al.  Computer Models of Creativity , 2009, AI Mag..

[9]  Flora S. Tsai,et al.  Review of Techniques for Intelligent Novelty Mining , 2010 .

[10]  Guy Hoffman,et al.  Shimon: an interactive improvisational robotic marimba player , 2010, CHI Extended Abstracts.

[11]  Andrea Lockerd Thomaz,et al.  Turn-Taking Based on Information Flow for Fluent Human-Robot Interaction , 2011, AI Mag..

[12]  Palle Dahlstedt A-Life for Music: Music and Computer Models of Living Systems , 2011 .

[13]  N. Collins Trading Faures: Virtual Musicians and Machine Ethics , 2011, Leonardo Music Journal.

[14]  Thor Magnusson The IXI Lang: A SuperCollider Parasite for Live Coding , 2011, ICMC.

[15]  Jason Freeman,et al.  LOLbot: Machine Musicianship in Laptop Ensembles , 2012, NIME.

[16]  Sergio L. Toral Marín,et al.  Small world networks and creativity in audio clip sharing , 2012, Int. J. Soc. Netw. Min..

[17]  Alan F. Blackwell,et al.  Collaboration and learning through live coding (Dagstuhl Seminar 13382) , 2013, Dagstuhl Reports.

[18]  Nicholas Davis An Enactive Approach to Facilitate Interactive Machine Learning for Co-Creative Agents , 2015, Creativity & Cognition.

[19]  Brian Magerko,et al.  An Enactive Model of Creativity for Computational Collaboration and Co-creation , 2015, Creativity in the Digital Age.

[20]  A survey of robotic musicianship , 2016, Commun. ACM.

[21]  Brian Magerko,et al.  Empirically Studying Participatory Sense-Making in Abstract Drawing with a Co-Creative Cognitive Agent , 2016, IUI.

[22]  Jason Freeman,et al.  STEAM-based interventions: Why student engagement is only part of the story , 2016, 2016 Research on Equity and Sustained Participation in Engineering, Computing, and Technology (RESPECT).

[23]  Jason Freeman,et al.  EarSketch: A STEAM-Based Approach for Underrepresented Populations in High School Computer Science Education , 2016, TOCE.

[24]  Karen Littleton,et al.  Digital technologies and the mediation of undergraduate students’ collaborative music compositional practices , 2016 .

[25]  Jason Freeman,et al.  Challenges and New Directions for Collaborative Live Coding in the Classroom , 2016 .

[26]  Jason Freeman,et al.  Turn-Taking and Chatting in Collaborative Music Live Coding , 2017, Audio Mostly Conference.