Notational Communication with Co-creative Systems: Studying Improvements to Musical Coordination

This research examines the impact of differences in extra-musical notational communication on a musician's co-creative experience with a music improvisation system. The method involves the development of musical improvisation agent technologies that support mixed-initiative communication and the use of mixed methods for studying the musician's co-creative engagement. The expected contributions are the findings about the impact of differences in extra-musical communication on the co-creative engagement with co-improvisation systems.

[1]  Mason Bretan,et al.  Visual cues-based anticipation for percussionist-robot interaction , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[2]  Lonce Wyse,et al.  A Real-Time Score for Collaborative Just-in-Time Composition , 2014, Organised Sound.

[3]  A. Williamon,et al.  Music Regulators in Two String Quartets: A Comparison of Communicative Behaviors between Low- and High-Stress Performance Conditions , 2016, Front. Psychol..

[4]  S. Kawase.  Gazing behavior and coordination during piano duo performance , 2013, Attention, Perception, & Psychophysics.

[5]  Louis McCallum,et al.  Shut up and play: A musical approach to engagement and social presence in Human Robot Interaction , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[6]  Elaine Chew,et al.  A Musical Improvisation System That Provides Visual Feedback to the Performer , 2007 .

[7]  J. Davidson.  Bodily movement and facial actions in expressive musical performance by solo and duo instrumentalists: Two distinctive case studies , 2012 .

[8]  Gil Weinberg,et al.  The Creation of a Multi-Human, Multi-Robot Interactive Jam Session , 2009, NIME.

[9]  François Pachet,et al.  CHILDREN CONFRONTING AN INTERACTIVE MUSICAL SYSTEM , 2004 .

[10]  Hannu Toivonen,et al.  Interaction Evaluation for Human-Computer Co-Creativity , 2015 .

[11]  Marc Sosnick-Pérez,et al.  Evaluating Interactive Music Systems: An HCI Approach , 2009, NIME.

[13]  Ritwik Banerji,et al.  Maxine's Turing Test - A Player-Program as Co-Ethnographer of Socio-Aesthetic Interaction in Improvised Music , 2021, MUME@AIIDE.

[14]  Tetsuya Ogata,et al.  A Musical Robot that Synchronizes with a Coplayer Using Non-Verbal Cues , 2012, Adv. Robotics.

[15]  David Murray-Rust,et al.  Towards a model of musical interaction and communication , 2011, Artif. Intell..

[16]  Antonios Liapis,et al.  Mixed-initiative co-creativity , 2014, FDG.

[17]  Ernest A. Edmonds,et al.  Modeling co-creativity in art and technology , 2002, Creativity & Cognition.

[18]  Nicholas Davis,et al.  Human-Computer Co-Creativity: Blending Human and Computational Creativity , 2013, Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment.

[19]  A. Williamon,et al.  Exploring Co-Performer Communication , 2002 .

[20]  Marc Chemillier,et al.  Improtek: Integrating harmonic Controls into Improvisation in the filiation of Omax , 2012, ICMC.