Human-Computer Music Performance: From Synchronized Accompaniment to Musical Partner

Live music performance with computers has motivated many research projects in science, engineering, and the arts. In spite of decades of work, it is surprising that there is not more technology for, and a better understanding of the computer as music performer. We review the development of techniques for live music performance and outline our efforts to establish a new direction, Human-Computer Music Performance (HCMP), as a framework for a variety of coordinated studies. Our work in this area spans performance analysis, synchronization techniques, and interactive performance systems. Our goal is to enable musicians to ncorporate computers into performances easily and effectively through a better understanding of requirements, new techniques, and practical, performance-worthy implementations. We conclude with directions for future work.

[1]  Barry Vercoe,et al.  The Synthetic Performer in The Context of Live Performance , 1984, International Conference on Mathematics and Computing.

[2]  Max V. Mathews,et al.  The Sequential Drum , 1980 .

[3]  Marc Sosnick-Pérez,et al.  Evaluating Interactive Music Systems: An HCI Approach , 2009, NIME.

[4]  Mark B. Sandler,et al.  A tutorial on onset detection in music signals , 2005, IEEE Transactions on Speech and Audio Processing.

[5]  Bryan Pardo,et al.  Aligning Semi-Improvised Music Audio with Its Lead Sheet , 2011, ISMIR.

[6]  Mark D. Plumbley,et al.  Real-Time Chord Recognition for Live Performance , 2009, ICMC.

[7]  Nick Collins,et al.  Introduction to Computer Music , 2010 .

[8]  Nicolas Gold.  A Framework to Evaluate the Adoption Potential of Interactive Performance Systems for Popular Music , 2012 .

[9]  Mark D. Plumbley,et al.  Real-time Visual Beat Tracking using a Comb Filter Matrix , 2011, ICMC.

[10]  Roger B. Dannenberg,et al.  An On-Line Algorithm for Real-Time Accompaniment , 1984, ICMC.

[11]  Mark D. Plumbley,et al.  B-Keeper: a beat-tracker for live performance , 2007, NIME '07.

[12]  Fabio Kon,et al.  The Quest for Low Latency , 2004, ICMC.

[13]  Orberto,et al.  Evaluation Methods for Musical Audio Beat Tracking Algorithms , 2009 .

[14]  Jan Borchers,et al.  Toward a Framework for Interactive Systems to Conduct Digital Audio and Video Streams , 2006 .

[15]  Roger B. Dannenberg,et al.  Extracting Commands from Gestures: Gesture Spotting and Recognition for Real-Time Music Performance , 2013, CMMR.

[16]  J. Sundberg,et al.  Musical performance. A synthesis‐by‐rule approach , 1981 .

[17]  Anders Friberg,et al.  Swing Ratios and Ensemble Timing in Jazz Performance: Evidence for a Common Rhythmic Pattern , 2002 .

[18]  Roger B. Dannenberg,et al.  A Virtual Orchestra for Human-Computer Music Performance , 2011, ICMC.

[19]  Roger B. Dannenberg,et al.  A Reference Architecture and Score Representation for Popular Music Human-Computer Music Performance Systems , 2011, NIME.

[20]  Rudolf Rasch,et al.  Timing and synchronization in ensemble performance. , 1988 .

[21]  Matthew E. P. Davies,et al.  Real-time beat-synchronous analysis of musical audio , 2009 .

[22]  Christopher Raphael,et al.  Music score alignment and computer accompaniment , 2006, CACM.

[23]  Peter Brinkmann.  Making Musical Apps , 2012 .

[24]  Larry A. Wasserman,et al.  Estimating the Error Distribution of a Single Tap Sequence without Ground Truth , 2009, ISMIR.

[25]  Steve Benford,et al.  Supporting traditional music-making: designing for situated discretion , 2012, CSCW '12.

[26]  P. Juslin,et al.  Toward a computational model of expression in music performance: The GERM model , 2001 .

[27]  Xavier Rodet,et al.  Synthesizing a choir in real-time using Pitch Synchronous Overlap Add (PSOLA) , 2000, ICMC.

[28]  Dan Stowell,et al.  Evaluation of live human-computer music-making: Quantitative and qualitative approaches , 2009, Int. J. Hum. Comput. Stud..

[29]  Simon Dixon,et al.  A Review of Automatic Rhythm Description Systems , 2005, Computer Music Journal.

[30]  Robert Rowe,et al.  Machine Musicianship , 2001 .

[31]  Christopher Ariza,et al.  The Interrogator as Critic: The Turing Test and the Evaluation of Generative Music Systems , 2009, Computer Music Journal.

[32]  Luís Paulo Reis,et al.  IBT: A Real-time Tempo and Beat Tracking System , 2010, ISMIR.

[33]  Chris Chafe,et al.  Simulation of Networked Ensemble Performance with Varying Time Delays: Characterization of Ensemble Accuracy , 2004, ICMC.