A Dynamic Timed-Language for Computer-Human Musical Interaction

In this paper, we present the programing of time and interaction in Antescofo, a real-time system for performance coordination between musicians and computer processes during live music performance. To this end, Antescofo relies on artificial machine listening and a domain specific real-time programing language. It extends each paradigm through strong coupling of the two and strong emphasis on temporal semantics and behavior of the system. The challenge in bringing human actions in the loop of computing is strongly related to temporal semantics of the language, and timeliness of live execution despite heterogeneous nature of time in the two mediums. Interaction scenarii are expressed at a symbolic level through the management of musical time (i.e. events like notes or beats in relative tempi) and of the 'physical' time (with relationships like succession, delay, duration, speed). Antescofo unique features are presented through a series of paradigmatic program samples which illustrate how to manage execution of different audio processes through time and their interactions with an external environment. The Antescofo approach has been validated through numerous uses of the system in live electronic performances in contemporary music repertoire by various international music ensembles.

[1]  Louis Mandel,et al.  Interactive Programming of Reactive Systems , 2009, Electron. Notes Theor. Comput. Sci..

[2]  Christopher Raphael The informatics philharmonic , 2011, CACM.

[3]  Thomas A. Henzinger,et al.  Event-Driven Programming with Logical Execution Times , 2004, HSCC.

[4]  David P. Anderson,et al.  A system for computer music performance , 1990, TOCS.

[5]  Jean-Louis Giavitto,et al.  Operational semantics of a domain specific language for real time musician–computer interaction , 2013, Discret. Event Dyn. Syst..

[6]  Thomas A. Henzinger,et al.  Giotto: a time-triggered language for embedded programming , 2001, Proc. IEEE.

[7]  Roger B. Dannenberg,et al.  An On-Line Algorithm for Real-Time Accompaniment , 1984, ICMC.

[8]  Yuan Feng,et al.  MusicScore: mobile music composition for practice and fun , 2012, ACM Multimedia.

[9]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[10]  Edward A. Lee Computing needs time , 2009, CACM.

[11]  Miller S. Puckette,et al.  Combining Event and Signal Processing in the MAX Graphical Programming Environment , 1991 .

[12]  Barry Vercoe,et al.  The Synthetic Performer in The Context of Live Performance , 1984, International Conference on Mathematics and Computing.

[13]  Arshia Cont,et al.  On the creative use of score following and its impact on research , 2011 .

[14]  Lucid Synchrone,et al.  Tutorial and Reference Manual , 2007 .

[15]  Hermann Kopetz,et al.  Event-Triggered Versus Time-Triggered Real-Time Systems , 1991, Operating Systems of the 90s and Beyond.

[16]  Myriam Desainte-Catherine,et al.  Interactive scores: A model for specifying temporal relations between interactive and static events , 2005 .

[17]  Arshia Cont,et al.  A Coupled Duration-Focused Architecture for Real-Time Music-to-Score Alignment , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Jean-Louis Giavitto,et al.  Correct Automatic Accompaniment Despite Machine listening or Human errors in Antescofo , 2012, ICMC.

[19]  Roger B. Dannenberg,et al.  The Implementation of Nyquist, A Sound Synthesis Language , 1997, ICMC.

[20]  E. Large,et al.  The dynamics of attending: How people track time-varying events. , 1999 .

[21]  Andrew Sorensen Impromptu : an interactive programming environment for composition and performance , 2005 .

[22]  Richard Boulanger The Csound book: perspectives in software synthesis, sound design, signal processing, and programming , 2000 .

[23]  Nicolas Halbwachs,et al.  Synchronous Programming of Reactive Systems , 1992, CAV.

[24]  Gérard Berry,et al.  The Esterel Synchronous Programming Language: Design, Semantics, Implementation , 1992, Sci. Comput. Program..

[25]  Andrew Sorensen,et al.  Programming with time: cyber-physical programming with impromptu , 2010, OOPSLA.

[26]  Roger B. Dannenberg,et al.  Arctic: A functional language for real-time control , 1984, LFP '84.

[27]  Arshia Cont,et al.  Antescofo: Anticipatory Synchronization and control of Interactive parameters in Computer Music , 2008, ICMC.