ImprovGenerator: Online Grammatical Induction for On-the-Fly Improvisation Accompaniment

We propose an online generative algorithm to enhance musical expression via intelligent improvisation accompaniment. Our framework called the ImprovGenerator, takes a live stream of percussion patterns and generates an improvised accompaniment track in real-time to stimulate new expressions in the improvisation. We use a mixture model to generate an accompaniment pattern, that takes into account both the hierarchical temporal structure of the live input patterns and the current musical context of the performance. The hierarchical structure is represented as a stochastic context-free grammar, which is used to generate accompaniment patterns based on the history of temporal patterns. We use a transition probability model to augment the grammar generated pattern to take into account the current context of the performance. In our experiments we show how basic beat patterns performed by a percussionist on a cajon can be used to automatically generate on-the-fly improvisation accompaniment for live performance.

[1]  Matthew Brown,et al.  PARSING CONTEXT-FREE GRAMMARS FOR MUSIC: A COMPUTATIONAL MODEL OF SCHENKERIAN ANALYSIS , 2004 .

[2]  Perry R. Cook,et al.  ChucK: a programming language for on-the-fly, real-time audio synthesis and multimedia , 2004, MULTIMEDIA '04.

[3]  Ian H. Witten,et al.  Identifying Hierarchical Structure in Sequences: A linear-time algorithm , 1997, J. Artif. Intell. Res..

[4]  Michael P. Wellman,et al.  Generalized Queries on Probabilistic Context-Free Grammars , 1996, AAAI/IAAI, Vol. 2.

[5]  Yoichi Sato,et al.  Recovering the Basic Structure of Human Activities from Noisy Video-Based Symbol Strings , 2008, Int. J. Pattern Recognit. Artif. Intell..

[6]  J. Mccormack Grammar-based music composition , 1996 .

[7]  D. Haussler,et al.  Stochastic context-free grammars for modeling RNA , 1993, 1994 Proceedings of the Twenty-Seventh Hawaii International Conference on System Sciences.

[8]  Shlomo Dubnov,et al.  OMax brothers: a dynamic yopology of agents for improvization learning , 2006, AMCMM '06.

[9]  Shlomo Dubnov,et al.  Using Factor Oracles for Machine Improvisation , 2004, Soft Comput..

[10]  Herbert F. Jelinek,et al.  Complex systems : from local interactions to global phenomena , 1996 .

[11]  Eoin Brazil Proceedings of the 2002 conference on New interfaces for musical expression , 2002 .

[12]  Gil Weinberg,et al.  Interactive jamming with Shimon: A social robotic musician , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[13]  N. Zabusky Computational synergetics: visualization and vortex dynamics , 1988 .

[14]  Robert M. Keller,et al.  A Grammatical Approach to Automatic Improvisation , 2007 .

[15]  Belinda Thom Learning Models for Interactive Melodic Improvisation , 1999, ICMC.

[16]  James Kippen,et al.  MODELLING MUSIC WITH GRAMMARS: FORMAL LANGUAGE REPRESENTATION IN THE BOL PROCESSOR , 1992 .

[17]  George E. Lewis Too Many Notes: Computers, Complexity and Culture in Voyager , 2000, Leonardo Music Journal.