Modeling Form for On-line Following of Musical Performances

Automated musical accompaniment of human performers often requires an agent be able to follow a musical score with similar facility to that of a human performer. Systems described in the literature represent musical scores in a way that assumes no large-scale structural variation of the piece during performance. If the performer deviates from the expected path by skipping or repeating a section, the system may become lost. We describe a way to automatically generate a Markov model from a written score that models the score form, and an on-line algorithm to align a performance to a score. The resulting system can follow performances that take alternate paths through the score without losing its place. We compare the performance of our system to that of sequence-based score followers on a melodic corpus of 98 Jazz melodies. Results show that explicitly representing the branching structure of a score significantly improves score following when the branch a performer may take is unknown beforehand.

[1]  Miller Puckette,et al.  Score Following in Practice , 1992, ICMC.

[2]  Edwaed W. Large.  Dynamic programming for the analysis of serial behaviors , 1993 .

[3]  Roger B. Dannenberg,et al.  Real-Time Computer Accompaniment of Keyboard Performances , 1985, ICMC.

[4]  Dragomir R. Radev,et al.  Probabilistic sequence alignment methods for on-line score following of music performances , 2005 .

[5]  Christopher Raphael,et al.  Automatic Segmentation of Acoustic Musical Signals Using Hidden Markov Models , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Roger B. Dannenberg,et al.  Automated Accompaniment of Musical Ensembles , 1994, AAAI.

[7]  Roger B. Dannenberg,et al.  Following an Improvisation in Real Time , 1987, ICMC.

[8]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[9]  Roger B. Dannenberg,et al.  A Stochastic Method of Tracking a Vocal Performer , 1997, ICMC.

[10]  Hank Heijink,et al.  Robust Score-Performance Matching: Taking Advantage of Structural Information , 1997, ICMC.

[11]  William P. Birmingham,et al.  Improved Score Following for Acoustic Performances , 2002, ICMC.

[12]  Christus,et al.  A General Method Applicable to the Search for Similarities in the Amino Acid Sequence of Two Proteins , 2022 .

[13]  Petri Toiviainen,et al.  An interactive MIDI accompanist , 1998 .

[14]  Roger B. Dannenberg,et al.  An On-Line Algorithm for Real-Time Accompaniment , 1984, ICMC.

[15]  Jason D. Vantomme,et al.  Score Following by Temporal Pattern , 1995 .

[16]  Miller Puckette,et al.  Score Following Using the Sung Voice , 1995, ICMC.