The Magaloff Project: An Interim Report

Abstract One of the main difficulties in studying expression in musical performance is the acquisition of data. While audio recordings abound, automatically extracting precise information related to timing, dynamics, and articulation is still not possible at the level of precision required for large-scale music performance studies. In 1989, the Russian pianist Nikita Magaloff performed essentially the entire works for solo piano by Frédéric Chopin on a Bösendorfer SE, a computer-controlled grand piano that precisely measures every key and pedal action by the performer. In this paper, we describe the process and the tools for the preparation of this collection, which comprises hundreds of thousands of notes. We then move on to presenting the results of initial exploratory studies of the expressive content of the data, specifically effects of performer age, performance errors, between-hand asynchronies, and tempo rubato. We also report preliminary results of a systematic study of the shaping of particular rhythmic passages, using the notion of phase-plane trajectories. Finally, we briefly describe how the Magaloff data were used to train a performance rendering system that won the 2008 Rencon International Performance Rendering Contest.

[1]  B. Silverman,et al.  Functional Data Analysis , 1997 .

[2]  Gerhard Widmer,et al.  THE MAGALOFF CORPUS: AN EMPIRICAL ERROR STUDY , 2010 .

[3]  B H Repp,et al.  Expressive timing in Schumann's "Träumerei:" an analysis of performances by graduate student pianists. , 1995, The Journal of the Acoustical Society of America.

[4]  Peter Desain,et al.  Effects of Tempo on the Timing of Simple Musical Rhythms , 2002 .

[5]  Eugene Narmour,et al.  The Analysis and Cognition of Basic Melodic Structures: The Implication-Realization Model , 1990 .

[6]  C. Palmer Mapping musical thought to musical performance. , 1989, Journal of experimental psychology. Human perception and performance.

[7]  Gerhard Widmer,et al.  YQX Plays Chopin , 2009, AI Mag..

[8]  B. Repp The Art of Inaccuracy: Why Pianists' Errors Are Difficult to Hear , 1996 .

[9]  Gerhard Widmer,et al.  In Search of the Horowitz Factor , 2003, AI Mag..

[10]  Eric Clarke,et al.  Some Aspects of Rhythm and Expression in Performances of Erik Satie's "Gnossienne No. 5" , 1985 .

[11]  Luke Windsor,et al.  Make Me a Match: An Evaluation of Different Approaches to ScorePerformance Matching , 2000, Computer Music Journal.

[12]  Roger B. Dannenberg,et al.  An On-Line Algorithm for Real-Time Accompaniment , 1984, ICMC.

[13]  Gerhard Widmer,et al.  EXPRESSIVE PERFORMANCE RENDERING: INTRODUCING PERFORMANCE CONTEXT , 2009 .

[14]  M. Grachten,et al.  Expressivity-aware tempo transformations of music performances using case based reasoning , 2006 .

[15]  C Palmer,et al.  Range of planning in music performance. , 1995, Journal of experimental psychology. Human perception and performance.

[16]  Gerhard Widmer,et al.  Investigations of Between-Hand Synchronization in Magaloff's Chopin , 2010, Computer Music Journal.

[17]  Karen DeMol,et al.  On Musical Excellence , 1992 .

[18]  Peter Desain,et al.  A structurally guided method for the decomposition of expression in music performance. , 2006, The Journal of the Acoustical Society of America.

[19]  Ruth Rasch,et al.  Synchronization in performed ensemble music , 1979 .

[20]  W. L. Windsor,et al.  Real and Simulated Expression: A Listening Study , 2000 .

[21]  Jeremy Pickens Feature selection for polyphonic music retrieval , 2001, SIGIR '01.

[22]  C. Palmer Anatomy of a Performance: Sources of Musical Expression , 1996 .

[23]  Kenji Suzuki,et al.  Rencon: Performance Rendering Contest for Automated Music Systems , 2008 .

[24]  Gerhard Widmer,et al.  Maintaining skill across the life span: Magaloff's entire Chopin at age 77 , 2009 .

[25]  Roberto Bresin,et al.  Measurement and reproduction accuracy of computer-controlled grand pianos. , 2003, The Journal of the Acoustical Society of America.

[26]  C. Palmer Music performance. , 1997, Annual review of psychology.

[27]  W Goebl,et al.  Melody lead in piano performance: expressive device or artifact? , 2001, The Journal of the Acoustical Society of America.

[28]  Christopher Raphael,et al.  Aligning music audio with symbolic scores using a hybrid graphical model , 2006, Machine Learning.

[29]  Thomas L. Rhea,et al.  Evolution of the Keyboard Interface: The Bosendorfer 290 SE Recording Piano and the Moog Multiply-Touch-Sensitive Keyboards , 1990 .

[30]  A. Gabrielsson Music Performance Research at the Millennium , 2003 .

[31]  Anders Friberg,et al.  Swing Ratios and Ensemble Timing in Jazz Performance: Evidence for a Common Rhythmic Pattern , 2002 .

[32]  B. Repp Diversity and commonality in music performance: an analysis of timing microstructure in Schumann's "Träumerei". , 1992, The Journal of the Acoustical Society of America.

[33]  Henkjan Honing The Final Ritard: On Music, Motion, and Kinematic Models , 2003, Computer Music Journal.

[34]  P. Baltes,et al.  Psychological perspectives on successful aging: The model of selective optimization with compensation. , 1990 .

[35]  Simon Dixon,et al.  Automatic Extraction of Tempo and Beat From Expressive Performances , 2001 .

[36]  Caroline Palmer,et al.  On the Assignment of Structure in Music Performance , 1996 .

[37]  Bernhard Niedermayer,et al.  Improving Accuracy of Polyphonic Music-to-Score Alignment , 2009, ISMIR.

[38]  Gerhard Widmer,et al.  Phase-plane visualizations of gestural structure in expressive timing , 2008 .

[39]  William P. Birmingham,et al.  Improved Score Following for Acoustic Performances , 2002, ICMC.

[40]  Ning Hu,et al.  A Bootstrap Method for Training an Accurate Audio Segmenter , 2005, ISMIR.

[41]  Richard Hudson Stolen Time: The History of Tempo Rubato , 1995 .

[42]  Gerhard Widmer,et al.  Phase-plane Representation and Visualization of Gestural Structure in Expressive Timing , 2009 .

[43]  Simon Dixon,et al.  Evaluation of the Audio Beat Tracking System BeatRoot , 2007 .

[44]  C. Palmer,et al.  Units of knowledge in music performance. , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[45]  Michael J. Fischer,et al.  The String-to-String Correction Problem , 1974, JACM.

[46]  Gerhard Widmer,et al.  Computational Models of Expressive Music Performance: The State of the Art , 2004 .

[47]  A. Gabrielsson The Performance of Music , 1999 .