Recognition of Piano Pedalling Techniques Using Gesture Data

This paper presents a study of piano pedalling technique recognition on the sustain pedal utilising gesture data that is collected using a novel measurement system. The recognition is comprised of two separate tasks: onset/offset detection and classification. The onset and offset time of each pedalling technique was computed through signal processing algorithms. Based on features extracted from every segment when the pedal is pressed, the task of classifying the segments by pedalling technique was undertaken using machine learning methods. We exploited and compared a Support Vector Machine (SVM) and a hidden Markov model (HMM) for classification. Recognition results can be represented by customised pedalling notations and visualised in a score following system.

[1]  Atau Tanaka,et al.  PiaF: A Tool for Augmented Piano Performance Using Gesture Variation Following , 2014, NIME.

[2]  Atau Tanaka,et al.  Machine Learning of Musical Gestures , 2013, NIME.

[3]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[4]  Deborah Rambo Sinn Playing Beyond the Notes: A Pianist's Guide to Musical Interpretation , 2013 .

[5]  Davide Rocchesso,et al.  Sound to Sense - Sense to Sound: A state of the art in Sound and Music Computing , 2008 .

[6]  György Fazekas,et al.  Piano pedaller: a measurement system for classification and visualisation of piano pedalling techniques , 2017, NIME.

[7]  Frédéric Bevilacqua,et al.  Gesture Analysis of Violin Bow Strokes , 2005, Gesture Workshop.

[8]  David Rowland,et al.  A History of Pianoforte Pedalling , 1993 .

[9]  William H. Press,et al.  Numerical Recipes: The Art of Scientific Computing , 1987 .

[10]  Diana Young,et al.  Classification of Common Violin Bowing Techniques Using Gesture Data from a Playable Measurement System , 2008, NIME.

[11]  Simon Dixon,et al.  Compensating for asynchronies between musical voices in score-performance alignment , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Sandra P. Rosenblum Pedaling the Piano: A Brief Survey from the Eighteenth Century to the Present , 1993 .

[13]  J. E. Glynn,et al.  Numerical Recipes: The Art of Scientific Computing , 1989 .

[14]  Thomas Hofmann,et al.  Hidden Markov Support Vector Machines , 2003, ICML.

[15]  Andrew P. McPherson,et al.  An Environment for Submillisecond-Latency Audio and Sensor Processing on BeagleBone Black , 2015 .

[16]  Giovanni De Poli,et al.  Sense in expressive music performance: Data acquisition, computational studies, and models , 2008 .

[17]  W. Press,et al.  Numerical Recipes: The Art of Scientific Computing , 1987 .