Piano pedaller: a measurement system for classification and visualisation of piano pedalling techniques

This paper presents the results of a study of piano pedalling techniques on the sustain pedal using a newly designed measurement system named Piano Pedaller. The system is comprised of an optical sensor mounted in the piano pedal bearing block and an embedded platform for recording audio and sensor data. This enables recording the pedalling gesture of real players and the piano sound under normal playing conditions. Using the gesture data collected from the system, the task of classifying these data by pedalling technique was undertaken using a Support Vector Machine (SVM). Results can be visualised in an audio based score following application to show pedalling together with the player’s position in the score.

[1]  Georg Essl,et al.  Visual Associations in Augmented Keyboard Performance , 2013, NIME.

[2]  Max Mühlhäuser,et al.  The Elbow Piano: Sonification of Piano Playing Movements , 2008, NIME.

[3]  Max Mühlhäuser,et al.  Analysis of Piano Playing Movements Spanning Multiple Touches , 2010, NIME.

[4]  Andrew P. McPherson,et al.  Portable Measurement and Mapping of Continuous Piano Gesture , 2013, NIME.

[5]  Simon Dixon,et al.  Compensating for asynchronies between musical voices in score-performance alignment , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Vesa Välimäki,et al.  Analysis and modeling of piano sustain-pedal effects. , 2007, The Journal of the Acoustical Society of America.

[7]  Giovanni De Poli,et al.  Sense in expressive music performance: Data acquisition, computational studies, and models , 2008 .

[8]  Atau Tanaka,et al.  PiaF: A Tool for Augmented Piano Performance Using Gesture Variation Following , 2014, NIME.

[9]  David Rowland,et al.  A History of Pianoforte Pedalling , 1993 .

[10]  Nicholas Gillian,et al.  A gesturally controlled improvisation system for piano , 2012 .

[11]  Atau Tanaka,et al.  Machine Learning of Musical Gestures , 2013, NIME.

[12]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[13]  William Brent.  The Gesturally Extended Piano , 2012, NIME.

[14]  Caroline Traube,et al.  Investigating pianists' individuality in the performance of five timbral nuances through patterns of articulation, touch, dynamics, and pedaling , 2014, Front. Psychol..

[15]  Deborah Rambo Sinn.  Playing Beyond the Notes: A Pianist's Guide to Musical Interpretation , 2013 .

[16]  P. L. Huray.  Authenticity in Performance: Eighteenth-Century Case Studies , 1990 .

[17]  Sandra P. Rosenblum.  Pedaling the Piano: A Brief Survey from the Eighteenth Century to the Present , 1993 .

[18]  Andrew P. McPherson,et al.  An Environment for Submillisecond-Latency Audio and Sensor Processing on BeagleBone Black , 2015 .

[19]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[20]  Gregory T. A. Kovacs,et al.  Motion artifact cancellation to obtain heart sounds from a single chest-worn accelerometer , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[21]  W. Press,et al.  Numerical Recipes: The Art of Scientific Computing , 1987 .

[22]  Youngmoo E. Kim,et al.  Piano Technique as a Case Study in Expressive Gestural Interaction , 2013, Music and Human-Computer Interaction.

[23]  Teknillinen Korkeakoulu,et al.  Analysis and Parametric Synthesis of the Piano Sound Abstract of the of Technology Master's Thesis , 2022 .