Detection of Piano Pedaling Techniques on the Sustain Pedal

Automatic detection of piano pedalling techniques is challenging as it is comprised of subtle nuances of piano timbres. In this paper, we address this problem on single notes using decision-tree-based support vector machines. Features are extracted from harmonics and residuals based on physical acoustics considerations and signal observations. We consider four distinct pedalling techniques on the sustain pedal (anticipatory full, anticipatory half, legato full and legato half pedalling) and create a new isolated-note dataset consisting of different pitches and velocities for each pedalling technique plus notes played without pedal. Our results using cross-validation trails show the effectiveness of the designed features and the trained classifiers for discriminating pedalling techniques.

[1]  Deborah Rambo Sinn Playing Beyond the Notes: A Pianist's Guide to Musical Interpretation , 2013 .

[2]  Vesa Välimäki,et al.  Analysis and modeling of piano sustain-pedal effects. , 2007, The Journal of the Acoustical Society of America.

[3]  Anssi Klapuri,et al.  Automatic music transcription: challenges and future directions , 2013, Journal of Intelligent Information Systems.

[4]  Yi-Hsuan Yang,et al.  Electric Guitar Playing Technique Detection in Real-World Recording Based on F0 Sequence Pattern Recognition , 2015, ISMIR.

[5]  Kin Hong Wong,et al.  Sinusoidal modeling for piano tones , 2013, 2013 IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC 2013).

[6]  Xavier Serra,et al.  Musical Sound Modeling with Sinusoids plus Noise , 1997 .

[7]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[8]  Vesa Välimäki,et al.  Analysis of the part-pedaling effect in the piano. , 2009, The Journal of the Acoustical Society of America.

[9]  Harvey Fletcher,et al.  Quality of Piano Tones , 1962 .

[10]  Sandra P. Rosenblum Pedaling the Piano: A Brief Survey from the Eighteenth Century to the Present , 1993 .

[11]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[12]  David Rowland,et al.  A History of Pianoforte Pedalling , 1993 .

[13]  Alexander Lerch,et al.  On Drum Playing Technique Detection in Polyphonic Mixtures , 2016, ISMIR.

[14]  Simon Dixon,et al.  An Attack/Decay Model for Piano Transcription , 2016, ISMIR.

[15]  Antony Schutz Piano "Forte Pedal" analysis and detection , 2008 .

[16]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[17]  György Fazekas,et al.  Piano pedaller: a measurement system for classification and visualisation of piano pedalling techniques , 2017, NIME.

[18]  S. Abe,et al.  Decision-tree-based multiclass support vector machines , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[19]  Mark B. Sandler,et al.  Piano Transcription in the Studio Using an Extensible Alternating Directions Framework , 2016, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[20]  Andrew P. McPherson,et al.  A Low-Cost Real-Time Tracking System for Violin , 2015 .

[21]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[22]  Bertrand David,et al.  A parametric model and estimation techniques for the inharmonicity and tuning of the piano. , 2013, The Journal of the Acoustical Society of America.

[23]  Gabriel Weinreich,et al.  Coupled piano strings , 1977 .

[24]  M. Newville,et al.  Lmfit: Non-Linear Least-Square Minimization and Curve-Fitting for Python , 2014 .

[25]  J. Freidman,et al.  Multivariate adaptive regression splines , 1991 .