A Novel Fundamental Frequency Estimator Based on Harmonic Pattern Match for Music Signals

The fundamental frequency (F0) is an ubiquitous and crucial feature of music signals. However, due to nonstationary noise, missing harmonics, nonideal, i.e., Undesired, physical vibration of the musical instruments, etc., the estimation of F0 represents a considerable challenge when desiring to obtain robust and reliable results. In this paper, a novel harmonic pattern match (HPM) algorithm for F0 estimation of music signals is proposed to achieve improved performance. The novel HPM algorithm relies on the autocorrelation both in the time domain and in the frequency domain, exploiting the spectrum subset to guide the searching of F0 candidates (FCs), and an efficient mechanism to evaluate the match between each FC and the harmonic pattern of the input signal. The harmonic pattern of the measured spectrum is converted into a set of sub-pitches, which are extracted from the segmented sub bands. Finally, the estimated F0 is selected to best match the sub-pitches under a weighting strategy. Validation experiments were carried out using a database representation of musical instruments consisting of single pitched notes and the viability of the HPM algorithm was demonstrated to be competitive with several other F0 estimators.

[1]  N. Fletcher,et al.  Music Producers.(Book Reviews: The Physics of Musical Instruments.) , 1991 .

[2]  Hui Li,et al.  A Pitch Detection Algorithm Based on AMDF and ACF , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[3]  Tetsuya Shimamura,et al.  Robust method of measurement of fundamental frequency by ACLOS: autocorrelation of log spectrum , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[4]  John G Harris,et al.  A sawtooth waveform inspired pitch estimator for speech and music. , 2008, The Journal of the Acoustical Society of America.

[5]  Wolfgang Hess,et al.  Pitch Determination of Speech Signals , 1983 .

[6]  Andreas Spanias,et al.  Cepstrum-based pitch detection using a new statistical V/UV classification algorithm , 1999, IEEE Trans. Speech Audio Process..

[7]  Wolfgang Hess,et al.  Pitch Determination of Speech Signals: Algorithms and Devices , 1983 .

[8]  Anssi Klapuri,et al.  Qualitative and quantitative aspects in the design of periodicity estimation algorithms , 2000, 2000 10th European Signal Processing Conference.

[9]  Daniel P. W. Ellis,et al.  Signal Processing for Music Analysis , 2011, IEEE Journal of Selected Topics in Signal Processing.

[10]  Xavier Serra,et al.  A system for sound analysis/transformation/synthesis based on a deterministic plus stochastic decomposition , 1989 .

[11]  John G. Harris,et al.  A Pitch Estimation Algorithm Based on the Smooth Harmonic Average Peak-to-Valley Envelope , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[12]  Hideki Kawahara,et al.  YIN, a fundamental frequency estimator for speech and music. , 2002, The Journal of the Acoustical Society of America.

[13]  Anssi Klapuri,et al.  Automatic Music Transcription as We Know it Today , 2004 .

[14]  Carlos Busso,et al.  Analysis of Emotionally Salient Aspects of Fundamental Frequency for Emotion Detection , 2009, IEEE Transactions on Audio, Speech, and Language Processing.

[15]  Xuejing Sun A pitch determination algorithm based on subharmonic-to-harmonic ratio , 2000, INTERSPEECH.

[16]  D. J. Hermes,et al.  Measurement of pitch by subharmonic summation. , 1988, The Journal of the Acoustical Society of America.

[17]  P. Boersma ACCURATE SHORT-TERM ANALYSIS OF THE FUNDAMENTAL FREQUENCY AND THE HARMONICS-TO-NOISE RATIO OF A SAMPLED SOUND , 1993 .

[18]  M. Schroeder Period histogram and product spectrum: new methods for fundamental-frequency measurement. , 1968, The Journal of the Acoustical Society of America.

[19]  M. P. Gelfer,et al.  The relative contributions of speaking fundamental frequency and formant frequencies to gender identification based on isolated vowels. , 2005, Journal of voice : official journal of the Voice Foundation.

[20]  Judith C. Brown,et al.  Musical frequency tracking using the methods of conventional and , 1991 .

[21]  A. de Cheveigné,et al.  The dependency of timbre on fundamental frequency. , 2003, The Journal of the Acoustical Society of America.

[22]  David A. Krubsack,et al.  A spectral autocorrelation method for measurement of the fundamental frequency of noise-corrupted speech , 1987, IEEE Trans. Acoust. Speech Signal Process..