A new approach to short-time harmonic analysis of tonal audio signals using harmonic sinusoidals

This paper presents a novel short-time frequency analysis algorithm, namely Instantaneous Harmonic Analysis (IHA), which can be used in Multiple Fundamental Frequency Estimation. Given a set of reference pitches, the objective of the algorithm is to transform the real-valued time-domain audio signal into a set of complex time-domain signals in such a way that the amplitude and phase of the resulting signals represent the amplitude and phase of the signal components with respect to the reference pitches. In the proposed algorithm, the instantaneous amplitude is identified as the presence of the pitch in time. The algorithm has been applied to three synthetic data sets for pureharmonic, one-overtone, and two-overtone data in a MIDI format and the results are reported here. To overcome the harmonic collision, a bottom of approach has been used for overtones elimination. A note event post-processing algorithm has also been developed for further analysis by representing the IHA output in the beat resolution.

[1]  Hui Li,et al.  Adaptive Instantaneous Frequency Estimation Based on EMD and TKEO , 2008, 2008 Congress on Image and Signal Processing.

[2]  Bernard C. Picinbono,et al.  On instantaneous amplitude and phase of signals , 1997, IEEE Trans. Signal Process..

[3]  J. Barbour.  Tuning and Temperament: A Historical Survey , 2004 .

[4]  G. Folland,et al.  The uncertainty principle: A mathematical survey , 1997 .

[5]  Hideki Kawahara,et al.  YIN, a fundamental frequency estimator for speech and music. , 2002, The Journal of the Acoustical Society of America.

[6]  M.G. Bellanger,et al.  Digital processing of speech signals , 1980, Proceedings of the IEEE.

[7]  Patrick J. Loughlin,et al.  When is instantaneous frequency the average frequency at each time? , 1999, IEEE Signal Processing Letters.

[8]  Norden E. Huang,et al.  On Instantaneous Frequency , 2009, Adv. Data Sci. Adapt. Anal..

[9]  Victor A. N. Barroso,et al.  Instantaneous frequency of multicomponent signals , 1999, IEEE Signal Processing Letters.

[10]  Leon Cohen,et al.  The uncertainty principle in signal analysis , 1994, Proceedings of IEEE-SP International Symposium on Time- Frequency and Time-Scale Analysis.

[11]  K. Gehrkens,et al.  Music Notation and Terminology , 1931 .

[12]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[13]  Judith C. Brown.  Calculation of a constant Q spectral transform , 1991 .

[14]  Sergio L. Netto,et al.  A constant-Q spectral transformation with improved frequency response , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[15]  Shubha Kadambe,et al.  A comparison of the existence of 'cross terms' in the Wigner distribution and the squared magnitude of the wavelet transform and the short-time Fourier transform , 1992, IEEE Trans. Signal Process..

[16]  Steven W. Smith,et al.  The Scientist and Engineer's Guide to Digital Signal Processing , 1997 .

[17]  Xuemei Chen,et al.  Multiple Pitch Estimation Based on Modified Harmonic Product Spectrum , 2013 .

[18]  Xavier Rodet,et al.  On the measurement of the instantaneous frequency and amplitude of partials in vocal vibrato , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[19]  Ernesto López,et al.  An Efficient Multi-Resolution Spectral Transform for Music Analysis , 2009, ISMIR.

[20]  Flemming Forsberg,et al.  Theory and applications of adaptive constant-Q distributions , 1998, IEEE Trans. Signal Process..