Audio Melody Extraction Based on Timbral Similarity of Melodic Fragments

The presented study deals with extraction of melodic line(s) from polyphonic audio recordings. Our approach is based on finding significant melodic fragments throughout the analyzed piece of music and clustering these fragments according to their timbral similarity. Fragments within clusters are taken to represent fragments belonging to different melodic lines. Holes between significant fragments within each cluster are filled-in by a shortest-path approach over all melodic fragments. The paper presents our study in more detail and provides results on real recordings

[1]  Masataka Goto.  A predominant-F/sub 0/ estimation method for CD recordings: MAP estimation using EM algorithm for adaptive tone models , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[2]  Antti Eronen,et al.  Automatic musical instrument recognition , 2001 .

[3]  Hugo Fastl,et al.  Psychoacoustics: Facts and Models , 1990 .

[4]  Guy J. Brown,et al.  Extracting Melody Lines From Complex Audio , 2004, ISMIR.

[5]  Marc Leman,et al.  An auditory model based transriber of vocal queries , 2003, ISMIR.

[6]  Anssi Klapuri,et al.  AUTOMATIC TRANSCRIPTION OF MUSIC , 2003 .

[7]  Xavier Serra,et al.  A sound analysis/synthesis system based on a deterministic plus stochastic decomposition , 1990 .

[8]  William M. Hartmann,et al.  Psychoacoustics: Facts and Models , 2001 .

[9]  A. Spanias,et al.  Perceptual coding of digital audio , 2000, Proceedings of the IEEE.

[10]  Matija Marolt.  Gaussian Mixture Models For Extraction Of Melodic Lines From Audio Recordings , 2004, ISMIR.

[11]  Juan Pablo,et al.  Towards the automated analysis of simple polyphonic music : a knowledge-based approach , 2003 .

[12]  D. Weinshall,et al.  Computing Gaussian Mixture Models with EM using Side-Information , 2003 .

[13]  Matija Marolt.  Networks of Adaptive Oscillators for Partial Tracking and Transcription of Music Recordings , 2004 .

[14]  Julius O. Smith,et al.  Spectral modeling synthesis: A sound analysis/synthesis based on a deterministic plus stochastic decomposition , 1990 .