Indexing and Retrieval of Music Documents through Pattern Analysis and Data Fusion Techniques

One of the challenges of music information retrieval is the automatic extraction of effective content descriptors of music documents, which can be used at indexing and at retrieval time to match queries with documents. In this paper it is proposed to index music documents with frequent musical patterns. A musical pattern is a sequence of features in the score that is repeated at least twice: features can regard perceptually relevant characteristics, such as rhythm, pitch, or both. Data fusion techniques are applied to merge the results obtained using different features. A set of experimental tests has been carried out on retrieval effectiveness, robustness to query errors, and dependency on query length on a collection of Beatles’ songs using a set of queries. The proposed approach gave good results, both using single features and, in particular, merging the rank lists obtained by different features with a data fusion approach.

[1]  Holger H. Hoos,et al.  GUIDO/MIR - an Experimental Musical Information Retrieval System based on GUIDO Music Notation , 2001, ISMIR.

[2]  Nicola Orio,et al.  An HMM-based pitch tracker for audio queries , 2003, ISMIR.

[3]  Emanuele Pollastri,et al.  A multimodal framework for music inputs (poster session) , 2000, ACM Multimedia.

[4]  Nicola Orio,et al.  Evaluating automatic melody segmentation aimed at music information retrieval , 2002, JCDL '02.

[5]  William P. Birmingham,et al.  MUSART: Music Retrieval Via Aural Queries , 2001, ISMIR.

[6]  Jong-Hak Lee,et al.  Analyses of multiple evidence combination , 1997, SIGIR '97.

[7]  J. Stephen Downie,et al.  Evaluation of a simple and effective music information retrieval method , 2000, SIGIR '00.

[8]  Nicola Orio,et al.  Musical information retrieval using melodic surface , 1999, DL '99.

[9]  Ning Hu,et al.  A comparison of melodic database retrieval techniques using sung queries , 2002, JCDL '02.

[10]  William P. Birmingham,et al.  HMM-based musical query retrieval , 2002, JCDL '02.

[11]  Anna Pienimäki,et al.  Indexing Music Databases Using Automatic Extraction of Frequent Phrases , 2002, ISMIR.

[12]  Ian H. Witten,et al.  Towards a digital library of popular music , 1999, DL '99.

[13]  William P. Birmingham,et al.  Automatic Thematic Extractor , 2003, Journal of Intelligent Information Systems.

[14]  Nicola Orio,et al.  SMILE: a System for Content-based Musical Information Retrieval Environments , 2000, RIAO.