Efficient kNN search in polyphonic music databases using a lower bounding mechanism

AbstractQuerying polyphonic music from a large data collection is an interesting topic. Recently, researchers have attempted to provide efficient methods for content-based retrieval in polyphonic music databases where queries are polyphonic. However, most of them do not work well for similarity search, which is important to many applications. In this paper, we propose three polyphonic representations with the associated similarity measures and a novel method to retrieve k music works that contain segments most similar to the query. In general, most of the index-based methods for similarity search generate all the possible answers to the query and then perform exact matching on the index for each possible answer. Based on the edit distance, our method generates only a few possible answers by performing the deletion and/or replacement operations on the query. Each possible answer is then used to perform exact matching on a list-based index, which allows the insertion operations to be performed. For each possible answer, its edit distance to the query is regarded as a lower bound of the edit distances between the matched results and the query. Based on the kNN results that match a possible answer, the possible answers that cannot provide better results are skipped. By using this mechanism, we design a method for efficient kNN search in polyphonic music databases. The experimental results show that our method outperforms the previous methods in efficiency. We also evaluate the effectiveness of our method by showing the search results to the musician and nonmusician user groups. The experimental results provide useful guidelines on the design of a polyphonic music database.

[1]  Brian Christopher Smith,et al.  Query by humming: musical information retrieval in an audio database , 1995, MULTIMEDIA '95.

[2]  Eduardo Miranda,et al.  You have printed the following article : A Framework for the Evaluation of Music Representation Systems , 2008 .

[3]  Mark B. Sandler,et al.  Polyphonic Score Retrieval Using Polyphonic Audio Queries: A Harmonic Modeling Approach , 2003, ISMIR.

[4]  Ian H. Witten,et al.  Tune Retrieval in the Multimedia Library , 2000, Multimedia Tools and Applications.

[5]  Edward M. McCreight,et al.  A Space-Economical Suffix Tree Construction Algorithm , 1976, JACM.

[6]  Atsuhiro Takasu,et al.  Phrase based feature extraction for musical information retrieval , 1999, 1999 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM 1999). Conference Proceedings (Cat. No.99CH36368).

[7]  Udi Manber,et al.  Fast text searching: allowing errors , 1992, CACM.

[8]  Arbee L. P. Chen,et al.  The effectiveness study of various music information retrieval approaches , 2002, CIKM '02.

[9]  J. Stephen Downie,et al.  Evaluation of a simple and effective music information retrieval method , 2000, SIGIR '00.

[10]  Wojciech Rytter,et al.  Text Algorithms , 1994 .

[11]  Justin Zobel,et al.  Melodic matching techniques for large music databases , 1999, MULTIMEDIA '99.

[12]  Juan Pablo Bello,et al.  Time-domain polyphonic transcription using self-generating databases , 2002 .

[13]  Andreas Kornstädt,et al.  Themefinder: A web-based melodic search tool , 1998 .

[14]  Kjell Lemström,et al.  SEMEX - An efficient Music Retrieval Prototype , 2000, ISMIR.

[15]  Yuen-Hsien Tseng,et al.  Content-based retrieval for music collections , 1999, SIGIR '99.

[16]  C. Krumhansl Cognitive Foundations of Musical Pitch , 1990 .

[17]  Christopher Raphael,et al.  Automatic Transcription of Piano Music , 2002, ISMIR.

[18]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[19]  Michael Clausen,et al.  PROMS: A Web-based Tool for Searching in Polyphonic Music , 2000, ISMIR.

[20]  Matthew J. Dovey A Technique for Regular Expression Style Searching in Polyphonic Music , 2001, ISMIR.

[21]  David De Roure,et al.  Content-based navigation of music using melodic pitch contours , 2000, Multimedia Systems.

[22]  Wesley W. Chu,et al.  Efficient searches for similar subsequences of different lengths in sequence databases , 2000, Proceedings of 16th International Conference on Data Engineering (Cat. No.00CB37073).

[23]  Ian H. Witten,et al.  The New Zealand Digital Library MELody inDEX , 1997, D Lib Mag..

[24]  Adriane Durey,et al.  Melody Spotting Using Hidden Markov Models , 2001, ISMIR.

[25]  David De Roure,et al.  A tool for content based navigation of music , 1998, MULTIMEDIA '98.

[26]  Jeremy Pickens Feature selection for polyphonic music retrieval , 2001, SIGIR '01.

[27]  Jeremy Pickens,et al.  A Survey of Feature Selection Techniques for Music Information Retrieval , 2001 .

[28]  Eleanor Selfridge-Field,et al.  Conceptual and representational issues in melodic comparison , 1998 .

[29]  Mark Sandler,et al.  Pitch Locking Monophonic Music Analysis , 2002 .

[30]  Chi Lap Yip,et al.  A study on n-gram indexing of musical features , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[31]  Gerard Salton,et al.  Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer , 1989 .

[32]  Tim Crawford,et al.  Harmonic models for polyphonic music retrieval , 2002, CIKM '02.

[33]  Saburō Shiroyama In Los Angeles , 1989, Made in Japan and other Japanese “Business Novels”.

[34]  Arbee L. P. Chen,et al.  An approximate string matching algorithm for content-based music data retrieval , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.