Robust Polyphonic Music Retrieval with N-grams

In this paper we investigate the retrieval performance of monophonic and polyphonic queries made on a polyphonic music database. We extend the n-gram approach for full-music indexing of monophonic music data to polyphonic music using both rhythm and pitch information. We define an experimental framework for a comparative and fault-tolerance study of various n-gramming strategies and encoding levels. For monophonic queries, we focus in particular on query-by-humming systems, and for polyphonic queries on query-by-example. Error models addressed in several studies are surveyed for the fault-tolerance study. Our experiments show that different n-gramming strategies and encoding precision differ widely in their effectiveness. We present the results of our study on a collection of 6366 polyphonic MIDI-encoded music pieces.

[1]  Jean-Gabriel Ganascia,et al.  Musical content-based retrieval: an overview of the Melodiscov approach and system , 1999, MULTIMEDIA '99.

[2]  Esko Ukkonen,et al.  Retrieving Music --- To Index or not to Index , 1998 .

[3]  J. Stephen Downie,et al.  Evaluating a simple approach to music information retrieval : conceiving melodic n-grams as text , 1999 .

[4]  Ian H. Witten,et al.  Towards the digital music library: tune retrieval from acoustic input , 1996, DL '96.

[5]  David Huron,et al.  Humdrum and Kern : selective feature encoding , 1997 .

[6]  Jeremy Pickens.  Feature selection for polyphonic music retrieval , 2001, SIGIR '01.

[7]  Masashi Yamamuro,et al.  A practical query-by-humming system for a large music database , 2000, ACM Multimedia.

[8]  Emanuele Pollastri.  An Audio Front End for Query-by-Humming Systems , 2001, ISMIR.

[9]  Andreas Kornstädt,et al.  Themefinder: A web-based melodic search tool , 1998 .

[10]  Stephen E. Robertson,et al.  Okapi at TREC-3 , 1994, TREC.

[11]  Stephen E. Robertson,et al.  GatfordCentre for Interactive Systems ResearchDepartment of Information , 1996 .

[12]  Edward J. Coyle,et al.  Perceptual Issues in Music Pattern Recognition: Complexity of Rhythm and Key Finding , 2001, Comput. Humanit..

[13]  Brian Christopher Smith,et al.  Query by humming: musical information retrieval in an audio database , 1995, MULTIMEDIA '95.

[14]  Rajeev Raman,et al.  String-Matching techniques for musical similarity and melodic recognition , 1998 .

[15]  Michael Clausen,et al.  PROMS: A Web-based Tool for Searching in Polyphonic Music , 2000, ISMIR.

[16]  Matthew J. Dovey.  A Technique for Regular Expression Style Searching in Polyphonic Music , 2001, ISMIR.

[17]  J. Stephen Downie,et al.  Evaluation of a simple and effective music information retrieval method , 2000, SIGIR '00.

[18]  Nicola Orio,et al.  Musical information retrieval using melodic surface , 1999, DL '99.

[19]  Eleanor Selfridge-Field,et al.  Beyond MIDI: the handbook of musical codes , 1997 .

[20]  Stephen P. Harter,et al.  Evaluation of information retrieval systems : Approaches, issues, and methods , 1997 .

[21]  Jonathan Foote,et al.  ARTHUR: Retrieving Orchestral Music by Long-Term Structure , 2000, ISMIR.

[22]  David De Roure,et al.  A tool for content based navigation of music , 1998, MULTIMEDIA '98.

[23]  Lutz Prechelt,et al.  An interface for melody input , 2001, TCHI.

[24]  David Huron.  Perceptual and Cognitive Applications in Music Information Retrieval , 2000, ISMIR.

[25]  Shyamala Doraisamy.  Locating recurring themes in musical sequences , 1995 .

[26]  Ian H. Witten,et al.  The New Zealand Digital Library MELody inDEX , 1997, D Lib Mag..

[27]  Justin Zobel,et al.  Melodic matching techniques for large music databases , 1999, MULTIMEDIA '99.

[28]  J. Zobel,et al.  Matching Techniques for Large Music Databases , 1999 .

[29]  H. Barlow,et al.  A dictionary of musical themes , 1975 .

[30]  Arbee L. P. Chen,et al.  Query by rhythm: an approach for song retrieval in music databases , 1998, Proceedings Eighth International Workshop on Research Issues in Data Engineering. Continuous-Media Databases and Applications.

[31]  Stephen E. Robertson,et al.  Okapi at TREC-6 Automatic ad hoc, VLC, routing, filtering and QSDR , 1997, TREC.

[32]  Eleanor Selfridge-Field,et al.  Conceptual and representational issues in melodic comparison , 1998 .

[33]  Gerard Salton,et al.  Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer , 1989 .

[34]  H. S. Heaps,et al.  Information retrieval, computational and theoretical aspects , 1978 .