Crowdsourcing A Real-World On-Line Query By Humming System

Systems able to find a song based on a sung, hummed, or whistled melody are called Query-By-Humming (QBH) systems. Tunebot is an online QBH web service and iPhone app that connects users to the desired recording on Amazon.com or iTunes. Tunebot’s searchable database is composed of thousands of usercontributed melodies. Melodies are collected from user queries, sung contributions and through contributions from on-line play of an associated iPhone Karaoke game: Karaoke Callout. In this paper we describe the architecture and workings of the paired systems, as well as issues involved in building a real-world, working music search engine from user-contributed data.

[1]  David A. Shamma,et al.  Karaoke callout: using social and collaborative cell phone networking for new entertainment modalities and data collection , 2006, AMCMM '06.

[2]  Avery Wang,et al.  An Industrial Strength Audio Search Algorithm , 2003, ISMIR.

[3]  George Tzanetakis,et al.  A comparative evaluation of search techniques for query-by-humming using the MUSART testbed , 2007 .

[4]  Remco C. Veltkamp,et al.  A Survey of Music Information Retrieval Systems , 2005, ISMIR.

[5]  Ton Kalker,et al.  A Highly Robust Audio Fingerprinting System , 2002, ISMIR.

[6]  Gaël Richard,et al.  Drum Loops Retrieval from Spoken Queries , 2005, Journal of Intelligent Information Systems.

[7]  Elaine Chew,et al.  Creating data resources for designing user-centric frontends for query by humming systems , 2003, MIR '03.

[8]  Bryan Pardo,et al.  Speeding Melody Search With Vantage Point Trees , 2008, ISMIR.

[9]  Ian H. Witten,et al.  The New Zealand Digital Library MELody inDEX , 1997, D Lib Mag..

[10]  Laurent Imbert,et al.  Accelerating Query-by-Humming on GPU , 2009, ISMIR.

[11]  Justin Zobel,et al.  Melodic matching techniques for large music databases , 1999, MULTIMEDIA '99.

[12]  Bryan Pardo,et al.  A Query by Humming System that Learns from Experience , 2007, ISMIR.

[13]  Steffen Pauws,et al.  CubyHum: a fully operational "query by humming" system , 2002, ISMIR.

[14]  William Forde Thompson.  Melodic Similarity: Concepts, Procedures, and Applications (Computing in Musicology 11) Walter B. Hewlett Eleanor Selfridge-Field , 1999 .

[15]  Justin Salamon,et al.  A Quantitative Evaluation of a Two Stage Retrieval Approach for a Melodic Query by Example System , 2009, ISMIR.

[16]  Michael J. Fischer,et al.  The String-to-String Correction Problem , 1974, JACM.

[17]  Andreas Kornstädt,et al.  Themefinder: A web-based melodic search tool , 1998 .

[18]  William P. Birmingham,et al.  A Comprehensive Trainable Error Model for Sung Music Queries , 2004, J. Artif. Intell. Res..

[19]  Eleanor Selfridge-Field,et al.  Melodic Similarity : concepts, procedures, and applications , 1998 .

[20]  Push Singh,et al.  The Public Acquisition of Commonsense Knowledge , 2002 .

[21]  Laura A. Dabbish,et al.  Labeling images with a computer game , 2004, AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors.

[22]  Ning Hu,et al.  A Probabilistic Model of Melodic Similarity , 2002, ICMC.

[23]  Ricardo A. Baeza-Yates,et al.  Searching in metric spaces , 2001, CSUR.