Harmonic models for polyphonic music retrieval

Most work in the ad hoc music retrieval field has focused on the retrieval of monophonic documents using monophonic queries. Polyphony adds considerably more complexity. We present a method by which polyphonic music documents may be retrieved by polyphonic music queries. A new harmonic description technique is given, wherein the information from all chords, rather than the most significant chord, is used. This description is then combined in a new and unique way with Markov statistical methods to create models of both documents and queries. Document models are compared to query models and then ranked by score. Though test collections for music are currently scarce, we give the first known recall-precision graphs for polyphonic music retrieval, and results are favorable.

[1]  Anssi Klapuri,et al.  AUTOMATIC TRANSCRIPTION OF MUSIC , 2003 .

[2]  Mark Sandler,et al.  BLACKBOARD SYSTEM AND TOP-DOWN PROCESSING FOR THE TRANSCRIPTION OF SIMPLE POLYPHONIC MUSIC , 2000 .

[3]  Holger H. Hoos,et al.  GUIDO/MIR - an Experimental Musical Information Retrieval System based on GUIDO Music Notation , 2001, ISMIR.

[4]  Yuen-Hsien Tseng,et al.  Content-based retrieval for music collections , 1999, SIGIR '99.

[5]  Shlomo Dubnov,et al.  Robust temporal and spectral modeling for query By melody , 2002, SIGIR '02.

[6]  Ian H. Witten,et al.  The New Zealand Digital Library MELody inDEX , 1997, D Lib Mag..

[7]  H. V. Jagadish,et al.  Indexing Hidden Markov Models for Music Retrieval , 2002, ISMIR.

[8]  Mark B. Sandler,et al.  Polyphonic Score Retrieval Using Polyphonic Audio Queries: A Harmonic Modeling Approach , 2003, ISMIR.

[9]  Jeremy Pickens.  Feature selection for polyphonic music retrieval , 2001, SIGIR '01.

[10]  Christopher Raphael,et al.  Automatic Transcription of Piano Music , 2002, ISMIR.

[11]  Jeremy Pickens.  A Comparison of Language Modeling and Probabilistic Text Information Retrieval Approaches to Monophonic Music Retrieval , 2000, ISMIR.

[12]  Adam Taro Lindsay,et al.  Using contour as a mid-level representation of melody , 1996 .

[13]  Beth Logan,et al.  A music similarity function based on signal analysis , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[14]  W. Dowling.  Scale and contour: Two components of a theory of memory for melodies. , 1978 .

[15]  William P. Birmingham,et al.  HMM-based musical query retrieval , 2002, JCDL '02.

[16]  John D. Lafferty,et al.  Model-based feedback in the language modeling approach to information retrieval , 2001, CIKM '01.

[17]  Jinxi Xu,et al.  The Design and Implementation of a Part of Speech Tagger for English , 1994 .

[18]  Donald Byrd,et al.  Problems of music information retrieval in the real world , 2002, Inf. Process. Manag..

[19]  Jorma Tarhio,et al.  Searching monophonic patterns within polyphonic sources , 2000 .

[20]  George Tzanetakis,et al.  Automatic Musical Genre Classification of Audio Signals , 2001, ISMIR.

[21]  Geraint A. Wiggins,et al.  Algorithms for discovering repeated patterns in multidimensional representations of polyphonic music , 2002 .

[22]  William P. Birmingham,et al.  The Chordal Analysis of Tonal Music , 2001 .

[23]  Simon Dixon,et al.  On the Computer Recognition of Solo Piano Music , 2000 .

[24]  Daniel P. W. Ellis,et al.  A Large-Scale Evaluation of Acoustic and Subjective Music-Similarity Measures , 2004, Computer Music Journal.

[25]  Costas S. Iliopoulos,et al.  Computing Approximate Repetitions in Musical Sequences , 2000, Stringology.

[26]  Jonathan Foote,et al.  ARTHUR: Retrieving Orchestral Music by Long-Term Structure , 2000, ISMIR.

[27]  William P. Birmingham,et al.  MUSART: Music Retrieval Via Aural Queries , 2001, ISMIR.

[28]  Michael Clausen,et al.  PROMS: A Web-based Tool for Searching in Polyphonic Music , 2000, ISMIR.

[29]  David De Roure,et al.  A tool for content based navigation of music , 1998, MULTIMEDIA '98.

[30]  David Sankoff,et al.  Comparison of musical sequences , 1990, Comput. Humanit..

[31]  Mark Sandler,et al.  Pitch Locking Monophonic Music Analysis , 2002 .

[32]  Kurt Stone,et al.  Music Notation in the Twentieth Century: A Practical Guidebook , 1980 .

[33]  Rajeev Raman,et al.  String-Matching techniques for musical similarity and melodic recognition , 1998 .

[34]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[35]  William P. Birmingham,et al.  Algorithms for Chordal Analysis , 2002, Computer Music Journal.

[36]  Arbee L. P. Chen,et al.  Music databases: indexing techniques and implementation , 1996, Proceedings of International Workshop on Multimedia Database Management Systems.

[37]  Christopher Raphael,et al.  Harmonic analysis with probabilistic graphical models , 2003, ISMIR.

[38]  Justin Zobel,et al.  Manipulation of music for melody matching , 1998, MULTIMEDIA '98.

[39]  Steven G. Blackburn.  Content Based Retrieval and Navigation of Music , 1999 .

[40]  Mohan S. Kankanhalli,et al.  Music scale modeling for melody matching , 2003, MULTIMEDIA '03.

[41]  Eleanor Selfridge-Field,et al.  Conceptual and representational issues in melodic comparison , 1998 .

[42]  Klaus Obermayer,et al.  A new method for tracking modulations in tonal music in audio data format , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[43]  Matthew J. Dovey.  A Technique for Regular Expression Style Searching in Polyphonic Music , 2001, ISMIR.

[44]  Kjell Lemström,et al.  Using Relative Interval Slope in Music Information Retrieval , 1999, ICMC.

[45]  Nicola Orio,et al.  Musical information retrieval using melodic surface , 1999, DL '99.

[46]  David Bainbridge.  The role of Music IR in the New Zealand Digital Music Library project , 2000, ISMIR.

[47]  Maxime Crochemore,et al.  Computing Evolutionary Chains in Musical Sequences , 2000, Electron. J. Comb..

[48]  Christopher Raphael,et al.  Automated Rhythm Transcription , 2001, ISMIR.

[49]  C. Roads,et al.  Grammars as Representations for Music , 1979 .

[50]  Roger B. Dannenberg,et al.  A Brief Survey of Music Representation Issues, Techniques, and Systems , 1993 .

[51]  H. Barlow,et al.  A dictionary of musical themes , 1975 .

[52]  J. Stephen Downie,et al.  Evaluating a simple approach to music information retrieval : conceiving melodic n-grams as text , 1999 .

[53]  Ronald E. Prather.  Harmonic analysis from the computer representation of a musical score , 1996, CACM.

[54]  Justin Zobel,et al.  Melodic matching techniques for large music databases , 1999, MULTIMEDIA '99.

[55]  Jorge Luis Borges,et al.  Tlon, Uqbar, Orbis Tertius , 1982 .

[56]  Chris Mellish,et al.  Statistical Learning of Harmonic Movement , 1999 .

[57]  Edward J. Coyle,et al.  Perceptual Issues in Music Pattern Recognition: Complexity of Rhythm and Key Finding , 2001, Comput. Humanit..

[58]  Kjell Lemström,et al.  Musical Information Retrieval Using Musical Parameters , 1998, ICMC.

[59]  W. Bruce Croft,et al.  The INQUERY Retrieval System , 1992, DEXA.

[60]  Brian Christopher Smith,et al.  Query by humming: musical information retrieval in an audio database , 1995, MULTIMEDIA '95.

[61]  Shyamala C. Doraisamy,et al.  An Approach Towards A Polyphonic Music Retrieval System , 2001, ISMIR.

[62]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[63]  Gerald Salton,et al.  Automatic text processing , 1988 .

[64]  Anssi Klapuri,et al.  Measuring the similarity of Rhythmic Patterns , 2002, ISMIR.

[65]  Juan Pablo Bello,et al.  Time-domain polyphonic transcription using self-generating databases , 2002 .