Scalable Searching and Ranking for Melodic Pattern Queries

We present the design and implementation of a scalable search engine for large Digital Score Libraries. It covers the core features expected from an information retrieval system. Music representation is pre-processed, simplified and normalized. Collections are searched for scores that match a melodic pattern, results are ranked on their similarity with the pattern, and matching fragments are finally identified on the fly. Moreover, all these features are designed to be integrated in a standard search engine and thus benefit from the horizontal scalability of such systems. Our method is fully implemented, and relies on ELASTICSEARCH for collection indexing. We describe its main components, report and study its performances.

[1]  Günter Lettl,et al.  Isometries of the Space of Convex Bodies in Euclidean Space , 1980 .

[2]  J. Prince,et al.  Contributions of pitch contour, tonality, rhythm, and meter to melodic similarity. , 2014, Journal of experimental psychology. Human perception and performance.

[3]  Stefan M. Rüger,et al.  A Polyphonic Music Retrieval System Using N-Grams , 2004, ISMIR.

[4]  David Maier,et al.  The Complexity of Some Problems on Subsequences and Supersequences , 1978, JACM.

[5]  Maxime Crochemore,et al.  A Pattern Extraction Algorithm for Abstract Melodic Representations that Allow Partial Overlapping of Intervallic Categories , 2005, ISMIR.

[6]  Hanan Samet,et al.  Foundations of multidimensional and metric data structures , 2006, Morgan Kaufmann series in data management systems.

[7]  Simon Dixon,et al.  Two Web Applications for Exploring Melodic Patterns in Jazz Solos , 2018, ISMIR.

[8]  Andreas F. Ehmann,et al.  Human Similarity Judgments: Implications for the Design of Formal Evaluations , 2007, ISMIR.

[9]  Costas S. Iliopoulos,et al.  Approximate string matching for music analysis , 2004, Soft Comput..

[10]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[11]  J. Stephen Downie,et al.  Evaluating a simple approach to music information retrieval : conceiving melodic n-grams as text , 1999 .

[12]  Nicolas Travers.  Putting into Practice: Full-Text Indexing with LUCENE , 2012 .

[13]  Eamonn Keogh.  Exact Indexing of Dynamic Time Warping , 2002, VLDB.

[14]  Camélia Constantin,et al.  The Melodic Signature Index for Fast Content-based Retrieval of Symbolic Scores Camelia Constantin , 2011, ISMIR.

[15]  Perry Roland,et al.  The Music Encoding Initiative ( MEI ) , 2002 .

[16]  Eleanor Selfridge-Field,et al.  The virtual score : representation, retrieval, restoration , 2001 .

[17]  Bin Feng,et al.  Research and Implementation of the Small-Scale Search Engine Based on Lucene , 2008, 2008 International Conference on Computer Science and Software Engineering.

[18]  Ian Knopke,et al.  The PerlHumdrum and PerlLilypond Toolkits for Symbolic Music Information Retrieval , 2008, ISMIR.

[19]  Remco C. Veltkamp,et al.  Using transportation distances for measuring melodic similarity , 2003, ISMIR.

[20]  Mauro Vallati,et al.  Symbolic Melodic Similarity: State of the Art and Future Challenges , 2016, Computer Music Journal.

[21]  Domenico Cantone,et al.  SOLVING THE ( α , δ )-APPROXIMATE MATCHING PROBLEM UNDER TRANSPOSITION INVARIANCE IN MUSICAL SEQUENCES , 2003 .

[22]  L. Bergroth,et al.  A survey of longest common subsequence algorithms , 2000, Proceedings Seventh International Symposium on String Processing and Information Retrieval. SPIRE 2000.

[23]  Godfried T. Toussaint,et al.  A Comparison of Rhythmic Similarity Measures , 2004, ISMIR.

[24]  Philippe Pasquier,et al.  The Significance of the Low Complexity Dimension in Music Similarity Judgements , 2017, ISMIR.

[25]  Andreas Kornstädt,et al.  Themefinder: A web-based melodic search tool , 1998 .

[26]  Domenico Cantone,et al.  Efficient Algorithms for the delta-Approximate String Matching Problem in Musical Sequences , 2004, Stringology.

[27]  Hewijin Christine Jiau,et al.  An Efficient Numeric Indexing Technique for Music Retrieval System , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[28]  Lutz Prechelt,et al.  An interface for melody input , 2001, TCHI.

[29]  Marc Leman,et al.  Content-Based Music Information Retrieval: Current Directions and Future Challenges , 2008, Proceedings of the IEEE.

[30]  Craig Stuart Sapp,et al.  Search Effectiveness Measures for Symbolic Music Queries in Very Large Databases , 2004, ISMIR.

[31]  Nicola Orio,et al.  Indexing and Retrieval of Music Documents through Pattern Analysis and Data Fusion Techniques , 2004, ISMIR.