How current optical music recognition systems are becoming useful for digital libraries

Optical Music Recognition (OMR) promises to make large collections of sheet music searchable by their musical content. It would open up novel ways of accessing the vast amount of written music that has never been recorded before. For a long time, OMR was not living up to that promise, as its performance was simply not good enough, especially on handwritten music or under non-ideal image conditions. However, OMR has recently seen a number of improvements, mainly due to the advances in machine learning. In this work, we take an OMR system based on the traditional pipeline and an end-to-end system, which represent the current state of the art, and illustrate in proof-of-concept experiments their applicability in retrieval settings. We also provide an example of a musicological study that can be replicated with OMR outputs at much lower costs. Taken together, this indicates that in some settings, current OMR can be used as a general tool for enriching digital libraries.

[1]  Liang Chen,et al.  MIDI-assisted egocentric optical music recognition , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[2]  Meinard Müller,et al.  Matching Musical Themes based on noisy OCR and OMR input , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Wendy Liu,et al.  Digital Document Image Retrieval Using Optical Music Recognition , 2012, ISMIR.

[4]  David Rizo,et al.  Symbolic music comparison with tree data structures , 2010 .

[5]  Matthew J. Dovey Overview of the OMRAS project: Online music retrieval and searching , 2004, J. Assoc. Inf. Sci. Technol..

[6]  Lior Shamir,et al.  Computer analysis of similarities between albums in popular music , 2014, Pattern Recognit. Lett..

[7]  Jorge Calvo-Zaragoza,et al.  End-to-End Neural Optical Music Recognition of Monophonic Scores , 2018 .

[8]  Alicia Fornés,et al.  CVC-MUSCIMA: a ground truth of handwritten music score images for writer identification and staff removal , 2012, International Journal on Document Analysis and Recognition (IJDAR).

[9]  Alan Marsden Interrogating Melodic Similarity: A Definitive Phenomenon or the Product of Interpretation? , 2012 .

[10]  Ichiro Fujinaga,et al.  PatternFinder: Content-Based Music Retrieval with music21 , 2017, DLfM.

[11]  J. M. Troost,et al.  Ascending and Descending Melodic Intervals: Statistical Findings and Their Perceptual Relevance , 1989 .

[12]  Pavel Pecina,et al.  The MUSCIMA++ Dataset for Handwritten Optical Music Recognition , 2017, 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR).

[13]  Florence March,et al.  2016 , 2016, Affair of the Heart.

[14]  Meinard Müller,et al.  Automatic Mapping of Scanned Sheet Music to Audio Recordings , 2008, ISMIR.

[15]  Horst M. Eidenberger,et al.  Towards Self-Learning Optical Music Recognition , 2017, 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA).

[16]  Jorge Calvo-Zaragoza,et al.  Camera-PrIMuS: Neural End-to-End Optical Music Recognition on Realistic Monophonic Scores , 2018, ISMIR.

[17]  Ichiro Fujinaga,et al.  Optical Music Recognition System within a Large-Scale Digitization Project , 2000, ISMIR.

[18]  Gerhard Widmer,et al.  Learning Audio-Sheet Music Correspondences for Score Identification and Offline Alignment , 2017, ISMIR.

[19]  Meinard Müller,et al.  Handling Scanned Sheet Music and Audio Recordings in Digital Music Libraries , 2009 .

[20]  Julián Urbano,et al.  MIREX 2013 Symbolic Melodic Similarity: A Geometric Model supported with Hybrid Sequence Alignment , 2013 .

[21]  Frank Kurth,et al.  The Probado Music Repository at the Bavarian State Library , 2007, ISMIR.

[22]  Gerhard Widmer,et al.  Towards Full-Pipeline Handwritten OMR with Musical Symbol Detection by U-Nets , 2018, ISMIR.

[23]  Carlos Guedes,et al.  Optical music recognition: state-of-the-art and open issues , 2012, International Journal of Multimedia Information Retrieval.

[24]  Ichiro Fujinaga,et al.  Introduction to SIMSSA (Single Interface for Music Score Searching and Analysis) , 2014, DLfM '14.