Automatic Handwritten Mensural Notation Interpreter: From Manuscript to MIDI Performance

This paper presents a novel automatic recognition framework for hand-written mensural music. It takes a scanned manuscript as input and yields as output modern music scores. Compared to the previous mensural Optical Music Recognition (OMR) systems, ours shows not only promising performance in music recognition, but also works as a complete pipeline which integrates both recognition and transcription. There are three main parts in this pipeline: i) region-ofinterest detection, ii) music symbol detection and classification, and iii) transcription to modern music. In addition to the output in modern notation, our system can generate a MIDI file as well. It provides an easy platform for the musicologists to analyze old manuscripts. Moreover, it renders these valuable cultural heritage resources available to non-specialists as well, as they can now access such ancient music in a better understandable form.

[1]  Christopher Ariza,et al.  Music21: A Toolkit for Computer-Aided Musicology and Symbolic Music Data , 2010, ISMIR.

[2]  Ichiro Fujinaga,et al.  Using the Gamera framework for the recognition of cultural heritage materials , 2002, JCDL '02.

[3]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[4]  Jun Ohya,et al.  Symbol Classification Approach for OMR of Square Notation Manuscripts , 2010, ISMIR.

[5]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[6]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[7]  Thomas Mensink,et al.  Improving the Fisher Kernel for Large-Scale Image Classification , 2010, ECCV.

[8]  Luc Van Gool,et al.  Automatic Stave Discovery for Musical Facsimiles , 2012, ACCV.

[9]  Andrew Zisserman,et al.  The devil is in the details: an evaluation of recent feature encoding methods , 2011, BMVC.

[10]  Tim Crawford,et al.  Evaluating OMR on the Early Music Online Collection , 2013, International Society for Music Information Retrieval Conference.

[11]  Ichiro Fujinaga,et al.  Gamera Versus Aruspix: Two Optical Music Recognition Approaches , 2008, ISMIR.

[12]  Ichiro Fujinaga,et al.  Gamera: Optical music recognition in a new shell , 2002, ICMC.

[13]  Ana M. Barbancho,et al.  Avoiding staff removal stage in optical music recognition: application to scores written in white mensural notation , 2015, Pattern Analysis and Applications.