Avoiding staff removal stage in optical music recognition: application to scores written in white mensural notation

Staff detection and removal is one of the most important issues in optical music recognition (OMR) tasks since common approaches for symbol detection and classification are based on this process. Due to its complexity, staff detection and removal is often inaccurate, leading to a great number of errors in posterior stages. For this reason, a new approach that avoids this stage is proposed in this paper, which is expected to overcome these drawbacks. Our approach is put into practice in a case of study focused on scores written in white mensural notation. Symbol detection is performed by using the vertical projection of the staves. The cross-correlation operator for template matching is used at the classification stage. The goodness of our proposal is shown in an experiment in which our proposal attains an extraction rate of 96 % and a classification rate of 92 %, on average. The results found have reinforced the idea of pursuing a new research line in OMR systems without the need of the removal of staff lines.

[1]  Whoi-Yul Kim,et al.  Fast and efficient method for computing ART , 2006, IEEE Transactions on Image Processing.

[2]  Shang-Hong Lai,et al.  Fast Template Matching Based on Normalized Cross Correlation With Adaptive Multilevel Winner Update , 2008, IEEE Transactions on Image Processing.

[3]  Laurent Pugin,et al.  Optical Music Recognition of Early Typographic Prints using Hidden Markov Models , 2006 .

[4]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  J. P. Lewis,et al.  Fast Template Matching , 2009 .

[6]  Øivind Due Trier,et al.  Evaluation of Binarization Methods for Document Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Herbert Freeman,et al.  On the Encoding of Arbitrary Geometric Configurations , 1961, IRE Trans. Electron. Comput..

[8]  Laurent Pugin,et al.  Optical Music Recognitoin of Early Typographic Prints using Hidden Markov Models , 2006, ISMIR.

[9]  Shijian Lu,et al.  An Effective Staff Detection and Removal Technique for Musical Documents , 2012, 2012 10th IAPR International Workshop on Document Analysis Systems.

[10]  J. Sarvaiya,et al.  Image Registration by Template Matching Using Normalized Cross-Correlation , 2009, 2009 International Conference on Advances in Computing, Control, and Telecommunication Technologies.

[11]  John A. Hartigan,et al.  Clustering Algorithms , 1975 .

[12]  S. Stigler.  Francis Galton's Account of the Invention of Correlation , 1989 .

[13]  Carlos Guedes,et al.  Optical music recognition: state-of-the-art and open issues , 2012, International Journal of Multimedia Information Retrieval.

[14]  Mariusz Szwoch,et al.  A Robust Detector for Distorted Music Staves , 2005, CAIP.

[15]  Kenji Shoji,et al.  Symbol Recognition of Printed Piano Scores with Touching Symbols , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[16]  Frederick Jelinek,et al.  Statistical methods for speech recognition , 1997 .

[17]  David Cooper,et al.  Embracing the Composer: Optical Recognition of Handwritten Manuscripts , 1999, International Conference on Mathematics and Computing.

[18]  João Rogério Caldas Pinto,et al.  Ancient Music Recovery for Digital Libraries , 2000, ECDL.

[19]  Ernesto Bribiesca,et al.  A new chain code , 1999, Pattern Recognit..

[20]  Alicia Fornés,et al.  Staff and graphical primitive segmentation in old handwritten music scores , 2005, CCIA.

[21]  Keith E. Muller,et al.  Contrast-limited adaptive histogram equalization: speed and effectiveness , 1990, [1990] Proceedings of the First Conference on Visualization in Biomedical Computing.

[22]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[23]  Yung-Sheng Chen,et al.  An Optical Music Recognition System for skew or Inverted Musical scores , 2013, Int. J. Pattern Recognit. Artif. Intell..

[24]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[25]  Elena Deza,et al.  Encyclopedia of Distances , 2014 .

[26]  Umapada Pal,et al.  An Efficient Staff Removal Approach from Printed Musical Documents , 2010, 2010 20th International Conference on Pattern Recognition.

[27]  T ZahnCharles,et al.  Fourier Descriptors for Plane Closed Curves , 1972 .

[28]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[29]  Isabel Barbancho,et al.  Optical Music Recognition for Scores Written in White Mensural Notation , 2009, EURASIP J. Image Video Process..

[30]  João Miguel da Costa Sousa,et al.  A new graph-like classification method applied to ancient handwritten musical symbols , 2003, Document Analysis and Recognition.

[31]  Isabel Barbancho,et al.  Automatic selection of the region of interest in ancient scores , 2010, Melecon 2010 - 2010 15th IEEE Mediterranean Electrotechnical Conference.

[32]  Timothy C. Bell,et al.  The Challenge of Optical Music Recognition , 2001, Comput. Humanit..

[33]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[34]  F. Tajeripour,et al.  Staff detection and removal using derivation and connected component analysis , 2012, The 16th CSI International Symposium on Artificial Intelligence and Signal Processing (AISP 2012).