LibROSA Based Assessment Tool for Music Information Retrieval Systems

Music is possibly the most impactful bonding over the society and culture. The process of perusing the music in classrooms is considered as a costly affair for the humans in rural areas. Although the tutorials (i.e., video lectures) are usually available for free access in internet, the process of learning and evaluation yet depends on conventional teacher-student affair. So, the need for an automated tool designating the process of analysis cum assessment of music is formulated in the music eternity. This proposed model focuses on providing a solution for this use case exactly where the users can play notes or music pieces on a musical instrument (i.e., piano ) and followed by evaluating their performance against a chosen benchmark audio file, named as 'teacher' file. The technique considers various features such as loudness, tempo, rolloff frequency, kurtosis, skewness and centroid associated with piano for evaluation process. The model emphasizes towards to distinguish the characteristics of different keys and it was achieved with the help of Essentia onset function and LibROSA python package. The evaluation was carried through a set of stages such as normalization of features, pattern matching to extract an effective grading sheet of the played tune (i.e., 'Student' file). The drawbacks such as identification of the sequence of musical tones and noise onsets were avoided using a pattern matching framework, named as REMOVE_NOISY_ONSETS. The performance factor is fixed based on the notes that were missed by the user and the extra notes played by the user. Hence, this technique is of cutting-edge technology in the expertise of music education using technology trends. The proposed tool also helps people, those were deprived of learning the instrument of their choice by giving them an easy-to-use software tool to evaluate themselves and also give a lucid user interface to review their performance.

[1]  J. Stephen Downie,et al.  Music information retrieval , 2005, Annu. Rev. Inf. Sci. Technol..

[2]  Alexander Lerch,et al.  Assessment of Student Music Performances Using Deep Neural Networks , 2018 .

[3]  Mohan S. Kankanhalli,et al.  Exploring User-Specific Information in Music Retrieval , 2017, SIGIR.

[4]  Bruce Ferwerda,et al.  Predicting Genre Preferences from Cultural and Socio-Economic Factors for Music Retrieval , 2017, ECIR.

[5]  Jean-Pierre Martens,et al.  A comparison of human and automatic musical genre classification , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  Tao Wang,et al.  Music Information Retrieval System Using Lyrics and Melody Information , 2009, 2009 Asia-Pacific Conference on Information Processing.

[7]  Yueming Lu,et al.  A Music Retrieval System Using Melody and Lyric , 2012, 2012 IEEE International Conference on Multimedia and Expo Workshops.

[8]  Ehsanollah Kabir,et al.  A query-by-example music retrieval system using feature and decision fusion , 2018, Multimedia Tools and Applications.

[9]  Nicola Orio,et al.  User-Aware Music Retrieval , 2012, Multimodal Music Processing.

[10]  Markus Schedl,et al.  Music Information Retrieval: Recent Developments and Applications , 2014, Found. Trends Inf. Retr..

[11]  Bob L. Sturm A Simple Method to Determine if a Music Information Retrieval System is a “Horse” , 2014, IEEE Transactions on Multimedia.

[12]  Bo Zhang,et al.  A Music Retrieval Method Based on Hidden Markov Model , 2018, 2018 International Conference on Intelligent Transportation, Big Data & Smart City (ICITBS).

[13]  Daniele Quercia,et al.  Auralist: introducing serendipity into music recommendation , 2012, WSDM '12.

[14]  Augusto Sarti,et al.  A Dimensional Contextual Semantic Model for music description and retrieval , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Anssi Klapuri,et al.  Automatic Transcription of Melody, Bass Line, and Chords in Polyphonic Music , 2008, Computer Music Journal.

[16]  Marc Leman,et al.  Content-Based Music Information Retrieval: Current Directions and Future Challenges , 2008, Proceedings of the IEEE.

[17]  Ichiro Fujinaga,et al.  The potential for automatic assessment of trumpet tone quality , 2011, ISMIR.