Classical Music on the Web - User Interfaces and Data Representations

We present a set of web-based user interfaces for explorative analysis and visualization of classical orchestral music and a web API that serves as a backend to those applications; we describe use cases that motivated our developments within the PHENICX project, which promotes a vital interaction between Music Information Retrieval research groups and a world-renowned symphony orchestra. Furthermore, we describe two real-world applications that involve the work presented here. Firstly, our web applications are used in the editorial stage of a periodically released subscription-based mobile app by the Royal Concertgebouw Orchestra (RCO) 1 , which serves as a contentdistribution channel for multi-modally enhanced recordings of classical concerts. Secondly, our web API and user interfaces have been successfully used to provide real-time information (such as the score, and explanatory comments from musicologists) to the audience during a live concert of the RCO.

[1]  Meinard Müller,et al.  Freischütz Digital: A Case Study for Reference-Based Audio Segmentation for Operas , 2013, ISMIR.

[2]  Meinard Müller,et al.  Lyrics-Based Audio Retrieval and Multimodal Navigation in Music Collections , 2007, ECDL.

[3]  Cynthia C. S. Liem,et al.  Innovating the Classical Music Experience in the PHENICX Project : Use Cases and Initial User Feedback , 2013 .

[4]  Gregory Burlet,et al.  Optical Measure Recognition in Common Music Notation , 2013, ISMIR.

[5]  Gerhard Widmer,et al.  Artificial Intelligence in the Concertgebouw , 2015, IJCAI.

[6]  Gerhard Widmer,et al.  MATCH: A Music Alignment Tool Chest , 2005, ISMIR.

[7]  Meinard Müller,et al.  Freischutz digital: A multimodal scenario for informed music processing , 2013, 2013 14th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS).

[8]  Meinard Müller,et al.  Linking Sheet Music and Audio - Challenges and New Approaches , 2012, Multimodal Music Processing.

[9]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[10]  Werner Goebl,et al.  Visualizing Expressive Performance in Tempo—Loudness Space , 2003, Computer Music Journal.

[11]  Mark B. Sandler,et al.  The Music Ontology , 2007, ISMIR.

[12]  Emilia Gómez,et al.  Hierarchical multi-scale set-class analysis , 2015 .

[13]  Gerhard Widmer,et al.  Automatic Alignment of Music Performances with Structural Differences , 2013, ISMIR.

[14]  Reinhard Kopiez,et al.  REALTIME ANALYSIS OF DYNAMIC SHAPING , 2000 .

[15]  Ichiro Fujinaga,et al.  The Music Encoding Initiative as a Document-Encoding Framework , 2011, ISMIR.