Reuse, Remix, Repeat: the Workflows of MIR

Many solutions for the reuse and remixing of MIR methods and the tools implementing them have been introduced over recent years. Proposals for achieving the necessary interoperability have ranged from shared software libraries and interfaces, through common frameworks and portals, to standardised file formats and metadata. Each proposal shares the desire to reuse and combine repurposable components into assemblies (or “workflows”) that can be used in novel and possibly more ambitious ways. Reuse and remixing also have great implications for the process of MIR research. The encapsulation of any algorithm and its operation ‐ including inputs, parameters, and outputs ‐ is fundamental to the repeatability and reproducibility of any experiment. This is desirable both for the open and reliable evaluation of algorithms (e.g. in MIREX) and for the advancement of MIR by building more effectively upon prior research. At present there is no clear best practice widely adopted throughout the community. Should this be considered a failure? Are there limits to interoperability unique to MIR, and how might they be overcome? In this paper we assess contemporary MIR solutions to these issues, aligning them with the emerging notion of Research Objects for reproducible research in other domains, and propose their adoption as a route to reuse in MIR.

[1]  Susan Leigh Star,et al.  Institutional Ecology, `Translations' and Boundary Objects: Amateurs and Professionals in Berkeley's Museum of Vertebrate Zoology, 1907-39 , 1989 .

[2]  George Tzanetakis,et al.  MARSYAS: a framework for audio analysis , 1999, Organised Sound.

[3]  Andreas F. Ehmann,et al.  Music-to-knowledge (M2K): a prototyping and evaluation environment for music digital library research , 2005, Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '05).

[4]  Ichiro Fujinaga,et al.  Overview of OMEN , 2006, ISMIR.

[5]  Mark B. Sandler,et al.  The Sonic Visualiser: A Visualisation Platform for Semantic Descriptors from Musical Signals , 2006, ISMIR.

[6]  Yolanda Gil Workflow Composition: Semantic Representations for Flexible Automation , 2007, Workflows for e-Science, Scientific Workflows for Grids.

[7]  Petri Toiviainen,et al.  MIR in Matlab (II): A Toolbox for Musical Feature Extraction from Audio , 2007, ISMIR.

[8]  Jamie Bullock,et al.  Libxtract: a Lightweight Library for audio Feature Extraction , 2007, ICMC.

[9]  Mark B. Sandler,et al.  The Music Ontology , 2007, ISMIR.

[10]  Mathieu Lagrange,et al.  Interoperability and the MARSYAS 0.2 Runtime , 2008, ICMC.

[11]  Perry R. Cook,et al.  Support for MIR Prototyping and Real-Time Applications in the ChucK Programming Language , 2008, ISMIR.

[12]  Ge Wang,et al.  The chuck audio programming language. a strongly-timed and on-the-fly environ/mentality , 2008 .

[13]  Marc Leman,et al.  Content-Based Music Information Retrieval: Current Directions and Future Challenges , 2008, Proceedings of the IEEE.

[14]  J. Stephen Downie,et al.  Ten Years of ISMIR: Reflections on Challenges and Opportunities , 2009, ISMIR.

[15]  Ichiro Fujinaga,et al.  Using ACE XML 2.0 to Store and Share Feature, Instance and Class Data for Musical Classification , 2009, ISMIR.

[16]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[17]  Carole A. Goble,et al.  Why Linked Data is Not Enough for Scientists , 2010, eScience.

[18]  Christian Breiteneder,et al.  Features for Content-Based Audio Retrieval , 2010, Adv. Comput..

[19]  Mert Bay,et al.  The Networked Environment for Music Analysis (NEMA) , 2010, 2010 6th World Congress on Services.

[20]  Michael A. Casey,et al.  Investigating Music Collections at Different Scales with AudioDB , 2010 .

[21]  Carole A. Goble,et al.  Why Linked Data is Not Enough for Scientists , 2010, 2010 IEEE Sixth International Conference on e-Science.

[22]  Cory McKay,et al.  Automatic music classification with jmir , 2010 .

[23]  David De Roure,et al.  Semantics for Music Analysis through Linked Data: How Country is My Country? , 2010, 2010 IEEE Sixth International Conference on e-Science.

[24]  Oscar Corcho,et al.  Workflow-centric research objects: First class citizens in scholarly discourse. , 2012, ESWC 2012.