Capturing and Indexing Rehearsals: The Design and Usage of a Digital Archive of Performing Arts

Preserving the cultural heritage of the performing arts raises difficult and sensitive issues, as each performance is unique by nature and the juxtaposition between the performers and the audience cannot be easily recorded. In this paper, we report on an experimental research project to preserve another aspect of the performing arts-the history of their rehearsals. We have specifically designed non-intrusive video recording and onsite documentation techniques to make this process transparent to the creative crew, and have developed a complete workflow to publish the recorded video data and their corresponding metadata online as Open Data using state-of-the-art audio and video processing to maximize non-linear navigation and hypervideo linking. The resulting open archive is made publicly available to researchers and amateurs alike and offers a unique account of the inner workings of the worlds of theater and opera.

[1]  Matthew Reason,et al.  Documentation, Disappearance and the Representation of Live Performance , 2006 .

[2]  Rémi Ronfard,et al.  Detecting and Naming Actors in Movies Using Generative Appearance Models , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Ruben Verborgh,et al.  Weaving the Web(VTT) of Data , 2014, LDOW.

[4]  Jean-François Bonastre,et al.  ALIZE, a free toolkit for speaker recognition , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[5]  Rik Van de Walle,et al.  Experiencing standardized media fragment annotations within HTML5 , 2012, Multimedia Tools and Applications.

[6]  Rik Van de Walle,et al.  Querying Datasets on the Web with High Availability , 2014, SEMWEB.

[7]  Yannick Prié,et al.  Curtains Up! Lights, Camera, Action! Documenting the Creation of Theater and Opera Productions with Linked Data and Web Technologies , 2015, ICWE.

[8]  Tim Berners-Lee,et al.  Linked data , 2020, Semantic Web for the Working Ontologist.

[9]  Rémi Ronfard,et al.  Audiovisual-based hypermedia authoring: using structured representations for efficient access to AV documents , 1999, HYPERTEXT '99.

[10]  C. V. Jawahar,et al.  Subtitle-free Movie to Script Alignment , 2009, BMVC.

[11]  Ian E. Smith,et al.  HyperCafe: narrative and aesthetic properties of hypervideo , 1996, HYPERTEXT '96.

[12]  Tim Berners-Lee,et al.  WorldWideWeb : proposal for a HyperText Project , 1990 .

[13]  Enrico Terrone On Time in Cinema , 2017 .

[14]  Tim Berners-Lee,et al.  Linked Data - The Story So Far , 2009, Int. J. Semantic Web Inf. Syst..

[15]  Morag Styles,et al.  CONVERSATION , 2005, Out of Nowhere.

[16]  Jean Carrive,et al.  Multimedia applications for playing with digitized theater performances , 2013, Multimedia Tools and Applications.

[17]  Nestor Fernando Bravo Filming Theater: The Audiovisual Documentation as a Substitute of the Performance , 2007 .

[18]  Rémi Ronfard,et al.  Multi-clip video editing from a single viewpoint , 2014, CVMP.

[19]  E. Prud hommeaux,et al.  SPARQL query language for RDF , 2011 .