BalOnSe: Ballet Ontology for Annotating and Searching Video performances

In this paper we present BalOnSe (named after the ballet step balance), an ontology-based web interface that allows the user to annotate classical ballet videos, with a hierarchical domain specific vocabulary and provides an archival system for videos of dance. The interface integrates a hierarchical vocabulary based on classical ballet syllabus terminology (Ballet.owl) implemented as an OWL-2 ontology. BalOnSe supports the search and browsing of the multimedia content using metadata (title, dancer featured, etc.), and also implements the functionality of "searching by movement concepts", i.e., filtering the videos that are associated with particular required terms of the vocabulary, based on previous submitted annotations. In the paper, we present the ballet.owl ontology, and its structure, explaining the conceptual modeling decisions. We highlight the main functionality of the system and finally, we present how the manual ontology guided annotation allows the user to search the content through the vocabularies and also view statistics in the form of tag clouds.

[1]  Ann Hutchinson Guest.  Labanotation: The System of Analyzing and Recording Movement , 1987 .

[2]  Ann Hutchinson Guest.  Seven Basic Movements in Dancing , 1995 .

[3]  Balakrishnan Chandrasekaran,et al.  What are ontologies, and why do we need them? , 1999, IEEE Intell. Syst..

[4]  Alberto Del Bimbo,et al.  Enhanced ontologies for video annotation and retrieval , 2005, MIR '05.

[5]  Balakrishnan Ramadoss,et al.  SEMI-AUTOMATED ANNOTATION AND RETRIEVAL OF DANCE MEDIA OBJECTS , 2007, Cybern. Syst..

[6]  Balakrishnan Ramadoss,et al.  Modeling the Dance Video Annotations , 2007, 2006 1st International Conference on Digital Information Management.

[7]  Michael Neff,et al.  An annotation scheme for conversational gestures: how to economically capture timing and form , 2007, Lang. Resour. Evaluation.

[8]  R. Ralph.  Dance Research: The Journal of the Society for Dance Research , 2007 .

[9]  Balakrishnan Ramadoss,et al.  Semantic Modeling and Retrieval of Dance Video Annotations , 2010, ArXiv.

[10]  Yannis E. Ioannidis,et al.  A Labanotation Based Ontology for Representing Dance Movement , 2011, Gesture Workshop.

[11]  Celine Latulipe,et al.  The choreographer's notebook: a video annotation system for dancers and choreographers , 2011, C&C '11.

[12]  Georgios Kouroupetroglou,et al.  Gesture and Sign Language in Human-Computer Interaction and Embodied Communication , 2012, Lecture Notes in Computer Science.

[13]  Saïd Mahmoudi,et al.  An Ontology for video human movement representation based on Benesh notation , 2012, 2012 International Conference on Multimedia Computing and Systems.

[14]  Diogo Cabral,et al.  Evaluation of a multimodal video annotator for contemporary dance , 2012, AVI.

[15]  Yannis E. Ioannidis,et al.  From Dance Notation to Conceptual Models: A Multilayer Approach , 2014, MOCO.