SEMI-AUTOMATED ANNOTATION AND RETRIEVAL OF DANCE MEDIA OBJECTS

This article considers a system for the semiautomatic annotation of an audio-visual media of dance domain, DMAR (Dance Media Annotation, authoring and Retrieval system). We present the architecture of the system, a manual annotation tool, a semiautomatic authoring tool and a search engine for the choreographers, dancers and students to demonstrate how the dance media can be semantically annotated and how this information can be used for the retrieval of the dance media objects. This article then outlines the underlying XML Schema based content description structures of DMAR and discusses the merits and demerits of our approach of evolving semantic network as the basis for the audio-visual content description. Further, this article proposes a quality metric, fidelity to evaluate the expressive power of the dance annotations. Finally, evaluation results are presented to depict the performance of the dance video queries in terms of precision and recall.

[1]  Tamas Ungvary,et al.  NUNTIUS: A Computer System for the Interactive Composition and Analysis of Music and Dance , 1992 .

[2]  Marios C. Angelides,et al.  COSMOS-7: A Video Content Modeling Framework for MPEG-7 , 2005, 11th International Multimedia Modelling Conference.

[3]  Les Carr,et al.  Decentering the dancing text: from dance intertext to hypertext , 2003, HYPERTEXT '03.

[4]  Balakrishnan Ramadoss,et al.  Modelling and Querying the Expressive Semantics of Dance Videos , 2006, J. Inf. Knowl. Manag..

[5]  Marios C. Angelides,et al.  Modeling Content for Semantic-Level Querying of Multimedia , 2004, Multimedia Tools and Applications.

[6]  Miguel Costa,et al.  Annotations as multiple perspectives of video content , 2002, MULTIMEDIA '02.

[7]  Murali Mani,et al.  Taxonomy of XML schema languages using formal language theory , 2005, TOIT.

[8]  Anoop Sarkar,et al.  Learning Verb Argument Structure from Minimally Annotated Corpora , 2002, COLING.

[9]  Glorianna Davenport,et al.  The Stratification System A Design Environment for Random Access Video , 2005 .

[10]  Kozaburo Hachimura,et al.  LabanEditor: Graphical editor for dance notation , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[11]  Alan P. Parkes Settings and the setting structure: the description and automated propagation of networks for perusing videodisk image states , 1989, SIGIR '89.

[12]  Don Herbison-Evans,et al.  Dance, Video, Notation and Computers , 2017 .

[13]  Forouzan Golshani,et al.  A Multimedia Information Repository for Cross Cultural Dance Studies , 2004, Multimedia Tools and Applications.

[14]  Glorianna Davenport,et al.  The Stratification System - A Design Emvironment for Random Access , 1992, NOSSDAV.

[15]  Balakrishnan Ramadoss,et al.  An Approach for Conceptual Modeling and Extracting Expressive Semantics from Dance Videos , 2004, CIT.

[16]  John Chapman,et al.  Notation of movement with computer assistance , 1978, ACM '78.

[17]  Don Herbison-Evans Waltzing on a KDF9 , 2001, J. Res. Pract. Inf. Technol..

[18]  Balakrishnan Ramadoss,et al.  Generic Modeling and Annotation of the Dance Video Semantics , 2006, The Sixth IEEE International Conference on Computer and Information Technology (CIT'06).

[19]  Ann Hutchinson,et al.  Labanotation : the system for recording movement , 1954 .

[20]  Yumi Sohn,et al.  MPEG-7 metadata authoring tool , 2002, MULTIMEDIA '02.

[21]  Balakrishnan Ramadoss,et al.  Aspects of Pervasive Computing for Web Based Learning , 2004, CIT.

[22]  Frank Nack,et al.  Saying What it Means: Semi-Automated (News) Media Annotation , 2004, Multimedia Tools and Applications.

[23]  George Politis,et al.  Computers and Dance: A Bibliography , 2017 .

[24]  Cécile Roisin,et al.  Multimedia modeling using MPEG-7 for authoring multimedia integration , 2003, MIR '03.

[25]  Balakrishnan Ramadoss,et al.  Semi-automatic annotation and MPEG-7 authoring of dance videos , 2006, CIKM '06.

[26]  Gerald Salton,et al.  Automatic text processing , 1988 .