A syntactical modeling and classification for performance evaluation of Bali traditional dance

This paper presents a linguistically motivated approach for dance gesture performance evaluation using skeleton tracking to robustly classify arbitrary dance gesture into one of predefined gesture classes and provide performance score in regards to the dance master's gesture. The gesture class in this study is a set common gesture of Bali traditional dances. The dance gesture is represented as a set of skeleton feature descriptors that are extracted from images captured using Kinect depth sensor. A set of rules are learned from the training examples to capture the structure of the gesture motion using grammar inference method. The empiric results showed that elbow and foot of dance performer are the most discriminative features for representing dance gesture of Bali traditional dance. Probabilistic and deterministic grammars achieved 0.92 and 0.95 of average precision for recognizing the tested dance gestures.

[1]  Li Wei,et al.  Experiencing SAX: a novel symbolic representation of time series , 2007, Data Mining and Knowledge Discovery.

[2]  Mathias Kölsch,et al.  The Enhancement of Low-Level Classifications for Ambient Assisted Living , 2008, BMI.

[3]  Imran Khan,et al.  Different Approaches in Pattern Recognition , 2012 .

[4]  José Oncina,et al.  Learning deterministic regular grammars from stochastic samples in polynomial time , 1999, RAIRO Theor. Informatics Appl..

[5]  Noel E. O'Connor,et al.  Evaluating a dancer's performance using kinect-based skeleton tracking , 2011, ACM Multimedia.

[6]  Kevin J. Lang Random DFA's can be approximately learned from sparse uniform examples , 1992, COLT '92.

[7]  Noel E. O'Connor,et al.  Enhanced visualisation of dance performance from automatically synchronised multimodal recordings , 2011, ACM Multimedia.

[8]  Eamonn J. Keogh A decade of progress in indexing and mining large time series databases , 2006, VLDB.

[9]  E. Mark Gold,et al.  Language Identification in the Limit , 1967, Inf. Control..

[10]  Barak A. Pearlmutter,et al.  Results of the Abbadingo One DFA Learning Competition and a New Evidence-Driven State Merging Algorithm , 1998, ICGI.

[11]  Noel E. O'Connor,et al.  An advanced virtual dance performance evaluator , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[13]  Darko Kirovski,et al.  Real-time classification of dance gestures from skeleton animation , 2011, SCA '11.

[14]  J. Oncina,et al.  INFERRING REGULAR LANGUAGES IN POLYNOMIAL UPDATED TIME , 1992 .

[15]  Irfan A. Essa,et al.  Recognizing multitasked activities from video using stochastic context-free grammar , 2002, AAAI/IAAI.

[16]  R. Sokal,et al.  THE COMPARISON OF DENDROGRAMS BY OBJECTIVE METHODS , 1962 .