Extraction of key postures from 3D human motion data for choreography summarization

Modelling and digitizing performing arts through motion capturing interfaces is an important aspect for the analysis, processing and documentation of intangible cultural heritage assets. However, existing modelling approaches may involve huge amounts of information which are difficult to process, store and analyze. To address these limitations, usually a skeleton describing the dancer motion is extracted. However, often the complexity still remains due to the high spatio-temporal dependencies of the detected skeleton joints. In this paper, an alternative approach is presented: choreography summarization. This means that a very small number of image frames are extracted to represent a choreography, thus significantly reducing the processing and storage complexity. In our approach the problem of choreography summarization is treated as an unsupervised clustering approach. Evaluation indices are introduced for monitoring the summarization performance. Experimental results on real-life dancing performances verifies the capability of the proposed method to capture the main patterns of a choreography with a very small number of trajectory points.

[1]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[2]  Athanasios Voulodimos,et al.  Transforming Intangible Folkloric Performing Arts into Tangible Choreographic Digital Objects: The Terpsichore Approach , 2017, VISIGRAPP.

[3]  Yuichi Iwadate,et al.  3D Archive System for Traditional Performing Arts , 2011, International Journal of Computer Vision.

[4]  Nikolaos D. Doulamis,et al.  Non-sequential multiscale content-based video decomposition , 2005, Signal Process..

[5]  Nikos Nikolaidis,et al.  Action recognition on motion capture data using a dynemes and forward differences representation , 2014, J. Vis. Commun. Image Represent..

[6]  Alexandra Pfister,et al.  Comparative abilities of Microsoft Kinect and Vicon 3D motion capture for gait analysis , 2014, Journal of medical engineering & technology.

[7]  Nikolaos Grammalidis,et al.  Dance analysis using multiple Kinect sensors , 2016, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[8]  Bernard Desgraupes Clustering Indices , 2016 .

[9]  Yuan Yan Tang,et al.  Efficient Human Motion Retrieval via Temporal Adjacent Bag of Words and Discriminative Neighborhood Preserving Dictionary Learning , 2017, IEEE Transactions on Human-Machine Systems.

[10]  Andreas Aristidou,et al.  Folk Dance Evaluation Using Laban Movement Analysis , 2015, JOCCH.

[11]  Nikolaos Doulamis,et al.  A LOW-COST MARKERLESS TRACKING SYSTEM FOR TRAJECTORYINTERPRETATION , 2017 .

[12]  Noel E. O'Connor,et al.  Evaluating a dancer's performance using kinect-based skeleton tracking , 2011, ACM Multimedia.

[13]  Stefanos D. Kollias,et al.  Efficient summarization of stereoscopic video sequences , 2000, IEEE Trans. Circuits Syst. Video Technol..

[14]  Gregor Strle,et al.  Ethnomuse: Archiving folk music and dance culture , 2009, IEEE EUROCON 2009.

[15]  Howard Leung,et al.  Interactive dancing game with real-time recognition of continuous dance moves from 3D human motion capture , 2011, ICUIMC '11.

[16]  Klara Nahrstedt,et al.  Advancing interactive collaborative mediums through tele-immersive dance (TED): a symbiotic creativity and design environment for art and computer science , 2008, ACM Multimedia.

[17]  Seongmin Baek,et al.  Motion Capture of the Human Body Using Multiple Depth Sensors , 2017 .

[18]  Atsushi Nakazawa,et al.  Dancing‐to‐Music Character Animation , 2006, Comput. Graph. Forum.

[19]  Nikos Grammalidis,et al.  Classification of Multidimensional Time-Evolving Data Using Histograms of Grassmannian Points , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Marinos Ioannides,et al.  In the wild image retrieval and clustering for 3D cultural heritage landmarks reconstruction , 2014, Multimedia Tools and Applications.

[21]  E. Protopapadakis,et al.  FOLK DANCE PATTERN RECOGNITION OVER DEPTH IMAGES ACQUIRED VIA KINECT SENSOR , 2017 .