Real-Time Recognition of Body Motion for Virtual Dance Collaboration System

A method of real-time recognition of body motion for virtual dance collaboration system is described. Fourteen feature values are extracted from motion captured body motion data, and the dimension of data is reduced by using principal component analysis (PCA). In the training phase, templates for motion recognition are constructed from training samples of several types of motion. In the recognition phase, feature values obtained from a real dancer's motion data are projected to the subspace obtained by PCA, and the system recognizes the real dancer's motion by comparing with the motion templates. In this paper, the method and the experiments using seven kinds of basic motions are presented. The recognition experiment proved that the method could be used for motion recognition. A preliminary experiment in which a real dancer and a virtual dancer collaborate with body motion was also carried out.

[1]  Kozaburo Hachimura,et al.  Analysis and evaluation of dancing movement based on LMA , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[2]  Hui Gao,et al.  Gender Recognition from Walking Movements using Adaptive Three-Mode PCA , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[3]  Frédéric Bevilacqua,et al.  3D motion capture data: motion analysis and mapping to music , 2002 .

[4]  Gerard Jounghyun Kim,et al.  Implementation and Evaluation of Just Follow Me: An Immersive, VR-Based, Motion-Training System , 2002, Presence: Teleoperators & Virtual Environments.

[5]  Loren Olson,et al.  A gesture-driven multimodal interactive dance system , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[6]  Loren Olson,et al.  Movement-based interactive dance performance , 2006, MM '06.

[7]  Woong Choi,et al.  CG Restoration of a Historical Noh Stage and Its Use for Edutainment , 2006, VSMM.

[8]  Kozaburo Hachimura,et al.  LabanEditor: Graphical editor for dance notation , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[9]  Daniel Thalmann,et al.  Interacting with Virtual Humans through Body Actions , 1998, IEEE Computer Graphics and Applications.

[11]  Kozaburo Hachimura,et al.  Method of generating coded description of human body motion from motion-captured data , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[12]  Mamoru Mitsuishi,et al.  A remote surgery experiment between Japan-Korea using the minimally invasive surgical system , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[13]  Andreas Daffertshofer,et al.  Principal components analysis of contemporary dance kinematics , 2004 .

[14]  Hank Kaczmarski,et al.  Tele-sports and tele-dance: full-body network interaction , 2003, VRST '03.

[15]  Chris Gunn,et al.  Combating Latency in Haptic Collaborative Virtual Environments , 2005, Presence: Teleoperators & Virtual Environments.

[16]  Cagatay Basdogan,et al.  Virtual environments for medical training: graphical and haptic simulation of laparoscopic common bile duct exploration , 2001 .