A Virtual Reality Dance Training System Using Motion Capture Technology

In this paper, a new dance training system based on the motion capture and virtual reality (VR) technologies is proposed. Our system is inspired by the traditional way to learn new movements-imitating the teacher's movements and listening to the teacher's feedback. A prototype of our proposed system is implemented, in which a student can imitate the motion demonstrated by a virtual teacher projected on the wall screen. Meanwhile, the student's motions will be captured and analyzed by the system based on which feedback is given back to them. The result of user studies showed that our system can successfully guide students to improve their skills. The subjects agreed that the system is interesting and can motivate them to learn.

[1]  Nadia Magnenat-Thalmann,et al.  Learning How to Dance Using a Web 3D Platform , 2007, ICWL.

[2]  Evangelia Kavakli,et al.  Teaching Traditional Dance using E-learning tools: Experience from the WebDANCE project , 2007 .

[3]  Atsushi Nakazawa,et al.  Dancing‐to‐Music Character Animation , 2006, Comput. Graph. Forum.

[4]  Asako Soga,et al.  Automatic Composition for Contemporary Dance Using 3D Motion Clips: Experiment on Dance Training and System Evaluation , 2009, 2009 International Conference on CyberWorlds.

[5]  Loren Olson,et al.  A gesture-driven multimodal interactive dance system , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[6]  Yoshinori Kuno,et al.  Dance training system with active vibro-devices and a mobile image display , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Markus H. Gross,et al.  Combining body sensors and visual sensors for motion training , 2005, ACE '05.

[8]  Kozaburo Hachimura,et al.  Analysis and evaluation of dancing movement based on LMA , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[9]  M. Lepper,et al.  A desire to be taught: Instructional consequences of intrinsic motivation , 1992 .

[10]  Ruzena Bajcsy,et al.  Collaborative dancing in tele-immersive environment , 2006, MM '06.

[11]  Taku Komura,et al.  e-Learning Martial Arts , 2006, ICWL.

[12]  Gazihan Alankus,et al.  Automated motion synthesis for dancing characters: Motion Capture and Retrieval , 2005 .

[13]  Slobodan Kalajdziski,et al.  Augmented reality environment for dance learning , 2003, International Conference on Information Technology: Research and Education, 2003. Proceedings. ITRE2003..

[14]  Philo Tan Chua Rebecca Crivella Bo Daly Ning Hu Russ Sch Pausch.  Tai Chi : Training for Physical Tasks in Virtual Environments , 2002 .

[15]  Carolina Cruz-Neira,et al.  Cyclone Uppercut, a boxing game for an immersive environment , 2005, ACE '05.

[16]  M. Yoshimura,et al.  Quantification of characteristic features of Japanese dance for individuality recognition , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[17]  Woontack Woo,et al.  MIDAS: MIC Interactive DAnce System , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[18]  Ning Hu,et al.  Training for physical tasks in virtual environments: Tai Chi , 2003, IEEE Virtual Reality, 2003. Proceedings..

[19]  Sung Yong Shin,et al.  Rhythmic-motion synthesis based on motion-beat analysis , 2003, ACM Trans. Graph..

[20]  Nadia Bianchi-Berthouze,et al.  Modeling human affective postures: an information theoretic characterization of posture features , 2004, Comput. Animat. Virtual Worlds.

[21]  H. Tamura,et al.  A prototype dance training support system with motion capture and mixed reality technologies , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[22]  Gazihan Alankus,et al.  Automated motion synthesis for dancing characters , 2005, Comput. Animat. Virtual Worlds.