Immersive performance training tools using motion capture technology

Traditionally, students can undergo performance training by imitating teachers' motions and improving their moves by following teachers' advice. However, teachers are not always available and there is a lack of effective self-training tools. In this paper, we propose an immersive performance training system with motion capture technology. Our aim is to provide a virtual training environment for performance training. In the environment, the student's performance is analyzed by our system and a virtual teacher will give feedback for his/her improvement. As a result, the student can self-train and get feedback the same way as in a traditional performance training lesson. We will present our prototype implementation of a dance education system according to our design of immersive performance training system with motion capture technology.

[1]  Chien Chou,et al.  Construction of a virtual reality learning environment for teaching structural analysis , 1997 .

[2]  Carolina Cruz-Neira,et al.  Cyclone Uppercut, a boxing game for an immersive environment , 2005, ACE '05.

[3]  M. Yoshimura,et al.  Quantification of characteristic features of Japanese dance for individuality recognition , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[4]  Ning Hu,et al.  Training for physical tasks in virtual environments: Tai Chi , 2003, IEEE Virtual Reality, 2003. Proceedings..

[5]  Frederic D. McKenzie,et al.  Training in Peacekeeping Operations Using Virtual Environments , 2004, IEEE Computer Graphics and Applications.

[6]  Yoshinori Kuno,et al.  Dance training system with active vibro-devices and a mobile image display , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Markus H. Gross,et al.  Combining body sensors and visual sensors for motion training , 2005, ACE '05.

[8]  H. Tamura,et al.  A prototype dance training support system with motion capture and mixed reality technologies , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[9]  Ruzena Bajcsy,et al.  Collaborative dancing in tele-immersive environment , 2006, MM '06.

[10]  Kozaburo Hachimura,et al.  Analysis and evaluation of dancing movement based on LMA , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..