Training for physical tasks in virtual environments: Tai Chi

We present a wireless virtual reality system and a prototype full body Tai Chi training application. Our primary contribution is the creation of a virtual reality system that tracks the full body in a working volume of 4 meters by 5 meters by 2.3 meters high to produce an animated representation of the user with 42 degrees of freedom. This - combined with a lightweight (<3 pounds) belt-worn video receiver and head-mounted display - provides a wide area, untethered virtual environment that allows exploration of new application areas. Our secondary contribution is our attempt to show that user interface techniques made possible by such a system can improve training for a full body motor task. We tested several immersive techniques, such as providing multiple copies of a teacher's body positioned around the student and allowing the student to superimpose his body directly over the virtual teacher None of these techniques proved significantly better than mimicking traditional Tai Chi instruction, where we provided one virtual teacher directly in front of the student. We consider the implications of these findings for future motion training tasks.

[1]  Alex Pentland,et al.  The ALIVE system: wireless, full-body interaction with autonomous agents , 1997, Multimedia Systems.

[2]  WelchGreg,et al.  High-Performance Wide-Area Optical Tracking , 2001 .

[3]  J. Y. Ruisseau,et al.  Learning and Training Simulator Virtual Reality Development for Parachute Descent , 2000 .

[4]  Sung Yong Shin,et al.  General Construction of Time-Domain Filters for Orientation Data , 2002, IEEE Trans. Vis. Comput. Graph..

[5]  Bernard D. Adelstein,et al.  Sensor spatial distortion, visual latency, and update rate effects on 3D tracking in virtual environments , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[6]  Sudhanshu Kumar Semwal,et al.  Mapping Algorithms for Real-Time Control of an Avatar Using Eight Sensors , 1998, Presence.

[7]  James W. Davis,et al.  Virtual PAT: A Virtual Personal Aerobics Trainer , 1998 .

[8]  Daniel Thalmann,et al.  A real time anatomical converter for human motion capture , 1996 .

[9]  David L. Tate,et al.  Virtual environments for shipboard firefighting training , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[10]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[11]  Greg Welch,et al.  Welch & Bishop , An Introduction to the Kalman Filter 2 1 The Discrete Kalman Filter In 1960 , 1994 .

[12]  S. Datta,et al.  Tai Chi for the Prevention of Fractures in a Nursing Home Population: An Economic Analysis , 2001 .

[13]  J. Molner,et al.  Immersion of a live individual combatant into a virtual battlespace , 1997, 14th Annual AESS/IEEE Dayton Section Symposium. Synthetic Visualization: Systems and Applications.

[14]  Chris Shaw,et al.  Firefighter training virtual environment , 2002, SIGGRAPH '02.

[15]  Ravin Balakrishnan,et al.  Reaching for objects in VR displays: lag and frame rate , 1994, TCHI.

[16]  Soon Ki Jung,et al.  Synthesis of Human Motion Using Kalman Filter , 1998, CAPTECH.

[17]  Gerard Jounghyun Kim,et al.  Implementation and Evaluation of Just Follow Me: An Immersive, VR-Based, Motion-Training System , 2002, Presence: Teleoperators & Virtual Environments.

[18]  M. Matarić,et al.  Evaluation Metrics and Results of Human Arm Movement Imitation , 2000 .

[19]  Norman I. Badler,et al.  Real-Time Control of a Virtual Human Using Minimal Sensors , 1993, Presence: Teleoperators & Virtual Environments.

[20]  Daniel Thalmann,et al.  Interacting with Virtual Humans through Body Actions , 1998, IEEE Computer Graphics and Applications.

[21]  M. Matarić,et al.  Fixation behavior in observation and imitation of human movement. , 1998, Brain research. Cognitive brain research.

[22]  Gabriele Wulf,et al.  Continuous Concurrent Feedback Degrades Skill Learning: Implications for Training and Simulation , 1997, Hum. Factors.

[23]  Greg Welch,et al.  High-Performance Wide-Area Optical Tracking: The HiBall Tracking System , 2001, Presence: Teleoperators & Virtual Environments.

[24]  Mary C. Whitton,et al.  Walking > walking-in-place > flying, in virtual environments , 1999, SIGGRAPH.