Onebody: Remote Posture Guidance System using First Person View in Virtual Environment

We present Onebody, a virtual reality system for remote posture guidance during sports or physical activity training, such as martial arts, yoga or dance, using first person perspective. The system uses skeletal tracking of the instructor and the students, rendered as virtual avatars. Using a virtual reality headset, the student can visualise the movement of the instructor's avatar, rendered in place of their own body. Onebody provides a first person perspective of the movement instruction, allowing the student to step into the instructor's body. We conducted a study to compare the performance of Onebody in terms of posture matching accuracy and user's preference, with existing techniques of delivering movement instructions, including pre-recorded video, video conferencing and third person view virtual reality. The result indicated that Onebody offers better posture accuracy in delivering movement instructions.

[1]  R. Riener,et al.  Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review , 2012, Psychonomic Bulletin & Review.

[2]  Tovi Grossman,et al.  YouMove: enhancing movement training with an augmented reality mirror , 2013, UIST.

[3]  Gabriele Wulf,et al.  Continuous Concurrent Feedback Degrades Skill Learning: Implications for Training and Simulation , 1997, Hum. Factors.

[4]  G. Wulf,et al.  Instructions about physical principles in learning a complex motor skill: to tell or not to tell.... , 1997, Research quarterly for exercise and sport.

[5]  C. Shea,et al.  Principles derived from the study of simple skills do not generalize to complex skill learning , 2002, Psychonomic bulletin & review.

[6]  Gerard Jounghyun Kim,et al.  Implementation and Evaluation of Just Follow Me: An Immersive, VR-Based, Motion-Training System , 2002, Presence: Teleoperators & Virtual Environments.

[7]  Charles H. Shea,et al.  Understanding the role of augmented feedback : The good, the bad and the ugly , 2004 .

[8]  Alexandra Pfister,et al.  Comparative abilities of Microsoft Kinect and Vicon 3D motion capture for gait analysis , 2014, Journal of medical engineering & technology.

[9]  P. S. Archambault,et al.  Evaluation of Kinect skeletal tracking in a virtual reality rehabilitation system for upper limb hemiparesis , 2013, 2013 International Conference on Virtual Rehabilitation (ICVR).

[10]  Jay J. Han,et al.  VR-Assisted Physical Rehabilitation: Adapting to the Needs of Therapists and Patients , 2013, Virtual Realities.

[11]  Ruzena Bajcsy,et al.  Immersive 3D Environment for Remote Collaboration and Training of Physical Activities , 2008, 2008 IEEE Virtual Reality Conference.

[12]  J. Bailenson,et al.  The Effect of Interactivity on Learning Physical Actions in Virtual Reality , 2008 .

[13]  E Bizzi,et al.  Augmented Feedback Presented in a Virtual Environment Accelerates Learning of a Difficult Motor Task. , 1997, Journal of motor behavior.

[14]  Ning Hu,et al.  Training for physical tasks in virtual environments: Tai Chi , 2003, IEEE Virtual Reality, 2003. Proceedings..

[15]  Maureen K. Holden,et al.  Virtual Environments for Motor Rehabilitation: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[16]  KomuraTaku,et al.  A Virtual Reality Dance Training System Using Motion Capture Technology , 2011 .

[17]  Ruzena Bajcsy,et al.  A Framework for Constructing Real-time Immersive Environments for Training Physical Activities , 2006, J. Multim..

[18]  Franck Multon,et al.  Third person view and guidance for more natural motor behaviour in immersive basketball playing , 2014, VRST '14.

[19]  Taku Komura,et al.  A Virtual Reality Dance Training System Using Motion Capture Technology , 2011, IEEE Transactions on Learning Technologies.

[20]  C. Shea,et al.  Motor skill learning and performance: a review of influential factors , 2010, Medical education.

[21]  Xing-Dong Yang,et al.  Physio@Home: Exploring Visual Guidance and Feedback Techniques for Physiotherapy Exercises , 2015, CHI.

[22]  Robert Rowe,et al.  Ghostman: Augmented Reality Application for Telerehabilitation and Remote Instruction of a Novel Motor Skill , 2014, BioMed research international.