Animation of 3D Avatars for Rehabilitation of the Upper Limbs

The paper presents a 3D Virtual Environment (VE) for neurorehabilitation of the upper limb. Patients move one of their arms trying to simulate concrete daily actions, such as grasping a bottle, opening a door or putting a book on a shelve. They wear a special garment that integrates four inertial sensors providing in real time information on the orientation of the patient's shoulder, elbow and wrist. The VE is a complete scenario integrating all the objects needed to perform virtually the actions simulated by the patients. In the VE, patients are represented by 3D avatars that, using the data provided by the inertial sensors, reproduce in real time their arm movements. Since only the arm movement is monitorized, but neither the hand nor the trunk and the neck, the system must combine real movements with baked animations in order to show a realistic behavior of the 3D avatar. Moreover, it must take into account collisions between the 3D avatar and the virtual objects. Finally, it must detect when the patient is about to simulate an interaction with an object in order to realize it virtually. We describe the strategies that we have designed to provide these functionalities.

[1]  Jeffrey A. Lewis,et al.  Virtual Reality-based System for Ankle Rehabilitation Post Stroke , 2002 .

[2]  Maureen K. Holden,et al.  Virtual Environments for Motor Rehabilitation: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[3]  L. Merabet,et al.  The plastic human brain cortex. , 2005, Annual review of neuroscience.

[4]  H. Stam,et al.  ''Playstation eyetoy games'' improve upper extremity-related motor functioning in subacute stroke: a randomized controlled clinical trial. , 2008, European journal of physical and rehabilitation medicine.

[5]  A. Rizzo,et al.  The status of virtual reality for the cognitive rehabilitation of persons with neurological disorders and acquired brain injury. , 1997, Studies in health technology and informatics.

[6]  G. Burdea Virtual Rehabilitation - Benefits and Challenges , 2003, Yearbook of Medical Informatics.

[7]  Darryl Charles,et al.  Serious Games for Upper Limb Rehabilitation Following Stroke , 2009, 2009 Conference in Games and Virtual Worlds for Serious Applications.

[8]  Richard E. Parent,et al.  Layered construction for deformable animated characters , 1989, SIGGRAPH.

[9]  Patrice L Weiss,et al.  Virtual reality training for stroke rehabilitation. , 2006, NeuroRehabilitation.

[10]  Lena H Ting,et al.  Neuromechanics of muscle synergies for posture and movement , 2007, Current Opinion in Neurobiology.

[11]  Robert Riener,et al.  Virtual reality and gait rehabilitation Augmented feedback for the Lokomat , 2009, 2009 Virtual Rehabilitation International Conference.

[12]  Albert A. Rizzo,et al.  Virtual Reality in Brain Damage Rehabilitation: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[13]  Alexandra Poulovassilis,et al.  Developing an Evaluation Methodology for Immersive Learning Experiences in a Virtual World , 2009, 2009 Conference in Games and Virtual Worlds for Serious Applications.

[14]  Daniel Thalmann,et al.  Joint-dependent local deformations for hand animation and object grasping , 1989 .

[15]  Grigore C. Burdea,et al.  A virtual-reality-based telerehabilitation system with force feedback , 2000, IEEE Transactions on Information Technology in Biomedicine.