Real-Time 3D Avatars for Tele-rehabilitation in Virtual Reality

We present work in progress on a tele-immersion system for telerehabilitation using real-time stereo vision and virtual environments. Stereo reconstruction is used to capture user's 3D avatar in real time and project it into a shared virtual environment, enabling a patient and therapist to interact remotely. Captured data can also be used to analyze the movement and provide feedback to the patient as we present in a preliminary study of stepping-in-place task. Such tele-presence system could in the future allow patients to interact remotely with remote physical therapist and virtual environment while objectively tracking their performance.

[1]  J. Krakauer.  Motor learning: its relevance to stroke recovery and neurorehabilitation. , 2006, Current opinion in neurology.

[2]  Rahul Malik,et al.  Immersive environments for rehabilitation activities , 2009, ACM Multimedia.

[3]  Ruzena Bajcsy,et al.  Multi-camera tele-immersion system with real-time model driven data compression , 2009, The Visual Computer.

[4]  Ruzena Bajcsy,et al.  Computational Model of Human Creativity in Dance Choreography , 2008, AAAI Spring Symposium: Creative Intelligent Systems.

[5]  Darryl Charles,et al.  Serious Games for Upper Limb Rehabilitation Following Stroke , 2009, 2009 Conference in Games and Virtual Worlds for Serious Applications.

[6]  T. Fukuda,et al.  The stepping test: two phases of the labyrinthine reflex. , 1959, Acta oto-laryngologica.

[7]  Zhong Zhou,et al.  Real-time stereo-vision system for 3D teleimmersive collaboration , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[8]  Patrice L. Weiss,et al.  Adapting an immersive virtual reality system for rehabilitation , 2003, Comput. Animat. Virtual Worlds.

[9]  M. Holden,et al.  Virtual Environment Training: A New Tool for Neurorehabilitation , 2002 .

[10]  J. Moline,et al.  Virtual reality for health care: a survey. , 1997, Studies in health technology and informatics.

[11]  T. Poggio,et al.  Synthesis and recognition of biological motion patterns based on linear superposition of prototypical motion sequences , 1999, Proceedings IEEE Workshop on Multi-View Modeling and Analysis of Visual Scenes (MVIEW'99).

[12]  J. Bailenson,et al.  The Effect of Interactivity on Learning Physical Actions in Virtual Reality , 2008 .

[13]  Tadej Bajd,et al.  Virtual environment for lower-extremities training. , 2008, Gait & posture.

[14]  B. Dobkin.  Rehabilitation after Stroke , 2005 .

[15]  Heidi Sveistrup,et al.  Motor rehabilitation using virtual reality , 2004, Journal of NeuroEngineering and Rehabilitation.

[16]  R.S. Leder,et al.  Nintendo Wii remote for computer simulated arm and wrist therapy in stroke survivors with upper extremity hemipariesis , 2008, 2008 Virtual Rehabilitation.