Virtual reality system for stroke recovery for upper limbs using ArUco markers

Visual feedback is a very important component for re-learning motor tasks in post stroke recovery. In this paper, a virtual reality (VR) based system for stroke recovery for upper limbs is described, where the patient is immersed with the help of a Head Mounted Display (HMD). The HMD renders a 3D scene containing the avatar of the patient, from a virtual camera position placed on the head of the avatar. The patient's limb subject to recovery is monitored with a webcam that tracks ArUco markers placed on the limb, and the avatar limb position is updated in real-time. This system is derived from TRAVEE system that uses augmented feedback to enhance the recovery process by creating new recovery methods.

[1]  Simona Caraiman,et al.  Architectural Design of a Real-Time Augmented Feedback System for Neuromotor Rehabilitation , 2015, 2015 20th International Conference on Control Systems and Computer Science.

[2]  Cynthia Breazeal,et al.  TIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning , 2007, IEEE Transactions on Robotics.

[3]  Florica Moldoveanu,et al.  The TRAVEE neuromotor rehabilitation system: In-vivo testing , 2017, 2017 Zooming Innovation in Consumer Electronics International Conference (ZINC).

[4]  Alan Sunderland,et al.  Neuroplasticity, learning and recovery after stroke: A critical evaluation of constraint-induced therapy , 2005, Neuropsychological rehabilitation.

[5]  JanMehrholz,et al.  Mirror Therapy for Improving Motor Function After Stroke , 2013 .

[6]  Carol Davila,et al.  CHALLENGES AND ISSUES FOR SUCCESSFULLY APPLYING VIRTUAL REALITY IN MEDICAL REHABILITATION , 2016 .

[7]  J. Deutsch,et al.  Virtual Reality for Stroke Rehabilitation , 2012 .

[8]  Kimberlee Jordan,et al.  Augmented Reality Assisted Upper Limb Rehabilitation Following Stroke , 2011 .

[9]  Robert Gabriel Lupu,et al.  The Design of a Scalable Haptic System Used for Impaired People Assistance , 2015, 2015 20th International Conference on Control Systems and Computer Science.

[10]  Christian Dohle,et al.  Mirror therapy for improving motor function after stroke. , 2012, The Cochrane database of systematic reviews.

[11]  Florica Moldoveanu,et al.  From neuromotor command to feedback: A survey of techniques for rehabilitation through altered perception , 2015, 2015 E-Health and Bioengineering Conference (EHB).

[12]  Febo Cincotti,et al.  Vibrotactile Feedback for Brain-Computer Interface Operation , 2007, Comput. Intell. Neurosci..

[13]  Florica Moldoveanu,et al.  The TRAVEE system for neuromotor recovery: Architecture and implementation , 2017, 2017 E-Health and Bioengineering Conference (EHB).

[14]  Susie Thomas,et al.  Virtual reality for stroke rehabilitation. , 2015, The Cochrane database of systematic reviews.

[15]  Florica Moldoveanu,et al.  Motion detection and rendering for upper limb post-stroke rehabilitation: Multimedia applications for medical and healthcare education and learning; Rehabilitative and assistive technologies , 2015, 2015 E-Health and Bioengineering Conference (EHB).

[16]  J. Ratcliffe,et al.  Virtual reality stroke rehabilitation – hype or hope? , 2015 .

[17]  Alejandro Baldominos Gómez,et al.  An Approach to Physical Rehabilitation Using State-of-the-art Virtual Reality and Motion Tracking Technologies , 2015, CENTERIS/ProjMAN/HCist.

[18]  Katherine J. Kuchenbecker,et al.  Lessons in using vibrotactile feedback to guide fast arm motions , 2011, 2011 IEEE World Haptics Conference.