Introduction to Low-Cost Motion-Tracking for Virtual Rehabilitation

Low-cost motion sensors have seen tremendous increase in popularity in the past few years. Accelerometers, gyroscopes or cameras can be found in most available smart phones and gaming controllers. The Apple® iPhone, Nintendo® Wii™ and the PlayStatio® EyeToy™ are just a few examples where such technology is used to provide a more natural interaction for the user. Depth-sensing cameras by companies such as Microsoft, PrimeSense and Asus can enhance the user experience even further by enabling full-body interaction. This chapter will specifically discuss the use of the Microsoft® Kinect™ depth-sensing camera (Kinect) for rehabilitation of patients with motor disabilities. In addition, examples will be provided of how the Kinect can be used with off-the-shelf computer games or utilized in conjunction with modern game development tools such as the game engine Unity. The examples will outline concepts and required resources in order to enable the reader to use low-cost depth-sensing cameras for rehabilitation.

[1]  S. Flynn,et al.  Feasibility of Using the Sony PlayStation 2 Gaming Platform for an Individual Poststroke: A Case Report , 2007, Journal of neurologic physical therapy : JNPT.

[2]  Rachel Proffitt,et al.  Development of an Interactive Game-Based Rehabilitation Tool for Dynamic Balance Training , 2010, Topics in stroke rehabilitation.

[3]  José Luis Pons Rovira,et al.  Virtual Reality System in Conjunction with Neurorobotics and Neuroprosthetics for Rehabilitation of Motor Disorders , 2011, MMVR.

[4]  A. Rizzo,et al.  Initial usability assessment of off-the-shelf video game consoles for clinical game-based motor rehabilitation , 2009 .

[5]  Mindy F Levin,et al.  Reaching in reality and virtual reality: a comparison of movement kinematics in healthy subjects and in adults with hemiparesis , 2004, Journal of NeuroEngineering and Rehabilitation.

[6]  J. Deutsch,et al.  Use of a Low-Cost, Commercially Available Gaming Console (Wii) for Rehabilitation of an Adolescent With Cerebral Palsy , 2008, Physical Therapy.

[7]  Jose L Pons,et al.  Advanced Hybrid Technology for Neurorehabilitation: The HYPER Project , 2012 .

[8]  Albert A. Rizzo,et al.  Leveraging Unencumbered Full Body Control of Animated Virtual Characters for Game-Based Rehabilitation , 2011, HCI.

[9]  G.C. Burdea,et al.  Virtual reality-enhanced stroke rehabilitation , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Mark Bolas,et al.  Markerless Full Body Tracking: Depth-Sensing Technology within Virtual Environments , 2011 .

[11]  Albert A. Rizzo,et al.  FAAST: The Flexible Action and Articulated Skeleton Toolkit , 2011, 2011 IEEE Virtual Reality Conference.

[12]  Michael Recce,et al.  A virtual reality based exercise system for hand rehabilitation post-stroke: transfer to function , 2004, EMBC 2004.

[13]  Mark Bolas,et al.  Designing informed game-based rehabilitation tasks leveraging advances in virtual reality , 2012, Disability and rehabilitation.

[14]  Russell M. Taylor,et al.  VRPN: a device-independent, network-transparent VR peripheral system , 2001, VRST '01.

[15]  A. Lamontagne,et al.  Locomotor rehabilitation in a complex virtual environment , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[16]  H Poizner,et al.  Virtual reality-based post-stroke hand rehabilitation. , 2002, Studies in health technology and informatics.

[17]  Francine Malouin,et al.  A Treadmill and Motion Coupled Virtual Reality System for Gait Training Post-Stroke , 2006, Cyberpsychology Behav. Soc. Netw..

[18]  George D Fulk,et al.  Locomotor training and virtual reality-based balance training for an individual with multiple sclerosis: a case report. , 2005, Journal of neurologic physical therapy : JNPT.

[19]  S. Adamovich,et al.  Virtual reality-augmented rehabilitation for patients following stroke. , 2002, Physical therapy.

[20]  M. Hallett,et al.  Virtual Reality–Induced Cortical Reorganization and Associated Locomotor Recovery in Chronic Stroke: An Experimenter-Blind Randomized Study , 2005, Stroke.

[21]  Sandeep K Subramanian,et al.  Virtual reality environments for post-stroke arm rehabilitation , 2007, Journal of NeuroEngineering and Rehabilitation.

[22]  A. Mirelman,et al.  Effects of Training With a Robot-Virtual Reality System Compared With a Robot Alone on the Gait of Individuals After Stroke , 2009, Stroke.

[23]  Wei-Shin Huang,et al.  A virtual reality-based system for hand function analysis , 2002, Comput. Methods Programs Biomed..

[24]  Patrice L. Weiss,et al.  Reaching within Video-Capture Virtual Reality: Using Virtual Reality as a Motor Control Paradigm , 2006, Cyberpsychology Behav. Soc. Netw..

[25]  D. Rand,et al.  The Sony PlayStation II EyeToy: Low-Cost Virtual Reality for Use in Rehabilitation , 2008, Journal of neurologic physical therapy : JNPT.

[26]  Judith E. Deutsch,et al.  IMPROVED GAIT AND ELEVATION SPEED OF INDIVIDUALS POST-STROKE AFTER LOWER EXTREMITY TRAINING IN VIRTUAL ENVIRONMENTS. , 2004 .

[27]  E. Todorov,et al.  Virtual Environment Training Improves Motor Performance in Two Patients with Stroke: Case Report , 1999 .

[28]  Gerard Jounghyun Kim,et al.  A SWOT Analysis of the Field of Virtual Reality Rehabilitation and Therapy , 2005, Presence: Teleoperators & Virtual Environments.

[29]  Eugene Tunik,et al.  Virtual reality to maximize function for hand and arm rehabilitation: exploration of neural mechanisms. , 2009, Studies in health technology and informatics.