Interdisciplinary Concepts for Design and Implementation of Mixed Reality Interactive Neurorehabilitation Systems for Stroke

Interactive neurorehabilitation (INR) systems provide therapy that can evaluate and deliver feedback on a patient's movement computationally. There are currently many approaches to INR design and implementation, without a clear indication of which methods to utilize best. This article presents key interactive computing, motor learning, and media arts concepts utilized by an interdisciplinary group to develop adaptive, mixed reality INR systems for upper extremity therapy of patients with stroke. Two INR systems are used as examples to show how the concepts can be applied within: (1) a small-scale INR clinical study that achieved integrated improvement of movement quality and functionality through continuously supervised therapy and (2) a pilot study that achieved improvement of clinical scores with minimal supervision. The notion is proposed that some of the successful approaches developed and tested within these systems can form the basis of a scalable design methodology for other INR systems. A coherent approach to INR design is needed to facilitate the use of the systems by physical therapists, increase the number of successful INR studies, and generate rich clinical data that can inform the development of best practices for use of INR in physical therapy.

[1]  George D Fulk,et al.  Accuracy of 2 Activity Monitors in Detecting Steps in People With Stroke and Traumatic Brain Injury , 2013, Physical Therapy.

[2]  Pavan K. Turaga,et al.  Attractor-Shape for Dynamical Analysis of Human Movement: Applications in Stroke Rehabilitation and Action Recognition , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[3]  Bart M. Demaerschalk,et al.  Systematic Review of Telestroke for Post-Stroke Care and Rehabilitation , 2013, Current Atherosclerosis Reports.

[4]  Thanassis Rikakis,et al.  Adaptive Mixed Reality Rehabilitation Improves Quality of Reaching Movements More Than Traditional Reaching Therapy Following Stroke , 2013, Neurorehabilitation and neural repair.

[5]  Sandeep K Subramanian,et al.  Arm Motor Recovery Using a Virtual Reality Intervention in Chronic Stroke , 2013, Neurorehabilitation and neural repair.

[6]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  J. Deutsch,et al.  Cochrane review: virtual reality for stroke rehabilitation. , 2012, European journal of physical and rehabilitation medicine.

[8]  R. Dickstein,et al.  Patient-Centered Integrated Motor Imagery Delivered in the Home With Telerehabilitation to Improve Walking After Stroke , 2012, Physical Therapy.

[9]  H. Sundaram,et al.  A computational framework for constructing interactive feedback for assisting motor learning , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Jermey N. A. Matthews.  3D printing breaks out of its mold , 2011 .

[11]  N. Stergiou,et al.  Human movement variability, nonlinear dynamics, and pathology: is there a connection? , 2011, Human movement science.

[12]  M. Duff,et al.  Exploring the bases for a mixed reality stroke rehabilitation system, Part II: Design of Interactive Feedback for upper limb rehabilitation , 2011, Journal of NeuroEngineering and Rehabilitation.

[13]  S. Wolf,et al.  Exploring the bases for a mixed reality stroke rehabilitation system, Part I: A unified approach for representing action, quantitative evaluation, and interactive feedback , 2011, Journal of NeuroEngineering and Rehabilitation.

[14]  Michelle J. Johnson,et al.  Advances in upper limb stroke rehabilitation: a technology push , 2011, Medical & Biological Engineering & Computing.

[15]  Jiping He,et al.  A Computational Framework for Quantitative Evaluation of Movement during Rehabilitation , 2011 .

[16]  A. Mihailidis,et al.  The development of an adaptive upper-limb stroke rehabilitation robotic system , 2011, Journal of NeuroEngineering and Rehabilitation.

[17]  Thanassis Rikakis,et al.  A Novel Adaptive Mixed Reality System for Stroke Rehabilitation: Principles, Proof of Concept, and Preliminary Application in 2 Patients , 2011, Topics in stroke rehabilitation.

[18]  M. Levin,et al.  Virtual Reality in Stroke Rehabilitation: A Meta-Analysis and Implications for Clinicians , 2011, Stroke.

[19]  Jermey N. A. Matthews.  Rankings place technology-courting US states on top , 2011 .

[20]  Grant D. Huang,et al.  Robot-assisted therapy for long-term upper-limb impairment after stroke. , 2010, The New England journal of medicine.

[21]  P. Morasso,et al.  Self-adaptive robot training of stroke survivors for continuous tracking movements , 2010, Journal of NeuroEngineering and Rehabilitation.

[22]  Elaine Strachota,et al.  Evaluation of the TheraDrive system for robot/computer assisted motivating rehabilitation after stroke , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Michael L. Littman,et al.  A tutorial on partially observable Markov decision processes , 2009 .

[24]  M. Levin,et al.  What Do Motor “Recovery” and “Compensation” Mean in Patients Following Stroke? , 2009, Neurorehabilitation and neural repair.

[25]  Daniel A. Braun,et al.  Motor Task Variation Induces Structural Learning , 2009, Current Biology.

[26]  J. Ryan,et al.  Cognitive strategy use to enhance motor skill acquisition post-stroke: A critical review , 2009, Brain injury.

[27]  R. Zatorre,et al.  Listening to musical rhythms recruits motor regions of the brain. , 2008, Cerebral cortex.

[28]  Hector Muñoz-Avila,et al.  Case-Based Plan Adaptation: An Analysis and Review , 2008, IEEE Intelligent Systems.

[29]  Nicolas Schweighofer,et al.  Performance-Based Adaptive Schedules Enhance Motor Learning , 2008, Journal of motor behavior.

[30]  J. Kleim,et al.  Principles of experience-dependent neural plasticity: implications for rehabilitation after brain damage. , 2008, Journal of speech, language, and hearing research : JSLHR.

[31]  J. Krakauer,et al.  Generalization of Motor Learning Depends on the History of Prior Action , 2006, PLoS biology.

[32]  C. Winstein,et al.  Explicit Information Interferes with Implicit Motor Learning of Both Continuous and Discrete Movement Tasks After Stroke , 2006, Journal of neurologic physical therapy : JNPT.

[33]  Brent Davis,et al.  Complexity and Education: Inquiries Into Learning, Teaching, and Research , 2006 .

[34]  J. Krakauer.  Motor learning: its relevance to stroke recovery and neurorehabilitation. , 2006, Current opinion in neurology.

[35]  Maureen K. Holden,et al.  Virtual Environments for Motor Rehabilitation: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[36]  Michael H. Thaut,et al.  Rhythm, Music, and the Brain: Scientific Foundations and Clinical Applications , 2005 .

[37]  Maria V. Sanchez-Vives,et al.  From presence to consciousness through virtual reality , 2005, Nature Reviews Neuroscience.

[38]  J. Saffran.  Statistical Language Learning , 2003 .

[39]  C. Spence,et al.  Multisensory Integration: Maintaining the Perception of Synchrony , 2003, Current Biology.

[40]  W. Prinz,et al.  Directing attention to movement effects enhances learning: A review , 2001, Psychonomic bulletin & review.

[41]  G. Rizzolatti,et al.  The Cortical Motor System , 2001, Neuron.

[42]  S. Wolf,et al.  Assessing Wolf Motor Function Test as Outcome Measure for Research in Patients After Stroke , 2001, Stroke.

[43]  Kevin J. Pugh,et al.  Learning science: A Deweyan perspective , 2001 .

[44]  Ferdinando A Mussa-Ivaldi,et al.  Modular features of motor control and learning , 1999, Current Opinion in Neurobiology.

[45]  D. H. Warren,et al.  Immediate perceptual response to intersensory discrepancy. , 1980, Psychological bulletin.

[46]  A. Fugl-Meyer,et al.  The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance. , 1975, Scandinavian journal of rehabilitation medicine.

[47]  Pavan K. Turaga,et al.  Decision support for stroke rehabilitation therapy via describable attribute-based decision trees , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[48]  Roberto Cano de la Cuerda,et al.  A telerehabilitation program by virtual reality-video games improves balance and postural control in multiple sclerosis patients. , 2013, NeuroRehabilitation.

[49]  Hamid Reza Rostami,et al.  Effects of modified constraint-induced movement therapy in virtual environment on upper-limb function in children with spastic hemiparetic cerebral palsy: a randomised controlled trial. , 2012, NeuroRehabilitation.

[50]  Pamela Samuelson,et al.  Is open-source software the answer? , 2012 .

[51]  Long Cheng,et al.  Kinematic Analysis and Quantitative Evaluation for Reach Movements in Stroke Rehabilitation , 2012 .

[52]  Andrea Gaggioli,et al.  Advanced Technologies in Rehabilitation - Empowering Cognitive, Physical, Social and Communicative Skills through Virtual Reality, Robots, Wearable Systems and Brain-Computer Interfaces , 2009 .

[53]  Robert L Sainburg,et al.  The roles of vision and proprioception in the planning of reaching movements. , 2009, Advances in experimental medicine and biology.

[54]  Giulio Sandini,et al.  Journal of Neuroengineering and Rehabilitation Performance Adaptive Training Control Strategy for Recovering Wrist Movements in Stroke Patients: a Preliminary, Feasibility Study , 2009 .

[55]  Judith E Deutsch,et al.  Virtual reality and gaming systems to improve walking and mobility for people with musculoskeletal and neuromuscular conditions. , 2009, Studies in health technology and informatics.

[56]  Richard M. Eastgate,et al.  Mixed reality environments in stroke rehabilitation: Interfaces across the real/virtual divide , 2007 .

[57]  Borko Furht,et al.  Encyclopedia of Multimedia , 2006 .

[58]  Mel Slater,et al.  An Investigation of Presence Response across Variations in Visual Realism , 2004 .

[59]  S. Yantis.  3 Goal-Directed and Stimulus-Driven Determinants of Attentional Control , 2000 .

[60]  B. Wilson.  Constructivist Learning Environments: Case Studies in Instructional Design , 1995 .

[61]  Carl Machover,et al.  Virtual reality , 1994, IEEE Computer Graphics and Applications.

[62]  Ernst Gombrich,et al.  The Story of Art , 1950 .

[63]  Sandeep K Subramanian,et al.  Journal of Neuroengineering and Rehabilitation Open Access Virtual Reality Environments for Post-stroke Arm Rehabilitation , 2022 .