Interdisciplinary Concepts for Design and Implementation of Mixed Reality Interactive Neurorehabilitation Systems for Stroke

Interactive neurorehabilitation (INR) systems provide therapy that can evaluate and deliver feedback on a patient's movement computationally. There are currently many approaches to INR design and implementation, without a clear indication of which methods to utilize best. This article presents key interactive computing, motor learning, and media arts concepts utilized by an interdisciplinary group to develop adaptive, mixed reality INR systems for upper extremity therapy of patients with stroke. Two INR systems are used as examples to show how the concepts can be applied within: (1) a small-scale INR clinical study that achieved integrated improvement of movement quality and functionality through continuously supervised therapy and (2) a pilot study that achieved improvement of clinical scores with minimal supervision. The notion is proposed that some of the successful approaches developed and tested within these systems can form the basis of a scalable design methodology for other INR systems. A coherent approach to INR design is needed to facilitate the use of the systems by physical therapists, increase the number of successful INR studies, and generate rich clinical data that can inform the development of best practices for use of INR in physical therapy.

[1]  Elaine Strachota,et al.  Evaluation of the TheraDrive system for robot/computer assisted motivating rehabilitation after stroke , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  Robert L Sainburg,et al.  The roles of vision and proprioception in the planning of reaching movements. , 2009, Advances in experimental medicine and biology.

[3]  Carl Machover,et al.  Virtual reality , 1994, IEEE Computer Graphics and Applications.

[4]  S. Yantis.  3 Goal-Directed and Stimulus-Driven Determinants of Attentional Control , 2000 .

[5]  Long Cheng.  Kinematic Analysis and Quantitative Evaluation for Reach Movements in Stroke Rehabilitation , 2012 .

[6]  Thanassis Rikakis,et al.  Adaptive Mixed Reality Rehabilitation Improves Quality of Reaching Movements More Than Traditional Reaching Therapy Following Stroke , 2013, Neurorehabilitation and neural repair.

[7]  A. Fugl-Meyer,et al.  The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance. , 1975, Scandinavian journal of rehabilitation medicine.

[8]  N. Stergiou,et al.  Human movement variability, nonlinear dynamics, and pathology: is there a connection? , 2011, Human movement science.

[9]  C. Spence,et al.  Multisensory Integration: Maintaining the Perception of Synchrony , 2003, Current Biology.

[10]  Judith E Deutsch,et al.  Virtual reality and gaming systems to improve walking and mobility for people with musculoskeletal and neuromuscular conditions. , 2009, Studies in health technology and informatics.

[11]  M. Levin,et al.  Virtual Reality in Stroke Rehabilitation: A Meta-Analysis and Implications for Clinicians , 2011, Stroke.

[12]  J. Krakauer,et al.  Generalization of Motor Learning Depends on the History of Prior Action , 2006, PLoS biology.

[13]  Kevin J. Pugh,et al.  Learning science: A Deweyan perspective , 2001 .

[14]  J. Deutsch,et al.  Cochrane review: virtual reality for stroke rehabilitation. , 2012, European journal of physical and rehabilitation medicine.

[15]  Pavan K. Turaga,et al.  Decision support for stroke rehabilitation therapy via describable attribute-based decision trees , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[16]  D. H. Warren,et al.  Immediate perceptual response to intersensory discrepancy. , 1980, Psychological bulletin.

[17]  Bart M. Demaerschalk,et al.  Systematic Review of Telestroke for Post-Stroke Care and Rehabilitation , 2013, Current Atherosclerosis Reports.

[18]  P. Morasso,et al.  Self-adaptive robot training of stroke survivors for continuous tracking movements , 2010, Journal of NeuroEngineering and Rehabilitation.

[19]  Thanassis Rikakis,et al.  A Novel Adaptive Mixed Reality System for Stroke Rehabilitation: Principles, Proof of Concept, and Preliminary Application in 2 Patients , 2011, Topics in stroke rehabilitation.

[20]  W. Prinz,et al.  Directing attention to movement effects enhances learning: A review , 2001, Psychonomic bulletin & review.

[21]  G. Rizzolatti,et al.  The Cortical Motor System , 2001, Neuron.

[22]  S. Wolf,et al.  Assessing Wolf Motor Function Test as Outcome Measure for Research in Patients After Stroke , 2001, Stroke.

[23]  Maria V. Sanchez-Vives,et al.  From presence to consciousness through virtual reality , 2005, Nature Reviews Neuroscience.

[24]  J. Saffran.  Statistical Language Learning , 2003 .

[25]  Pavan K. Turaga,et al.  Attractor-Shape for Dynamical Analysis of Human Movement: Applications in Stroke Rehabilitation and Action Recognition , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[26]  David H. Uttal,et al.  Statistical Language Learning: Mechanisms and Constraints Learning the Sounds of Words Statistical Learning and Syntax , 2022 .

[27]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Roberto Cano de la Cuerda,et al.  A telerehabilitation program by virtual reality-video games improves balance and postural control in multiple sclerosis patients. , 2013, NeuroRehabilitation.

[29]  George D Fulk,et al.  Accuracy of 2 Activity Monitors in Detecting Steps in People With Stroke and Traumatic Brain Injury , 2013, Physical Therapy.

[30]  J. Ryan,et al.  Cognitive strategy use to enhance motor skill acquisition post-stroke: A critical review , 2009, Brain injury.

[31]  Brent Davis,et al.  Complexity and Education: Inquiries Into Learning, Teaching, and Research , 2006 .

[32]  Thanassis Rikakis,et al.  A computational framework for constructing interactive feedback for assisting motor learning , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[33]  Ernst Gombrich,et al.  The Story of Art , 1950 .

[34]  J. Krakauer.  Motor learning: its relevance to stroke recovery and neurorehabilitation. , 2006, Current opinion in neurology.

[35]  C. Winstein,et al.  Explicit Information Interferes with Implicit Motor Learning of Both Continuous and Discrete Movement Tasks After Stroke , 2006, Journal of neurologic physical therapy : JNPT.

[36]  J. Kleim,et al.  Principles of experience-dependent neural plasticity: implications for rehabilitation after brain damage. , 2008, Journal of speech, language, and hearing research : JSLHR.

[37]  Pamela Samuelson.  Is open-source software the answer? , 2012 .

[38]  Maureen K. Holden,et al.  Virtual Environments for Motor Rehabilitation: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[39]  B. Wilson.  Constructivist Learning Environments: Case Studies in Instructional Design , 1995 .

[40]  Daniel A. Braun,et al.  Motor Task Variation Induces Structural Learning , 2009, Current Biology.

[41]  Michael H. Thaut,et al.  Rhythm, Music, and the Brain: Scientific Foundations and Clinical Applications , 2005 .

[42]  Jermey N. A. Matthews.  3D printing breaks out of its mold , 2011 .

[43]  Andrea Gaggioli,et al.  Advanced Technologies in Rehabilitation - Empowering Cognitive, Physical, Social and Communicative Skills through Virtual Reality, Robots, Wearable Systems and Brain-Computer Interfaces , 2009 .

[44]  Michelle J. Johnson,et al.  Advances in upper limb stroke rehabilitation: a technology push , 2011, Medical & Biological Engineering & Computing.

[45]  Grant D. Huang,et al.  Robot-assisted therapy for long-term upper-limb impairment after stroke. , 2010, The New England journal of medicine.

[46]  Giulio Sandini,et al.  Performance adaptive training control strategy for recovering wrist movements in stroke patients: a preliminary, feasibility study , 2009, Journal of NeuroEngineering and Rehabilitation.

[47]  R. Dickstein,et al.  Patient-Centered Integrated Motor Imagery Delivered in the Home With Telerehabilitation to Improve Walking After Stroke , 2012, Physical Therapy.

[48]  Nicolas Schweighofer,et al.  Performance-Based Adaptive Schedules Enhance Motor Learning , 2008, Journal of motor behavior.

[49]  Ferdinando A Mussa-Ivaldi,et al.  Modular features of motor control and learning , 1999, Current Opinion in Neurobiology.

[50]  Michael L. Littman,et al.  A tutorial on partially observable Markov decision processes , 2009 .

[51]  Mel Slater,et al.  An Investigation of Presence Response across Variations in Visual Realism , 2004 .

[52]  S. Wolf,et al.  Exploring the bases for a mixed reality stroke rehabilitation system, Part I: A unified approach for representing action, quantitative evaluation, and interactive feedback , 2011, Journal of NeuroEngineering and Rehabilitation.

[53]  Hector Muñoz-Avila,et al.  Case-Based Plan Adaptation: An Analysis and Review , 2008, IEEE Intelligent Systems.

[54]  R. Zatorre,et al.  Listening to musical rhythms recruits motor regions of the brain. , 2008, Cerebral cortex.

[55]  Mindy F Levin,et al.  Arm Motor Recovery Using a Virtual Reality Intervention in Chronic Stroke , 2013, Neurorehabilitation and neural repair.

[56]  T. Pridmore,et al.  Mixed reality environments in stroke rehabilitation: Interfaces across the real/virtual divide , 2007 .

[57]  Hamid Reza Rostami,et al.  Effects of modified constraint-induced movement therapy in virtual environment on upper-limb function in children with spastic hemiparetic cerebral palsy: a randomised controlled trial. , 2012, NeuroRehabilitation.

[58]  A. Mihailidis,et al.  The development of an adaptive upper-limb stroke rehabilitation robotic system , 2011, Journal of NeuroEngineering and Rehabilitation.

[59]  Jiping He,et al.  A Computational Framework for Quantitative Evaluation of Movement during Rehabilitation , 2011 .

[60]  M. Levin,et al.  What Do Motor “Recovery” and “Compensation” Mean in Patients Following Stroke? , 2009, Neurorehabilitation and neural repair.

[61]  Sandeep K Subramanian,et al.  Virtual reality environments for post-stroke arm rehabilitation , 2007, Journal of NeuroEngineering and Rehabilitation.

[62]  M. Duff,et al.  Exploring the bases for a mixed reality stroke rehabilitation system, Part II: Design of Interactive Feedback for upper limb rehabilitation , 2011, Journal of NeuroEngineering and Rehabilitation.

[63]  Borko Furht,et al.  Encyclopedia of Multimedia , 2006 .