SENSORIMOTOR REHABILITATION SYSTEM FOR THE UPPER LIMB WITH VIRTUAL ENVIRONMENT, EXOSKELETON ROBOT, AND REAL OBJECTS

The Sensory Motor Training Station (SMTS), designed to provide concurrent sensorimotor hand and arm training and performance measurement features, incorporates virtual reality, an upper limb robot, and interaction with real objects to provide the nervous system with multimodal sensory experience during movement training. One goal of the SMTS design is to provide training to view, reach, and touch real objects even when the patient is unable to move adequately enough to participate in traditional therapies. Current exercises focus upon concurrent movement and multi-sensory training to improve strategies to recognize arm location and object location to improve prehension, a particularly important skill in activities of daily living and for quality of life in persons with impaired sensory and or motor skills. In a recent experiment, eleven control subjects pointed to virtual targets or viewed and touched real objects in active or passive robot movement conditions while viewing the virtual limb proxy. Viewing and touching the real objects improved performance in an arm location task in both active and passive robot conditions.

[1]  C. Spence,et al.  Visual Capture of Touch: Out-of-the-Body Experiences With Rubber Gloves , 2000, Psychological science.

[2]  N. Ward Compensatory mechanisms in the aging motor system , 2006, Ageing Research Reviews.

[3]  Fisher Cm,et al.  Concerning the Mechanism of Recovery in Stroke Hemiphegia , 1992 .

[4]  Dennis A. Nowak,et al.  The impact of stroke on the performance of grasping: Usefulness of kinetic and kinematic motion analysis , 2008, Neuroscience & Biobehavioral Reviews.

[5]  J. Kalaska,et al.  Proprioceptive activity in primate primary somatosensory cortex during active arm reaching movements. , 1994, Journal of neurophysiology.

[6]  Qinyin Qiu,et al.  Incorporating Haptic Effects Into Three-Dimensional Virtual Environments to Train the Hemiparetic Upper Extremity , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  A Farnè,et al.  Dynamic size-change of peri-hand space through tool-use: spatial extension or shift of the multi-sensory area. , 2007, Journal of neuropsychology.

[8]  N. Byl,et al.  Effectiveness of Sensory and Motor Rehabilitation of the Upper Limb Following the Principles of Neuroplasticity: Patients Stable Poststroke , 2003, Neurorehabilitation and neural repair.

[9]  M. Jeannerod,et al.  The coupling of arm and finger movements during prehension , 2004, Experimental Brain Research.

[10]  H. Krebs,et al.  Effects of Robot-Assisted Therapy on Upper Limb Recovery After Stroke: A Systematic Review , 2008, Neurorehabilitation and neural repair.

[11]  J. Liepert,et al.  Treatment-induced cortical reorganization after stroke in humans. , 2000, Stroke.

[12]  Julie Duque,et al.  Encoding a motor memory in the older adult by action observation , 2006, NeuroImage.

[13]  Nicholas P. Holmes,et al.  The body schema and multisensory representation(s) of peripersonal space , 2004, Cognitive Processing.

[14]  C. Terwee,et al.  Effectiveness of exercise therapy: a best-evidence summary of systematic reviews. , 2005, The Australian journal of physiotherapy.

[15]  Andrew A G Mattar,et al.  Motor Learning by Observing , 2005, Neuron.

[16]  Bharat B. Biswal,et al.  fMRI Analysis of Neural Mechanisms Underlying Rehabilitation in Virtual Reality: Activating Secondary Motor Areas , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  Gerard G. Fluet,et al.  Recovery of hand function in virtual reality: Training hemiparetic hand and arm together or separately , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  Qinyin Qiu,et al.  Journal of Neuroengineering and Rehabilitation Design of a Complex Virtual Reality Simulation to Train Finger Motion for Persons with Hemiparesis: a Proof of Concept Study , 2022 .

[19]  Ilja Frissen,et al.  Visual recalibration of auditory spatial perception: two separate neural circuits for perceptual learning , 2009, The European journal of neuroscience.

[20]  M. Hallett,et al.  Improving hand function in chronic stroke. , 2002, Archives of neurology.

[21]  Elisabetta Làdavas,et al.  Multisensory‐based Approach to the Recovery of Unisensory Deficit , 2008, Annals of the New York Academy of Sciences.

[22]  Ajitkumar P. Mulavara,et al.  The interplay between strategic and adaptive control mechanisms in plastic recalibration of locomotor function , 2007, Experimental Brain Research.

[23]  M. Levin,et al.  Virtual Reality in Stroke Rehabilitation: A Systematic Review of its Effectiveness for Upper Limb Motor Recovery , 2007, Topics in stroke rehabilitation.

[24]  Gian Luigi Lenzi,et al.  Motor Recovery After Early Brain Damage A Case of Brain Plasticity , 1994, Stroke.

[25]  Craig S. Chapman,et al.  Obstacle avoidance during online corrections. , 2010, Journal of vision.

[26]  Aina Puce,et al.  Viewing the motion of human body parts activates different regions of premotor, temporal, and parietal cortex , 2004, NeuroImage.

[27]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[28]  T. Elbert,et al.  New treatments in neurorehabiliation founded on basic research , 2002, Nature Reviews Neuroscience.

[29]  G. Wulf,et al.  Conceptions of Ability Affect Motor Learning , 2009, Journal of motor behavior.

[30]  M. Goodale,et al.  Visual pathways to perception and action. , 1993, Progress in brain research.

[31]  J. Liepert,et al.  Training‐induced changes of motor cortex representations in stroke patients , 2000, Acta neurologica Scandinavica.

[32]  F. Pavani,et al.  Left tactile extinction following visual stimulation of a rubber hand. , 2000, Brain : a journal of neurology.

[33]  P. Haggard,et al.  Touch and the body , 2010, Neuroscience & Biobehavioral Reviews.

[34]  M. Kossut,et al.  Learning‐induced expansion of cortical maps – what happens to adjacent cortical representations? , 1998, Neuroreport.

[35]  J. Kalaska,et al.  Parietal area 5 neuronal activity encodes movement kinematics, not movement dynamics , 2004, Experimental Brain Research.

[36]  E. Tunik,et al.  A virtual reality-based system integrated with fmri to study neural mechanisms of action observation-execution: a proof of concept study. , 2009, Restorative neurology and neuroscience.

[37]  N. Hogan,et al.  Robotic devices as therapeutic and diagnostic tools for stroke recovery. , 2009, Archives of neurology.

[38]  J. Tanji,et al.  Neuronal activity in the primate supplementary, pre-supplementary and premotor cortex during externally and internally instructed sequential movements , 1994, Neuroscience Research.

[39]  Glyn W. Humphreys,et al.  Motor facilitation following action observation: A behavioural study in prehensile action , 2003, Brain and Cognition.

[40]  I. Robertson,et al.  Rehabilitation of brain damage: brain plasticity and principles of guided recovery. , 1999, Psychological bulletin.

[41]  F. Binkofski,et al.  Motor functions of the Broca’s region , 2004, Brain and Language.

[42]  Andrea Serino,et al.  Action-dependent plasticity in peripersonal space representations , 2008, Cognitive neuropsychology.

[43]  Anna Czlonkowska,et al.  Underfunding of Stroke Research: A Europe-Wide Problem , 2004, Stroke.

[44]  J. Mazziotta,et al.  Cortical mechanisms of human imitation. , 1999, Science.

[45]  D. Kiper,et al.  Observing Virtual Arms that You Imagine Are Yours Increases the Galvanic Skin Response to an Unexpected Threat , 2008, PloS one.

[46]  Lara A. Boyd,et al.  Implicit motor-sequence learning in humans following unilateral stroke: the impact of practice and explicit knowledge , 2001, Neuroscience Letters.

[47]  Andrew N. Meltzoff,et al.  Neural circuits involved in imitation and perspective-taking , 2006, NeuroImage.

[48]  Melvyn A Goodale,et al.  Dual routes to action: contributions of the dorsal and ventral streams to adaptive behavior. , 2005, Progress in brain research.

[49]  P. Haggard,et al.  Viewing the body modulates tactile receptive fields , 2007, Experimental Brain Research.

[50]  R. Nudo Remodeling of cortical motor representations after stroke: implications for recovery from brain damage , 1997, Molecular Psychiatry.

[51]  J. Feigenson,et al.  Factors Influencing Outcome and Length of Stay in a Stroke Rehabilitation Unit Part 1. Analysis of 248 Unscreened Patients ‐Medical and Functional Prognostic Indicators , 1977, Stroke.

[52]  J F Kalaska,et al.  Central neural mechanisms of touch and proprioception. , 1994, Canadian journal of physiology and pharmacology.

[53]  M A Goodale,et al.  Kinematic analysis of limb movements in neuropsychological research: subtle deficits and recovery of function. , 1990, Canadian journal of psychology.

[54]  P. Raghavan,et al.  The nature of hand motor impairment after stroke and its treatment , 2007, Current treatment options in cardiovascular medicine.

[55]  G. Wulf,et al.  Social-comparative feedback affects motor skill learning. , 2010, Quarterly journal of experimental psychology.

[56]  Jaap H. Buurke,et al.  The Effectiveness of the Bobath Concept in Stroke Rehabilitation: What is the Evidence? , 2009, Stroke.

[57]  Sabah Master,et al.  Task-specific increase in corticomotor excitability during tactile discrimination , 2009, Experimental Brain Research.

[58]  Robert Riener,et al.  ARMin: a robot for patient-cooperative arm therapy , 2007, Medical & Biological Engineering & Computing.

[59]  Y. Paulignan,et al.  An Interference Effect of Observed Biological Movement on Action , 2003, Current Biology.

[60]  Douglas C Noll,et al.  Cortical Plasticity During Three-Week Motor Skill Learning , 2004, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[61]  M. Guadagnoli,et al.  Challenge Point: A Framework for Conceptualizing the Effects of Various Practice Conditions in Motor Learning , 2004, Journal of motor behavior.

[62]  Peter Langhorne,et al.  Effects of Augmented Exercise Therapy Time After Stroke: A Meta-Analysis , 2004, Stroke.

[63]  Maureen K. Holden,et al.  Virtual Environments for Motor Rehabilitation: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[64]  F. Binkofski,et al.  The mirror neuron system and action recognition , 2004, Brain and Language.

[65]  Jeroen B. J. Smeets,et al.  Avoiding moving obstacles , 2008, Experimental Brain Research.

[66]  E. Tunik,et al.  Sensorimotor training in virtual reality: a review. , 2009, NeuroRehabilitation.

[67]  John A. Pyles,et al.  Neural adaptation for novel objects during dynamic articulation , 2009, Neuropsychologia.

[68]  L. Stone,et al.  Rehabilitation of hemiparesis after stroke with a mirror , 1999, The Lancet.

[69]  G. Rizzolatti,et al.  Neural Circuits Underlying Imitation Learning of Hand Actions An Event-Related fMRI Study , 2004, Neuron.

[70]  Qinyin Qiu,et al.  Design of a Virtual Reality-Based System For Hand and Arm Rehabilitation , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[71]  Maria V. Sanchez-Vives,et al.  Virtual Hand Illusion Induced by Visuomotor Correlations , 2010, PloS one.

[72]  Eugene Tunik,et al.  Virtual reality to maximize function for hand and arm rehabilitation: exploration of neural mechanisms. , 2009, Studies in health technology and informatics.

[73]  J. Ryan,et al.  Cognitive strategy use to enhance motor skill acquisition post-stroke: A critical review , 2009, Brain injury.

[74]  P. Haggard,et al.  Can vision of the body ameliorate impaired somatosensory function? , 2007, Neuropsychologia.

[75]  David Whitney,et al.  The influence of visual motion on fast reaching movements to a stationary object , 2003, Nature.

[76]  C. Fisher,et al.  Concerning the Mechanism of Recovery in Stroke Hemiphegia , 1992, Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques.

[77]  J. Soechting,et al.  Somatosensory cortical activity in relation to arm posture: nonuniform spatial tuning. , 1996, Journal of neurophysiology.

[78]  Bent Indredavik,et al.  Not All Stroke Units Are the Same: A Comparison of Physical Activity Patterns in Melbourne, Australia, and Trondheim, Norway , 2008, Stroke.

[79]  J. Feigenson,et al.  Factors Influencing Outcome and Length of Stay in a Stroke Rehabilitation Unit: Part 2. Comparison of 318 Screened and 248 Unscreened Patients , 1977, Stroke.

[80]  E. Burdet,et al.  Robot-assisted rehabilitation of hand function. , 2010, Current opinion in neurology.

[81]  M. Johnson,et al.  Quantifying kinematics of purposeful movements to real, imagined, or absent functional objects: Implications for modelling trajectories for robot-assisted ADL tasks** , 2007, Journal of NeuroEngineering and Rehabilitation.

[82]  R. Nudo,et al.  Neural Substrates for the Effects of Rehabilitative Training on Motor Recovery After Ischemic Infarct , 1996, Science.

[83]  Alvaro Pascual-Leone,et al.  The time course of off-line motor sequence learning. , 2005, Brain research. Cognitive brain research.

[84]  Geoffrey Donnan,et al.  Inactive and Alone: Physical Activity Within the First 14 Days of Acute Stroke Unit Care , 2004, Stroke.

[85]  KM Jacobs,et al.  Reshaping the cortical motor map by unmasking latent intracortical connections , 1991, Science.

[86]  M. Goodale,et al.  Chapter 28 Visual pathways to perception and action , 1993 .

[87]  H. C. Dijkerman,et al.  Interference of grasping observation during prehension, a behavioural study , 2006, Experimental Brain Research.

[88]  A. Timmermans,et al.  Technology-assisted training of arm-hand skills in stroke: concepts on reacquisition of motor control and therapist guidelines for rehabilitation technology design , 2009, Journal of NeuroEngineering and Rehabilitation.

[89]  Eliane C Magdalon,et al.  Virtual reality environments to enhance upper limb functional recovery in patients with hemiparesis. , 2009, Studies in health technology and informatics.

[90]  G. Kwakkel,et al.  The impact of physical therapy on functional outcomes after stroke: what's the evidence? , 2004, Clinical rehabilitation.

[91]  Patrick Haggard,et al.  On-Line Control of Grasping Actions: Object-Specific Motor Facilitation Requires Sustained Visual Input , 2007, The Journal of Neuroscience.

[92]  L. Cohen,et al.  Concurrent action observation modulates practice‐induced motor memory formation , 2008, The European journal of neuroscience.

[93]  Catherine E Lang,et al.  Counting Repetitions: An Observational Study of Outpatient Therapy for People with Hemiparesis Post-Stroke , 2007, Journal of neurologic physical therapy : JNPT.

[94]  Melvyn A. Goodale,et al.  Seeing all the obstacles in your way: the effect of visual feedback and visual feedback schedule on obstacle avoidance while reaching , 2010, Experimental Brain Research.

[95]  G. Kwakkel,et al.  Understanding the pattern of functional recovery after stroke: facts and theories. , 2004, Restorative neurology and neuroscience.

[96]  M. Iacoboni,et al.  The mirror neuron system and the consequences of its dysfunction , 2006, Nature Reviews Neuroscience.

[97]  Michael Recce,et al.  A virtual reality based exercise system for hand rehabilitation post-stroke: transfer to function , 2004, EMBC 2004.

[98]  J. Krakauer Motor learning: its relevance to stroke recovery and neurorehabilitation. , 2006, Current opinion in neurology.

[99]  Jeremy D Wong,et al.  Visual cues signaling object grasp reduce interference in motor learning. , 2009, Journal of neurophysiology.

[100]  C. Asanuma Mapping movements within a moving motor map , 1991, Trends in Neurosciences.

[101]  J. Lackner,et al.  Vestibular, proprioceptive, and haptic contributions to spatial orientation. , 2005, Annual review of psychology.

[102]  Steven C Cramer,et al.  Repairing the human brain after stroke. II. Restorative therapies , 2008, Annals of neurology.

[103]  P Tallal,et al.  Cortical plasticity underlying perceptual, motor, and cognitive skill development: implications for neurorehabilitation. , 1996, Cold Spring Harbor symposia on quantitative biology.

[104]  Leslie G. Ungerleider,et al.  Formation of a Motor Memory by Action Observation , 2005, The Journal of Neuroscience.

[105]  B. Dobkin Activity‐dependent learning contributes to motor recovery , 1998, Annals of neurology.

[106]  A. Timmermans,et al.  Arm and hand skills: Training preferences after stroke , 2009, Disability and rehabilitation.