Design and Test of a Closed-Loop FES System for Supporting Function of the Hemiparetic Hand Based on Automatic Detection Using the Microsoft Kinect Sensor

This paper describes the design of a FES system automatically controlled in a closed loop using a Microsoft Kinect sensor, for assisting both cylindrical grasping and hand opening. The feasibility of the system was evaluated in real-time in stroke patients with hand function deficits. A hand function exercise was designed in which the subjects performed an arm and hand exercise in sitting position. The subject had to grasp one of two differently sized cylindrical objects and move it forward or backwards in the sagittal plane. This exercise was performed with each cylinder with and without FES support. Results showed that the stroke patients were able to perform up to 29% more successful grasps when they were assisted by FES. Moreover, the hand grasp-and-hold and hold-and-release durations were shorter for the smaller of the two cylinders. FES was appropriately timed in more than 95% of all trials indicating successful closed loop FES control. Future studies should incorporate options for assisting forward reaching in order to target a larger group of stroke patients.

[1]  Mary Y. Harley,et al.  Contralaterally Controlled Functional Electrical Stimulation for Upper Extremity Hemiplegia , 2012, Neurorehabilitation and neural repair.

[2]  James H. Cauraugh,et al.  Electromyogram-triggered neuromuscular stimulation and stroke motor recovery of arm/hand functions: a meta-analysis , 2004, Journal of the Neurological Sciences.

[3]  Subashan Perera,et al.  Persisting Consequences of Stroke Measured by the Stroke Impact Scale , 2002, Stroke.

[4]  Veronika Fialka-Moser,et al.  Non-invasive neuromuscular electrical stimulation in patients with central nervous system lesions: an educational review. , 2012, Journal of rehabilitation medicine.

[5]  Eric Rogers,et al.  The application of precisely controlled functional electrical stimulation to the shoulder, elbow and wrist for upper limb stroke rehabilitation: a feasibility study , 2014, Journal of NeuroEngineering and Rehabilitation.

[6]  R. Tong,et al.  Bilateral Upper Limb Training With Functional Electric Stimulation in Patients With Chronic Stroke , 2009, Neurorehabilitation and Neural Repair.

[7]  Thierry Keller,et al.  A multi-pad electrode based functional electrical stimulation system for restoration of grasp , 2012, Journal of NeuroEngineering and Rehabilitation.

[8]  Ning Jiang,et al.  Peripheral Electrical Stimulation Triggered by Self-Paced Detection of Motor Intention Enhances Motor Evoked Potentials , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  T. Loetscher,et al.  Cognitive rehabilitation for attention deficits following stroke. , 2019, The Cochrane database of systematic reviews.

[10]  Julius P. A. Dewald,et al.  Involuntary paretic wrist/finger flexion forces and EMG increase with shoulder abduction load in individuals with chronic stroke , 2012, Clinical Neurophysiology.

[11]  J. Kleim,et al.  Principles of experience-dependent neural plasticity: implications for rehabilitation after brain damage. , 2008, Journal of speech, language, and hearing research : JSLHR.

[12]  Owen Howlett,et al.  Functional electrical stimulation improves activity after stroke: a systematic review with meta-analysis. , 2015, Archives of physical medicine and rehabilitation.

[13]  Nathaniel S. Makowski,et al.  Functional Electrical Stimulation to Augment Poststroke Reach and Hand Opening in the Presence of Voluntary Effort , 2014, Neurorehabilitation and neural repair.

[14]  Geraldine Mann,et al.  Accelerometer-Triggered Electrical Stimulation for Reach and Grasp in Chronic Stroke Patients , 2011, Neurorehabilitation and neural repair.

[15]  Maarten J. IJzerman,et al.  Electrical stimulation of the upper extremity in stroke: cyclic versus EMG-triggered stimulation , 2008, Clinical rehabilitation.

[16]  Dejan B Popović,et al.  Microsoft Kinect-Based Artificial Perception System for Control of Functional Electrical Stimulation Assisted Grasping , 2014, BioMed research international.

[17]  G. Kwakkel,et al.  Impact of EMG-triggered neuromuscular stimulation of the wrist and finger extensors of the paretic hand after stroke: a systematic review of the literature , 2008, Clinical rehabilitation.

[18]  T. Olsen,et al.  Outcome and time course of recovery in stroke. Part II: Time course of recovery. The Copenhagen Stroke Study. , 1995, Archives of physical medicine and rehabilitation.

[19]  T. Sinkjaer,et al.  Clinical evaluation of Functional Electrical Therapy in acute hemiplegic subjects. , 2003, Journal of rehabilitation research and development.