Validation and test of a closed-loop tele-rehabilitation system based on functional electrical stimulation and computer vision for analysing facial expressions in stroke patients

The aim of the present study was to validate and test a closed-loop tele-rehabilitation system for training of hand function and analyzing facial expressions in stroke patients. The paper presents the methods for controlling functional electrical stimulation (FES) to assist hand opening and grasping. The main outcome of the FES control was time differences in grip detections performed by the automatic system and by analysis of the output from force sensing resistors. This time difference was in the range of 0 to 0.8 s. Results from analysis of facial expressions were very variable showing that subjects were disgusted, happy and angry during the exercises, which were not in agreement with the observations made during the experimental sessions.

[1]  N. Lannin,et al.  Telerehabilitation services for stroke. , 2013, The Cochrane database of systematic reviews.

[2]  Chris Harris,et al.  Markerless Motion Capture and Measurement of Hand Kinematics: Validation and Application to Home-Based Upper Limb Rehabilitation , 2013, IEEE Transactions on Biomedical Engineering.

[3]  Veronika Fialka-Moser,et al.  Non-invasive neuromuscular electrical stimulation in patients with central nervous system lesions: an educational review. , 2012, Journal of rehabilitation medicine.

[4]  Subashan Perera,et al.  Persisting Consequences of Stroke Measured by the Stroke Impact Scale , 2002, Stroke.

[5]  Thomas B. Moeslund,et al.  Improved pulse detection from head motions using DCT , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[6]  S. Brophy,et al.  Interventions for latent autoimmune diabetes (LADA) in adults. , 2011, The Cochrane database of systematic reviews.

[7]  Gernot R. Müller-Putz,et al.  Kinect-based detection of self-paced hand movements: Enhancing functional brain mapping paradigms , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[9]  G. Kwakkel,et al.  Impact of EMG-triggered neuromuscular stimulation of the wrist and finger extensors of the paretic hand after stroke: a systematic review of the literature , 2008, Clinical rehabilitation.

[10]  T. Olsen,et al.  Outcome and time course of recovery in stroke. Part II: Time course of recovery. The Copenhagen Stroke Study. , 1995, Archives of physical medicine and rehabilitation.

[11]  C. Darwin,et al.  The Expression of the Emotions in Man and Animals: Frontmatter , 1916 .

[12]  P. Knapp Expression of the emotions in man , 1963 .

[13]  Tim Johansson,et al.  Telerehabilitation in stroke care – a systematic review , 2011, Journal of telemedicine and telecare.

[14]  R. B. Knapp,et al.  Physiological signals and their use in augmenting emotion recognition for human-machine interaction , 2011 .