MAGNI Dynamics: A Vision-Based Kinematic and Dynamic Upper-Limb Model for Intelligent Robotic Rehabilitation

This paper presents a home-based robot-rehabilitation instrument, called ”MAGNI Dynamics”, that utilized a vision-based kinematic/dynamic module and an adaptive haptic feedback controller. The system is expected to provide personalized rehabilitation by adjusting its resistive and supportive behavior according to a fuzzy intelligence controller that acts as an inference system, which correlates the user’s performance to different stiffness factors. The vision module uses the Kinect’s skeletal tracking to monitor the user’s effort in an unobtrusive and safe way, by estimating the torque that affects the user’s arm. The system’s torque estimations are justified by capturing electromyographic data from primitive hand motions (Shoulder Abduction and Shoulder Forward Flexion). Moreover, we present and analyze how the Barrett WAM generates a force-field with a haptic controller to support or challenge the users. Experiments show that by shifting the proportional value, that corresponds to different stiffness factors of the haptic path, can potentially help the user to improve his/her motor skills. Finally, potential areas for future research are discussed, that address how a rehabilitation robotic framework may include multisensing data, to improve the user’s recovery process. Keywords—Human-robot interaction, kinect, kinematics, dynamics, haptic control, rehabilitation robotics, artificial intelligence.

[1]  Fillia Makedon,et al.  A Motion and Force Analysis System for Human Upper-limb Exercises , 2016, PETRA.

[2]  F. Sandford,et al.  The intra- and inter-rater reliability of manual muscle testing and a hand-held dynamometer for measuring wrist strength in symptomatic and asymptomatic subjects , 2011 .

[3]  S. Cuthbert,et al.  On the reliability and validity of manual muscle testing: a literature review , 2007, Chiropractic & osteopathy.

[4]  Fillia Makedon,et al.  MAGNI: A Real-Time Robot-Aided Game-Based Tele-Rehabilitation System , 2016, HCI.

[5]  Martin Levesley,et al.  Home-based Computer Assisted Arm Rehabilitation (hCAAR) robotic device for upper limb exercise after stroke: results of a feasibility study in home setting , 2014, Journal of NeuroEngineering and Rehabilitation.

[6]  S.K. Agrawal,et al.  Active Leg Exoskeleton (ALEX) for Gait Rehabilitation of Motor-Impaired Patients , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[7]  Subhas Chandra Mukhopadhyay,et al.  Wearable Sensors for Human Activity Monitoring: A Review , 2015, IEEE Sensors Journal.

[8]  Bruno Dehez,et al.  A robotic device as a sensitive quantitative tool to assess upper limb impairments in stroke patients: a preliminary prospective cohort study. , 2012, Journal of rehabilitation medicine.

[9]  Loredana Zollo,et al.  Dynamic Adaptive System for Robot-Assisted Motion Rehabilitation , 2016, IEEE Systems Journal.

[10]  Vangelis Metsis,et al.  Guided physical therapy through the use of the Barrett WAM robotic arm , 2014, 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE) Proceedings.

[11]  Sheng Quan Xie,et al.  Exoskeleton robots for upper-limb rehabilitation: state of the art and future prospects. , 2012, Medical engineering & physics.

[12]  C. Detrembleur,et al.  Joint torque variability and repeatability during cyclic flexion-extension of the elbow , 2016, BMC Sports Science, Medicine and Rehabilitation.

[13]  J. Liu,et al.  Learning to perform a novel movement pattern using haptic guidance: slow learning, rapid forgetting, and attractor paths , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[14]  H. Gomi,et al.  Multijoint muscle regulation mechanisms examined by measured human arm stiffness and EMG signals. , 1999, Journal of neurophysiology.

[15]  Frank Tendick,et al.  Haptic guidance: experimental evaluation of a haptic training method for a perceptual motor skill , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[16]  Margrit Betke,et al.  Dynamic Adjustment of Physical Exercises Based on Performance Using the Proficio Robotic Arm , 2016, PETRA.

[17]  Alessandro De Luca,et al.  A modified newton-euler method for dynamic computations in robot fault detection and control , 2009, 2009 IEEE International Conference on Robotics and Automation.

[18]  John J. Craig Zhu,et al.  Introduction to robotics mechanics and control , 1991 .

[19]  Fillia Makedon,et al.  Robot-aided rehabilitation using force analysis , 2015, PETRA.

[20]  C. Hagert,et al.  Manual strength testing in 14 upper limb muscles: a study of inter-rater reliability. , 2004, Acta orthopaedica Scandinavica.

[21]  Fillia Makedon,et al.  Quantitative analysis of the human upper-limp kinematic model for robot-based rehabilitation applications , 2016, 2016 IEEE International Conference on Automation Science and Engineering (CASE).

[22]  Alex Mihailidis,et al.  Development of a fuzzy logic based intelligent system for autonomous guidance of post-stroke rehabilitation exercise , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).