Inertial-Robotic Motion Tracking in End-Effector-Based Rehabilitation Robots

End-effector-based robotic systems provide easy-to-set-up motion support in rehabilitation of stroke and spinal-cord-injured patients. However, measurement information is obtained only about the motion of the limb segments to which the systems are attached and not about the adjacent limb segments. We demonstrate in one particular experimental setup that this limitation can be overcome by augmenting an end-effector-based robot with a wearable inertial sensor. Most existing inertial motion tracking approaches rely on a homogeneous magnetic field and thus fail in indoor environments and near ferromagnetic materials and electronic devices. In contrast, we propose a magnetometer-free sensor fusion method. It uses a quaternion-based algorithm to track the heading of a limb segment in real time by combining the gyroscope and accelerometer readings with position measurements of one point along that segment. We apply this method to an upper-limb rehabilitation robotics use case in which the orientation and position of the forearm and elbow are known, and the orientation and position of the upper arm and shoulder are estimated by the proposed method using an inertial sensor worn on the upper arm. Experimental data from five healthy subjects who performed 282 proper executions of a typical rehabilitation motion and 163 executions with compensation motion are evaluated. Using a camera-based system as a ground truth, we demonstrate that the shoulder position and the elbow angle are tracked with median errors around 4 cm and 4°, respectively; and that undesirable compensatory shoulder movements, which were defined as shoulder displacements greater ±10 cm for more than 20% of a motion cycle, are detected and classified 100% correctly across all 445 performed motions. The results indicate that wearable inertial sensors and end-effector-based robots can be combined to provide means for effective rehabilitation therapy with likewise detailed and accurate motion tracking for performance assessment, real-time biofeedback and feedback control of robotic and neuroprosthetic motion support.

[1]  Loredana Zollo,et al.  Upper-limb kinematic reconstruction during stroke robot-aided therapy , 2015, Medical & Biological Engineering & Computing.

[2]  Loredana Zollo,et al.  Human arm joints reconstruction algorithm in rehabilitation therapies assisted by end-effector robotic devices , 2018, Journal of NeuroEngineering and Rehabilitation.

[4]  B. Wünsche,et al.  Assessment of movement quality in robot- assisted upper limb rehabilitation after stroke: a review , 2014, Journal of NeuroEngineering and Rehabilitation.

[5]  F. V. D. van der Helm,et al.  Magnetic distortion in motion labs, implications for validating inertial magnetic sensors. , 2009, Gait & posture.

[6]  Thomas B. Schön,et al.  An optimization-based approach to human body motion capture using inertial sensors , 2014 .

[7]  Thomas Seel,et al.  Hybrid Inertial-Robotic Motion Tracking for Posture Biofeedback in Upper Limb Rehabilitation* , 2018, 2018 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob).

[8]  Guobin Shen,et al.  Magicol: Indoor Localization Using Pervasive Magnetic Field and Opportunistic WiFi Sensing , 2015, IEEE Journal on Selected Areas in Communications.

[9]  Huosheng Hu,et al.  Human motion tracking for rehabilitation - A survey , 2008, Biomed. Signal Process. Control..

[10]  Torsten Bumgarner,et al.  Biomechanics and Motor Control of Human Movement , 2013 .

[11]  H. F. Machiel van der Loos,et al.  Development of robots for rehabilitation therapy: the Palo Alto VA/Stanford experience. , 2000, Journal of rehabilitation research and development.

[12]  M. Levin,et al.  Compensatory Versus Noncompensatory Shoulder Movements Used for Reaching in Stroke , 2016, Neurorehabilitation and neural repair.

[13]  Marc-André Bégin,et al.  Magnetometer-free Realtime Inertial Motion Tracking by Exploitation of Kinematic Constraints in 2-DoF Joints , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[14]  John Weston,et al.  Strapdown Inertial Navigation Technology , 1997 .

[15]  Qingcong Wu,et al.  Analytical Inverse Kinematic Resolution of a Redundant Exoskeleton for Upper-Limb Rehabilitation , 2016, Int. J. Humanoid Robotics.

[16]  Alireza Gharabaghi,et al.  Compensation or Restoration: Closed-Loop Feedback of Movement Quality for Assisted Reach-to-Grasp Exercises with a Multi-Joint Arm Exoskeleton , 2016, Front. Neurosci..

[17]  Thomas Seel,et al.  Exploiting kinematic constraints to compensate magnetic disturbances when calculating joint angles of approximate hinge joints from orientation estimates of inertial sensors , 2017, 2017 International Conference on Rehabilitation Robotics (ICORR).

[18]  Andrea C. Bozoki,et al.  Classification of Alzheimer’s Disease, Mild Cognitive Impairment and Normal Control Subjects Using Resting-State fMRI Based Network Connectivity Analysis , 2018, IEEE Journal of Translational Engineering in Health and Medicine.

[19]  L Dipietro,et al.  Changing motor synergies in chronic stroke. , 2007, Journal of neurophysiology.

[20]  Ricardo Morales,et al.  Kinematic reconstruction of the human arm joints in robot-aided therapies with Hermes robot , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[21]  Francisco J. Badesa,et al.  Estimation of Human Arm Joints Using Two Wireless Sensors in Robotic Rehabilitation Tasks , 2015, Sensors.

[22]  Norbert Schmitz,et al.  Survey of Motion Tracking Methods Based on Inertial Sensors: A Focus on Upper Limb Human Motion , 2017, Sensors.

[23]  Sebastian Thrun,et al.  3-Axis magnetic field mapping and fusion for indoor localization , 2012, 2012 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[24]  G. Merolla,et al.  Robotics in shoulder rehabilitation. , 2014, Muscles, ligaments and tendons journal.

[25]  Oscar Ruiz-Salguero,et al.  Inverse Kinematics for Upper Limb Compound Movement Estimation in Exoskeleton-Assisted Rehabilitation , 2016, BioMed research international.

[26]  T. Sinkjær,et al.  Control of Movement for the Physically Disabled , 2000 .

[27]  S. Leonhardt,et al.  A survey on robotic devices for upper limb rehabilitation , 2014, Journal of NeuroEngineering and Rehabilitation.

[28]  Longhan Xie,et al.  sEMG-Based Trunk Compensation Detection in Rehabilitation Training , 2019, Front. Neurosci..

[29]  Rory A. Cooper,et al.  Using the kinect to limit abnormal kinematics and compensation strategies during therapy with end effector robots , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[30]  Bertram Taetz,et al.  Towards self-calibrating inertial body motion capture , 2016, 2016 19th International Conference on Information Fusion (FUSION).

[31]  Matjaz Mihelj,et al.  Human arm kinematics for robot based rehabilitation , 2005, Robotica.

[32]  Sheroz Khan,et al.  Motion capture sensing techniques used in human upper limb motion: a review , 2019, Sensor Review.

[33]  Luca Padua,et al.  Robotic and Sensor Technology for Upper Limb Rehabilitation , 2018, PM & R : the journal of injury, function, and rehabilitation.

[34]  R. Riener,et al.  Increasing motivation in robot-aided arm rehabilitation with competitive and cooperative gameplay , 2014, Journal of NeuroEngineering and Rehabilitation.

[35]  David A. Forsyth,et al.  Skeletal parameter estimation from optical motion capture data , 2004, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[36]  Ram Dantu,et al.  LocateMe , 2013, ACM Trans. Intell. Syst. Technol..

[37]  Bulmaro A. Valdés,et al.  Biofeedback vs. game scores for reducing trunk compensation after stroke: a randomized crossover trial , 2018, Topics in stroke rehabilitation.

[38]  Timothy D. Lee,et al.  Motor Learning and Performance: From Principles to Application , 2013 .

[39]  Babak Taati,et al.  Automatic Detection of Compensation During Robotic Stroke Rehabilitation Therapy , 2018, IEEE Journal of Translational Engineering in Health and Medicine.

[40]  S. Garbade,et al.  Clinical relevance of the effects of reach-to-grasp training using trunk restraint in individuals with hemiparesis poststroke: A systematic review. , 2016, Journal of rehabilitation medicine.

[41]  Thomas Seel,et al.  Eliminating the Effect of Magnetic Disturbances on the Inclination Estimates of Inertial Sensors , 2017 .

[42]  Thomas Seel,et al.  On Motions That Allow for Identification of Hinge Joint Axes from Kinematic Constraints and 6D IMU Data , 2019, 2019 18th European Control Conference (ECC).

[43]  D. Anton Occupational biomechanics , 1986 .

[44]  Alessandro Tognetti,et al.  Wearable Goniometer and Accelerometer Sensory Fusion for Knee Joint Angle Measurement in Daily Life , 2015, Sensors.

[45]  Jill Whitall,et al.  Compensatory arm reaching strategies after stroke: induced position analysis. , 2013, Journal of rehabilitation research and development.

[46]  P. Gallina,et al.  Design, Implementation and Clinical Tests of a Wire-Based Robot for Neurorehabilitation , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[47]  Agnès Roby-Brami,et al.  The trunk as a part of the kinematic chain for reaching movements in healthy subjects and hemiparetic patients , 2011, Brain Research.

[48]  Fredrik Olsson,et al.  Joint Axis Estimation for Fast and Slow Movements Using Weighted Gyroscope and Acceleration Constraints , 2019, 2019 22th International Conference on Information Fusion (FUSION).

[49]  Thomas Seel,et al.  Automatic anatomical calibration for IMU-based elbow angle measurement in disturbed magnetic fields , 2017 .

[50]  Thomas Seel,et al.  Alignment-free, self-calibrating elbow angles measurement using inertial sensors , 2017, 2016 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI).

[51]  D. Reinkensmeyer,et al.  Review of control strategies for robotic movement training after neurologic injury , 2009, Journal of NeuroEngineering and Rehabilitation.

[52]  Simona Crea,et al.  Design and Experimental Characterization of a Shoulder-Elbow Exoskeleton With Compliant Joints for Post-Stroke Rehabilitation , 2019, IEEE/ASME Transactions on Mechatronics.

[53]  David Putrino,et al.  Robotic Rehabilitation and Spinal Cord Injury: a Narrative Review , 2018, Neurotherapeutics.

[54]  M. Levin,et al.  Compensatory strategies for reaching in stroke. , 2000, Brain : a journal of neurology.

[55]  Sebastian Madgwick,et al.  Estimation of IMU and MARG orientation using a gradient descent algorithm , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[56]  J. Basmajian,et al.  Agonist and antagonist activity during voluntary upper-limb movement in patients with stroke. , 1992, Physical therapy.

[57]  J. Daly,et al.  Comparison of robotics, functional electrical stimulation, and motor learning methods for treatment of persistent upper extremity dysfunction after stroke: a randomized controlled trial. , 2015, Archives of physical medicine and rehabilitation.

[58]  E D Oña,et al.  A Review of Robotics in Neurorehabilitation: Towards an Automated Process for Upper Limb , 2018, Journal of healthcare engineering.

[59]  Thomas Schauer,et al.  Sensing motion and muscle activity for feedback control of functional electrical stimulation: Ten years of experience in Berlin , 2017, Annu. Rev. Control..

[60]  M. Levin,et al.  What Do Motor “Recovery” and “Compensation” Mean in Patients Following Stroke? , 2009, Neurorehabilitation and neural repair.

[61]  Jaap H. Buurke,et al.  Inertial Sensor Measurements of Upper-Limb Kinematics in Stroke Patients in Clinic and Home Environment , 2018, Front. Bioeng. Biotechnol..

[62]  Luca De Vito,et al.  Measurements and sensors for motion tracking in motor rehabilitation , 2014, IEEE Instrumentation & Measurement Magazine.

[63]  Denis Mottet,et al.  Rehabilitation of arm function after stroke. Literature review. , 2009, Annals of physical and rehabilitation medicine.

[64]  Thomas Seel,et al.  Realtime assessment of foot orientation by Accelerometers and Gyroscopes , 2015 .

[65]  Olivier Lambercy,et al.  Magnetometer-Based Drift Correction During Rest in IMU Arm Motion Tracking , 2019, Sensors.

[66]  Thomas Seel,et al.  A Tangible Solution for Hand Motion Tracking in Clinical Applications , 2019, Sensors.

[67]  C. Burgar,et al.  Robot-assisted movement training compared with conventional therapy techniques for the rehabilitation of upper-limb motor function after stroke. , 2002, Archives of physical medicine and rehabilitation.

[68]  Francesca Cordella,et al.  Bio-Cooperative Approach for the Human-in-the-Loop Control of an End-Effector Rehabilitation Robot , 2018, Front. Neurorobot..