Physical Extraction and Feature Fusion for Multi-Mode Signals in a Measurement System for Patients in Rehabilitation Exoskeleton

Measurement system of exoskeleton robots can reflect the state of the patient. In this study, we combined an inertial measurement unit and a visual measurement unit to obtain a repeatable fusion measurement system to compensate for the deficiencies of the single data acquisition mode used by exoskeletons. Inertial measurement unit is comprised four distributed angle sensors. Triaxial acceleration and angular velocity information were transmitted to an upper computer by Bluetooth. The data sent to the control center were processed by a Kalman filter to eliminate any noise. Visual measurement unit uses camera to acquire real time images and related data information. The two data acquisition methods were fused and have its weight. Comparisons of the fusion results with individual measurement results demonstrated that the data fusion method could effectively improve the accuracy of system. It provides a set of accurate real-time measurements for patients in rehabilitation exoskeleton and data support for effective control of exoskeleton robot.

[1]  Chee-Meng Chew,et al.  Novel Functional Task-Based Gait Assistance Control of Lower Extremity Assistive Device for Level Walking , 2016, IEEE Transactions on Industrial Electronics.

[2]  Qingguo Li,et al.  Concurrent validation of Xsens MVN measurement of lower limb joint angular kinematics , 2013, Physiological measurement.

[3]  James Llinas,et al.  An introduction to multisensor data fusion , 1997, Proc. IEEE.

[4]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[5]  J. L. Roux.  An Introduction to the Kalman Filter , 2003 .

[6]  Wei Guo,et al.  A flexible sensing system capable of sensations imitation and motion monitoring with reliable encapsulation , 2018 .

[7]  Paolo Bonato,et al.  Wearable Sensors and Systems , 2010, IEEE Engineering in Medicine and Biology Magazine.

[8]  Umit Onen,et al.  Design and Actuator Selection of a Lower Extremity Exoskeleton , 2014, IEEE/ASME Transactions on Mechatronics.

[9]  Chang-Soo Han,et al.  Development of real-time gait phase detection system for a lower extremity exoskeleton robot , 2017 .

[10]  Russell H. Taylor,et al.  Medical robotics in computer-integrated surgery , 2003, IEEE Trans. Robotics Autom..

[11]  Asier Zubizarreta,et al.  Virtual Sensors for Advanced Controllers in Rehabilitation Robotics , 2018, Sensors.

[12]  Wei Yang,et al.  Human hip joint center analysis for biomechanical design of a hip joint exoskeleton , 2016, Frontiers of Information Technology & Electronic Engineering.

[13]  Masayoshi Tomizuka,et al.  A Wireless Human Motion Monitoring System Based on Joint Angle Sensors and Smart Shoes , 2014, HRI 2014.

[14]  James L. Crowley,et al.  Mathematical Foundations of Navigation and Perception for an Autonomous Mobile Robot , 1995, Reasoning with Uncertainty in Robotics.

[15]  E. Wood,et al.  Data Assimilation for Estimating the Terrestrial Water Budget Using a Constrained Ensemble Kalman Filter , 2006 .

[16]  F. Biering-Sørensen,et al.  Gait training after spinal cord injury: safety, feasibility and gait function following 8 weeks of training with the exoskeletons from Ekso Bionics , 2017, Spinal Cord.

[17]  Robert J. Wood,et al.  Wearable soft sensing suit for human gait measurement , 2014, Int. J. Robotics Res..

[18]  Kyoungchul Kong,et al.  A mobile motion capture system based on inertial sensors and smart shoes , 2013, 2013 IEEE International Conference on Robotics and Automation.

[19]  Jang Gyu Lee,et al.  Dead reckoning navigation of a mobile robot using an indirect Kalman filter , 1996, 1996 IEEE/SICE/RSJ International Conference on Multisensor Fusion and Integration for Intelligent Systems (Cat. No.96TH8242).

[20]  Dafang Zhuang,et al.  Advances in Multi-Sensor Data Fusion: Algorithms and Applications , 2009, Sensors.

[21]  Masayoshi Tomizuka,et al.  A Wireless Human Motion Monitoring System for Smart Rehabilitation , 2016 .

[22]  Yoshiaki Hayashi,et al.  An EMG-Based Control for an Upper-Limb Power-Assist Exoskeleton Robot , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  A. Esquenazi,et al.  Safety and tolerance of the ReWalk™ exoskeleton suit for ambulation by people with complete spinal cord injury: A pilot study , 2012, The journal of spinal cord medicine.

[24]  Thomas Moore,et al.  A Generalized Extended Kalman Filter Implementation for the Robot Operating System , 2014, IAS.

[25]  Pascal Vasseur,et al.  Introduction to multi-sensor data fusion , 2004 .

[26]  Jianhai Han,et al.  Active rehabilitation training system for upper limb based on virtual reality , 2017 .

[27]  Bram Vanderborght,et al.  Multi-Axis Force Sensor for Human–Robot Interaction Sensing in a Rehabilitation Robotic Device , 2017, Sensors.

[28]  D Thalmann,et al.  Using skeleton-based tracking to increase the reliability of optical motion capture. , 2001, Human movement science.