A New Multi-Sensor Fusion Scheme to Improve the Accuracy of Knee Flexion Kinematics for Functional Rehabilitation Movements

Exergames have been proposed as a potential tool to improve the current practice of musculoskeletal rehabilitation. Inertial or optical motion capture sensors are commonly used to track the subject’s movements. However, the use of these motion capture tools suffers from the lack of accuracy in estimating joint angles, which could lead to wrong data interpretation. In this study, we proposed a real time quaternion-based fusion scheme, based on the extended Kalman filter, between inertial and visual motion capture sensors, to improve the estimation accuracy of joint angles. The fusion outcome was compared to angles measured using a goniometer. The fusion output shows a better estimation, when compared to inertial measurement units and Kinect outputs. We noted a smaller error (3.96°) compared to the one obtained using inertial sensors (5.04°). The proposed multi-sensor fusion system is therefore accurate enough to be applied, in future works, to our serious game for musculoskeletal rehabilitation.

[1]  H. Fardoun,et al.  Virtual Rehabilitation for Multiple Sclerosis Using a Kinect-Based System: Randomized Controlled Trial , 2014, JMIR serious games.

[2]  Tao Liu,et al.  Development of a wearable sensor system for quantitative gait analysis , 2009 .

[3]  L. Brosseau,et al.  Intratester and intertester reliability and criterion validity of the parallelogram and universal goniometers for active knee flexion in healthy subjects. , 1997, Physiotherapy research international : the journal for researchers and clinicians in physical therapy.

[4]  Noel E. O'Connor,et al.  Low-cost accurate skeleton tracking based on fusion of kinect and wearable inertial sensors , 2014, 2014 22nd European Signal Processing Conference (EUSIPCO).

[5]  Halim Elie Tannous.  Interactive and connected rehabilitation systems for e-health. (La rééducation fonctionnelle à domicile) , 2016 .

[6]  Thomas Lindh,et al.  Local Time Synchronization in Bluetooth Piconets for Data Fusion Using Mobile Phones , 2011, 2011 International Conference on Body Sensor Networks.

[7]  B Bonnechère,et al.  Validity and reliability of the Kinect within functional assessment activities: comparison with standard stereophotogrammetry. , 2014, Gait & posture.

[8]  Noel E. O'Connor,et al.  HeartHealth: A Cardiovascular Disease Home-based Rehabilitation System , 2015, EUSPN/ICTH.

[9]  Brice Bouvier,et al.  Upper Limb Kinematics Using Inertial and Magnetic Sensors: Comparison of Sensor-to-Segment Calibrations , 2015, Sensors.

[10]  Juan Manuel Ibarra Zannatha,et al.  Development of a system based on 3D vision, interactive virtual environments, ergonometric signals and a humanoid for stroke rehabilitation , 2013, Comput. Methods Programs Biomed..

[11]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[12]  Franck Multon,et al.  Pose Estimation with a Kinect for Ergonomic Studies: Evaluation of the Accuracy Using a Virtual Mannequin , 2015, Sensors.

[13]  Roderick Murray-Smith,et al.  Fusing Kinect sensor and inertial sensors with multi-rate Kalman filter , 2014 .

[14]  Alexandra Pfister,et al.  Comparative abilities of Microsoft Kinect and Vicon 3D motion capture for gait analysis , 2014, Journal of medical engineering & technology.

[15]  Peter H Veltink,et al.  Accelerometer and rate gyroscope measurement of kinematics: an inexpensive alternative to optical motion analysis systems. , 2002, Journal of biomechanics.

[16]  Yao-Jen Chang,et al.  A Kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities. , 2011, Research in developmental disabilities.

[17]  Edwin Olson,et al.  A passive solution to the sensor synchronization problem , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Li Wang,et al.  Quaternion-Based Kalman Filter for AHRS Using an Adaptive-Step Gradient Descent Algorithm , 2015 .

[19]  B. Andrews,et al.  Detecting absolute human knee angle and angular velocity using accelerometers and rate gyroscopes , 2001, Medical and Biological Engineering and Computing.

[20]  Joel C. Perry,et al.  Effective Game use in Neurorehabilitation: User-Centered Perspectives , 2011 .

[21]  Aria Alasty,et al.  Human Arm Motion Tracking by Orientation-Based Fusion of Inertial Sensors and Kinect Using Unscented Kalman Filter. , 2016, Journal of biomechanical engineering.

[22]  Pascal Fua,et al.  Estimation and visualization of sagittal kinematics of lower limbs orientation using body-fixed sensors , 2006, IEEE Transactions on Biomedical Engineering.

[23]  Armando Barreto,et al.  Implementing a Sensor Fusion Algorithm for 3D Orientation Detection with Inertial/Magnetic Sensors , 2015 .

[24]  Wei Li,et al.  Motion games improve balance control in stroke survivors: A preliminary study based on the principle of constraint-induced movement therapy , 2013, Displays.

[25]  Daniel Cremers,et al.  Real-time human motion tracking using multiple depth cameras , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  B M Jolles,et al.  Functional calibration procedure for 3D knee joint angle description using inertial sensors. , 2009, Journal of biomechanics.

[27]  Dong Pyo Jang,et al.  Development of virtual reality proprioceptive rehabilitation system for stroke patients , 2014, Comput. Methods Programs Biomed..

[28]  R. B. Davis,et al.  A gait analysis data collection and reduction technique , 1991 .

[29]  Robert B. McGhee,et al.  An extended Kalman filter for quaternion-based orientation estimation using MARG sensors , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[30]  Sebastian Madgwick,et al.  Estimation of IMU and MARG orientation using a gradient descent algorithm , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[31]  Ioannis Paraskevopoulos,et al.  Design guidelines for developing customised serious games for Parkinson's Disease rehabilitation using bespoke game sensors , 2014, Entertain. Comput..

[32]  D. M. Henderson.  Euler angles, quaternions, and transformation matrices for space shuttle analysis , 1977 .

[33]  Richard W. Bohannon,et al.  Clinical measurement of range of motion. Review of goniometry emphasizing reliability and validity. , 1987, Physical therapy.

[34]  Bertram Taetz,et al.  On Inertial Body Tracking in the Presence of Model Calibration Errors , 2016, Sensors.

[35]  D. Istrate,et al.  Serious game and functional rehabilitation for the lower limbs , 2016 .

[36]  Enrique J. Gómez,et al.  Upper Limb Portable Motion Analysis System Based on Inertial Technology for Neurorehabilitation Purposes , 2010, Sensors.

[37]  Chen Feng,et al.  Upper limb motion tracking with the integration of IMU and Kinect , 2015, Neurocomputing.

[38]  Taeyoung Kim,et al.  Characterising and minimising sources of error in inertial body sensor networks , 2013, Int. J. Auton. Adapt. Commun. Syst..

[39]  Basel Kikhia,et al.  Optimal Placement of Accelerometers for the Detection of Everyday Activities , 2013, Sensors.

[40]  Kamiar Aminian,et al.  A new approach to accurate measurement of uniaxial joint angles based on a combination of accelerometers and gyroscopes , 2005, IEEE Transactions on Biomedical Engineering.

[41]  K. Aminian,et al.  Ambulatory measurement of 3D knee joint angle. , 2008, Journal of biomechanics.

[42]  Dan Istrate,et al.  Feasibility study of a serious game based on Kinect system for functional rehabilitation of the lower limbs , 2016 .

[43]  Christoph Kalkbrenner,et al.  Motion Capturing with Inertial Measurement Units and Kinect - Tracking of Limb Movement using Optical and Orientation Information , 2014, BIODEVICES.

[44]  Adam Wojciechowski,et al.  Hybrid Method of Human Limb Joints Positioning - Hand Movement Case Study , 2016, ITIB.

[45]  Tien-Lung Sun,et al.  An Impact Study of the Design of Exergaming Parameters on Body Intensity from Objective and Gameplay-Based Player Experience Perspectives, Based on Balance Training Exergame , 2013, PloS one.

[46]  Po-Yin Chen,et al.  Lower limb power rehabilitation (LLPR) using interactive video game for improvement of balance function in older people. , 2012, Archives of gerontology and geriatrics.