Machine Learning Improvements to Human Motion Tracking with IMUs

Inertial Measurement Units (IMUs) have become a popular solution for tracking human motion. The main problem of using IMU data for deriving the position of different body segments throughout time is related to the accumulation of the errors in the inertial data. The solution to this problem is necessary to improve the use of IMUs for position tracking. In this work, we present several Machine Learning (ML) methods to improve the position tracking of various body segments when performing different movements. Firstly, classifiers were used to identify the periods in which the IMUs were stopped (zero-velocity detection). The models Random Forest, Support Vector Machine (SVM) and neural networks based on Long-Short-Term Memory (LSTM) layers were capable of identifying those periods independently of the motion and body segment with a substantially higher performance than the traditional fixed-threshold zero-velocity detectors. Afterwards, these techniques were combined with ML regression models based on LSTMs capable of estimating the displacement of the sensors during periods of movement. These models did not show significant improvements when compared with the more straightforward double integration of the linear acceleration data with drift removal for translational motion estimate. Finally, we present a model based on LSTMs that combined simultaneously zero-velocity detection with the translational motion of sensors estimate. This model revealed a lower average error for position tracking than the combination of the previously referred methodologies.

[1]  Rin-ichiro Taniguchi,et al.  End-to-End Learning Framework for IMU-Based 6-DOF Odometry , 2019, Sensors.

[2]  Norbert Schmitz,et al.  Survey of Motion Tracking Methods Based on Inertial Sensors: A Focus on Upper Limb Human Motion , 2017, Sensors.

[3]  Faicel Chamroukhi,et al.  Physical Human Activity Recognition Using Wearable Sensors , 2015, Sensors.

[4]  Keyu Wu,et al.  AbolDeepIO: A Novel Deep Inertial Odometry Network for Autonomous Vehicles , 2020, IEEE Transactions on Intelligent Transportation Systems.

[5]  Nikhil Buduma,et al.  Fundamentals of deep learning , 2017 .

[6]  Subhas Mukhopadhyay,et al.  MEMS based IMU for tilting measurement: Comparison of complementary and kalman filter based data fusion , 2015, 2015 IEEE 10th Conference on Industrial Electronics and Applications (ICIEA).

[7]  Arno Solin,et al.  DEEP LEARNING BASED SPEED ESTIMATION FOR CONSTRAINING STRAPDOWN INERTIAL NAVIGATION ON SMARTPHONES , 2018, 2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP).

[8]  Angelica Munoz-Melendez,et al.  Wearable Inertial Sensors for Human Motion Analysis: A Review , 2016, IEEE Sensors Journal.

[9]  Yu Liu,et al.  Cart-Mounted Geolocation System for Unexploded Ordnance With Adaptive ZUPT Assistance , 2012, IEEE Transactions on Instrumentation and Measurement.

[10]  Andrew Markham,et al.  Deep-Learning-Based Pedestrian Inertial Navigation: Methods, Data Set, and On-Device Inference , 2020, IEEE Internet of Things Journal.

[11]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[12]  J. Winters,et al.  Wearable sensors and telerehabilitation , 2003, IEEE Engineering in Medicine and Biology Magazine.

[13]  Agathoniki Trigoni,et al.  IONet: Learning to Cure the Curse of Drift in Inertial Odometry , 2018, AAAI.

[14]  Paul D. Groves,et al.  Navigation using inertial sensors [Tutorial] , 2015, IEEE Aerospace and Electronic Systems Magazine.

[15]  Patricia Morreale,et al.  Wireless Sensor Network Applications in Urban Telehealth , 2007, 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW'07).

[16]  Jonathan Kelly,et al.  LSTM-Based Zero-Velocity Detection for Robust Inertial Navigation , 2018, 2018 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[17]  Michael Philippsen,et al.  A Bidirectional LSTM for Estimating Dynamic Human Velocities from a Single IMU , 2019, 2019 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[18]  Serena Ivaldi,et al.  Human movement and ergonomics: An industry-oriented dataset for collaborative robotics , 2019, Int. J. Robotics Res..

[19]  Isaac Skog,et al.  Zero-Velocity Detection—An Algorithm Evaluation , 2010, IEEE Transactions on Biomedical Engineering.

[20]  Davide Scaramuzza,et al.  A Tutorial on Quantitative Trajectory Evaluation for Visual(-Inertial) Odometry , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Arno Solin,et al.  PIVO: Probabilistic Inertial-Visual Odometry for Occlusion-Robust Navigation , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[22]  Arno Solin,et al.  Inertial Odometry on Handheld Smartphones , 2017, 2018 21st International Conference on Information Fusion (FUSION).

[23]  Sebastian Madgwick,et al.  Estimation of IMU and MARG orientation using a gradient descent algorithm , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[24]  Wei Wu,et al.  Selective Sensor Fusion for Neural Visual-Inertial Odometry , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Sen Wang,et al.  VINet: Visual-Inertial Odometry as a Sequence-to-Sequence Learning Problem , 2017, AAAI.

[26]  Han Wang,et al.  OriNet: Robust 3-D Orientation Estimation With a Single Particular IMU , 2020, IEEE Robotics and Automation Letters.

[27]  Mark de Zee,et al.  Estimation of Ground Reaction Forces and Moments During Gait Using Only Inertial Motion Capture , 2016, Sensors.

[28]  Josh Patterson,et al.  Deep Learning: A Practitioner's Approach , 2017 .

[29]  P. Abbeel,et al.  Kalman filtering , 2020, IEEE Control Systems Magazine.

[30]  Paul J. M. Havinga,et al.  Activity Recognition Using Inertial Sensing for Healthcare, Wellbeing and Sports Applications: A Survey , 2010, ARCS Workshops.

[31]  Qi Shan,et al.  RIDI: Robust IMU Double Integration , 2017, ECCV.

[32]  Valentin Peretroukhin,et al.  Robust Data-Driven Zero-Velocity Detection for Foot-Mounted Inertial Navigation , 2020, IEEE Sensors Journal.

[33]  Wolfram Burgard,et al.  A benchmark for the evaluation of RGB-D SLAM systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[34]  Xie Ling,et al.  Applications of zero-velocity detector and Kalman filter in zero velocity update for inertial navigation system , 2014, Proceedings of 2014 IEEE Chinese Guidance, Navigation and Control Conference.

[35]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[36]  Yiqing Yao,et al.  An IMM-Aided ZUPT Methodology for an INS/DVL Integrated Navigation System , 2017, Sensors.

[37]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.

[38]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Paul D. Groves,et al.  Navigation Using Inertial Sensors , 2015 .

[40]  M. Lunt Introduction to statistical modelling: linear regression. , 2015, Rheumatology.

[41]  Sachini Herath,et al.  RoNIN: Robust Neural Inertial Navigation in the Wild: Benchmark, Evaluations, & New Methods , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).