A Wearable Magnetometer-Free Motion Capture System: Innovative Solutions for Real-World Applications

Although inertial and magnetic wearable sensors are promising tools to develop novel technologies for human motion capture, their diffusion is being limited by their fair accuracy. In indoor applications, most of the inaccuracy comes from the magnetic disturbances contained in the magnetometer data. Besides, non-technicians might easily fail in properly calibrating the magnetometers. Hence, a novel magnetometer-free motion capture system was developed in this work, in the attempt to increase sensors accuracy and usability. Innovative strategies, invisible to the user, were introduced to compensate for the lack of the magnetometer: (a) an accurate linear Kalman filter-based 3D orientation estimator; (b) a simple sensor-to-segment calibration procedure; (c) efficient error compensations for soft-tissue artifact; (d) a simple solution to guarantee a common reference to all body segments. Ten expert Yoga practitioners were asked to perform a common sequence (sun salutation) while inertial sensor data and ground-truth data were acquired for the upper-body through a customized body area network and a stereophotogrammetric system, respectively. As expected, the overall joint angles accuracy proved to be dependent on the acquisition time window. The achieved worst-case accuracy at 90 s was 6 and 14 deg, depending on the main rotational axis involved (vertical or horizontal axis, respectively). Given the large and unconstrained angular workspace explored at each joint (up to 200 deg), these errors make the proposed solution (which can easily be extended to the full human body) an eligible alternative to current motion capture systems relying on magnetometers.

[1]  Dana Kulic,et al.  Human motion estimation on Lie groups using IMU measurements , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  K. Aminian,et al.  Ambulatory measurement of 3D knee joint angle. , 2008, Journal of biomechanics.

[3]  Angelo M. Sabatini,et al.  Dealing with Magnetic Disturbances in Human Motion Capture: A Survey of Techniques , 2016, Micromachines.

[4]  Marco Parvis,et al.  Procedure for effortless in-field calibration of three-axial rate gyro and accelerometers , 1995 .

[5]  Federica Verdini,et al.  UKF Magnetometer-Free Sensor Fusion for Pelvis Pose Estimation During Treadmill Walking , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[6]  Katherine J. Kuchenbecker,et al.  Spatially distributed tactile feedback for kinesthetic motion guidance , 2010, 2010 IEEE Haptics Symposium.

[7]  Angelo M. Sabatini,et al.  A linear Kalman Filtering-based approach for 3D orientation estimation from Magnetic/Inertial sensors , 2015, 2015 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[8]  Oliver J. Woodman,et al.  An introduction to inertial navigation , 2007 .

[9]  Peter Langendörfer,et al.  Detecting Elementary Arm Movements by Tracking Upper Limb Joint Angles With MARG Sensors , 2016, IEEE Journal of Biomedical and Health Informatics.

[10]  Valentina Camomilla,et al.  Trends Supporting the In-Field Use of Wearable Inertial Sensors for Sport Performance Evaluation: A Systematic Review , 2018, Sensors.

[11]  Daniel Arthur James,et al.  Development of inertial and novel marker-based techniques and analysis for upper arm rotational velocity measurements in tennis , 2010 .

[12]  Angelo M. Sabatini,et al.  Estimating Orientation Using Magnetic and Inertial Sensors and Different Sensor Fusion Approaches: Accuracy Assessment in Manual and Locomotion Tasks , 2014, Sensors.

[13]  Zhiqiang Zhang,et al.  A Novel Hierarchical Information Fusion Method for Three-Dimensional Upper Limb Motion Estimation , 2011, IEEE Transactions on Instrumentation and Measurement.

[14]  Sebastian Madgwick,et al.  Estimation of IMU and MARG orientation using a gradient descent algorithm , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[15]  F. V. D. van der Helm,et al.  Magnetic distortion in motion labs, implications for validating inertial magnetic sensors. , 2009, Gait & posture.

[16]  Tomomasa Sato,et al.  Development of a Tiny Orientation Estimation Device to Operate under Motion and Magnetic Disturbance , 2007, Int. J. Robotics Res..

[17]  Laura Rocchi,et al.  Ambulatory measurement of shoulder and elbow kinematics through inertial and magnetic sensors , 2008, Medical & Biological Engineering & Computing.

[18]  Diana Hodgins,et al.  Inertial sensor-based knee flexion/extension angle estimation. , 2009, Journal of biomechanics.

[19]  Julien Favre,et al.  An effortless procedure to align the local frame of an inertial measurement unit to the local frame of another motion capture system. , 2012, Journal of biomechanics.

[20]  Rong Zhu,et al.  A real-time articulated human motion tracking using tri-axis inertial/magnetic sensors package , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Demoz Gebre-Egziabher,et al.  A Non-linear , Two-step Estimation Algorithm for Calibrating Solid-state Strapdown Magnetometers , 2001 .

[22]  Angelo M. Sabatini,et al.  A Novel Kalman Filter for Human Motion Tracking With an Inertial-Based Dynamic Inclinometer , 2015, IEEE Transactions on Biomedical Engineering.

[23]  M. Shuster,et al.  Three-axis attitude determination from vector observations , 1981 .

[24]  Angelo M. Sabatini,et al.  How Angular Velocity Features and Different Gyroscope Noise Types Interact and Determine Orientation Estimation Accuracy , 2015, Sensors.

[25]  G. Wahba A Least Squares Estimate of Satellite Attitude , 1965 .

[26]  I. Bar-Itzhack,et al.  Novel quaternion Kalman filter , 2002, IEEE Transactions on Aerospace and Electronic Systems.

[27]  Emanuele Menegatti,et al.  A robust and easy to implement method for IMU calibration without external equipments , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[28]  P H Veltink,et al.  Ambulatory measurement of arm orientation. , 2007, Journal of biomechanics.

[29]  Xiaoping Yun,et al.  An investigation of the effects of magnetic variations on inertial/magnetic orientation sensors , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[30]  Jack T Dennerlein,et al.  A novel method for assessing the 3-D orientation accuracy of inertial/magnetic sensors. , 2013, Journal of biomechanics.

[31]  Peter H. Veltink,et al.  Ambulatory Position and Orientation Tracking Fusing Magnetic and Inertial Sensing , 2007, IEEE Transactions on Biomedical Engineering.

[32]  Angelo M. Sabatini,et al.  Quaternion-based extended Kalman filter for determining orientation by inertial and magnetic sensing , 2006, IEEE Transactions on Biomedical Engineering.

[33]  A. Cappello,et al.  Soft tissue artefact assessment in humeral axial rotation. , 2004, Gait & posture.

[34]  Young Soo Suh Orientation Estimation Using a Quaternion-Based Indirect Kalman Filter With Adaptive Estimation of External Acceleration , 2010, IEEE Transactions on Instrumentation and Measurement.

[35]  Bertram Taetz,et al.  Validity, Test-Retest Reliability and Long-Term Stability of Magnetometer Free Inertial Sensor Based 3D Joint Kinematics , 2018, Sensors.

[36]  F. Markley Attitude determination using vector observations and the singular value decomposition , 1988 .

[37]  A. M. Sabatini,et al.  A novel functional calibration method for real-time elbow joint angles estimation with magnetic-inertial sensors. , 2017, Journal of biomechanics.

[38]  Marc-André Bégin,et al.  Magnetometer-free Realtime Inertial Motion Tracking by Exploitation of Kinematic Constraints in 2-DoF Joints , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[39]  Malcolm D. Shuster Survey of attitude representations , 1993 .

[40]  Thomas Seel,et al.  IMU-Based Joint Angle Measurement for Gait Analysis , 2014, Sensors.

[41]  François Fraysse,et al.  Comparison of anatomical, functional and regression methods for estimating the rotation axes of the forearm. , 2014, Journal of biomechanics.

[42]  Angelo M. Sabatini,et al.  Estimating Three-Dimensional Orientation of Human Body Parts by Inertial/Magnetic Sensing , 2011, Sensors.