Magnetometer-Based Drift Correction During Rest in IMU Arm Motion Tracking

Real-time motion capture of the human arm in the home environment has many use cases, such as video game and therapy applications. The required tracking can be based on off-the-shelf Inertial Measurement Units (IMUs) with integrated three-axis accelerometers, gyroscopes, and magnetometers. However, this usually requires a homogeneous magnetic field to correct for orientation drift, which is often not available inside buildings. In this paper, RPMC (Rest Pose Magnetometer-based drift Correction), a novel method that is robust to long term drift in environments with inhomogeneous magnetic fields, is presented. The sensor orientation is estimated by integrating the angular velocity measured by the gyroscope and correcting drift around the pitch and roll axes with the acceleration information. This commonly leads to short term drift around the gravitational axis. Here, during the calibration phase, the local magnetic field direction for each sensor, and its orientation relative to the inertial frame, are recorded in a rest pose. It is assumed that arm movements in free space are exhausting and require regular rest. A set of rules is used to detect when the user has returned to the rest pose, to then correct for the drift that has occurred with the magnetometer. Optical validations demonstrated accurate (root mean square error RMS=6.1°), low latency (61ms) tracking of the user’s wrist orientation, in real time, for a full hour of arm movements. The reduction in error relative to three alternative methods implemented for comparison was between 82.5% and 90.7% for the same movement and environment. Therefore, the proposed arm tracking method allows for the correction of orientation drift in an inhomogeneous magnetic field by exploiting the user’s need for frequent rest.

[1]  J. Huisman The Netherlands , 1996, The Lancet.

[2]  Albert A. Rizzo,et al.  Beyond the standard clinical rating scales: Fine-grained assessment of post-stroke motor functionality using wearable inertial sensors , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  Olivier Lambercy,et al.  Self-directed arm therapy at home after stroke with a sensor-based virtual reality training system , 2016, Journal of NeuroEngineering and Rehabilitation.

[4]  I-Ming Chen,et al.  A virtual reality system for arm and hand rehabilitation , 2010 .

[5]  Lawrence Wai-Choong Wong,et al.  Ubiquitous Human Upper-Limb Motion Estimation using Wearable Sensors , 2011, IEEE Transactions on Information Technology in Biomedicine.

[6]  Per Backlund,et al.  Computer game-based upper extremity training in the home environment in stroke persons: a single subject design , 2012, Journal of NeuroEngineering and Rehabilitation.

[7]  Jongho Lee,et al.  Compensated Heading Angles for Outdoor Mobile Robots in Magnetically Disturbed Environment , 2018, IEEE Transactions on Industrial Electronics.

[8]  Wojciech Matusik,et al.  Practical motion capture in everyday surroundings , 2007, ACM Trans. Graph..

[9]  Sebastian Madgwick,et al.  Estimation of IMU and MARG orientation using a gradient descent algorithm , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[10]  Francisco J. Badesa,et al.  Estimation of Human Arm Joints Using Two Wireless Sensors in Robotic Rehabilitation Tasks , 2015, Sensors.

[11]  D. Roetenberg,et al.  Xsens MVN: Full 6DOF Human Motion Tracking Using Miniature Inertial Sensors , 2009 .

[12]  Huosheng Hu,et al.  Integration of Vision and Inertial Sensors for 3D Arm Motion Tracking in Home-based Rehabilitation , 2007, Int. J. Robotics Res..

[13]  Tao Liu,et al.  How Magnetic Disturbance Influences the Attitude and Heading in Magnetic and Inertial Sensor-Based Orientation Estimation , 2017, Sensors.

[14]  Martin Levesley,et al.  Home-based Computer Assisted Arm Rehabilitation (hCAAR) robotic device for upper limb exercise after stroke: results of a feasibility study in home setting , 2014, Journal of NeuroEngineering and Rehabilitation.

[15]  Huosheng Hu,et al.  A Novel Sensing and Data Fusion System for 3-D Arm Motion Tracking in Telerehabilitation , 2008, IEEE Transactions on Instrumentation and Measurement.

[16]  Olivier Lambercy,et al.  Does motivation matter in upper-limb rehabilitation after stroke? ArmeoSenso-Reward: study protocol for a randomized controlled trial , 2017, Trials.

[17]  D. Roetenberg,et al.  Estimating Body Segment Orientation by Applying Inertial and Magnetic Sensing Near Ferromagnetic Materials , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Sebastian Thrun,et al.  3-Axis magnetic field mapping and fusion for indoor localization , 2012, 2012 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[19]  L. Connell,et al.  Patients' Use of a Home-Based Virtual Reality System to Provide Rehabilitation of the Upper Limb Following Stroke , 2014, Physical Therapy.

[20]  Peter H. Veltink,et al.  Ambulatory Position and Orientation Tracking Fusing Magnetic and Inertial Sensing , 2007, IEEE Transactions on Biomedical Engineering.

[21]  P. Veltink,et al.  Compensation of magnetic disturbances improves inertial and magnetic sensing of human body segment orientation , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Robert F. Kirsch,et al.  Miniature Low-Power Inertial Sensors: Promising Technology for Implantable Motion Capture Systems , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Steven M. LaValle,et al.  Head tracking for the Oculus Rift , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Huosheng Hu,et al.  Human motion tracking for rehabilitation - A survey , 2008, Biomed. Signal Process. Control..

[25]  Pourang Irani,et al.  Consumed endurance: a metric to quantify arm fatigue of mid-air interactions , 2014, CHI.

[26]  M A Nussbaum,et al.  Fatigue and endurance limits during intermittent overhead work. , 2001, AIHAJ : a journal for the science of occupational and environmental health and safety.

[27]  J. Kuipers Quaternions and Rotation Sequences , 1998 .

[28]  Francis L. Merat,et al.  Introduction to robotics: Mechanics and control , 1987, IEEE J. Robotics Autom..

[29]  Per Backlund,et al.  The Birth of Elinor: A Collaborative Development of a Game Based System for Stroke Rehabilitation , 2009, 2009 Second International Conference in Visualisation.

[30]  John J. Craig,et al.  Introduction to Robotics Mechanics and Control , 1986 .

[31]  John J. Craig,et al.  Introduction to robotics - mechanics and control (2. ed.) , 1989 .

[32]  F. V. D. van der Helm,et al.  Magnetic distortion in motion labs, implications for validating inertial magnetic sensors. , 2009, Gait & posture.

[33]  Pubudu N. Pathirana,et al.  Robust and Accurate Capture of Human Joint Pose Using an Inertial Sensor , 2018, IEEE Journal of Translational Engineering in Health and Medicine.

[34]  James McNames,et al.  Shoulder and Elbow Joint Angle Tracking With Inertial Sensors , 2012, IEEE Transactions on Biomedical Engineering.

[35]  Peter H Veltink,et al.  Assessment of hand kinematics using inertial and magnetic sensors , 2014, Journal of NeuroEngineering and Rehabilitation.

[36]  Bryan Buchholz,et al.  ISB recommendation on definitions of joint coordinate systems of various joints for the reporting of human joint motion--Part II: shoulder, elbow, wrist and hand. , 2005, Journal of biomechanics.

[37]  Olivier Lambercy,et al.  Assessment-driven arm therapy at home using an IMU-based virtual reality system , 2015, 2015 IEEE International Conference on Rehabilitation Robotics (ICORR).