Kinematic chain based multi-joint capturing using monocular visual-inertial measurements

Combining light-weight visual and inertial modalities for motion capturing has been popular in robotics researches. There exist scale ambiguity, inaccurate pose estimation with little or no baseline, incremental drifts over time in visual-inertial fusion. Thus, in this paper, we propose a robust motion capturing method based on the multi-joint kinematic chain using monocular visual-inertial sensors. Our method is able to recover monocular visual scale through the joint geometry constraint. Additionally, we take inertial pre-integration to assist visual outlier removal using Maximum A Posteriori method. Ultimately, the kinematic chain model is leveraged to constrain the associated multiple visual-inertial estimation drifts during long time tracking. In the experiments, we conduct multi-joint capturing on a robotic arm. The quality of motion reconstruction is evaluated by comparing the estimated results with the measurements from an optical motion tracking system OptiTrack.

[1]  Xi Chen,et al.  An inertial-based human motion tracking system with twists and exponential maps , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Huosheng Hu,et al.  Integration of Vision and Inertial Sensors for 3D Arm Motion Tracking in Home-based Rehabilitation , 2007, Int. J. Robotics Res..

[3]  Wei Liang,et al.  A novel approach to orientation estimation using inertial cues and visual feature locality constraint , 2016, 2016 IEEE 14th International Conference on Industrial Informatics (INDIN).

[4]  Ya Tian,et al.  An Adaptive-Gain Complementary Filter for Real-Time Human Motion Tracking With MARG Sensors in Free-Living Environments , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Stergios I. Roumeliotis,et al.  A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[6]  Frank Dellaert,et al.  On-Manifold Preintegration for Real-Time Visual--Inertial Odometry , 2015, IEEE Transactions on Robotics.

[7]  Michael Bosse,et al.  Keyframe-based visual–inertial odometry using nonlinear optimization , 2015, Int. J. Robotics Res..

[8]  Anastasios I. Mourikis,et al.  Real-time motion tracking on a cellphone using inertial sensing and a rolling-shutter camera , 2013, 2013 IEEE International Conference on Robotics and Automation.

[9]  Bodo Rosenhahn,et al.  Multisensor-fusion for 3D full-body human motion capture , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.