Legged Robot State-Estimation Through Combined Forward Kinematic and Preintegrated Contact Factors

State-of-the-art robotic perception systems have achieved sufficiently good performance using Inertial Measurement Units (IMUs), cameras, and nonlinear optimization techniques, that they are now being deployed as technologies. However, many of these methods rely significantly on vision and often fail when visual tracking is lost due to lighting or scarcity of features. This paper presents a state-estimation technique for legged robots that takes into account the robot's kinematic model as well as its contact with the environment. We introduce forward kinematic factors and preintegrated contact factors into a factor graph framework that can be incrementally solved in real-time. The forward kinematic factor relates the robot's base pose to a contact frame through noisy encoder measurements. The preintegrated contact factor provides odometry measurements of this contact frame while accounting for possible foot slippage. Together, the two developed factors constrain the graph optimization problem allowing the robot's trajectory to be estimated. The paper evaluates the method using simulated and real sensory IMU and kinematic data from experiments with a Cassie-series robot designed by Agility Robotics. These preliminary experiments show that using the proposed method in addition to IMU decreases drift and improves localization accuracy, suggesting that its use can enable successful recovery from a loss of visual tracking.

[1]  Frank Dellaert,et al.  iSAM2: Incremental smoothing and mapping using the Bayes tree , 2012, Int. J. Robotics Res..

[2]  Gerald P. Roston,et al.  Dead Reckoning Navigation For Walking Robots , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Koushil Sreenath,et al.  Dynamic Walking on Randomly-Varying Discrete Terrain with One-step Preview , 2017, Robotics: Science and Systems.

[4]  Salah Sukkarieh,et al.  Visual-Inertial-Aided Navigation for High-Dynamic Motion in Built Environments Without Initial Conditions , 2012, IEEE Transactions on Robotics.

[5]  R. Siegwart,et al.  ROBOT-CENTRIC ELEVATION MAPPING WITH UNCERTAINTY ESTIMATES , 2014 .

[6]  Nicholas Rotella,et al.  State estimation for a humanoid robot , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Frank Dellaert,et al.  IMU Preintegration on Manifold for Efficient Visual-Inertial Maximum-a-Posteriori Estimation , 2015, Robotics: Science and Systems.

[8]  Michael Andre Bloesch State Estimation for Legged Robots - Kinematics, Inertial Sensing, and Computer Vision , 2017 .

[9]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[10]  Levent Tunçel,et al.  Optimization algorithms on matrix manifolds , 2009, Math. Comput..

[11]  John M. Lee Introduction to Smooth Manifolds , 2002 .

[12]  Frank Dellaert,et al.  Eliminating conditionally independent sets in factor graphs: A unifying perspective based on smart factors , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[13]  F. Dellaert Factor Graphs and GTSAM: A Hands-on Introduction , 2012 .

[14]  Maani Ghaffari Jadidi,et al.  Supplementary Material to : Legged Robot State-Estimation Through Combined Kinematic and Preintegrated Contact Factors , 2017 .

[15]  Jessy W. Grizzle,et al.  First Steps Toward Supervised Learning for Underactuated Bipedal Robot Locomotion , with Outdoor Experiments on the Wave Field , 2016 .

[16]  John J. Leonard,et al.  Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age , 2016, IEEE Transactions on Robotics.

[17]  Hugh F. Durrant-Whyte,et al.  Simultaneous Localization and Mapping with Sparse Extended Information Filters , 2004, Int. J. Robotics Res..

[18]  Mike Stilman,et al.  State Estimation for Legged Robots - Consistent Fusion of Leg Kinematics and IMU , 2012, RSS 2012.

[19]  E. Westervelt,et al.  Feedback Control of Dynamic Bipedal Robot Locomotion , 2007 .

[20]  Roland Siegwart,et al.  State Estimation for Legged Robots - Consistent Fusion of Leg Kinematics and IMU , 2012, Robotics: Science and Systems.

[21]  G. Chirikjian Stochastic Models, Information Theory, and Lie Groups, Volume 2 , 2012 .

[22]  Frank Dellaert,et al.  On-Manifold Preintegration for Real-Time Visual--Inertial Odometry , 2015, IEEE Transactions on Robotics.

[23]  Seth J. Teller,et al.  Drift-free humanoid state estimation fusing kinematic, inertial and LIDAR sensing , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[24]  Hanumant Singh,et al.  Exactly Sparse Delayed-State Filters for View-Based SLAM , 2006, IEEE Transactions on Robotics.

[25]  Timothy D. Barfoot,et al.  State Estimation for Robotics , 2017 .

[26]  Simona Nobili,et al.  Heterogeneous Sensor Fusion for Accurate State Estimation of Dynamic Legged Robots , 2017, Robotics: Science and Systems.

[27]  Hugh F. Durrant-Whyte,et al.  A solution to the simultaneous localization and map building (SLAM) problem , 2001, IEEE Trans. Robotics Autom..