An Extended Kalman Filter-Based Robot Pose Estimation Approach with Vision and Odometry

Visual cameras and encoders are usually equipped on mobile robotic systems. In this paper, we present a robust extended Kalman filter-based pose estimation approach by fusing the information from both the onboard camera and encoders. Different from existing works, the system state is chosen in a new simplified way, including the robot pose and the depth of feature points. Moreover, a new observation model is formulated and the corresponding Jacobian matrix is derived. A robust feature association approach with an outlier removing mechanism is proposed. Experimental results are provided to demonstrate the effectiveness of the proposed approach.

[1]  S. Y. Chen,et al.  Kalman Filter for Robot Vision: A Survey , 2012, IEEE Transactions on Industrial Electronics.

[2]  Xuebo Zhang,et al.  Prediction-based interception control strategy design with a specified approach angle constraint for wheeled service robots , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Yongchun Fang,et al.  Visual servoing of mobile robots for posture stabilization: from theory to experiments , 2015 .

[4]  François Chaumette,et al.  Active Structure From Motion: Application to Point, Sphere, and Cylinder , 2014, IEEE Transactions on Robotics.

[5]  John J. Leonard,et al.  Real-time 6-DOF multi-session visual SLAM over large-scale environments , 2013, Robotics Auton. Syst..

[6]  Tom Drummond,et al.  Image based optimisation without global consistency for constant time monocular visual SLAM , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Andreas Geiger,et al.  Visual SLAM for autonomous ground vehicles , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  Dimitrios G. Kottas,et al.  Consistency Analysis and Improvement of Vision-aided Inertial Navigation , 2014, IEEE Transactions on Robotics.

[9]  Xi Liu,et al.  Motion-Estimation-Based Visual Servoing of Nonholonomic Mobile Robots , 2011, IEEE Transactions on Robotics.

[10]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[11]  Stergios I. Roumeliotis,et al.  Two Efficient Solutions for Visual Odometry Using Directional Correspondence , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Magnus Jansson,et al.  Vision-Aided Inertial Navigation Based on Ground Plane Feature Detection , 2014, IEEE/ASME Transactions on Mechatronics.

[13]  Friedrich Fraundorfer,et al.  Visual Odometry Part I: The First 30 Years and Fundamentals , 2022 .

[14]  Agostino Martinelli,et al.  Vision and IMU Data Fusion: Closed-Form Solutions for Attitude, Speed, Absolute Scale, and Bias Determination , 2012, IEEE Transactions on Robotics.