Vision and IMU Data Fusion: Closed-Form Determination of the Absolute Scale, Speed and Attitude

This chapter describes an algorithm for determining the speed and the attitude of a sensor assembling constituted by a monocular camera and inertial sensors (three orthogonal accelerometers and three orthogonal gyroscopes). The system moves in a 3D unknown environment. The algorithm inputs are the visual and inertial measurements during a very short time interval. The outputs are: the speed and attitude, the absolute scale and the bias affecting the inertial measurements. The determination of these outputs is obtained by a simple closed form solution which analytically expresses the previous physical quantities in terms of the sensor measurements. This closed form determination allows performing the overall estimation in a very short time interval and without the need of any initialization or prior knowledge. This is a key advantage since allows eliminating the drift on the absolute scale and on the orientation. The performance of the proposed algorithm is evaluated with real experiments.

[1]  Salah Sukkarieh,et al.  Real-time implementation of airborne inertial-SLAM , 2007, Robotics Auton. Syst..

[2]  Roland Siegwart,et al.  A Toolbox for Easily Calibrating Omnidirectional Cameras , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Michael H. Smolensky,et al.  Editorial: Special Issue , 1987 .

[4]  Agostino Martinelli,et al.  Vision and IMU Data Fusion: Closed-Form Solutions for Attitude, Speed, Absolute Scale, and Bias Determination , 2012, IEEE Transactions on Robotics.

[5]  G. M.,et al.  Partial Differential Equations I , 2023, Applied Mathematical Sciences.

[6]  D. Allen-Booth,et al.  Classical Mechanics 2nd edn , 1974 .

[7]  Jack B. Kuipers,et al.  Quaternions and Rotation Sequences: A Primer with Applications to Orbits, Aerospace and Virtual Reality , 2002 .

[8]  Roland Siegwart,et al.  Vision based MAV navigation in unknown and unstructured environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[9]  Agostino Martinelli,et al.  State Estimation Based on the Concept of Continuous Symmetry and Observability Analysis: The Case of Calibration , 2011, IEEE Transactions on Robotics.

[10]  J. W. Humberston.  Classical mechanics , 1980, Nature.

[11]  Peter I. Corke,et al.  Editorial: Special Issue: 2nd Workshop on Integration of Vision and Inertial Sensors , 2007, Int. J. Robotics Res..

[12]  Michael Veth,et al.  Fusing Low-Cost Image and Inertial Sensors for Passive Navigation , 2007 .

[13]  Roland Siegwart,et al.  Vision-based MAV Navigation: Implementation Challenges Towards a Usable System in Real-Life Scenarios , 2012, RSS 2012.

[14]  Agostino Martinelli,et al.  Closed-form solution for attitude and speed determination by fusing monocular vision and inertial sensor measurements , 2011, 2011 IEEE International Conference on Robotics and Automation.

[15]  Markus Vincze,et al.  Simultaneous Motion and Structure Estimation by Fusion of Inertial and Vision Data , 2007, Int. J. Robotics Res..

[16]  Markus Vincze,et al.  Fast Ego-motion Estimation with Multi-rate Fusion of Inertial and Vision , 2007, Int. J. Robotics Res..

[17]  Salah Sukkarieh,et al.  Building a Robust Implementation of Bearing‐only Inertial SLAM for a UAV , 2007, J. Field Robotics.

[18]  Jonathan P. How,et al.  Vision-based guidance and control of a hovering vehicle in unknown, GPS-denied environments , 2009, 2009 IEEE International Conference on Robotics and Automation.

[19]  Jorge Dias,et al.  Relative Pose Calibration Between Visual and Inertial Sensors , 2007, Int. J. Robotics Res..

[20]  H. C. Corben,et al.  Classical Mechanics (2nd ed.) , 1961 .

[21]  Peter Corke,et al.  An Introduction to Inertial and Visual Sensing , 2007, Int. J. Robotics Res..

[22]  Raffaello D'Andrea,et al.  A simple learning strategy for high-speed quadrocopter multi-flips , 2010, 2010 IEEE International Conference on Robotics and Automation.