Initialization-Free Monocular Visual-Inertial State Estimation with Application to Autonomous MAVs

The quest to build smaller, more agile micro aerial vehicles has led the research community to address cameras and Inertial Measurement Units (IMUs) as the primary sensors for state estimation and autonomy. In this paper we present a monocular visual-inertial system (VINS) for an autonomous quadrotor which relies only on an inexpensive off-the-shelf camera and IMU, and describe a robust state estimator which allows the robot to execute trajectories at 2 m/s with roll and pitch angles of 20 degrees, with accelerations over 4 m/\(\text {s}^2\). The main innovations in the paper are an approach to estimate the vehicle motion without initialization and a method to determine scale and metric state information without encountering any degeneracy in real time.

[1]  Dimitrios G. Kottas,et al.  Detecting and dealing with hovering maneuvers in vision-aided inertial navigation systems , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[3]  Anastasios I. Mourikis,et al.  Estimator initialization in vision-aided inertial navigation with unknown camera-IMU calibration , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Stergios I. Roumeliotis,et al.  A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[5]  Sven Lange,et al.  Incremental smoothing vs. filtering for sensor fusion on an indoor UAV , 2013, 2013 IEEE International Conference on Robotics and Automation.

[6]  Roland Siegwart,et al.  Real-time onboard visual-inertial state estimation and self-calibration of MAVs in unknown environments , 2012, 2012 IEEE International Conference on Robotics and Automation.

[7]  Roland Siegwart,et al.  Deterministic initialization of metric state estimation filters for loosely-coupled monocular vision-inertial systems , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Anastasios I. Mourikis,et al.  High-precision, consistent EKF-based visual-inertial odometry , 2013, Int. J. Robotics Res..

[9]  Gabe Sibley,et al.  Sliding window filter with application to planetary landing , 2010 .

[10]  Agostino Martinelli,et al.  Closed-Form Solution of Visual-Inertial Structure from Motion , 2013, International Journal of Computer Vision.

[11]  Tomás Pajdla,et al.  Robust Rotation and Translation Estimation in Multiview Reconstruction , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Dimitrios G. Kottas,et al.  On the Consistency of Vision-Aided Inertial Navigation , 2012, ISER.

[13]  Gaurav S. Sukhatme,et al.  Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibration , 2011, Int. J. Robotics Res..

[14]  Salah Sukkarieh,et al.  Visual-Inertial-Aided Navigation for High-Dynamic Motion in Built Environments Without Initial Conditions , 2012, IEEE Transactions on Robotics.

[15]  Roland Siegwart,et al.  Keyframe-based Visual-Inertial SLAM using Nonlinear Optimization , 2013, RSS 2013.

[16]  Agostino Martinelli,et al.  Vision and IMU Data Fusion: Closed-Form Solutions for Attitude, Speed, Absolute Scale, and Bias Determination , 2012, IEEE Transactions on Robotics.

[17]  Vijay Kumar,et al.  Vision-Based State Estimation and Trajectory Control Towards High-Speed Flight with a Quadrotor , 2013, Robotics: Science and Systems.

[18]  Stefano Soatto,et al.  Visual-inertial navigation, mapping and localization: A scalable real-time causal approach , 2011, Int. J. Robotics Res..

[19]  Rafik Mebarki,et al.  Closed-form solution for absolute scale velocity estimation using visual and inertial data with a sliding least-squares estimation , 2013, 21st Mediterranean Conference on Control and Automation.

[20]  Frank Dellaert,et al.  Incremental light bundle adjustment for robotics navigation , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.