A comparison of scale estimation schemes for a quadrotor UAV based on optical flow and IMU measurements

For the purpose of autonomous UAV flight control, cameras are ubiquitously exploited as a cheap and effective onboard sensor for obtaining non-metric position or velocity measurements. Since the metric scale cannot be directly recovered from visual input only, several methods have been proposed in the recent literature to overcome this limitation by exploiting independent `metric' information from additional onboard sensors. The flexibility of most approaches is, however, often limited by the need of constantly tracking over time a certain set of features in the environment, thus potentially suffering from possible occlusions or loss of tracking during flight. In this respect, in this paper we address the problem of estimating the scale of the observed linear velocity in the UAV body frame from direct measurement of the instantaneous (and non-metric) optical flow, and the integration of an onboard Inertial Measurement Unit (IMU) for providing (metric) acceleration readings. To this end, two different estimation techniques are developed and critically compared: a standard Extended Kalman Filter (EKF) and a novel nonlinear observer stemming from the adaptive control literature. Results based on simulated and real data recorded during a quadrotor UAV flight demonstrate the effectiveness of the approach.

[1]  Roland Siegwart,et al.  Versatile distributed pose estimation and sensor self-calibration for an autonomous MAV , 2012, 2012 IEEE International Conference on Robotics and Automation.

[2]  Giuseppe Oriolo,et al.  3D structure identification from image moments , 2008, 2008 IEEE International Conference on Robotics and Automation.

[3]  Marc Pollefeys,et al.  An open source and open hardware embedded metric optical flow CMOS camera for indoor and outdoor applications , 2013, 2013 IEEE International Conference on Robotics and Automation.

[4]  Javier Civera,et al.  Inverse Depth Parametrization for Monocular SLAM , 2008, IEEE Transactions on Robotics.

[5]  Paolo Robuffo 3D Structure Identification from Image Moments , 2008 .

[6]  Robert E. Mahony,et al.  Nonlinear Complementary Filters on the Special Orthogonal Group , 2008, IEEE Transactions on Automatic Control.

[7]  Antonio Franchi,et al.  The TeleKyb framework for a modular and extendible ROS-based quadrotor control , 2013, 2013 European Conference on Mobile Robots.

[8]  Roland Siegwart,et al.  Real-time onboard visual-inertial state estimation and self-calibration of MAVs in unknown environments , 2012, 2012 IEEE International Conference on Robotics and Automation.

[9]  Roland Siegwart,et al.  Fusion of IMU and Vision for Absolute Scale Estimation in Monocular SLAM , 2011, J. Intell. Robotic Syst..

[10]  Riccardo Marino,et al.  Nonlinear control design: geometric, adaptive and robust , 1995 .

[11]  Heinrich H. Bülthoff,et al.  Robust optical-flow based self-motion estimation for a quadrotor UAV , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Heinrich H. Bülthoff,et al.  On-board velocity estimation and closed-loop control of a quadrotor UAV based on optical flow , 2012, 2012 IEEE International Conference on Robotics and Automation.

[13]  Andreas Zell,et al.  Automatic Take Off, Tracking and Landing of a Miniature UAV on a Moving Carrier Vehicle , 2011, J. Intell. Robotic Syst..

[14]  S. Shankar Sastry,et al.  c ○ 2000 Kluwer Academic Publishers. Manufactured in The Netherlands. Linear Differential Algorithm for Motion Recovery: A Geometric Approach , 2022 .

[15]  Giuseppe Oriolo,et al.  Feature Depth Observation for Image-based Visual Servoing: Theory and Experiments , 2008, Int. J. Robotics Res..

[16]  Agostino Martinelli,et al.  Vision and IMU Data Fusion: Closed-Form Solutions for Attitude, Speed, Absolute Scale, and Bias Determination , 2012, IEEE Transactions on Robotics.

[17]  Robert E. Mahony,et al.  Landing a VTOL Unmanned Aerial Vehicle on a Moving Platform Using Optical Flow , 2012, IEEE Transactions on Robotics.

[18]  Roland Siegwart,et al.  Closed-form solution for absolute scale velocity determination combining inertial measurements and a single feature correspondence , 2011, 2011 IEEE International Conference on Robotics and Automation.

[19]  Giuseppe Oriolo,et al.  On-Line Estimation of Feature Depth for Image-Based Visual Servoing Schemes , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[20]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[21]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .