On-board velocity estimation and closed-loop control of a quadrotor UAV based on optical flow

Robot vision became a field of increasing importance in micro aerial vehicle robotics with the availability of small and light hardware. While most approaches rely on external ground stations because of the need of high computational power, we will present a full autonomous setup using only on-board hardware. Our work is based on the continuous homography constraint to recover ego-motion from optical flow. Thus we are able to provide an efficient fall back routine for any kind of UAV (Unmanned Aerial Vehicles) since we rely solely on a monocular camera and on on-board computation. In particular, we devised two variants of the classical continuous 4-point algorithm and provided an extensive experimental evaluation against a known ground truth. The results show that our approach is able to recover the ego-motion of a flying UAV in realistic conditions and by only relying on the limited on-board computational power. Furthermore, we exploited the velocity estimation for closing the loop and controlling the motion of the UAV online.

[1]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[2]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Carlo Tomasi,et al.  Comparison of approaches to egomotion computation , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[5]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[6]  Roland Siegwart,et al.  Backstepping and Sliding-mode Techniques Applied to an Indoor Micro Quadrotor , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[7]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[8]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[9]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[10]  David W. Murray,et al.  Video-rate localization in multiple maps for wearable augmented reality , 2008, 2008 12th IEEE International Symposium on Wearable Computers.

[11]  Robert E. Mahony,et al.  Nonlinear Complementary Filters on the Special Orthogonal Group , 2008, IEEE Transactions on Automatic Control.

[12]  Martin Buss,et al.  Autonomous hovering of a vision/IMU guided quadrotor , 2009, 2009 International Conference on Mechatronics and Automation.

[13]  Peter I. Corke,et al.  A new framework for force feedback teleoperation of robotic vehicles based on optical flow , 2009, 2009 IEEE International Conference on Robotics and Automation.

[14]  Kenzo Nonami,et al.  Optic flow-based vision system for autonomous 3D localization and control of small aerial vehicles , 2009, Robotics Auton. Syst..

[15]  Andrew J. Davison,et al.  Live dense reconstruction with a single moving camera , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Roland Siegwart,et al.  Vision based MAV navigation in unknown and unstructured environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[17]  Andreas Zell,et al.  Automatic Take Off, Tracking and Landing of a Miniature UAV on a Moving Carrier Vehicle , 2011, J. Intell. Robotic Syst..

[18]  Vijay Kumar,et al.  Autonomous multi-floor indoor navigation with a computationally constrained MAV , 2011, 2011 IEEE International Conference on Robotics and Automation.

[19]  Marc Pollefeys,et al.  PIXHAWK: A system for autonomous flight using onboard computer vision , 2011, 2011 IEEE International Conference on Robotics and Automation.

[20]  Kolja Kühnlenz,et al.  A vision-guided autonomous quadrotor in an air-ground multi-robot system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[21]  Roland Siegwart,et al.  Fusion of IMU and Vision for Absolute Scale Estimation in Monocular SLAM , 2011, J. Intell. Robotic Syst..

[22]  Roland Siegwart,et al.  Onboard IMU and monocular vision based control for MAVs in unknown in- and outdoor environments , 2011, 2011 IEEE International Conference on Robotics and Automation.

[23]  Rogelio Lozano,et al.  Combining Stereo Vision and Inertial Navigation System for a Quad-Rotor UAV , 2011, J. Intell. Robotic Syst..