Continuous on-board monocular-vision-based elevation mapping applied to autonomous landing of micro aerial vehicles

In this paper, we propose a resource-efficient system for real-time 3D terrain reconstruction and landing-spot detection for micro aerial vehicles. The system runs on an on-board smartphone processor and requires only the input of a single downlooking camera and an inertial measurement unit. We generate a two-dimensional elevation map that is probabilistic, of fixed size, and robot-centric, thus, always covering the area immediately underneath the robot. The elevation map is continuously updated at a rate of 1 Hz with depth maps that are triangulated from multiple views using recursive Bayesian estimation. To highlight the usefulness of the proposed mapping framework for autonomous navigation of micro aerial vehicles, we successfully demonstrate fully autonomous landing including landing-spot detection in real-world experiments.

[1]  Simon Lacroix,et al.  Autonomous Detection of Safe Landing Areas for an UAV from Monocular Images , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[3]  Andrew E. Johnson,et al.  Lidar-Based Hazard Avoidance for Safe Landing on Mars , 2002 .

[4]  Davide Scaramuzza,et al.  SVO: Fast semi-direct monocular visual odometry , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[5]  R. Siegwart,et al.  ROBOT-CENTRIC ELEVATION MAPPING WITH UNCERTAINTY ESTIMATES , 2014 .

[6]  Roland Siegwart,et al.  Vision-Controlled Micro Flying Robots: From System Design to Autonomous Navigation and Mapping in GPS-Denied Environments , 2014, IEEE Robotics & Automation Magazine.

[7]  Daniel Cremers,et al.  Real-Time Dense Geometry from a Handheld Camera , 2010, DAGM-Symposium.

[8]  Larry H. Matthies,et al.  Vision Guided Landing of an Autonomous Helicopter in Hazardous Terrain , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[9]  Jan-Michael Frahm,et al.  Real-Time Plane-Sweeping Stereo with Multiple Sweeping Directions , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Gaurav S. Sukhatme,et al.  Towards vision-based safe landing for an autonomous helicopter , 2002, Robotics Auton. Syst..

[11]  Carlos Hernández,et al.  Video-based, real-time multi-view stereo , 2011, Image Vis. Comput..

[12]  Roland Siegwart,et al.  A robust and modular multi-sensor fusion approach applied to MAV navigation , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Davide Scaramuzza,et al.  Appearance-based Active, Monocular, Dense Reconstruction for Micro Aerial Vehicles , 2014, Robotics: Science and Systems.

[14]  Gaurav S. Sukhatme,et al.  Vision-based autonomous landing of an unmanned aerial vehicle , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[15]  Xavier Bresson,et al.  Fast Global Minimization of the Active Contour/Snake Model , 2007, Journal of Mathematical Imaging and Vision.

[16]  Davide Scaramuzza,et al.  REMODE: Probabilistic, monocular dense reconstruction in real time , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Nathan Michael,et al.  Vision-based Landing Site Evaluation and Trajectory Generation Toward Rooftop Landing , 2014, Robotics: Science and Systems.

[18]  Flavio Fontana,et al.  Autonomous, Vision‐based Flight and Live Dense 3D Mapping with a Quadrotor Micro Aerial Vehicle , 2016, J. Field Robotics.

[19]  Roland Siegwart,et al.  Intuitive 3D Maps for MAV Terrain Exploration and Obstacle Avoidance , 2011, J. Intell. Robotic Syst..

[20]  Andrew J. Davison,et al.  DTAM: Dense tracking and mapping in real-time , 2011, 2011 International Conference on Computer Vision.

[21]  Sebastian Scherer,et al.  Autonomous landing at unprepared sites by a full-scale helicopter , 2012, Robotics Auton. Syst..