Robust Monocular Flight in Cluttered Outdoor Environments

Recently, there have been numerous advances in the development of biologically inspired lightweight Micro Aerial Vehicles (MAVs). While autonomous navigation is fairly straight-forward for large UAVs as expensive sensors and monitoring devices can be employed, robust methods for obstacle avoidance remains a challenging task for MAVs which operate at low altitude in cluttered unstructured environments. Due to payload and power constraints, it is necessary for such systems to have autonomous navigation and flight capabilities using mostly passive sensors such as cameras. In this paper, we describe a robust system that enables autonomous navigation of small agile quad-rotors at low altitude through natural forest environments. We present a direct depth estimation approach that is capable of producing accurate, semi-dense depth-maps in real time. Furthermore, a novel wind-resistant control scheme is presented that enables stable way-point tracking even in the presence of strong winds. We demonstrate the performance of our system through extensive experiments on real images and field tests in a cluttered outdoor environment.

[1]  C. Tomasi.  Detection and Tracking of Point Features , 1991 .

[2]  R. C. Coulter,et al.  Implementation of the Pure Pursuit Path Tracking Algorithm , 1992 .

[3]  Mark B. Boslough.  Autonomous Dynamic Soaring Platform for Distributed Mobile Sensor Arrays , 2002 .

[4]  S. Shankar Sastry,et al.  Model identification and attitude control for a micromechanical flying insect including thorax and sensor models , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[5]  Michael J. Allen,et al.  Autonomous Soaring for Improved Endurance of a Small Uninhabited Air Vehicle , 2005 .

[6]  J. Langelaan,et al.  Towards Autonomous UAV Flight in Forests , 2005 .

[7]  Ashutosh Saxena,et al.  Learning Depth from Single Monocular Images , 2005, NIPS.

[8]  S. Sastry,et al.  Autonomous Exploration in Unknown Urban Environments for Unmanned Aerial Vehicles , 2005 .

[9]  Alonzo Kelly,et al.  Toward Reliable Off Road Autonomous Vehicles Operating in Challenging Environments , 2006, Int. J. Robotics Res..

[10]  Ilan Kroo,et al.  Control Law Design for Improving UAV Performance Using Wind Turbulence , 2006 .

[11]  S. Shankar Sastry,et al.  The Recursive Multi-Frame Planar Parallax Algorithm , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[12]  Alonzo Kelly,et al.  Optimal Sampling In the Space of Paths: Preliminary Results , 2006 .

[13]  J. Langelaan.  Long Distance/Duration Trajectory Optimization for Small UAVs , 2007 .

[14]  Sebastian Scherer,et al.  Flying Fast and Low Among Obstacles: Methodology and Experiments , 2008, Int. J. Robotics Res..

[15]  Emmanuel G. Collins,et al.  Robot navigation in very cluttered environments by preference-based fuzzy behaviors , 2008, Robotics Auton. Syst..

[16]  Jack W. Langelaan,et al.  Biologically Inspired Flight Techniques for Small and Micro Unmanned Aerial Vehicles , 2008 .

[17]  Salah Sukkarieh,et al.  3D smooth path planning for a UAV in cluttered natural environments , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Steven L. Waslander,et al.  Wind Disturbance Estimation and Rejection for Quadrotor Position Control , 2009 .

[19]  Nicholas Roy,et al.  Autonomous Flight in Unknown Indoor Environments , 2009 .

[20]  Todd Templeton.  Accurate Real-Time Reconstruction of Distant Scenes Using Computer Vision: The Recursive Multi-Frame Planar Parallax Algorithm , 2009 .

[21]  Ross A. Knepper,et al.  Path diversity is only part of the problem , 2009, 2009 IEEE International Conference on Robotics and Automation.

[22]  Daniel Cremers,et al.  Real-Time Dense Geometry from a Handheld Camera , 2010, DAGM-Symposium.

[23]  Stefano Soatto,et al.  Visual-inertial navigation, mapping and localization: A scalable real-time causal approach , 2011, Int. J. Robotics Res..

[24]  Andrew J. Davison,et al.  DTAM: Dense tracking and mapping in real-time , 2011, 2011 International Conference on Computer Vision.

[25]  Vijay Kumar,et al.  Minimum snap trajectory generation and control for quadrotors , 2011, 2011 IEEE International Conference on Robotics and Automation.

[26]  Salah Sukkarieh,et al.  Visual-Inertial-Aided Navigation for High-Dynamic Motion in Built Environments Without Initial Conditions , 2012, IEEE Transactions on Robotics.

[27]  Horst Bischof,et al.  Dense reconstruction on-the-fly , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Emilio Frazzoli,et al.  High-speed flight in an ergodic forest , 2012, 2012 IEEE International Conference on Robotics and Automation.

[29]  Roland Siegwart,et al.  Real-time onboard visual-inertial state estimation and self-calibration of MAVs in unknown environments , 2012, 2012 IEEE International Conference on Robotics and Automation.

[30]  Albert S. Huang,et al.  Estimation, planning, and mapping for autonomous flight using an RGB-D camera in GPS-denied environments , 2012, Int. J. Robotics Res..

[31]  Martial Hebert,et al.  Contextual Sequence Prediction with Application to Control Library Optimization , 2012, Robotics: Science and Systems.

[32]  Martial Hebert,et al.  Learning monocular reactive UAV control in cluttered natural environments , 2012, 2013 IEEE International Conference on Robotics and Automation.

[33]  Horst Bischof,et al.  Incremental Surface Extraction from Sparse Structure-from-Motion Point Clouds , 2013, BMVC.

[34]  Changchang Wu,et al.  Towards Linear-Time Incremental Structure from Motion , 2013, 2013 International Conference on 3D Vision.

[35]  Marc Pollefeys,et al.  An open source and open hardware embedded metric optical flow CMOS camera for indoor and outdoor applications , 2013, 2013 IEEE International Conference on Robotics and Automation.

[36]  Vijay Kumar,et al.  Vision-Based State Estimation and Trajectory Control Towards High-Speed Flight with a Quadrotor , 2013, Robotics: Science and Systems.

[37]  Horst Bischof,et al.  Flexible and User-Centric Camera Calibration using Planar Fiducial Markers , 2013, BMVC.

[38]  Daniel Cremers,et al.  Semi-dense Visual Odometry for a Monocular Camera , 2013, 2013 IEEE International Conference on Computer Vision.

[39]  Rob Fergus,et al.  Depth Map Prediction from a Single Image using a Multi-Scale Deep Network , 2014, NIPS.

[40]  Horst Bischof,et al.  Automated End-to-End Workflow for Precise and Geo-accurate Reconstructions using Fiducial Markers , 2014 .

[41]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[42]  Frank Dellaert,et al.  IMU Preintegration on Manifold for Efficient Visual-Inertial Maximum-a-Posteriori Estimation , 2015, Robotics: Science and Systems.

[43]  K. Madhava Krishna,et al.  Autonomous navigation of generic monocular quadcopter in natural environment , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[44]  Martial Hebert,et al.  Vision and Learning for Deliberative Monocular Cluttered Flight , 2014, FSR.

[45]  Martial Hebert,et al.  Semi-Dense Visual Odometry for Monocular Navigation in Clutt ered Environment , 2015 .

[46]  Horst Bischof,et al.  Building with drones: Accurate 3D facade reconstruction using MAVs , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).