Fast, autonomous flight in GPS‐denied and cluttered environments

One of the most challenging tasks for a flying robot is to autonomously navigate between target locations quickly and reliably while avoiding obstacles in its path, and with little to no a-priori knowledge of the operating environment. This challenge is addressed in the present paper. We describe the system design and software architecture of our proposed solution, and showcase how all the distinct components can be integrated to enable smooth robot operation. We provide critical insight on hardware and software component selection and development, and present results from extensive experimental testing in real-world warehouse environments. Experimental testing reveals that our proposed solution can deliver fast and robust aerial robot autonomous navigation in cluttered, GPS-denied environments.

[1]  Vijay Kumar,et al.  Minimum snap trajectory generation and control for quadrotors , 2011, 2011 IEEE International Conference on Robotics and Automation.

[2]  Vijay Kumar,et al.  Mixed-integer quadratic program trajectory generation for heterogeneous quadrotor teams , 2012, 2012 IEEE International Conference on Robotics and Automation.

[3]  Roland Siegwart,et al.  Design and control of an indoor micro quadrotor , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[4]  Yu Zhang,et al.  Robust Autonomous Flight in Constrained and Visually Degraded Shipboard Environments , 2017, J. Field Robotics.

[5]  Charles Richter,et al.  Aggressive flight of fixed-wing and quadrotor aircraft in dense indoor environments , 2015, Int. J. Robotics Res..

[6]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[7]  Vijay Kumar,et al.  QuadCloud: A Rapid Response Force with Quadrotor Teams , 2014, ISER.

[8]  Davide Scaramuzza,et al.  REMODE: Probabilistic, monocular dense reconstruction in real time , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Wolfram Burgard,et al.  Towards a navigation system for autonomous indoor flying , 2009, 2009 IEEE International Conference on Robotics and Automation.

[10]  Javier Civera,et al.  Inverse Depth Parametrization for Monocular SLAM , 2008, IEEE Transactions on Robotics.

[11]  Michael Gassner,et al.  SVO: Semidirect Visual Odometry for Monocular and Multicamera Systems , 2017, IEEE Transactions on Robotics.

[12]  Davide Scaramuzza,et al.  SVO: Fast semi-direct monocular visual odometry , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Rudolph van der Merwe,et al.  The unscented Kalman filter for nonlinear estimation , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[14]  Vijay Kumar,et al.  Energetics in robotic flight at small scales , 2017, Interface Focus.

[15]  Stergios I. Roumeliotis,et al.  A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[16]  H.F. Durrant-Whyte,et al.  A new approach for filtering nonlinear systems , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[17]  Claire J. Tomlin,et al.  Quadrotor Helicopter Flight Dynamics and Control: Theory and Experiment , 2007 .

[18]  Robin Deits,et al.  Computing Large Convex Regions of Obstacle-Free Space Through Semidefinite Programming , 2014, WAFR.

[19]  Robin Deits,et al.  Efficient mixed-integer planning for UAVs in cluttered environments , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Ufuk Topcu,et al.  Optimization-based trajectory generation with linear temporal logic specifications , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Roland Siegwart,et al.  Vision based MAV navigation in unknown and unstructured environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[22]  J. Escareno,et al.  Embedded control of a four-rotor UAV , 2006, 2006 American Control Conference.

[23]  V. Moreau,et al.  Dynamic modeling and intuitive control strategy for an "X4-flyer" , 2005, 2005 International Conference on Control and Automation.

[24]  Camillo J. Taylor,et al.  Towards fully autonomous visual inspection of dark featureless dam penstocks using MAVs , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[25]  Jizhong Xiao,et al.  Autonomous quadrotor flight using onboard RGB-D visual odometry , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Nicholas Roy,et al.  RANGE - robust autonomous navigation in GPS-denied environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[27]  Nicholas Roy,et al.  Autonomous Flight in Unknown Indoor Environments , 2009 .

[28]  G. Gerhart,et al.  Stereo vision and laser odometry for autonomous helicopters in GPS-denied indoor environments , 2009 .

[29]  Vijay Kumar,et al.  The GRASP Multiple Micro-UAV Testbed , 2010, IEEE Robotics & Automation Magazine.

[30]  Sven Behnke,et al.  Autonomous Navigation for Micro Aerial Vehicles in Complex GNSS-denied Environments , 2016, J. Intell. Robotic Syst..

[31]  Vijay Kumar,et al.  Planning Dynamically Feasible Trajectories for Quadrotors Using Safe Flight Corridors in 3-D Complex Environments , 2017, IEEE Robotics and Automation Letters.

[32]  Vijay Kumar,et al.  High speed navigation for quadrotors with limited onboard sensing , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[33]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Ji Zhang,et al.  Enabling aggressive motion estimation at low-drift and accurate mapping in real-time , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[35]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[36]  Vijay Kumar,et al.  Autonomous multi-floor indoor navigation with a computationally constrained MAV , 2011, 2011 IEEE International Conference on Robotics and Automation.

[37]  Alban Grastien,et al.  Online Graph Pruning for Pathfinding On Grid Maps , 2011, AAAI.

[38]  Roland Siegwart,et al.  Backstepping and Sliding-mode Techniques Applied to an Indoor Micro Quadrotor , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[39]  Sebastian Scherer,et al.  Autonomous Exploration and Motion Planning for an Unmanned Aerial Vehicle Navigating Rivers , 2015, J. Field Robotics.

[40]  Jonathan P. How,et al.  Receding horizon control of autonomous aerial vehicles , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[41]  Roland Siegwart,et al.  Robust visual inertial odometry using a direct EKF-based approach , 2015, IROS 2015.

[42]  J. De Schutter,et al.  Influence of propeller configuration on propulsion system efficiency of multi-rotor Unmanned Aerial Vehicles , 2016, 2016 International Conference on Unmanned Aircraft Systems (ICUAS).

[43]  Marc Pollefeys,et al.  PX4: A node-based multithreaded open source robotics framework for deeply embedded platforms , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[44]  Roland Siegwart,et al.  Full control of a quadrotor , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[45]  Taeyoung Lee,et al.  Geometric tracking control of a quadrotor UAV on SE(3) , 2010, 49th IEEE Conference on Decision and Control (CDC).

[46]  Teodor Tomic,et al.  Autonomous Vision‐based Micro Air Vehicle for Indoor and Outdoor Navigation , 2014, J. Field Robotics.

[47]  Vijay Kumar,et al.  Vision-Based State Estimation and Trajectory Control Towards High-Speed Flight with a Quadrotor , 2013, Robotics: Science and Systems.

[48]  Nicholas Roy,et al.  Planning in information space for a quadrotor helicopter in a GPS-denied environment , 2008, 2008 IEEE International Conference on Robotics and Automation.

[49]  Stefano Soatto,et al.  Visual-inertial navigation, mapping and localization: A scalable real-time causal approach , 2011, Int. J. Robotics Res..

[50]  Charles Richter,et al.  Polynomial Trajectory Planning for Aggressive Quadrotor Flight in Dense Indoor Environments , 2016, ISRR.

[51]  Aaron M. Harrington,et al.  Power and weight considerations in small, agile quadrotors , 2014, Defense + Security Symposium.

[52]  Vijay Kumar,et al.  Safe receding horizon control for aggressive MAV flight with limited range sensing , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[53]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[54]  Vijay Kumar,et al.  Toward autonomous avian-inspired grasping for micro aerial vehicles , 2014, Bioinspiration & biomimetics.

[55]  Carlos Hernández,et al.  Video-based, real-time multi-view stereo , 2011, Image Vis. Comput..

[56]  Sergei Lupashin,et al.  The Flight Assembled Architecture installation: Cooperative construction with flying machines , 2014, IEEE Control Systems.

[57]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.