Robust Vision-based Obstacle Avoidance for Micro Aerial Vehicles in Dynamic Environments

In this paper, we present an on-board vision-based approach for avoidance of moving obstacles in dynamic environments. Our approach relies on an efficient obstacle detection and tracking algorithm based on depth image pairs, which provides the estimated position, velocity and size of the obstacles. Robust collision avoidance is achieved by formulating a chance-constrained model predictive controller (CC-MPC) to ensure that the collision probability between the micro aerial vehicle (MAV) and each moving obstacle is below a specified threshold. The method takes into account MAV dynamics, state estimation and obstacle sensing uncertainties. The proposed approach is implemented on a quadrotor equipped with a stereo camera and is tested in a variety of environments, showing effective on-line collision avoidance of moving obstacles.

[1]  Jonathan P. How,et al.  Vision-based guidance and control of a hovering vehicle in unknown, GPS-denied environments , 2009, 2009 IEEE International Conference on Robotics and Automation.

[2]  Charles Richter,et al.  Polynomial Trajectory Planning for Aggressive Quadrotor Flight in Dense Indoor Environments , 2016, ISRR.

[3]  Russ Tedrake,et al.  NanoMap: Fast, Uncertainty-Aware Proximity Queries with Lazy Search Over Local 3D Data , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Javier Alonso-Mora,et al.  Distributed Multi-Robot Formation Splitting and Merging in Dynamic Environments , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[5]  Moritz Diehl,et al.  ACADO toolkit—An open‐source framework for automatic control and dynamic optimization , 2011 .

[6]  Luxin Han,et al.  FIESTA: Fast Incremental Euclidean Distance Fields for Online Motion Planning of Aerial Robots , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[7]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[8]  Jonathan P. How,et al.  Aggressive 3-D collision avoidance for high-speed navigation , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Vijay Kumar,et al.  Robust Stereo Visual Inertial Odometry for Fast Autonomous Flight , 2017, IEEE Robotics and Automation Letters.

[10]  Fei Gao,et al.  Flying on point clouds: Online trajectory generation and autonomous navigation for quadrotors in cluttered environments , 2018, J. Field Robotics.

[11]  Iwan Ulrich,et al.  VFH+: reliable obstacle avoidance for fast mobile robots , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[12]  Andreas Zell,et al.  Robust and efficient volumetric occupancy mapping with an application to stereo vision , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Davide Scaramuzza,et al.  How Fast Is Too Fast? The Role of Perception Latency in High-Speed Sense and Avoid , 2019, IEEE Robotics and Automation Letters.

[14]  Javier Alonso-Mora,et al.  Chance-Constrained Collision Avoidance for MAVs in Dynamic Environments , 2019, IEEE Robotics and Automation Letters.

[15]  Ya-Zhong Luo,et al.  A review of uncertainty propagation in orbital mechanics , 2017 .

[16]  Marc Pollefeys,et al.  Reactive avoidance using embedded stereo vision for MAV flight , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Yi Lin,et al.  Online Safe Trajectory Generation for Quadrotors Using Fast Marching Method and Bernstein Basis Polynomial , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Jonathan P. How,et al.  FASTER: Fast and Safe Trajectory Planner for Flights in Unknown Environments , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Marc Pollefeys,et al.  Vision-based autonomous mapping and exploration using a quadrotor MAV , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Sebastian Scherer,et al.  First results in detecting and avoiding frontal obstacles from a monocular camera for micro unmanned aerial vehicles , 2013, 2013 IEEE International Conference on Robotics and Automation.

[21]  Manuela M. Veloso,et al.  Depth camera based indoor mobile robot localization and navigation , 2012, 2012 IEEE International Conference on Robotics and Automation.

[22]  Vijay Kumar,et al.  Planning Dynamically Feasible Trajectories for Quadrotors Using Safe Flight Corridors in 3-D Complex Environments , 2017, IEEE Robotics and Automation Letters.

[23]  Russ Tedrake,et al.  Funnel libraries for real-time robust feedback motion planning , 2016, Int. J. Robotics Res..

[24]  Vijay Kumar,et al.  A Survey on Aerial Swarm Robotics , 2018, IEEE Transactions on Robotics.

[25]  Roland Siegwart,et al.  Voxblox: Incremental 3D Euclidean Signed Distance Fields for on-board MAV planning , 2016, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[26]  Titus Cieslewski,et al.  Rapid exploration with multi-rotors: A frontier selection method for high speed flight , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  Javier Alonso-Mora,et al.  B-UAVC: Buffered Uncertainty-Aware Voronoi Cells for Probabilistic Multi-Robot Collision Avoidance , 2019, 2019 International Symposium on Multi-Robot and Multi-Agent Systems (MRS).

[28]  Tone Magister,et al.  The Autonomous Flight , 2012 .