Bio-inspired Obstacle Avoidance for Flying Robots with Active Sensing

This paper presents a novel vision-based obstacle avoidance system for flying robots working in dynamic environments. Instead of fusing multiple sensors to enlarge the view field, we introduce a bio-inspired solution that utilizes a stereo camera with independent rotational DOF to sense the obstacles actively. In particular, the rotation is planned heuristically by multiple objectives that can benefit flight safety, including tracking dynamic obstacles, observing the heading direction, and exploring the previously unseen area. With this sensing result, a flight path is planned based on real-time sampling and collision checking in state space, which constitutes an active sense and avoid (ASAA) system. Experiments demonstrate that this system is capable of handling environments with dynamic obstacles and abrupt changes in goal direction. Since only one stereo camera is utilized, this system provides a low-cost but effective approach to overcome the view field limitation in visual navigation.

[1]  Vijay Kumar,et al.  Towards Search-based Motion Planning for Micro Aerial Vehicles , 2018, ArXiv.

[2]  Hiroshi Ishiguro,et al.  Omni-directional stereo for making global map , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[3]  Kin Huat Low,et al.  Three-dimensional (3D) Dynamic Obstacle Perception in a Detect-and-Avoid Framework for Unmanned Aerial Vehicles , 2019, 2019 International Conference on Unmanned Aircraft Systems (ICUAS).

[4]  Rafael Fierro,et al.  Real-time Quadrotor Navigation Through Planning in Depth Space in Unstructured Environments* , 2019, 2019 International Conference on Unmanned Aircraft Systems (ICUAS).

[5]  Qiang Zhou,et al.  Hybrid obstacle avoidance system with vision and ultrasonic sensors for multi-rotor MAVs , 2018, Ind. Robot.

[6]  Fabio Tozeto Ramos,et al.  Simple online and realtime tracking , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[7]  Roland Siegwart,et al.  Omnidirectional visual obstacle detection using embedded FPGA , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  Daniel Cremers,et al.  Real-time trajectory replanning for MAVs using uniform B-splines and a 3D circular buffer , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  Jonathan P. How,et al.  Aggressive 3-D collision avoidance for high-speed navigation , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Youmin Zhang,et al.  Sense and avoid technologies with applications to unmanned aircraft systems: Review and prospects , 2015 .

[11]  Heinrich H. Bülthoff,et al.  Obstacle detection, tracking and avoidance for a teleoperated UAV , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Narendra Ahuja,et al.  An Omnidirectional Stereo Vision System Using a Single Camera , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[13]  Vijay Kumar,et al.  Planning Dynamically Feasible Trajectories for Quadrotors Using Safe Flight Corridors in 3-D Complex Environments , 2017, IEEE Robotics and Automation Letters.

[14]  Wenhan Luo,et al.  Multiple object tracking: A literature review , 2014, Artif. Intell..

[15]  Section De Microtechnique,et al.  design and control of quadrotors with application to autonomous flying , 2007 .

[16]  Fei Gao,et al.  Robust Real-time UAV Replanning Using Guided Gradient-based Optimization and Topological Paths , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Marc Pollefeys,et al.  Autonomous obstacle avoidance and maneuvering on a vision-guided MAV using on-board processing , 2011, 2011 IEEE International Conference on Robotics and Automation.

[18]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[19]  Robert E. Mahony,et al.  Vision Based Forward Sensitive Reactive Control for a Quadrotor VTOL , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Shengyong Chen,et al.  Active vision in robotic systems: A survey of recent developments , 2011, Int. J. Robotics Res..

[21]  Marc Pollefeys,et al.  Reactive avoidance using embedded stereo vision for MAV flight , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Jörg Stückler,et al.  Multilayered Mapping and Navigation for Autonomous Micro Aerial Vehicles , 2016, J. Field Robotics.

[23]  Craig A. Woolsey,et al.  Sense and avoid based on visual pose estimation for small UAS , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[24]  Samir Bouabdallah,et al.  Design and control of quadrotors with application to autonomous flying , 2007 .

[25]  Shaojie Shen,et al.  Online generation of collision-free trajectories for quadrotor flight in unknown cluttered environments , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Javier Alonso-Mora,et al.  Robust Vision-based Obstacle Avoidance for Micro Aerial Vehicles in Dynamic Environments , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[27]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.