Obstacle Recognition and Avoidance for UAVs Under Resource-Constrained Environments

Existing resource-intensive obstacle avoidance techniques are hard to be applied on the small-size Unmanned Aerial Vehicles (UAVs) that have limited sensing and computation capacity. Therefore, it is necessary to develop an obstacle recognition and avoidance scheme which works under resource-constrained environments. To this backdrop, this paper first presents an obstacle recognition model based on monocular vision feature points. Afterwards, an obstacle recognition algorithm is put forward, whose computational complexity is low. Then, an obstacle avoidance method is proposed to regulate the obstacle-avoidance path of a UAV until it arrives its destination. To evaluate the effectiveness of the presented algorithms, we design and implement a simulation platform on Objective Modular Network Testbed in C++ (OMNeT++), and conduct a series of experiments. Experimental results show that the proposed model and algorithms can effectively guide a micro UAV to its destination using only an embedded processor and 0.5kg extra load. Even in poor communication conditions, the UAV can independently avoid obstacles and reach the destination only by acquiring the destination coordinates from the ground station.

[1]  Farid Kendoul,et al.  Survey of advances in guidance, navigation, and control of unmanned rotorcraft systems , 2012, J. Field Robotics.

[2]  Pascual Campoy Cervera,et al.  A Review of Deep Learning Methods and Applications for Unmanned Aerial Vehicles , 2017, J. Sensors.

[3]  Paul Y. Oh,et al.  Optic-Flow-Based Collision Avoidance , 2008, IEEE Robotics & Automation Magazine.

[4]  Randal W. Beard,et al.  Obstacle avoidance for unmanned air vehicles using optical flow probability distributions , 2004, SPIE Optics East.

[5]  Jeong-Oog Lee,et al.  Obstacle avoidance for small UAVs using monocular vision , 2011 .

[6]  Darius Burschka,et al.  Reactive Obstacle Avoidance for Highly Maneuverable Vehicles Based on a Two-Stage Optical Flow Clustering , 2017, IEEE Transactions on Intelligent Transportation Systems.

[7]  Dario Floreano,et al.  3D Vision-based Navigation for Indoor Microflyers , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[8]  Mohamed S. Shehata,et al.  Image Matching Using SIFT, SURF, BRIEF and ORB: Performance Comparison for Distorted Images , 2017, ArXiv.

[9]  Michel Bilodeau,et al.  Road tracking, lane segmentation and obstacle recognition by mathematical morphology , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[10]  Lei Zhu,et al.  Research on obstacles avoidance technology For UAV based on improved PTAM algorithm , 2015, 2015 IEEE International Conference on Progress in Informatics and Computing (PIC).

[11]  Xianglin Wei,et al.  Joint Optimization of Energy Consumption and Delay in Cloud-to-Thing Continuum , 2019, IEEE Internet of Things Journal.

[12]  Tarek Hamel,et al.  A UAV for bridge inspection: Visual servoing control law with orientation limits , 2007 .

[13]  Paul Y. Oh,et al.  Neural Nets and Optic Flow for Autonomous Micro-Air-Vehicle Navigation , 2004 .

[14]  Sergey Levine,et al.  Learning deep control policies for autonomous aerial vehicles with MPC-guided policy search , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[15]  nbsp,et al.  Field-Testing of a Helicopter UAV Obstacle Field Navigation and Landing System , 2009 .

[16]  Tinne Tuytelaars,et al.  How hard is it to cross the room? - Training (Recurrent) Neural Networks to steer a UAV , 2017, ArXiv.

[17]  David G. Lowe,et al.  Scalable Nearest Neighbor Algorithms for High Dimensional Data , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Arun K. Somani,et al.  Monocular vision SLAM for indoor aerial vehicles , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  B. Remes,et al.  Design, Aerodynamics, and Vision-Based Control of the DelFly , 2009 .

[20]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[21]  Farid Kendoul,et al.  Beyond visual range obstacle avoidance and infrastructure inspection by an autonomous helicopter , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Gaurav S. Sukhatme,et al.  Vision‐based navigation through urban canyons , 2009, J. Field Robotics.

[23]  Mark B. Colton,et al.  Haptic collision avoidance for a remotely operated quadrotor UAV in indoor environments , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[24]  Hilbert J. Kappen,et al.  Efficient Optical Flow and Stereo Vision for Velocity Estimation and Obstacle Avoidance on an Autonomous Pocket Drone , 2016, IEEE Robotics and Automation Letters.

[25]  J. Gonçalves,et al.  UAV photogrammetry for topographic monitoring of coastal areas , 2015 .

[26]  Michael A. Goodrich,et al.  Supporting wilderness search and rescue using a camera‐equipped mini UAV , 2008, J. Field Robotics.

[27]  K. Madhava Krishna,et al.  DeepFly: towards complete autonomous navigation of MAVs with monocular camera , 2016, ICVGIP '16.

[28]  Yahong Rosa Zheng,et al.  Task Assignment and Path Planning for Multiple Autonomous Underwater Vehicles Using 3D Dubins Curves † , 2017, Sensors.

[29]  Tetsuji Ogawa,et al.  Vision based SLAM for humanoid robots: A survey , 2013, 2013 Second International Japan-Egypt Conference on Electronics, Communications and Computers (JEC-ECC).

[30]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[31]  Sebastian Scherer,et al.  Flying Fast and Low Among Obstacles: Methodology and Experiments , 2008, Int. J. Robotics Res..

[32]  Simin Nadjm-Tehrani,et al.  Mobility Models for UAV Group Reconnaissance Applications , 2006, 2006 International Conference on Wireless and Mobile Communications (ICWMC'06).