Monocular Vision-Based Dynamic Moving Obstacles Detection and Avoidance

In this paper, we proposed an UAV system for obstacle avoidance depending of a ground station processing based on monocular vision. To accomplish detection, tracking, proximity estimation and dynamic obstacles avoidance that are approaching the UAV, a series of methods and techniques are implemented. To detect movement, frame differentiation was applied to consecutive frames, once the moving object is detected, we detect Shi-Tomasi feature points to track the object using optical flow method Lucas-Kanade. To make possible proximity estimation, a linear regression method based on the area covered by the object was used. A fuzzy logic controller was designed to avoid the moving object, we considered the approach rate and the area of the object to control UAV’s position in relation to the object as fuzzy inputs.

[1]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[2]  Wilbert G. Aguilar,et al.  Vertical take off and landing with fixed rotor , 2017, 2017 CHILEAN Conference on Electrical, Electronics Engineering, Information and Communication Technologies (CHILECON).

[3]  Wilbert G. Aguilar,et al.  Pose Estimation Based on Monocular Visual Odometry and Lane Detection for Intelligent Vehicles , 2018, AVR.

[4]  Dezhen Song,et al.  IMU-based localization and slip estimation for skid-steered mobile robots , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Wilbert G. Aguilar,et al.  Geolocation and Counting of People with Aerial Thermal Imaging for Rescue Purposes , 2018, AVR.

[6]  Roland Siegwart,et al.  MAV navigation through indoor corridors using optical flow , 2010, 2010 IEEE International Conference on Robotics and Automation.

[7]  Zhixiang Liu,et al.  Unmanned surface vehicles: An overview of developments and challenges , 2016, Annu. Rev. Control..

[8]  Wilbert G. Aguilar,et al.  E-services from Emergency Communication Network: Aerial Platform Evaluation , 2018, 2018 International Conference on eDemocracy & eGovernment (ICEDEG).

[9]  Chunhua Zhang,et al.  The application of small unmanned aerial systems for precision agriculture: a review , 2012, Precision Agriculture.

[10]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Cecilio Angulo,et al.  Real-Time Model-Based Video Stabilization for Microaerial Vehicles , 2015, Neural Processing Letters.

[12]  Jessie Y C Chen,et al.  UAV-guided navigation for ground robot tele-operation in a military reconnaissance environment , 2010, Ergonomics.

[13]  Wilbert G. Aguilar,et al.  Wireless communication system for the transmission of thermal images from a UAV , 2017, 2017 CHILEAN Conference on Electrical, Electronics Engineering, Information and Communication Technologies (CHILECON).

[14]  Wilbert G. Aguilar,et al.  Simulation System Based on Augmented Reality for Optimization of Training Tactics on Military Operations , 2018, AVR.

[15]  Wilbert G. Aguilar,et al.  Pedestrian Detection for UAVs Using Cascade Classifiers with Meanshift , 2017, 2017 IEEE 11th International Conference on Semantic Computing (ICSC).

[16]  Luis Valentin,et al.  Detección de obstáculos durante vuelo autónomo de drones utilizando SLAM monocular , 2016, Res. Comput. Sci..

[17]  Wilbert G. Aguilar,et al.  Interface of optimal electro-optical/infrared for unmanned aerial vehicles , 2018 .

[18]  Wilbert G. Aguilar,et al.  Real-Time Detection and Simulation of Abnormal Crowd Behavior , 2017, AVR.

[19]  Wilbert G. Aguilar,et al.  SVM and RGB-D Sensor Based Gesture Recognition for UAV Control , 2018, AVR.

[20]  Wilbert Geovanny Aguilar Castillo,et al.  Obstacle Avoidance Based-Visual Navigation for Micro Aerial Vehicles , 2017 .

[21]  Stefano Caselli,et al.  Detection of Nuclear Sources by UAV Teleoperation Using a Visuo-Haptic Augmented Reality Interface , 2017, Sensors.

[22]  Hammam A. Alshazly,et al.  Image Features Detection, Description and Matching , 2016 .

[23]  Wilbert G. Aguilar,et al.  Math Model of UAV Multi Rotor Prototype with Fixed Wing Aerodynamic Structure for a Flight Simulator , 2017, AVR.

[24]  Wilbert G. Aguilar,et al.  Robust Motion Estimation Based on Multiple Monocular Camera for Indoor Autonomous Navigation of Micro Aerial Vehicle , 2018, AVR.

[25]  Wilbert G. Aguilar,et al.  Developing of a Video-Based Model for UAV Autonomous Navigation , 2017 .

[26]  Wilbert G. Aguilar,et al.  Visual SLAM with a RGB-D Camera on a Quadrotor UAV Using on-Board Processing , 2017, IWANN.

[27]  Charles Richter,et al.  Polynomial Trajectory Planning for Aggressive Quadrotor Flight in Dense Indoor Environments , 2016, ISRR.

[28]  Wilbert G. Aguilar,et al.  On-Board Target Virtualization Using Image Features for UAV Autonomous Tracking , 2018, UNet.

[29]  Wei Zhang,et al.  A Unified Framework for Street-View Panorama Stitching , 2016, Sensors.

[30]  Cecilio Angulo,et al.  Real-time video stabilization without phantom movements for micro aerial vehicles , 2014, EURASIP J. Image Video Process..

[31]  Wilbert G. Aguilar,et al.  Capture and processing of geospatial data with laser scanner system for 3D modeling and virtual reality of Amazonian Caves , 2017, 2017 IEEE Second Ecuador Technical Chapters Meeting (ETCM).

[32]  Wilbert G. Aguilar,et al.  On-Board Visual SLAM on a UGV Using a RGB-D Camera , 2017, ICIRA.

[33]  Jun Zhang,et al.  Novel Technique for Vision-Based UAV Navigation , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[34]  Sergio Montenegro,et al.  Obstacle Detection and Collision Avoidance for a UAV With Complementary Low-Cost Sensors , 2015, IEEE Access.

[35]  Cecilio Angulo,et al.  Pedestrian Detection for UAVs Using Cascade Classifiers and Saliency Maps , 2017, IWANN.

[36]  Wilbert G. Aguilar,et al.  3D Environment Mapping Using the Kinect V2 and Path Planning Based on RRT Algorithms , 2016 .

[37]  Wilbert G. Aguilar,et al.  Convolutional Neuronal Networks Based Monocular Object Detection and Depth Perception for Micro UAVs , 2018, IScIDE.

[38]  Ramon Costa-Castelló,et al.  Autonomous Navigation Control for Quadrotors in Trajectories Tracking , 2017, ICIRA.

[39]  Wilbert G. Aguilar,et al.  Statistical Abnormal Crowd Behavior Detection and Simulation for Real-Time Applications , 2017, ICIRA.

[40]  Wilbert G. Aguilar,et al.  Real-Time 3D Modeling with a RGB-D Camera and On-Board Processing , 2017, AVR.

[41]  Heinrich H. Bülthoff,et al.  Obstacle detection, tracking and avoidance for a teleoperated UAV , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).