Robot Vision: Obstacle-Avoidance Techniques for Unmanned Aerial Vehicles

In this article, a vision-based technique for obstacle avoidance and target identification is combined with haptic feedback to develop a new teleoperated navigation system for underactuated aerial vehicles in unknown environments. A three-dimensional (3-D) map of the surrounding environment is built by matching the keypoints among several images, which are acquired by an onboard camera and stored in a buffer together with the corresponding estimated odometry. Hence, based on the 3-D map, a visual identification algorithm is employed to localize both obstacles and the desired target to build a virtual field accordingly. A bilateral control system has been developed such that an operator can safely navigate in an unknown environment and perceive it by means of a vision-based haptic force-feedback device. Experimental tests in an indoor environment verify the effectiveness of the proposed teleoperated control.

[1]  Stefan Hrabar,et al.  Vision-Based 3D Navigation for an Autonomous Helicopter , 2006 .

[2]  Y.K. Kwag,et al.  Obstacle awareness and collision avoidance radar sensor system for low-altitude flying smart UAV , 2004, The 23rd Digital Avionics Systems Conference (IEEE Cat. No.04CH37576).

[3]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[4]  Rafik Mebarki,et al.  Closed-form solution for absolute scale velocity estimation using visual and inertial data with a sliding least-squares estimation , 2013, 21st Mediterranean Conference on Control and Automation.

[5]  Peter I. Corke,et al.  Intercontinental haptic teleoperation of a flying vehicle: A step towards real-time applications , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[7]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Antonio Henrique,et al.  Obstacle avoidance using time-to-contact information , 2004 .

[9]  Zhang,et al.  Honeybee navigation en route to the goal: visual flight control and odometry , 1996, The Journal of experimental biology.

[10]  Jean-Christophe Zufferey,et al.  Bio-inspired Flying Robots: Experimental Synthesis of Autonomous Indoor Flyers , 2008 .

[11]  Roland Siegwart,et al.  Robust Real-Time Visual Odometry with a Single Camera and an IMU , 2011, BMVC.

[12]  N. Franceschini,et al.  Two optic flow regulators for speed control and obstacle avoidance , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[13]  Stefano Stramigioli,et al.  Bilateral teleoperation of underactuated unmanned aerial vehicles: The virtual slave concept , 2012, 2012 IEEE International Conference on Robotics and Automation.

[14]  G. Oriolo,et al.  Robotics: Modelling, Planning and Control , 2008 .

[15]  Roland Siegwart,et al.  MAV navigation through indoor corridors using optical flow , 2010, 2010 IEEE International Conference on Robotics and Automation.

[16]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[17]  Timothy W. McLain,et al.  Static and Dynamic Obstacle Avoidance for Miniature Air Vehicles , 2005 .

[18]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[19]  David W. Murray,et al.  A Square Root Unscented Kalman Filter for visual monoSLAM , 2008, 2008 IEEE International Conference on Robotics and Automation.

[20]  Vincenzo Lippiello,et al.  Fast incremental clustering and representation of a 3D point cloud sequence with planar regions , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Ian D. Reid,et al.  Real-Time Monocular SLAM with Straight Lines , 2006, BMVC.

[22]  Andreas Geiger,et al.  Visual odometry based on stereo image sequences with RANSAC-based outlier rejection scheme , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[23]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[24]  Vincenzo Lippiello,et al.  Wall inspection control of a VTOL unmanned aerial vehicle based on a stereo optical flow , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Michael H Dickinson,et al.  The influence of visual landscape on the free flight behavior of the fruit fly Drosophila melanogaster. , 2002, The Journal of experimental biology.

[26]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[27]  Debasish Ghose,et al.  Radar-assisted collision avoidance/guidance strategy for planar flight , 2001 .

[28]  Vincenzo Lippiello,et al.  MAV indoor navigation based on a closed-form solution for absolute scale velocity estimation using Optical Flow and inertial data , 2011, IEEE Conference on Decision and Control and European Control Conference.

[29]  P. Chiacchio,et al.  Aerial service robotics: The AIRobots perspective , 2012, 2012 2nd International Conference on Applied Robotics for the Power Industry (CARPI).