Autonomous Flights Through Image-Defined Paths

This paper addresses the problem of autonomous quadrotor navigation through a previously-mapped indoor area. In particular, we focus on the case where a user walks through a building and collects images. Subsequently, a visual map of the area, represented as a graph of linked images, is constructed and used for automatically determining visual paths (i.e., sequences of images connecting the start to the end image locations specified by the user). The quadrotor follows the desired path by iteratively (i) determining the desired motion to the next reference frame, (ii) controlling its roll, pitch, yaw-rate, and thrust, and (iii) appropriately switching to a new reference image. For motion estimation and reference-image switching, we concurrently employ the results of the 2pt and the 5pt RANSAC to distinguish and deal with both cases of sufficient and insufficient baseline (e.g., rotation in place). The accuracy and robustness of our algorithm are evaluated experimentally on two quadrotors navigating along lengthy corridors, and through tight spaces inside a building and in the presence of dynamic obstacles (e.g., people walking).

[1]  Kenzo Nonami,et al.  Visual Servoing of Quadrotor Micro-Air Vehicle Using Color-Based Tracking Algorithm , 2010 .

[2]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[3]  R. K. Shyamasundar,et al.  Introduction to algorithms , 1996 .

[4]  Daewon Lee,et al.  Autonomous landing of a VTOL UAV on a moving platform using image-based visual servoing , 2012, 2012 IEEE International Conference on Robotics and Automation.

[5]  Robert E. Mahony,et al.  Image-Based Visual Servo Control of the Translation Kinematics of a Quadrotor Aerial Vehicle , 2009, IEEE Transactions on Robotics.

[6]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[7]  S. Hutchinson,et al.  Visual Servo Control Part II : Advanced Approaches , 2007 .

[8]  Gene F. Franklin,et al.  Digital control of dynamic systems , 1980 .

[9]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[10]  Ashutosh Saxena,et al.  Autonomous MAV flight in indoor environments using single image perspective cues , 2011, 2011 IEEE International Conference on Robotics and Automation.

[11]  Luc Van Gool,et al.  Feature based omnidirectional sparse visual path following , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[13]  George K. I. Mann,et al.  Vision-based qualitative path-following control of quadrotor aerial vehicle , 2014, 2014 International Conference on Unmanned Aircraft Systems (ICUAS).

[14]  Dimitrios G. Kottas,et al.  Efficient Visual-Inertial Navigation using a Rolling-Shutter Camera with Inaccurate Timestamps , 2014, Robotics: Science and Systems.

[15]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[16]  Sinisa Segvic,et al.  Experimental Evaluation of Autonomous Driving Based on Visual Memory and Image-Based Visual Servoing , 2011, IEEE Transactions on Intelligent Transportation Systems.

[17]  Zhichao Chen,et al.  Qualitative Vision-Based Path Following , 2009, IEEE Transactions on Robotics.

[18]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[20]  Philippe Martinet,et al.  Vision-based navigation of unmanned aerial vehicles , 2010 .

[21]  Berthold K. P. Horn Relative orientation , 1987, International Journal of Computer Vision.

[22]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[23]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[24]  Marc Pollefeys,et al.  An open source and open hardware embedded metric optical flow CMOS camera for indoor and outdoor applications , 2013, 2013 IEEE International Conference on Robotics and Automation.

[25]  Stergios I. Roumeliotis,et al.  Active vision-based robot localization and navigation in a visual memory , 2011, 2011 IEEE International Conference on Robotics and Automation.

[26]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[27]  Philippe Martinet,et al.  Indoor navigation of a non-holonomic mobile robot using a visual memory , 2008, Auton. Robots.