Vision-based Autonomous Control of a Quadrotor UAV using an Onboard RGB-D Camera and its Application to Haptic Teleoperation

Abstract In this paper we present the design of a platform for autonomous navigation of a quadrotor UAV based on RGB-D technology. The proposed platform can safely navigate in an unknown environment while self-stabilization is done relying only on its own sensor perception. We developed an estimation system based on the integration of IMU and RGB-D measurements in order to estimate the velocity of the quadrotor in its body frame. Experimental tests conducted as teleoperation experiments show the effectiveness of our approach in an unstructured environment.

[1]  Robert Mahony,et al.  Admittance mode framework for haptic teleoperation of hovering vehicles with unlimited workspace , 2010 .

[2]  Stefano Stramigioli,et al.  Switching-based mapping and control for haptic teleoperation of aerial robots , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Antonio Franchi,et al.  Experiments on Intercontinental Haptic Control of Multiple UAVs , 2012, IAS.

[4]  René van Paassen,et al.  Artificial Force Field for Haptic Feedback in UAV Teleoperation , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[5]  Robert E. Mahony,et al.  Nonlinear Complementary Filters on the Special Orthogonal Group , 2008, IEEE Transactions on Automatic Control.

[6]  Roland Siegwart,et al.  Vision-Controlled Micro Flying Robots: From System Design to Autonomous Navigation and Mapping in GPS-Denied Environments , 2014, IEEE Robotics & Automation Magazine.

[7]  H. Bülthoff,et al.  Semi-Autonomous Haptic Teleoperation Control Architecture of Multiple Unmanned Aerial Vehicles , 2013 .

[8]  Wolfram Burgard,et al.  A Fully Autonomous Indoor Quadrotor , 2012, IEEE Transactions on Robotics.

[9]  Antonio Franchi,et al.  The TeleKyb framework for a modular and extendible ROS-based quadrotor control , 2013, 2013 European Conference on Mobile Robots.

[10]  Paolo Fiorini,et al.  Search and Rescue Robotics , 2008, Springer Handbook of Robotics.

[11]  Philippe Martin,et al.  The true role of accelerometer feedback in quadrotor control , 2010, 2010 IEEE International Conference on Robotics and Automation.

[12]  Robert E. Mahony,et al.  Representation of vehicle dynamics in haptic teleoperation of aerial robots , 2013, 2013 IEEE International Conference on Robotics and Automation.

[13]  Tarek Hamel,et al.  Haptic-based bilateral teleoperation of underactuated Unmanned Aerial Vehicles , 2011 .

[14]  Daniel Cremers,et al.  Robust odometry estimation for RGB-D cameras , 2013, 2013 IEEE International Conference on Robotics and Automation.

[15]  Daniel Cremers,et al.  Camera-based navigation of a low-cost quadrocopter , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Peter I. Corke,et al.  A novel approach to haptic tele-operation of aerial robot vehicles , 2010, 2010 IEEE International Conference on Robotics and Automation.

[17]  Roland Siegwart,et al.  Monocular‐SLAM–based navigation for autonomous micro helicopters in GPS‐denied environments , 2011, J. Field Robotics.

[18]  Tarek Hamel,et al.  Bilateral haptic teleoperation of VTOL UAVs , 2013, 2013 IEEE International Conference on Robotics and Automation.

[19]  Antonio Franchi,et al.  Shared Control : Balancing Autonomy and Human Assistance with a Group of Quadrotor UAVs , 2012, IEEE Robotics & Automation Magazine.

[20]  Darius Burschka,et al.  State estimation for highly dynamic flying systems using key frame odometry with varying time delays , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  ChangSu Ha,et al.  Semiautonomous Haptic Teleoperation Control Architecture of Multiple Unmanned Aerial Vehicles , 2013, IEEE/ASME Transactions on Mechatronics.

[22]  Nicholas Roy,et al.  State estimation for aggressive flight in GPS-denied environments using onboard sensing , 2012, 2012 IEEE International Conference on Robotics and Automation.

[23]  Nicolas Roussel,et al.  1 € filter: a simple speed-based low-pass filter for noisy input in interactive systems , 2012, CHI.

[24]  Antonio Franchi,et al.  Bilateral Teleoperation of Groups of Mobile Robots With Time-Varying Topology , 2012, IEEE Transactions on Robotics.

[25]  Antonio Franchi,et al.  Modeling and Control of UAV Bearing Formations with Bilateral High-level Steering , 2012, Int. J. Robotics Res..

[26]  Vijay Kumar,et al.  Autonomous multi-floor indoor navigation with a computationally constrained MAV , 2011, 2011 IEEE International Conference on Robotics and Automation.