Onboard IMU and monocular vision based control for MAVs in unknown in- and outdoor environments

In this paper, we present our latest achievements towards the goal of autonomous flights of an MAV in unknown environments, only having a monocular camera as exteroceptive sensor. As MAVs are highly agile, it is not sufficient to directly use the visual input for position control at the framerates that can be achieved with small onboard computers. Our contributions in this work are twofold. First, we present a solution to overcome the issue of having a low frequent onboard visual pose update versus the high agility of an MAV. This is solved by filtering visual information with inputs from inertial sensors. Second, as our system is based on monocular vision, we present a solution to estimate the metric visual scale aid of an air pressure sensor. All computation is running onboard and is tightly integrated on the MAV to avoid jitter and latencies. This framework enables stable flights indoors and outdoors even under windy conditions.

[1]  Eric Johnson,et al.  Augmenting UAV autonomy , 2006, IEEE Robotics & Automation Magazine.

[2]  Robert E. Mahony,et al.  Control of a quadrotor helicopter using visual feedback , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[3]  Robert E. Mahony,et al.  Robust Nonlinear Fusion of Inertial and Visual Data for position, velocity and attitude estimation of UAV , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[4]  Roland Siegwart,et al.  Vision based Position Control for MAVs using one single Artificial Landmark , 2010 .

[5]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[6]  Simon Zingg,et al.  MAV Obstacle Avoidance Using Optical Flow , 2009 .

[7]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[8]  A. Isidori.  Nonlinear Control Systems , 1985 .

[9]  Gaurav S. Sukhatme,et al.  Combined optic-flow and stereo-based navigation of urban canyons for a UAV , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Gerd Hirzinger,et al.  Energy-efficient Autonomous Four-rotor Flying Robot Controlled at 1 kHz , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[11]  Raffaello D'Andrea,et al.  A simple learning strategy for high-speed quadrocopter multi-flips , 2010, 2010 IEEE International Conference on Robotics and Automation.

[12]  Jonathan P. How,et al.  Vision-based guidance and control of a hovering vehicle in unknown, GPS-denied environments , 2009, 2009 IEEE International Conference on Robotics and Automation.

[13]  Jian Wang,et al.  Markerless, vision-assisted flight control of a quadrocopter , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Nicholas Roy,et al.  Stereo vision and laser odometry for autonomous helicopters in GPS-denied indoor environments , 2009, Defense + Commercial Sensing.

[15]  S. Park,et al.  RIC (robust internal-loop compensator) based flight control of a quad-rotor type UAV , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Roland Siegwart,et al.  Vision based MAV navigation in unknown and unstructured environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[18]  Robert E. Mahony,et al.  Hovering flight and vertical landing control of a VTOL Unmanned Aerial Vehicle using optical flow , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Robert E. Mahony,et al.  Visual servo trajectory tracking for a four rotor VTOL aerial vehicle , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[20]  Roland Siegwart,et al.  Backstepping and Sliding-mode Techniques Applied to an Indoor Micro Quadrotor , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.