A high-performance MAV for autonomous navigation in complex 3D environments

Micro aerial vehicles, such as multirotors, are particular well suited for the autonomous monitoring, inspection, and surveillance of buildings, e.g., for maintenance in industrial plants. Key prerequisites for the fully autonomous operation of micro aerial vehicles in complex 3D environments include real-time state estimation, obstacle detection, mapping, and navigation planning. In this paper, we describe an integrated system with a multimodal sensor setup for omnidirectional environment perception and 6D state estimation. Our MAV is equipped with a variety of sensors including a dual 3D laser scanner, three stereo camera pairs, an IMU and a powerful onboard computer to achieve these tasks in real-time. Our experimental evaluation demonstrates the performance of the integrated system.

[1]  Jörg Stückler,et al.  Local multi-resolution representation for 6D motion estimation and mapping with a continuously rotating 3D laser scanner , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Julius Ziegler,et al.  StereoScan: Dense 3d reconstruction in real-time , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[3]  Jonghyuk Kim,et al.  Integrated navigation system using camera and gimbaled laser scanner for indoor and outdoor autonomous flight of UAVs , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Stefan Kohlbrecher,et al.  A flexible and scalable SLAM system with full 3D motion estimation , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[5]  Andreas Zell,et al.  On-Board Dual-Stereo-Vision for the Navigation of an Autonomous MAV , 2013, Journal of Intelligent & Robotic Systems.

[6]  Eric N. Johnson,et al.  Monocular Visual Mapping for Obstacle Avoidance on UAVs , 2013, 2013 International Conference on Unmanned Aircraft Systems (ICUAS).

[7]  Jizhong Xiao,et al.  3 D Indoor Mapping for Micro-UAVs Using Hybrid Range Finders and Multi-Volume Occupancy Grids , 2010 .

[8]  Boris Jutzi,et al.  Weighted data fusion for UAV-borne 3D mapping with camera and line laser scanner , 2014 .

[9]  Karl Tuyls,et al.  OctoSLAM: A 3D mapping approach to situational awareness of unmanned aerial vehicles , 2013, 2013 International Conference on Unmanned Aircraft Systems (ICUAS).

[10]  Teodor Tomic,et al.  Autonomous Vision‐based Micro Air Vehicle for Indoor and Outdoor Navigation , 2014, J. Field Robotics.

[11]  Sebastian Scherer,et al.  Perception for a river mapping robot , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Jörg Stückler,et al.  Local Multi-resolution Surfel Grids for MAV Motion Estimation and 3D Mapping , 2014, IAS.

[13]  StücklerJörg,et al.  Multilayered Mapping and Navigation for Autonomous Micro Aerial Vehicles , 2016 .

[14]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[15]  Jörg Stückler,et al.  Multilayered Mapping and Navigation for Autonomous Micro Aerial Vehicles , 2016, J. Field Robotics.

[16]  Martial Hebert,et al.  Learning monocular reactive UAV control in cluttered natural environments , 2012, 2013 IEEE International Conference on Robotics and Automation.

[17]  Youdan Kim,et al.  3D Shape Mapping of Obstacle Using Stereo Vision Sensor on Quadrotor UAV , 2014 .

[18]  Rogelio Lozano,et al.  A Vision and GPS-Based Real-Time Trajectory Planning for a MAV in Unknown and Low-Sunlight Environments , 2014, J. Intell. Robotic Syst..

[19]  Wolfgang Förstner,et al.  INCREMENTAL REAL-TIME BUNDLE ADJUSTMENT FOR MULTI-CAMERA SYSTEMS WITH POINTS AT INFINITY , 2013 .

[20]  Wolfgang Förstner,et al.  Fish-Eye-Stereo Calibration and Epipolar Rectification , 2005 .

[21]  Radhakant Padhi,et al.  Reactive Collision Avoidance of UAVs with Stereovision Camera Sensors using UKF , 2014 .

[22]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[23]  Sven Behnke,et al.  Mapping with Micro Aerial Vehicles by Registration of Sparse 3D Laser Scans , 2014, IAS.

[24]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[25]  Edwin Olson,et al.  AprilTag: A robust and flexible visual fiducial system , 2011, 2011 IEEE International Conference on Robotics and Automation.

[26]  Wolfram Burgard,et al.  A Fully Autonomous Indoor Quadrotor , 2012, IEEE Transactions on Robotics.

[27]  Darius Burschka,et al.  Toward a Fully Autonomous UAV: Research Platform for Indoor and Outdoor Urban Search and Rescue , 2012, IEEE Robotics & Automation Magazine.

[28]  Sebastian Scherer,et al.  First results in detecting and avoiding frontal obstacles from a monocular camera for micro unmanned aerial vehicles , 2013, 2013 IEEE International Conference on Robotics and Automation.

[29]  Sven Behnke,et al.  Layered Mission and Path Planning for MAV Navigation with Partial Environment Knowledge , 2014, IAS.

[30]  Marc Pollefeys,et al.  PIXHAWK: A micro aerial vehicle design for autonomous flight using onboard computer vision , 2012, Auton. Robots.

[31]  Karthik Dantu,et al.  Autonomous MAV guidance with a lightweight omnidirectional vision sensor , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).