Towards fully autonomous visual inspection of dark featureless dam penstocks using MAVs

In the last decade, multi-rotor Micro Aerial Vehicles (MAVs) have attracted great attention from robotics researchers. Offering affordable agility and maneuverability, multi-rotor aircrafts have become the most commonly used platforms for robotics applications. Amongst the most promising applications are inspection of power-lines, cell-towers, large and constrained infrastructures and precision agriculture. While GPS offers an easy solution for outdoor autonomy, using on-board sensors is the only solution for autonomy in constrained indoor environments. In this paper, we present our results on autonomous inspection of completely dark, featureless, symmetric dam penstocks using cameras and range sensors. We use a hex-rotor platform equipped with an IMU, four cameras and two lidars. One of the cameras tracks features on the walls using the on-board illumination to estimate the position along the tunnel axis unobservable to range sensors while all of the cameras are used for panoramic image construction. The two lidars estimate the remaining degrees of freedom (DOF). Outputs of the two estimators are fused using an Unscented Kalman Filter (UKF). A moderately trained operator defines waypoints using the Remote Control (RC). We demonstrate our results from Carters Dam, GA and Glen Canyon Dam, AZ which include panoramic images for cracks and rusty spot detection and 6-DOF estimation results with ground truth comparisons. To our knowledge ours is the only study that can autonomously inspect environments with no geometric cues and poor to no external illumination using MAVs.

[1]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[2]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[3]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[4]  Andrea Censi,et al.  On achievable accuracy for range-finder localization , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[5]  Andrea Censi,et al.  An ICP variant using a point-to-line metric , 2008, 2008 IEEE International Conference on Robotics and Automation.

[6]  John J. Leonard,et al.  Cooperative AUV Navigation Using a Single Surface Craft , 2009, FSR.

[7]  Avideh Zakhor,et al.  Image augmented laser scan matching for indoor dead reckoning , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Edwin Olson,et al.  Real-time correlative scan matching , 2009, 2009 IEEE International Conference on Robotics and Automation.

[9]  Avideh Zakhor,et al.  Indoor localization and visualization using a human-operated backpack system , 2010, 2010 International Conference on Indoor Positioning and Indoor Navigation.

[10]  Vijay Kumar,et al.  Autonomous multi-floor indoor navigation with a computationally constrained MAV , 2011, 2011 IEEE International Conference on Robotics and Automation.

[11]  Raffaello D'Andrea,et al.  Quadrocopter Trajectory Generation and Control , 2011 .

[12]  Kazuya Yoshida,et al.  Collaborative mapping of an earthquake‐damaged building via ground and aerial robots , 2012, J. Field Robotics.

[13]  Vijay Kumar,et al.  Trajectory generation and control for precise aggressive maneuvers with quadrotors , 2012, Int. J. Robotics Res..

[14]  Alexander Zelinsky.  Field and Service Robotics , 2012 .

[15]  Charles Richter,et al.  Polynomial Trajectory Planning for Aggressive Quadrotor Flight in Dense Indoor Environments , 2016, ISRR.

[16]  Vijay Kumar,et al.  Incremental micro-UAV motion replanning for exploring unknown environments , 2013, 2013 IEEE International Conference on Robotics and Automation.

[17]  Davide Scaramuzza,et al.  SVO: Fast semi-direct monocular visual odometry , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Guido Morgenthal,et al.  Quality Assessment of Unmanned Aerial Vehicle (UAV) Based Visual Inspection of Structures , 2014 .

[19]  Vijay Kumar,et al.  Devices, systems, and methods for automated monitoring enabling precision agriculture , 2015, 2015 IEEE International Conference on Automation Science and Engineering (CASE).

[20]  Brett Browning,et al.  Visual mapping for natural gas pipe inspection , 2015, Int. J. Robotics Res..