Collaborative localization of aerial and ground robots through elevation maps

Collaboration between aerial and ground robots can benefit from exploiting the complementary capabilities of each system, thereby improving situational awareness and environment interaction. For this purpose, we present a localization method that allows the ground robot to determine and track its position within a map acquired by a flying robot. To maintain invariance with respect to differing sensor choices and viewpoints, the method utilizes elevation maps built independently by each robot's onboard sensors. The elevation maps are then used for global localization: specifically, we find the relative position and orientation of the ground robot using the aerial map as a reference. Our work compares four different similarity measures for computing the congruence of elevation maps (akin to dense, image-based template matching) and evaluates their merit. Furthermore, a particle filter is implemented for each similarity measure to track multiple location hypotheses and to use the robot motion to converge to a unique solution. This allows the ground robot to make use of the extended coverage of the map from the flying robot. The presented method is demonstrated through the collaboration of a quadrotor equipped with a downward-facing monocular camera and a walking robot equipped with a rotating laser range scanner.

[1]  Davide Scaramuzza,et al.  Air-ground localization and map augmentation using monocular dense reconstruction , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Teresa A. Vidal-Calleja,et al.  Large scale multiple robot visual mapping with heterogeneous landmarks in semi-structured terrain , 2011, Robotics Auton. Syst..

[3]  Roland Siegwart,et al.  Collaborative navigation for flying and walking robots , 2016, IROS 2016.

[4]  Gianfranco Visentin,et al.  Towards orbital based global rover localization , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[6]  Francesco Pozzi,et al.  Exponential smoothing weighted correlations , 2012 .

[7]  George J. Pappas,et al.  UAV and UGV Collaboration for Active Ground Feature Search and Localization , 2004 .

[8]  Kazuya Yoshida,et al.  Collaborative mapping of an earthquake‐damaged building via ground and aerial robots , 2012, J. Field Robotics.

[9]  Roland Siegwart,et al.  State estimation for legged robots on unstable and slippery terrain , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Timothy D. Barfoot,et al.  Long-range rover localization by matching LIDAR scans to orbital elevation maps , 2010 .

[11]  G. Conte,et al.  Micro Unmanned Aerial Vehicle Visual Servoing for Cooperative Indoor Exploration , 2008, 2008 IEEE Aerospace Conference.

[12]  Davide Scaramuzza,et al.  REMODE: Probabilistic, monocular dense reconstruction in real time , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Christian Früh,et al.  Reconstructuring 3D City Models by Merging Ground-Based and Airborne Views , 2003, VLBV.

[14]  Arne Roennau,et al.  Enhancing sensor capabilities of walking robots through cooperative exploration with aerial robots , 2013 .

[15]  Elizabeth A. Peck,et al.  Introduction to Linear Regression Analysis , 2001 .

[16]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[17]  Alonzo Kelly,et al.  Integrated Air/Ground Vehicle System for Semi-Autonomous Off-Road Navigation , 2002 .

[18]  R. Siegwart,et al.  ROBOT-CENTRIC ELEVATION MAPPING WITH UNCERTAINTY ESTIMATES , 2014 .

[19]  Flavio Fontana,et al.  Aerial-guided navigation of a ground robot among movable obstacles , 2014, 2014 IEEE International Symposium on Safety, Security, and Rescue Robotics (2014).

[20]  Horst Bischof,et al.  Automatic alignment of 3D reconstructions using a Digital Surface Model , 2011, CVPR 2011 WORKSHOPS.

[21]  Antonio Barrientos,et al.  An Aerial–Ground Robotic System for Navigation and Obstacle Mapping in Large Outdoor Areas , 2013, Sensors.

[22]  Tim Kazik,et al.  Visual odometry based on the Fourier-Mellin transform for a rover using a monocular ground-facing camera , 2011, 2011 IEEE International Conference on Mechatronics.

[23]  Davide Scaramuzza,et al.  A monocular pose estimation system based on infrared LEDs , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[24]  M. Hutter,et al.  A Universal Grid Map Library: Implementation and Use Case for Rough Terrain Navigation , 2016 .

[25]  Joaquim Salvi,et al.  Fourier‐based Registration for Robust Forward‐looking Sonar Mosaicing in Low‐visibility Underwater Environments , 2015, J. Field Robotics.

[26]  Roland Siegwart,et al.  Starleth: A compliant quadrupedal robot for fast, efficient, and versatile locomotion , 2012 .

[27]  El Houssein Chouaib Harik,et al.  UAV-UGV cooperation for objects transportation in an industrial area , 2015, 2015 IEEE International Conference on Industrial Technology (ICIT).

[28]  Wolfram Burgard,et al.  Robust Monte Carlo localization for mobile robots , 2001, Artif. Intell..

[29]  A. Goshtasby Similarity and Dissimilarity Measures , 2012 .