Collaborative navigation for flying and walking robots

Flying and walking robots can use their complementary features in terms of viewpoint and payload capability to the best in a heterogeneous team. To this end, we present our online collaborative navigation framework for unknown and challenging terrain. The method leverages the flying robot's onboard monocular camera to create both a map of visual features for simultaneous localization and mapping and a dense representation of the environment as an elevation map. This shared knowledge from the flying platform enables the walking robot to localize itself against the global map, and plan a global path to the goal by interpreting the elevation map in terms of traversability. While following the planned path, the absolute pose corrections are fused with the legged state estimation and the elevation map is continuously updated with distance measurements from an onboard laser range sensor. This allows the legged robot to safely navigate towards the goal while taking into account any changes in the environment. In this setup, our approach is independent of external localization, relative observations between the robots, and does not require an initial guess about the pose of the robots. The presented methods are fully integrated and we demonstrate their capabilities in an experiment with a hexacopter and a quadrupedal robot.

[1]  Teresa A. Vidal-Calleja,et al.  Large scale multiple robot visual mapping with heterogeneous landmarks in semi-structured terrain , 2011, Robotics Auton. Syst..

[2]  Michael Bosse,et al.  Placeless Place-Recognition , 2014, 2014 2nd International Conference on 3D Vision.

[3]  Roland Siegwart,et al.  Control of dynamic gaits for a quadrupedal robot , 2013, ICRA 2013.

[4]  Michael Bosse,et al.  Get Out of My Lab: Large-scale, Real-Time Visual-Inertial Localization , 2015, Robotics: Science and Systems.

[5]  Roland Siegwart,et al.  A synchronized visual-inertial sensor system with FPGA pre-processing for accurate real-time SLAM , 2014, ICRA 2014.

[6]  Kazuya Yoshida,et al.  Collaborative mapping of an earthquake‐damaged building via ground and aerial robots , 2012, J. Field Robotics.

[7]  Alonzo Kelly,et al.  Integrated Air/Ground Vehicle System for Semi-Autonomous Off-Road Navigation , 2002 .

[8]  G. Conte,et al.  Micro Unmanned Aerial Vehicle Visual Servoing for Cooperative Indoor Exploration , 2008, 2008 IEEE Aerospace Conference.

[9]  El Houssein Chouaib Harik,et al.  UAV-UGV cooperation for objects transportation in an industrial area , 2015, 2015 IEEE International Conference on Industrial Technology (ICIT).

[10]  Roland Siegwart,et al.  Map API - scalable decentralized map building for robots , 2015, ICRA 2015.

[11]  Gaurav S. Sukhatme,et al.  Adaptive teams of autonomous aerial and ground robots for situational awareness , 2007, J. Field Robotics.

[12]  R. Siegwart,et al.  ROBOT-CENTRIC ELEVATION MAPPING WITH UNCERTAINTY ESTIMATES , 2014 .

[13]  Flavio Fontana,et al.  Aerial-guided navigation of a ground robot among movable obstacles , 2014, 2014 IEEE International Symposium on Safety, Security, and Rescue Robotics (2014).

[14]  Alonzo Kelly,et al.  Toward Reliable Off Road Autonomous Vehicles Operating in Challenging Environments , 2006, Int. J. Robotics Res..

[15]  R. Siegwart,et al.  Noise characterization of depth sensors for surface inspections , 2012, 2012 2nd International Conference on Applied Robotics for the Power Industry (CARPI).

[16]  Simon Lacroix,et al.  Vision-Based SLAM: Stereo and Monocular Approaches , 2007, International Journal of Computer Vision.

[17]  Roland Siegwart,et al.  Toward Combining Speed, Efficiency, Versatility, and Robustness in an Autonomous Quadruped , 2014, IEEE Transactions on Robotics.

[18]  Heiko Hirschmüller,et al.  Stereo-vision-based navigation of a six-legged walking robot in unknown rough terrain , 2012, Int. J. Robotics Res..

[19]  Arne Roennau,et al.  Enhancing sensor capabilities of walking robots through cooperative exploration with aerial robots , 2013 .

[20]  George J. Pappas,et al.  UAV and UGV Collaboration for Active Ground Feature Search and Localization , 2004 .

[21]  Roland Siegwart,et al.  State estimation for legged robots on unstable and slippery terrain , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Davide Scaramuzza,et al.  Air-ground localization and map augmentation using monocular dense reconstruction , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Roland Siegwart,et al.  Navigation planning for legged robots in challenging terrain , 2016, IROS 2016.

[24]  Michael Bosse,et al.  Keep it brief: Scalable creation of compressed localization maps , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[25]  Ignacy Duleba,et al.  On the application of elastic band method to repeatable inverse kinematics in robot manipulators , 2013 .