Leaving Flatland: Toward real-time 3D navigation

We report our first experiences with Leaving Flatland, an exploratory project that studies the key challenges of closing the loop between autonomous perception and action on challenging terrain. We propose a comprehensive system for localization, mapping, and planning for the RHex mobile robot in fully 3D indoor and outdoor environments. This system integrates Visual Odometry-based localization with new techniques in real-time 3D mapping from stereo data. The motion planner uses a new decomposition approach to adapt existing 2D planning techniques to operate in 3D terrain. We test the map-building and motion-planning subsystems on real and synthetic data, and show that they have favorable computational performance for use in high-speed autonomous navigation.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  Thierry Siméon,et al.  A practical motion planner for all-terrain mobile robots , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[3]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[4]  Martin Buehler,et al.  Stable Stair Climbing in a Simple Hexapod Robot , 2001 .

[5]  Daniel E. Koditschek,et al.  RHex: A Simple and Highly Mobile Hexapod Robot , 2001, Int. J. Robotics Res..

[6]  Wolfram Burgard,et al.  Using EM to Learn 3D Models of Indoor Environments with Mobile Robots , 2001, ICML.

[7]  Jean-Claude Latombe,et al.  On Delaying Collision Checking in PRM Planning: Application to Multi-Robot Coordination , 2002, Int. J. Robotics Res..

[8]  Joachim Hertzberg,et al.  Automatic model refinement for 3D reconstruction with mobile robots , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[9]  Roland Siegwart,et al.  A Fast and Robust 3D Feature Extraction Algorithm for Structured Environment Reconstruction , 2003 .

[10]  Timothy Bretl,et al.  Multi-Step Motion Planning for Free-Climbing Robots , 2004, WAFR.

[11]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[12]  Tom Duckett,et al.  3D modeling of indoor environments by a mobile robot with a laser scanner and panoramic camera , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[13]  Michael Beetz,et al.  Detection and Classification of Gateways for the Acquisition of Structured Robot Maps , 2004, DAGM-Symposium.

[14]  Sebastian Thrun,et al.  An Application of Markov Random Fields to Range Sensing , 2005, NIPS.

[15]  Robert C. Bolles,et al.  Outdoor Mapping and Navigation Using Stereo Vision , 2006, ISER.

[16]  Sebastian Thrun.  Winning the DARPA grand challenge , 2006 .

[17]  David Nister,et al.  Bundle Adjustment Rules , 2006 .

[18]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[19]  Kurt Konolige,et al.  Real-time Localization in Outdoor Environments using Stereo Vision and Inexpensive GPS , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[20]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[21]  Sebastian Thrun,et al.  Winning the DARPA Grand Challenge , 2006, PKDD.

[22]  Wolfram Burgard,et al.  Semantic labeling of places using information extracted from laser and vision sensor data , 2006 .

[23]  Kurt Konolige,et al.  Large-Scale Visual Odometry for Rough Terrain , 2007, ISRR.

[24]  Wolfram Burgard,et al.  Supervised semantic labeling of places using information extracted from sensor data , 2007, Robotics Auton. Syst..

[25]  Kurt Konolige,et al.  CenSurE: Center Surround Extremas for Realtime Feature Detection and Matching , 2008, ECCV.

[26]  Masahiro Fujita,et al.  3D Perception and Environment Map Generation for Humanoid Robot Navigation , 2008, Int. J. Robotics Res..

[27]  Nico Blodow,et al.  Towards 3D Point cloud based object maps for household environments , 2008, Robotics Auton. Syst..

[28]  Kurt Konolige,et al.  Distributed multirobot exploration, mapping, and task allocation , 2008, Annals of Mathematics and Artificial Intelligence.

[29]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[30]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .