Gaussian process modeling of large-scale terrain

In this article we present the complete details of the architecture and implementation of Leaving Flatland, an exploratory project that attempts to surmount the challenges of closing the loop between autonomous perception and action on challenging terrain. The proposed system includes comprehensive localization, mapping, path planning, and visualization techniques for a mobile robot to operate autonomously in complex three-dimensional (3D) indoor and outdoor environments. In doing so we integrate robust visual odometry localization techniques with real-time 3D mapping methods from stereo data to obtain consistent global models annotated with semantic labels. These models are used by a multiregion motion planner that adapts existing two-dimensional planning techniques to operate in 3D terrain. All the system components are evaluated on a variety of real-world data sets, and their computational performance is shown to be favorable for high-speed autonomous navigation. © 2009 Wiley Periodicals, Inc.

[1]  Kurt Konolige,et al.  Real-Time Detection of Independent Motion using Stereo , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[2]  Ross A. Knepper,et al.  Constrained Optimization Path Following of Wheeled Robots in Natural Terrain , 2006, ISER.

[3]  Kurt Konolige,et al.  Real-time Localization in Outdoor Environments using Stereo Vision and Inexpensive GPS , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[4]  Tom Duckett,et al.  3D modeling of indoor environments by a mobile robot with a laser scanner and panoramic camera , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[5]  Daniel E. Koditschek,et al.  RHex: A Simple and Highly Mobile Hexapod Robot , 2001, Int. J. Robotics Res..

[6]  Michael Beetz,et al.  Detection and Classification of Gateways for the Acquisition of Structured Robot Maps , 2004, DAGM-Symposium.

[7]  Martial Hebert,et al.  Directional Associative Markov Network for 3-D Point Cloud Classification , 2008 .

[8]  S. Pellegrini,et al.  Building 3D maps with semantic elements integrating 2D laser, stereo vision and INS on a mobile robot , 2007 .

[9]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[10]  Roland Siegwart,et al.  Cognitive maps for mobile robots - an object based approach , 2007, Robotics Auton. Syst..

[11]  Thierry Siméon,et al.  A practical motion planner for all-terrain mobile robots , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[12]  Paul Newman,et al.  Fast Probabilistic Labeling of City Maps , 2008, Robotics: Science and Systems.

[13]  Bruno Raffin,et al.  Parallel Adaptive Octree Carving for Real-time 3D Modeling , 2007, 2007 IEEE Virtual Reality Conference.

[14]  Kurt Konolige,et al.  Distributed multirobot exploration, mapping, and task allocation , 2008, Annals of Mathematics and Artificial Intelligence.

[15]  Jean-Claude Latombe,et al.  On Delaying Collision Checking in PRM Planning: Application to Multi-Robot Coordination , 2002, Int. J. Robotics Res..

[16]  Amir Shirkhodaie,et al.  Visual terrain mapping for traversable path planning of mobile robots , 2004, SPIE Optics East.

[17]  Wolfram Burgard,et al.  Supervised semantic labeling of places using information extracted from sensor data , 2007, Robotics Auton. Syst..

[18]  Robert C. Bolles,et al.  Outdoor Mapping and Navigation Using Stereo Vision , 2006, ISER.

[19]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[20]  Michael Beetz,et al.  Leaving Flatland: Realtime 3D Stereo Semantic Reconstruction , 2008, ICIRA.

[21]  Wolfram Burgard,et al.  Using EM to Learn 3D Models of Indoor Environments with Mobile Robots , 2001, ICML.

[22]  Timothy Bretl,et al.  Motion Planning for a Six-Legged Lunar Robot , 2006, WAFR.

[23]  Martial Hebert,et al.  Natural terrain classification using 3-d ladar data , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[24]  Joachim Hertzberg,et al.  Automatic model refinement for 3D reconstruction with mobile robots , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[25]  Sebastian Thrun,et al.  An Application of Markov Random Fields to Range Sensing , 2005, NIPS.

[26]  Roland Siegwart,et al.  A Fast and Robust 3D Feature Extraction Algorithm for Structured Environment Reconstruction , 2003 .

[27]  Jiri Matas,et al.  Randomized RANSAC with Td, d test , 2004, Image Vis. Comput..

[28]  Jiri Matas,et al.  Randomized RANSAC with T(d, d) test , 2002, BMVC.

[29]  Timothy Bretl,et al.  Multi-Step Motion Planning for Free-Climbing Robots , 2004, WAFR.