Traversability classification for UGV navigation: a comparison of patch and superpixel representations

Robot navigation in complex outdoor terrain can benefit from accurate traversability classification. Appearance- based traversability estimation can provide a long-range sensing capability which complements the traditional use of stereo or LIDAR ranging. In the standard approach to traversability classification, each image frame is decomposed into patches or pixels for further analysis. However, classification at the pixel level is prone to noise and complicates the task of identifying homogeneous regions for navigation. Fixed-sized patches aggregate pixel information, resulting in better noise properties, but they can span multiple distinct image regions, which can degrade the classification performance and make thin obstacles difficult to detect. We address the use of superpixels as the visual primitives for traversability estimation. Superpixels are obtained from an over-segmentation of the image and they aggregate visually homogeneous pixels while respecting natural terrain boundaries. We show that superpixels are superior to patches in classification accuracy and result in more effective navigation in complex terrain environments. Our experimental results include a study of the effect of patch and superpixel size on classification accuracy. We demonstrate that superpixels can be computed on-line on a real robot at a sufficient frame rate to support long-range sensing and planning.

[1]  Larry H. Matthies,et al.  Foliage discrimination using a rotating ladar , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[2]  James M. Rehg,et al.  Traversability classification using unsupervised on-line visual learning for outdoor robot navigation , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[3]  Larry H. Matthies,et al.  Stereo vision for planetary rovers: Stochastic modeling to near real-time implementation , 1991, Optics & Photonics.

[4]  David M. Bradley,et al.  Vegetation Detection for Driving in Complex Environments , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[5]  Michel Devy,et al.  Robot Visual Navigation in Semi-structured Outdoor Environments , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[6]  Dean Pomerleau,et al.  ALVINN, an autonomous land vehicle in a neural network , 2015 .

[7]  Jitendra Malik,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001, International Journal of Computer Vision.

[8]  Larry H. Matthies,et al.  Stereo-Based Tree Traversability Analysis for Autonomous Off-Road Navigation , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[9]  Martial Hebert,et al.  Natural terrain classification using 3-d ladar data , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[10]  Christopher Rasmussen,et al.  Combining laser range, color, and texture cues for autonomous road following , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[11]  Illah R. Nourbakhsh,et al.  Appearance-Based Obstacle Detection with Monocular Color Vision , 2000, AAAI/IAAI.

[12]  Anthony Stentz,et al.  Online adaptive rough-terrain navigation vegetation , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[13]  Avinash C. Kak,et al.  Vision for Mobile Robot Navigation: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Ashutosh Saxena,et al.  High speed obstacle avoidance using monocular vision and reinforcement learning , 2005, ICML.

[15]  Sebastian Thrun,et al.  Self-supervised Monocular Road Detection in Desert Terrain , 2006, Robotics: Science and Systems.

[16]  Martial Hebert,et al.  Classifier fusion for outdoor obstacle detection , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[17]  Roberto Manduchi,et al.  Terrain perception for DEMO III , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[18]  Mark Ollis,et al.  Structural method for obstacle detection and terrain classification , 2003, SPIE Defense + Commercial Sensing.

[19]  Alexei A. Efros,et al.  Geometric context from a single image , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[20]  Alonzo Kelly,et al.  Terrain typing for real robots , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[21]  Ben Southall,et al.  Stereo perception on an off-road vehicle , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[22]  Reid G. Simmons,et al.  Recent progress in local and global traversability for planetary rovers , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[23]  Roberto Manduchi,et al.  Obstacle Detection and Terrain Classification for Autonomous Off-Road Navigation , 2005, Auton. Robots.

[24]  Alonzo Kelly,et al.  Toward Reliable Off Road Autonomous Vehicles Operating in Challenging Environments , 2006, Int. J. Robotics Res..

[25]  Pierrick Grandjean,et al.  Fast cross-country navigation on fair terrains , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[26]  Takeo Kanade,et al.  Vision and Navigation for the Carnegie-Mellon Navlab , 1987 .

[27]  Alexei A. Efros,et al.  Opportunistic Use of Vision to Push Back the Path-Planning Horizon , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Martial Hebert,et al.  Toward generating labeled maps from color and range data for robot navigation , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).