Learning terrain segmentation with classifier ensembles for autonomous robot navigation in unstructured environments

Autonomous robot navigation in unstructured outdoor environments is a challenging area of active research and is currently unsolved. The navigation task requires identifying safe, traversable paths that allow the robot to progress toward a goal while avoiding obstacles. Stereo is an effective tool in the near field, but used alone leads to a common failure mode in autonomous navigation in which suboptimal trajectories are followed due to nearsightedness, or the robot’s inability to distinguish obstacles and safe terrain in the far field. This can be addressed through the use of machine learning methods to accomplish near-to-far learning, in which near-field terrain appearance and stereo readings are used to train models able to predict far-field terrain. This paper proposes to enhance existing, memoryless near-to-far learning approaches through the use of classifier ensembles that allow terrain models trained on data seen at different points in time to be preserved and referenced later. These stored models serve as memory, and we show that they can be leveraged for more effective far-field terrain classification on future images seen by the robot. A five-factor, full-factorial, repeated-measures experimental evaluation is performed on hand-labeled data sets taken directly from the problem domain. The experiments result in many statistically significant findings, the most important being that the proposed near-to-far Best-K Ensemble Algorithm, with appropriate parameter selection, outperforms the single-model, nonensemble baseline approach in far-field terrain classification. Several other findings that inform the use of near-to-far ensemble methods are also presented. C © 2009 Wiley Periodicals, Inc.

[1]  Dean Pomerleau,et al.  ALVINN, an autonomous land vehicle in a neural network , 2015 .

[2]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[3]  Sebastian Thrun,et al.  Self-supervised Monocular Road Detection in Desert Terrain , 2006, Robotics: Science and Systems.

[4]  Alonzo Kelly,et al.  An Analysis of Requirements for Rough Terrain Autonomous Mobility , 1999 .

[5]  Alonzo Kelly,et al.  Toward Reliable Off Road Autonomous Vehicles Operating in Challenging Environments , 2006, Int. J. Robotics Res..

[6]  Michael J. Procopio,et al.  An experimental analysis of classifier ensembles for learning drifting concepts over time in autonomous outdoor robot navigation , 2007 .

[7]  Takeo Kanade,et al.  Progress in robot road-following , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[8]  Avinash C. Kak,et al.  Vision for Mobile Robot Navigation: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[10]  Gregory Z. Grudic,et al.  Learning in dynamic environments with Ensemble Selection for autonomous outdoor robot navigation , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Matthew Turk,et al.  VITS-A Vision System for Autonomous Land Vehicle Navigation , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Gregory Z. Grudic,et al.  Outdoor Path Labeling Using Polynomial Mahalanobis Distance , 2006, Robotics: Science and Systems.

[13]  Gregory Z. Grudic,et al.  Online Learning of Multiple Perceptual Models for Navigation in Unknown Terrain , 2007, FSR.

[14]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[15]  Takeo Kanade,et al.  Autonomous land vehicle project at CMU , 1986, CSC '86.

[16]  Charles E. Thorpe,et al.  UNSCARF-a color vision system for the detection of unstructured roads , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[17]  Rich Caruana,et al.  Data mining in metric space: an empirical analysis of supervised learning performance criteria , 2004, ROCAI.

[18]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[19]  Zhi-Hua Zhou,et al.  Exploratory Under-Sampling for Class-Imbalance Learning , 2006, Sixth International Conference on Data Mining (ICDM'06).

[20]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[21]  Roberto Manduchi,et al.  Terrain perception for DEMO III , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[22]  Michael J. Procopio,et al.  Using Binary Classifiers to Augment Stereo Vision for Enhanced Autonomous Robot Navigation ; CU-CS-1027-07 , 2007 .

[23]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[24]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[25]  Karl Murphy,et al.  Performance evaluation of UGV obstacle detection with CCD/FLIR stereo vision and LADAR , 1998, Proceedings of the 1998 IEEE International Symposium on Intelligent Control (ISIC) held jointly with IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA) Intell.

[26]  Larry H. Matthies,et al.  Towards learned traversability for robot navigation: From underfoot to the far field , 2006, J. Field Robotics.

[27]  Gregory Z. Grudic,et al.  Long-Term learning using multiple models for outdoor autonomous robot navigation , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Sanjiv Singh,et al.  Autonomous Cross-Country Navigation Using Stereo Vision , 1999 .

[29]  David W. Opitz,et al.  An Empirical Evaluation of Bagging and Boosting , 1997, AAAI/IAAI.

[30]  Eric Bauer,et al.  An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants , 1999, Machine Learning.

[31]  Michael J. Turmon,et al.  Autonomous off-road navigation with end-to-end learning for the LAGR program , 2009 .

[32]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[33]  Gerhard Widmer,et al.  Learning in the presence of concept drift and hidden contexts , 2004, Machine Learning.

[34]  Philip S. Yu,et al.  Mining concept-drifting data streams using ensemble classifiers , 2003, KDD '03.

[35]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Takashi Omori,et al.  ACE: Adaptive Classifiers-Ensemble System for Concept-Drifting Environments , 2005, Multiple Classifier Systems.

[37]  Darwin T. Kuan,et al.  Autonomous Robotic Vehicle Road Following , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[39]  Rich Caruana,et al.  Ensemble selection from libraries of models , 2004, ICML.

[40]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[41]  Robert A. Jacobs,et al.  Methods For Combining Experts' Probability Assessments , 1995, Neural Computation.

[42]  Tsu-Shuan Chang,et al.  An Obstacle Avoidance Algorithm For An Autonomous Land Vehicle , 1987, Other Conferences.

[43]  Young-Woo Seo,et al.  A perception mechanism for supporting autonomous intersection handling in urban driving , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[44]  Ludmila I. Kuncheva,et al.  Classifier Ensembles for Changing Environments , 2004, Multiple Classifier Systems.

[45]  Andrew W. Moore,et al.  Fast Robust Logistic Regression for Large Sparse Datasets with Binary Outputs , 2003, AISTATS.

[46]  Bernard Zenko,et al.  Is Combining Classifiers with Stacking Better than Selecting the Best One? , 2004, Machine Learning.

[47]  Marcus A. Maloof,et al.  Dynamic weighted majority: a new ensemble method for tracking concept drift , 2003, Third IEEE International Conference on Data Mining.

[48]  J. Andrew Bagnell,et al.  Improving Robot Navigation Through Self-Supervised Online Learning , 2006, Robotics: Science and Systems.

[49]  Ethem Alpaydin,et al.  Introduction to Machine Learning (Adaptive Computation and Machine Learning) , 2004 .

[50]  Roberto Manduchi,et al.  Obstacle Detection and Terrain Classification for Autonomous Off-Road Navigation , 2005, Auton. Robots.

[51]  Chih-Jen Lin,et al.  Trust Region Newton Method for Logistic Regression , 2008, J. Mach. Learn. Res..

[52]  Michael Happold,et al.  Enhancing Supervised Terrain Classification with Predictive Unsupervised Learning , 2006, Robotics: Science and Systems.

[53]  Thomas G. Dietterich Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[54]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[55]  Nathalie Japkowicz,et al.  The Class Imbalance Problem: Significance and Strategies , 2000 .

[56]  Sebastian Thrun,et al.  Adaptive Road Following using Self-Supervised Learning and Reverse Optical Flow , 2005, Robotics: Science and Systems.

[57]  Eric Krotkov,et al.  The DARPA PerceptOR evaluation experiments , 2007, Auton. Robots.

[58]  William Nick Street,et al.  A streaming ensemble algorithm (SEA) for large-scale classification , 2001, KDD '01.

[59]  Larry D. Jackel,et al.  The DARPA LAGR program: Goals, challenges, methodology, and phase I results , 2006, J. Field Robotics.

[60]  Eric R. Ziegel,et al.  Analysis of Binary Data (2nd ed.) , 1991 .

[61]  David H. Wolpert,et al.  Stacked generalization , 1992, Neural Networks.

[62]  Alexey Tsymbal,et al.  The problem of concept drift: definitions and related work , 2004 .

[63]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.