Terrain Segmentation with On-Line Mixtures of Experts for Autonomous Robot Navigation

We describe an on-line machine learning ensemble technique, based on an adaptation of the mixture of experts (ME) model, for predicting terrain in autonomous outdoor robot navigation. Binary linear models, trained on-line on images seen by the robot at different points in time, are added to a model library as the robot navigates. To predict terrain in a given image, each model in the library is applied to feature data from that image, and the models' predictions are combined according to a single-layer (flat) ME approach. Although these simple linear models have excellent discrimination in their local area in feature space, they do not generalize well to other types of terrain, and must be applied carefully. We use the distribution of training data as the source of the a priori pointwise mixture coefficients that form the soft gating network in the ME model. Single-class Gaussian models are learned during training, then later used to perform density estimation of incoming data points, resulting in pointwise estimates of model applicability . The combined output given by ME thus permits models to abstain from making predictions for certain parts of the image. We show that this method outperforms a less sophisticated, non-local baseline method in a statistically significant evaluation using natural datasets taken from the domain.

[1]  Gregory Z. Grudic,et al.  Learning in dynamic environments with Ensemble Selection for autonomous outdoor robot navigation , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  D. R. Cox,et al.  The analysis of binary data , 1971 .

[3]  Gregory Z. Grudic,et al.  Online Learning of Multiple Perceptual Models for Navigation in Unknown Terrain , 2007, FSR.

[4]  J. A. Anderson,et al.  7 Logistic discrimination , 1982, Classification, Pattern Recognition and Reduction of Dimensionality.

[5]  Andrew P. Bradley,et al.  The use of the area under the ROC curve in the evaluation of machine learning algorithms , 1997, Pattern Recognit..

[6]  Robert A. Jacobs,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1993, Neural Computation.

[7]  D. Wolfe,et al.  Nonparametric Statistical Methods. , 1974 .

[8]  Gregory Z. Grudic,et al.  Long-Term learning using multiple models for outdoor autonomous robot navigation , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[10]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[11]  Ian Diamond,et al.  Analysis of Binary Data. 2nd Edn. , 1990 .

[12]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[13]  Shin Ishii,et al.  On-line EM Algorithm for the Normalized Gaussian Network , 2000, Neural Computation.

[14]  Douglas A. Wolfe,et al.  Nonparametric Statistical Methods , 1973 .

[15]  Peter A. Flach,et al.  Learning Decision Trees Using the Area Under the ROC Curve , 2002, ICML.

[16]  C. Borror Nonparametric Statistical Methods, 2nd, Ed. , 2001 .

[17]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[18]  Larry D. Jackel,et al.  The DARPA LAGR program: Goals, challenges, methodology, and phase I results , 2006, J. Field Robotics.

[19]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[20]  Robert A. Jacobs,et al.  Methods For Combining Experts' Probability Assessments , 1995, Neural Computation.

[21]  D. Cox,et al.  Analysis of Binary Data (2nd ed.). , 1990 .

[22]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[23]  Larry H. Matthies,et al.  Towards learned traversability for robot navigation: From underfoot to the far field , 2006, J. Field Robotics.

[24]  Gregory Z. Grudic,et al.  Learning terrain segmentation with classifier ensembles for autonomous robot navigation in unstructured environments , 2009, J. Field Robotics.

[25]  Chih-Jen Lin,et al.  Trust Region Newton Method for Logistic Regression , 2008, J. Mach. Learn. Res..

[26]  Kevin W. Bowyer,et al.  Combination of Multiple Classifiers Using Local Accuracy Estimates , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[28]  Gregory Z. Grudic,et al.  Outdoor Path Labeling Using Polynomial Mahalanobis Distance , 2006, Robotics: Science and Systems.

[29]  Peter A. Flach The Geometry of ROC Space: Understanding Machine Learning Metrics through ROC Isometrics , 2003, ICML.