Sensor and classifier fusion for outdoor obstacle detection: an application of data fusion to autonomous off-road navigation

This paper describes an approach for using several levels of data fusion in the domain of autonomous off-road navigation. We are focusing on outdoor obstacle detection, and we present techniques that leverage on data fusion and machine learning for increasing the reliability of obstacle detection systems. We are combining color and IR imagery with range information from a laser range finder. We show that in addition to fusing data at the pixel level, performing high level classifier fusion is beneficial in our domain. Our general approach is to use machine learning techniques for automatically deriving effective models of the classes of interest (obstacle and non-obstacle for example). We train classifiers on different subsets of the features we extract from our sensor suite and show how different classifier fusion schemes can be applied for obtaining a multiple classifier system that is more robust than any of the classifiers presented as input. We present experimental results we obtained on data collected with both the Experimental Unmanned Vehicle (XUV) and a CMU developed robotic vehicle.

[1]  John G. Harris,et al.  Autonomous cross-country navigation with the ALV , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[2]  S. Y. Harmon.  The ground surveillance robot (GSR): An autonomous vehicle designed to transit unknown terrain , 1987, IEEE J. Robotics Autom..

[3]  Anthony Stentz,et al.  The CMU system for mobile robot navigation , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[4]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[5]  Scott Y. Harmon,et al.  Sensor data fusion through a distributed blackboard , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[6]  Leo Breiman,et al.  Stacked regressions , 2004, Machine Learning.

[7]  Roberto Manduchi,et al.  Terrain perception for DEMO III , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[8]  Robert E. Schapire,et al.  The Boosting Approach to Machine Learning An Overview , 2003 .

[9]  Martial Hebert,et al.  Terrain Classification Techniques From Ladar Data For Autonomous Navigation , 2002 .

[10]  Dean A. Pomerleau,et al.  Progress in neural network-based vision for autonomous robot driving , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[11]  Peter L. Bartlett,et al.  Boosting Algorithms as Gradient Descent , 1999, NIPS.

[12]  L. Cooper,et al.  When Networks Disagree: Ensemble Methods for Hybrid Neural Networks , 1992 .

[13]  Robert E. Schapire,et al.  A Brief Introduction to Boosting , 1999, IJCAI.

[14]  David H. Wolpert,et al.  Stacked generalization , 1992, Neural Networks.

[15]  Anthony Stentz,et al.  Sensor fusion for autonomous outdoor navigation using neural networks , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[16]  Andrew McCallum,et al.  Toward Optimal Active Learning through Monte Carlo Estimation of Error Reduction , 2001, ICML 2001.

[17]  Robert A. Jacobs,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1993, Neural Computation.

[18]  Nasser M. Nasrabadi,et al.  Combination of two learning algorithms for automatic target recognition , 1997, Proceedings of International Conference on Image Processing.

[19]  Hans P. Moravec,et al.  The Stanford Cart and the CMU Rover , 1983, Proceedings of the IEEE.

[20]  Steven A. Shafer,et al.  An architecture for sensor fusion in a mobile robot , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[21]  A. Robert de Saint Vincent.  A 3D perception system for the mobile robot hilare , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[22]  Paul A. Viola,et al.  Boosting Image Retrieval , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[23]  Gunnar Rätsch,et al.  Soft Margins for AdaBoost , 2001, Machine Learning.

[24]  M. Perrone.  Improving regression estimation: Averaging methods for variance reduction with extensions to general convex measure optimization , 1993 .

[25]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[26]  C. M. Shoemaker,et al.  The Demo III UGV program: a testbed for autonomous navigation research , 1998, Proceedings of the 1998 IEEE International Symposium on Intelligent Control (ISIC) held jointly with IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA) Intell.

[27]  Padhraic Smyth,et al.  An Evaluation of Linearly Combining Density Estimators via Stacking , 1998 .