A novel outdoor scene-understanding framework for unmanned ground vehicles with 3D laser scanners

Outdoor scene understanding plays a key role for unmanned ground vehicles (UGVs) to navigate in complex urban environments. This paper presents a novel 3D scene-understanding framework for UGVs to handle uncertain and changing lighting conditions outdoors. A 2D bearing angle (BA) image is deployed to perform scene understanding so that the computational burden in the process of segmentation and classification of the 3D laser point cloud can be reduced. An improved super-pixel algorithm is used for fast 3D scene segmentation, and then the Gentle–Adaboost algorithm is utilized to perform super-pixel patch classification using the texture features of the Gray Level Co-occurrence Matrix. All false classification results in the uncertain super-pixel patches of BA images are transformed back to raw 3D laser points and a re-classification is conducted to refine the 3D scene understanding for UGVs. The results from a real laser dataset taken from a large-scale campus environment show the validity and robust performance of the proposed approach, in comparison with the results from Korea Advanced Institute of Science and Technology dataset.

[1]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  J. Macgregor,et al.  Image texture analysis: methods and comparisons , 2004 .

[3]  Jindong Tan,et al.  A 3D object model for wireless camera networks with network constraints , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[4]  Ahmad Kamal Aijazi,et al.  Segmentation Based Classification of 3D Urban Point Clouds: A Super-Voxel Based Approach with Evaluation , 2013, Remote. Sens..

[5]  Armin B. Cremers,et al.  Performance of histogram descriptors for the classification of 3D laser range data in urban environments , 2012, 2012 IEEE International Conference on Robotics and Automation.

[6]  Li Fei-Fei,et al.  Towards total scene understanding: Classification, annotation and segmentation in an automatic framework , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Rainer Lienhart,et al.  Empirical Analysis of Detection Cascades of Boosted Classifiers for Rapid Object Detection , 2003, DAGM-Symposium.

[8]  Myung Jin Chung,et al.  Urban structure classification using the 3D normal distribution transform for practical robot applications , 2013, Adv. Robotics.

[9]  Fionn Murtagh,et al.  Algorithms for hierarchical clustering: an overview , 2012, WIREs Data Mining Knowl. Discov..

[10]  Joan Serrat,et al.  On-board image-based vehicle detection and tracking , 2011 .

[11]  Roland Siegwart,et al.  Extrinsic self calibration of a camera and a 3D laser range finder from natural scenes , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  S. C. Johnson.  Hierarchical clustering schemes , 1967, Psychometrika.

[13]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[14]  Bastian Leibe,et al.  Joint 2D-3D temporally consistent semantic segmentation of street scenes , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Martial Hebert,et al.  Onboard contextual classification of 3-D point clouds with learned high-order Markov Random Fields , 2009, 2009 IEEE International Conference on Robotics and Automation.

[16]  Robert E. Schapire,et al.  The Boosting Approach to Machine Learning An Overview , 2003 .

[17]  Huosheng Hu,et al.  3-D-Laser-Based Scene Measurement and Place Recognition for Mobile Robots in Dynamic Indoor Environments , 2013, IEEE Transactions on Instrumentation and Measurement.

[18]  M. Himmelsbach,et al.  Real-time object classification in 3D point clouds using point feature histograms , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Martial Hebert,et al.  Contextual classification with functional Max-Margin Markov Networks , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.