Vegetation detection for outdoor automobile guidance

Recently, there are many autonomous navigation applications done in outdoor environment. However, safe navigation is still a daunting challenge in terrain containing vegetation. Thus, a study on vegetation detection for outdoor automobile navigation is investigated in this work. At the early state of our research, we focused on the segmentation of LADAR data into two classes by using local three-dimensional point cloud statistics. The classes are: scatter to represent vegetation such as tall grasses, bushes and tree canopy, surface to capture solid objects like ground surface, rocks or tree trunks. However, the only use of 3D features would never result a real robust vegetation detection system because of lacking color information. We, hence, propose a 2D-3D combination approach which can utilize the complement of three-dimensional point distribution and color descriptor. Firstly, 3D point cloud is segmented into regions of homogeneous distance. The local point distribution is then analyzed for each region to extract scatter features. Secondly, a coarse 2D-3D calibration needs to be implemented in order to map the regions to the corresponding color image. Then, color descriptors are studied and applied to each region and considered as color features. Those all scatter and color features will be trained by Support Vector Machine to generate vegetation classifier. Finally, we will show the out-performance of this approach in comparison with more conventional approaches.

[1]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[2]  Xavier Brun,et al.  Modeling and Calibration of Coupled Fish-Eye CCD Camera and Laser Range Scanner for Outdoor Environment Reconstruction , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[3]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[4]  Richard Willstätter,et al.  Untersuchungen Uber Chlorophyll: Methoden Und Ergebnisse , 2009 .

[5]  James Lee Hafner,et al.  Efficient Color Histogram Indexing for Quadratic Form Distance Functions , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Jeff A. Bilmes,et al.  A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models , 1998 .

[7]  W. Marsden I and J , 2012 .

[8]  Martial Hebert,et al.  Natural terrain classification using 3-d ladar data , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[9]  Robert M. Gray,et al.  Image retrieval using color histograms generated by Gauss mixture vector quantization , 2004, Comput. Vis. Image Underst..

[10]  Klaus-Dieter Kuhnert,et al.  Terrain classification based on structure for autonomous navigation in complex environments , 2010, International Conference on Communications and Electronics 2010.

[11]  Guoqiang Peter Zhang,et al.  Neural networks for classification: a survey , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[12]  Martial Hebert,et al.  Natural terrain classification using three‐dimensional ladar data for ground robot mobility , 2006, J. Field Robotics.

[13]  Markus Ax,et al.  Combining Distance and Modulation Information for Detecting Pedestrians in Outdoor Environment using a PMD Camera , 2010 .

[14]  Christopher Rasmussen,et al.  Combining laser range, color, and texture cues for autonomous road following , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[15]  G. Baudat,et al.  Kernel-based methods and function approximation , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[16]  David M. Bradley,et al.  Vegetation Detection for Driving in Complex Environments , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[17]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[18]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[19]  David Mumford,et al.  Statistics of range images , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[20]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[21]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.