A 2D/3D Vision Based Approach Applied to Road Detection in Urban Environments

This paper presents an approach for road detection based on image segmentation. This segmentation is resulted from merging 2D and 3D image processing data from a stereo vision system. The 2D layer returns a matrix containing pixel's clusters based on the Watershed transform. Whereas the 3D layer return labels, that are classified by the V-Disparity technique, to free spaces, obstacles and non-classified area. Thus, a feature's descriptor for each cluster is composed with features from both layers. The road pattern recognition was performed by an artificial neural network, trained to obtain a final result from this feature's descriptor. The proposed work reports real experiments carried out in a challenging urban environment to illustrate the validity and application of this approach.

[1]  Luc Vincent,et al.  Morphological Area Openings and Closings for Grey-scale Images , 1994 .

[2]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[3]  Véronique Berge-Cherfaoui,et al.  Drivable space characterization using automotive lidar and georeferenced map information , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[4]  Jérôme Darbon,et al.  An efficient algorithm for attribute openings and closings , 2005, 2005 13th European Signal Processing Conference.

[5]  Philip H. S. Torr,et al.  Automatic dense visual semantic mapping from street-level imagery , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Nanning Zheng,et al.  An efficient road detection method in noisy urban environment , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[7]  Alberto Broggi,et al.  Obstacle Detection with Stereo Vision for Off-Road Vehicle Navigation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[8]  Michel Bilodeau,et al.  Road tracking, lane segmentation and obstacle recognition by mathematical morphology , 1992, Proceedings of the Intelligent Vehicles `92 Symposium.

[9]  Ashfaqur Rahman,et al.  An hierarchical approach towards road image segmentation , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[10]  Janito Vaqueiro Ferreira,et al.  Advances on Watershed Processing on GPU Architecture , 2011, ISMM.

[11]  N. Hautiere,et al.  Road Segmentation Supervised by an Extended V-Disparity Algorithm for Autonomous Navigation , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[12]  Thomas Schamm,et al.  3D-segmentation of traffic environments with u/v-disparity supported by radar-given masterpoints , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[13]  Denis Fernando Wolf,et al.  A Road Following Approach Using Artificial Neural Networks Combinations , 2011, J. Intell. Robotic Syst..

[14]  Michael H. F. Wilkinson,et al.  A Comparison of Algorithms for Connected Set Openings and Closings , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[16]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[17]  Antonio M. López,et al.  Road Detection Based on Illuminant Invariance , 2011, IEEE Transactions on Intelligent Transportation Systems.

[18]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[19]  Ryan M. Eustice,et al.  TerraMax™: Team Oshkosh urban robot , 2008 .

[20]  Pierre Soille,et al.  Morphological gradients , 1993, J. Electronic Imaging.

[21]  R. Danescu,et al.  A Sensor for Urban Driving Assistance Systems Based on Dense Stereovision , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[22]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[23]  Roberto de Alencar Lotufo,et al.  Relationships between some watershed definitions and their tie-zone transforms , 2010, Image Vis. Comput..

[24]  Fadi Dornaika,et al.  A New Framework for Stereo Sensor Pose Through Road Segmentation and Registration , 2011, IEEE Transactions on Intelligent Transportation Systems.

[25]  Philippe Salembier,et al.  Connected operators and pyramids , 1993, Optics & Photonics.