Traffic sign detection in MLS acquired point clouds for geometric and image-based semantic inventory

Nowadays, mobile laser scanning has become a valid technology for infrastructure inspection. This technology permits collecting accurate 3D point clouds of urban and road environments and the geometric and semantic analysis of data became an active research topic in the last years. This paper focuses on the detection of vertical traffic signs in 3D point clouds acquired by a LYNX Mobile Mapper system, comprised of laser scanning and RGB cameras. Each traffic sign is automatically detected in the LiDAR point cloud, and its main geometric parameters can be automatically extracted, therefore aiding the inventory process. Furthermore, the 3D position of traffic signs are reprojected on the 2D images, which are spatially and temporally synced with the point cloud. Image analysis allows for recognizing the traffic sign semantics using machine learning approaches. The presented method was tested in road and urban scenarios in Galicia (Spain). The recall results for traffic sign detection are close to 98%, and existing false positives can be easily filtered after point cloud projection. Finally, the lack of a large, publicly available Spanish traffic sign database is pointed out.

[1]  Xiaolin Hu,et al.  Traffic sign detection based on convolutional neural networks , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[2]  H. Fleyeh.  Shadow And Highlight Invariant Colour Segmentation Algorithm For Traffic Signs , 2006, 2006 IEEE Conference on Cybernetics and Intelligent Systems.

[3]  Lijuan Liu,et al.  A novel traffic sign detection method via color segmentation and robust shape matching , 2015, Neurocomputing.

[4]  George Vosselman,et al.  Recognizing basic structures from mobile laser scanning data for road inventory studies , 2011 .

[5]  Zhilu Wu,et al.  A hierarchical method for traffic sign classification with support vector machines , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[6]  Bruno Vallet,et al.  Detection and 3D reconstruction of traffic signs from multiple view color images , 2013 .

[7]  Yann LeCun,et al.  Traffic sign recognition with multi-scale Convolutional Networks , 2011, The 2011 International Joint Conference on Neural Networks.

[8]  José Luis Alba-Castro,et al.  Fast real-time multiclass traffic sign detection based on novel shape and texture descriptors , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[9]  Federico Tombari,et al.  Traffic sign detection via interest region extraction , 2015, Pattern Recognit..

[10]  Pedro Arias,et al.  Accuracy verification of the Lynx Mobile Mapper system , 2013 .

[11]  Jürgen Schmidhuber,et al.  Multi-column deep neural network for traffic sign classification , 2012, Neural Networks.

[12]  Pedro Arias,et al.  Evaluation of road signs using radiometric and geometric data from terrestrial LiDAR , 2013 .

[13]  Dia I. Abu-Al-Nadi,et al.  Road traffic sign detection in color images , 2003, 10th IEEE International Conference on Electronics, Circuits and Systems, 2003. ICECS 2003. Proceedings of the 2003.

[14]  Peter H. N. de With,et al.  Color exploitation in hog-based traffic sign detection , 2010, 2010 IEEE International Conference on Image Processing.

[15]  Johannes Stallkamp,et al.  Detection of traffic signs in real-world images: The German traffic sign detection benchmark , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[16]  Nicolas David,et al.  Towards 3D lidar point cloud registration improvement using optimal neighborhood knowledge , 2013 .

[17]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[18]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[19]  Pedro Arias,et al.  Automatic Segmentation and Shape-Based Classification of Retro-Reflective Traffic Signs from Mobile LiDAR Data , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Johannes Stallkamp,et al.  Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition , 2012, Neural Networks.

[21]  Saturnino Maldonado-Bascón,et al.  Goal Evaluation of Segmentation Algorithms for Traffic Sign Recognition , 2010, IEEE Transactions on Intelligent Transportation Systems.

[22]  Edilson de Aguiar,et al.  Traffic sign detection with VG-RAM weightless neural networks , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[23]  Peter H. N. de With,et al.  Robust detection, classification and positioning of traffic signs from street-level panoramic images for inventory purposes , 2012, 2012 IEEE Workshop on the Applications of Computer Vision (WACV).

[24]  Vincenzo Barrile,et al.  Automatic Recognition of Road Signs by Hough Transform: Road-GIS , 2012 .

[25]  George Vosselman,et al.  Mapping curbstones in airborne and mobile laser scanning data , 2012, Int. J. Appl. Earth Obs. Geoinformation.

[26]  Faliang Chang,et al.  Rapid Multiclass Traffic Sign Detection in High-Resolution Images , 2014, IEEE Transactions on Intelligent Transportation Systems.

[27]  Jun Yu,et al.  Semiautomated Extraction of Street Light Poles From Mobile LiDAR Point-Clouds , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Zhilu Wu,et al.  A robust, coarse-to-fine traffic sign detection method , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[29]  Andrés Serna,et al.  Detection, segmentation and classification of 3D urban objects using mathematical morphology and supervised learning , 2014 .

[30]  Bisheng Yang,et al.  Hierarchical extraction of urban objects from mobile laser scanning data , 2015 .