Automatic Segmentation and Shape-Based Classification of Retro-Reflective Traffic Signs from Mobile LiDAR Data

Recently, many studies have demonstrated the valid contribution of mobile laser scanning to road safety improvements, thus intense efforts have been made to implement automatic data processing using laser scanning data, with special emphasis on road object recognition. This study is focused on the detection and classification of retro-reflective vertical traffic signs according to their function (danger, give way, prohibition/obligation, and indication) from mobile laser scanning data by considering geometric and radiometric information, but without relying on trajectory data. The global strategy for segmentation involves the application of an optimized intensity threshold in order to segment the points that correspond to traffic sign panels. Next, contour recognition is performed for each sign using a linear regression model based on a raster image, which is generated for each cluster of points. The shape evaluation is motivated by the correspondence between contour shape and function of the traffic. The completeness of results for detection (92.11%) and classification (83.91%) demonstrates that this implementation is promising for the automatic detection and inventory analysis of traffic signs in road mapping applications. The efficiency rates are acceptable in urban areas, but our tests indicate that the detection and classification rates are more robust in road environments.

[1]  Andrés Serna,et al.  Detection, segmentation and classification of 3D urban objects using mathematical morphology and supervised learning , 2014 .

[2]  Yongjun Zhang,et al.  Road Centerline Extraction in Complex Urban Scenes From LiDAR Data Based on Multiple Features , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[3]  C. Ioannidis,et al.  Automatic road sign detecion and classification based on support vector machines and HOG descriptos , 2014 .

[4]  Peter H. N. de With,et al.  Robust detection, classification and positioning of traffic signs from street-level panoramic images for inventory purposes , 2012, 2012 IEEE Workshop on the Applications of Computer Vision (WACV).

[5]  Bisheng Yang,et al.  Semi-automated extraction and delineation of 3D roads of street scene from mobile laser scanning point clouds , 2013 .

[6]  Hongbin Zha,et al.  Segmentation and classification of range image from an intelligent vehicle in urban environment , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  C. Lin,et al.  Eigen-feature analysis of weighted covariance matrices for LiDAR point cloud classification , 2014 .

[8]  Beatriz Marcotegui,et al.  Point cloud segmentation towards urban ground modeling , 2009, 2009 Joint Urban Remote Sensing Event.

[9]  Pedro Arias,et al.  Accuracy verification of the Lynx Mobile Mapper system , 2013 .

[10]  J. Demantké,et al.  DIMENSIONALITY BASED SCALE SELECTION IN 3D LIDAR POINT CLOUDS , 2012 .

[11]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[12]  Bruno Vallet,et al.  Detection and 3D reconstruction of traffic signs from multiple view color images , 2013 .

[13]  Henk J. A. M. Heijmans,et al.  The algebraic basis of mathematical morphology : II. Openings and closings , 1991, CVGIP Image Underst..

[14]  Jun Yu,et al.  Semiautomated Extraction of Street Light Poles From Mobile LiDAR Point-Clouds , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[15]  George Vosselman,et al.  Recognizing basic structures from mobile laser scanning data for road inventory studies , 2011 .

[16]  Bertrand Douillard,et al.  On the segmentation of 3D LIDAR point clouds , 2011, 2011 IEEE International Conference on Robotics and Automation.

[17]  Aleksey Boyko,et al.  Extracting roads from dense point clouds in large scale urban environment , 2011 .

[18]  Zhidong Deng,et al.  LIDAR and vision-based real-time traffic sign detection and recognition algorithm for intelligent vehicle , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[19]  D. Lichti,et al.  CLASSIFICATION AND SEGMENTATION OF TERRESTRIAL LASER SCANNER POINT CLOUDS USING LOCAL VARIANCE INFORMATION , 2006 .

[20]  Xinhua Zhuang,et al.  Image Analysis Using Mathematical Morphology , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Alberto Holgado-Barco,et al.  An automated approach to vertical road characterisation using mobile LiDAR systems: Longitudinal profiles and cross-sections , 2014 .

[22]  Swarup Medasani,et al.  Automatic recognition of diverse 3-D objects and analysis of large urban scenes using ground and aerial LIDAR sensors , 2010, CLEO/QELS: 2010 Laser Science to Photonic Applications.

[23]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[24]  Paul H. Lewis,et al.  An automated algorithm for extracting road edges from terrestrial mobile LiDAR data , 2013 .

[25]  Markus H. Gross,et al.  Efficient simplification of point-sampled surfaces , 2002, IEEE Visualization, 2002. VIS 2002..

[26]  Cheng Wang,et al.  Using mobile laser scanning data for automated extraction of road markings , 2014 .

[27]  Pedro Arias,et al.  PERFORMANCE TESTING OF 3D POINT CLOUD SOFTWARE , 2013 .

[28]  Henk J. A. M. Heijmans,et al.  The algebraic basis of mathematical morphology. I Dilations and erosions , 1990, Comput. Vis. Graph. Image Process..

[29]  Vladimir G. Kim,et al.  Shape-based recognition of 3D point clouds in urban environments , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[30]  Peter H. N. de With,et al.  Optimal Performance-Efficiency Trade-off for Bag of Words Classification of Road Signs , 2014, 2014 22nd International Conference on Pattern Recognition.