Semantic labelling of road furniture in mobile laser scanning data.

Abstract. Road furniture semantic labelling is vital for large scale mapping and autonomous driving systems. Much research has been investigated on road furniture interpretation in both 2D images and 3D point clouds. Precise interpretation of road furniture in mobile laser scanning data still remains unexplored. In this paper, a novel method is proposed to interpret road furniture based on their logical relations and functionalities. Our work represents the most detailed interpretation of road furniture in mobile laser scanning data. 93.3 % of poles are correctly extracted and all of them are correctly recognised. 94.3 % of street light heads are detected and 76.9 % of them are correctly identified. Despite errors arising from the recognition of other components, our framework provides a promising solution to automatically map road furniture at a detailed level in urban environments.

[1]  Federico Tombari,et al.  Automatic detection of pole-like structures in 3D urban environments , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  V. Wichmann,et al.  Eigenvalue and graph-based object extraction from mobile laser scanning point clouds , 2013 .

[3]  Cheng Wang,et al.  Bag-of-visual-phrases and hierarchical deep models for traffic sign detection and recognition in mobile laser scanning data , 2016 .

[4]  G. Vosselman.  Point cloud segmentation for urban scene classification , 2013 .

[5]  Stefan Hinz,et al.  Semantic point cloud interpretation based on optimal neighborhoods, relevant features and efficient classifiers , 2015 .

[6]  Claus Brenner,et al.  Extraction of Features from Mobile Laser Scanning Data for Future Driver Assistance Systems , 2009, AGILE Conf..

[7]  Juha Hyyppä,et al.  Detection of Vertical Pole-Like Objects in a Road Environment Using Vehicle-Based Laser Scanning Data , 2010, Remote. Sens..

[8]  Jianxiong Xiao,et al.  Deep Sliding Shapes for Amodal 3D Object Detection in RGB-D Images , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Martial Hebert,et al.  Contextual classification with functional Max-Margin Markov Networks , 2009, CVPR.

[10]  Bisheng Yang,et al.  Hierarchical extraction of urban objects from mobile laser scanning data , 2015 .

[11]  S. J. Oude Elberink,et al.  User-assisted Object Detection by Segment Based Similarity Measures in Mobile Laser Scanner Data , 2014 .

[12]  Martial Hebert,et al.  3-D scene analysis via sequenced predictions over points and regions , 2011, 2011 IEEE International Conference on Robotics and Automation.

[13]  Pedro Arias,et al.  Automatic Segmentation and Shape-Based Classification of Retro-Reflective Traffic Signs from Mobile LiDAR Data , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  S. J. Oude Elberink,et al.  POLE-LIKE STREET FURNITURE DECOMPOSTION IN MOBILE LASER SCANNING DATA , 2016 .

[15]  Vladimir G. Kim,et al.  Shape-based recognition of 3D point clouds in urban environments , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[16]  Derek D. Lichti,et al.  Detecting road poles from mobile terrestrial laser scanning data , 2013 .

[17]  S. J. Oude Elberink,et al.  Optimizing detection of road furniture (pole-like object) in Mobile Laser Scanner data , 2013 .

[18]  Carlos Cabo,et al.  An algorithm for automatic detection of pole-like street furniture objects from Mobile Laser Scanner point clouds , 2014 .

[19]  Abdul Nurunnabi,et al.  Robust Segmentation for Large Volumes of Laser Scanning Three-Dimensional Point Cloud Data , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Jing Huang,et al.  Pole-like object detection and classification from urban point clouds , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Konrad Schindler,et al.  FAST SEMANTIC SEGMENTATION OF 3D POINT CLOUDS WITH STRONGLY VARYING DENSITY , 2016 .

[22]  Martial Hebert,et al.  Learning message-passing inference machines for structured prediction , 2011, CVPR 2011.

[23]  Bisheng Yang,et al.  USING MOBILE LASER SCANNING DATA FOR FEATURES EXTRACTION OF HIGH ACCURACY DRIVING MAPS , 2016 .

[24]  Jianxiong Xiao,et al.  Sliding Shapes for 3D Object Detection in Depth Images , 2014, ECCV.

[25]  Pedro Arias,et al.  Traffic sign detection in MLS acquired point clouds for geometric and image-based semantic inventory , 2016 .

[26]  Jouko Lampinen,et al.  Object Classification and Recognition From Mobile Laser Scanning Point Clouds in a Road Environment , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[27]  George Vosselman,et al.  Recognizing basic structures from mobile laser scanning data for road inventory studies , 2011 .

[28]  H. Yokoyama,et al.  Detection and Classification of Pole-like Objects from Mobile Laser Scanning Data of Urban Environments , 2013 .

[29]  Jun Yu,et al.  Semiautomated Extraction of Street Light Poles From Mobile LiDAR Point-Clouds , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Jianxiong Xiao,et al.  3D ShapeNets: A deep representation for volumetric shapes , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  G. Sithole,et al.  Recognising structure in laser scanning point clouds , 2004 .

[32]  Hiroshi Masuda,et al.  DETECTION AND CLASSIFICATION OF POLE-LIKE OBJECTS FROM MOBILE MAPPING DATA , 2015 .

[33]  Konrad Schindler,et al.  IMPLICIT SHAPE MODELS FOR OBJECT DETECTION IN 3D POINT CLOUDS , 2012, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[34]  Bisheng Yang,et al.  A shape-based segmentation method for mobile laser scanning point clouds , 2013 .