Urban object classification with 3D Deep-Learning

Automatic urban object detection remains a challenge for city management. Existing approaches in remote sensing include the use of aerial images or LiDAR to map a scene. This is, for example, the case for patch-based detection methods. However, these methods do not fully exploit the 3D information given by a LiDAR acquisition because they are similar to depth map. 3D Deep-Learning methods are promising to tackle the issue of the urban objects detection inside a LiDAR cloud. In this paper, we present the results of several experiments on urban object classification with the PointNet network trained with public data and tested on our data-set. We show that such a methodology delivers encouraging results, and also identify the limits and the possible improvements.

[1]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[3]  Christian Früh,et al.  Google Street View: Capturing the World at Street Level , 2010, Computer.

[4]  François Goulette,et al.  Paris-rue-Madame Database - A 3D Mobile Laser Scanner Dataset for Benchmarking Urban Detection, Segmentation and Classification Methods , 2014, ICPRAM.

[5]  François Goulette,et al.  Paris-Lille-3D: A large and high-quality ground-truth urban point cloud dataset for automatic segmentation and classification , 2017, Int. J. Robotics Res..

[6]  Bastian Leibe,et al.  Exploring Spatial Context for 3D Semantic Segmentation of Point Clouds , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[7]  Yasuyuki Matsushita,et al.  RotationNet: Joint Object Categorization and Pose Estimation Using Multiviews from Unsupervised Viewpoints , 2016, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[8]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Sebastian Scherer,et al.  VoxNet: A 3D Convolutional Neural Network for real-time object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[11]  Dieter Fox,et al.  Object Recognition in 3D Point Clouds Using Web Data and Domain Adaptation , 2010, Int. J. Robotics Res..

[12]  Marc Chaumont,et al.  First Experiments of Deep Learning on LiDAR Point Clouds for Classification of Urban Objects , 2018 .

[13]  Bertrand Douillard,et al.  An occlusion-aware feature for range images , 2012, 2012 IEEE International Conference on Robotics and Automation.

[14]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..