CNN-based 3D object classification using Hough space of LiDAR point clouds

With the wide application of Light Detection and Ranging (LiDAR) in the collection of high-precision environmental point cloud information, three-dimensional (3D) object classification from point clouds has become an important research topic. However, the characteristics of LiDAR point clouds, such as unstructured distribution, disordered arrangement, and large amounts of data, typically result in high computational complexity and make it very difficult to classify 3D objects. Thus, this paper proposes a Convolutional Neural Network (CNN)-based 3D object classification method using the Hough space of LiDAR point clouds to overcome these problems. First, object point clouds are transformed into Hough space using a Hough transform algorithm, and then the Hough space is rasterized into a series of uniformly sized grids. The accumulator count in each grid is then computed and input to a CNN model to classify 3D objects. In addition, a semi-automatic 3D object labeling tool is developed to build a LiDAR point clouds object labeling library for four types of objects (wall, bush, pedestrian, and tree). After initializing the CNN model, we apply a dataset from the above object labeling library to train the neural network model offline through a large number of iterations. Experimental results demonstrate that the proposed method achieves object classification accuracy of up to 93.3% on average.

[1]  Bin Dai,et al.  Performance of global descriptors for velodyne-based urban object recognition , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[2]  Gerard Jounghyun Kim,et al.  IoT + AR: pervasive and augmented environments for “Digi-log” shopping experience , 2019, Human-centric Computing and Information Sciences.

[3]  Markus Vincze,et al.  Ensemble of shape functions for 3D object classification , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[4]  Jin Liu,et al.  Attention-based BiGRU-CNN for Chinese question classification , 2019, Journal of Ambient Intelligence and Humanized Computing.

[5]  Hamad Naeem,et al.  A Hybrid Proposed Framework for Object Detection and Classification , 2018, J. Inf. Process. Syst..

[6]  Ruohan Meng A fusion steganographic algorithm based on Faster R-CNN , 2018 .

[7]  Simon Fong,et al.  Enhanced ground segmentation method for Lidar point clouds in human-centric autonomous robot systems , 2019, Hum. centric Comput. Inf. Sci..

[8]  Andrés Serna,et al.  Detection, segmentation and classification of 3D urban objects using mathematical morphology and supervised learning , 2014 .

[9]  Gary R. Bradski,et al.  Fast 3D recognition and pose using the Viewpoint Feature Histogram , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Miguel Cazorla,et al.  Semi-supervised 3D object recognition through CNN labeling , 2018, Appl. Soft Comput..

[11]  Jin Wang,et al.  Lightweight deep network for traffic sign classification , 2019, Annals of Telecommunications.

[12]  Subhransu Maji,et al.  Multi-view Convolutional Neural Networks for 3D Shape Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[13]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Weisi Lin,et al.  B-SHOT: A binary feature descriptor for fast and efficient keypoint matching on 3D point clouds , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Yifan Xu,et al.  SpiderCNN: Deep Learning on Point Sets with Parameterized Convolutional Filters , 2018, ECCV.

[16]  Yuan Tian,et al.  Automatic ground points filtering of roadside LiDAR data using a channel-based filtering algorithm , 2019, Optics & Laser Technology.

[17]  Zaid Ameen Abduljabbar,et al.  An effective image retrieval based on optimized genetic algorithm utilized a novel SVM-based convolutional neural network classifier , 2019, Human-centric Computing and Information Sciences.

[18]  Jin Wang,et al.  A full convolutional network based on DenseNet for remote sensing scene classification. , 2019, Mathematical biosciences and engineering : MBE.

[19]  Peng Li,et al.  Object Detection in Terrestrial Laser Scanning Point Clouds Based on Hough Forest , 2014, IEEE Geoscience and Remote Sensing Letters.

[20]  Bisheng Yang,et al.  A novel binary shape context for 3D local surface description , 2017 .

[21]  Xiang Li,et al.  Toward real-time 3D object recognition: A lightweight volumetric CNN framework using multitask learning , 2017, Comput. Graph..

[22]  Mohammed Bennamoun,et al.  3D Object Recognition in Cluttered Scenes with Local Surface Features: A Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Mohammed Bennamoun,et al.  A novel local surface feature for 3D object recognition under clutter and occlusion , 2015, Inf. Sci..

[24]  Wen Hao,et al.  Structure-based object detection from scene point clouds , 2016, Neurocomputing.

[25]  Christoph Strecha,et al.  Classification of Aerial Photogrammetric 3D Point Clouds , 2017, ArXiv.

[26]  Federico Tombari,et al.  SHOT: Unique signatures of histograms for surface and texture description , 2014, Comput. Vis. Image Underst..

[27]  Liang Xiao,et al.  Hybrid conditional random field based camera-LIDAR fusion for road detection , 2017, Inf. Sci..

[28]  Hui Zeng,et al.  Convolutional Neural Network Based Multi-feature Fusion for Non-rigid 3D Model Retrieval , 2018, Journal of Information Processing Systems.

[29]  Jun-Ho Huh,et al.  Automatic Emotion-Based Music Classification for Supporting Intelligent IoT Applications , 2019, Electronics.

[30]  Wei Wu,et al.  PointCNN: Convolution On X-Transformed Points , 2018, NeurIPS.