Automated Detection of Three-Dimensional Cars in Mobile Laser Scanning Point Clouds Using DBM-Hough-Forests

This paper presents an automated algorithm for rapidly and effectively detecting cars directly from large-volume 3-D point clouds. Rather than using low-order descriptors, a multilayer feature generation model is created to obtain high-order feature representations for 3-D local patches through deep learning techniques. To handle cars with different levels of incompleteness caused by data acquisition ways and occlusions, a hierarchical visibility estimation model is developed to augment Hough voting. Considering scale and orientation variations in the azimuth direction, a set of multiscale Hough forests is constructed to rotationally cast votes to estimate cars' centroids. Quantitative assessments show that the proposed algorithm achieves average completeness, correctness, quality, and F1-measure of 0.94, 0.96, 0.90, and 0.95, respectively, in detecting 3-D cars. Comparative studies also demonstrate that the proposed algorithm outperforms the other four existing algorithms in accurately and completely detecting 3-D cars from large-scale 3-D point clouds.

[1]  Craig L. Glennie,et al.  Synthesis of Transportation Applications of Mobile LIDAR , 2013, Remote. Sens..

[2]  Marcel Körtgen,et al.  3 D Shape Matching with 3 D Shape Contexts , 2003 .

[3]  Liujuan Cao,et al.  Vehicle Detection in High-Resolution Aerial Images via Sparse Representation and Superpixels , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Csaba Benedek,et al.  Extraction of Vehicle Groups in Airborne Lidar Point Clouds With Two-Level Point Processes , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Gustavo Carneiro,et al.  Combining Multiple Dynamic Models and Deep Learning Architectures for Tracking the Left Ventricle Endocardium in Ultrasound Data , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Cheng Wang,et al.  Automated Extraction of Urban Road Facilities Using Mobile Laser Scanning Data , 2015, IEEE Transactions on Intelligent Transportation Systems.

[7]  Nico Blodow,et al.  Aligning point cloud views using persistent feature histograms , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Jun Zhou,et al.  VHR Object Detection Based on Structural Feature Extraction and Query Expansion , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Damir Čemerin,et al.  IV , 2011 .

[10]  Konrad Schindler,et al.  IMPLICIT SHAPE MODELS FOR OBJECT DETECTION IN 3D POINT CLOUDS , 2012, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[11]  Joshua B. Tenenbaum,et al.  Learning with Hierarchical-Deep Models , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Peng Li,et al.  Object Detection in Terrestrial Laser Scanning Point Clouds Based on Hough Forest , 2014, IEEE Geoscience and Remote Sensing Letters.

[13]  Jun Yu,et al.  Semiautomated Extraction of Street Light Poles From Mobile LiDAR Point-Clouds , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[15]  Qin Yan,et al.  Automatic Vehicle Extraction from Airborne LiDAR Data Using an Object-Based Point Cloud Analysis Method , 2014, Remote. Sens..

[16]  Tijmen Tieleman,et al.  Training restricted Boltzmann machines using approximations to the likelihood gradient , 2008, ICML '08.

[17]  Kostas Daniilidis,et al.  Object Detection from Large-Scale 3D Datasets Using Bottom-Up and Top-Down Descriptors , 2008, ECCV.

[18]  Ahmed Shaker,et al.  Radiometric Correction and Normalization of Airborne LiDAR Intensity Data for Improving Land-Cover Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Pedro Arias,et al.  Automatic filtering of vehicles from mobile LiDAR datasets , 2014 .

[20]  Baojun Zhao,et al.  Compressed-Domain Ship Detection on Spaceborne Optical Image Using Deep Neural Network and Extreme Learning Machine , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Stefan Hinz,et al.  Extraction and motion estimation of vehicles in single-pass airborne LiDAR data towards urban traffic analysis , 2011 .

[22]  Cheng Wang,et al.  Three-Dimensional Object Matching in Mobile Laser Scanning Point Clouds , 2015, IEEE Geoscience and Remote Sensing Letters.

[23]  Luc Van Gool,et al.  Hough Forests for Object Detection, Tracking, and Action Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  David B. Dunson,et al.  Deep Learning with Hierarchical Convolutional Factor Analysis , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Uwe Stilla,et al.  Comparison of Two Methods for Vehicle Extraction From Airborne LiDAR Data Toward Motion Analysis , 2011, IEEE Geoscience and Remote Sensing Letters.

[26]  Marcel Körtgen,et al.  3D Shape Matching with 3D Shape Contexts , 2003 .

[27]  Geoffrey E. Hinton,et al.  An Efficient Learning Procedure for Deep Boltzmann Machines , 2012, Neural Computation.

[28]  Jean-Charles Noyer,et al.  Feature Extraction in Scanning Laser Range Data Using Invariant Parameters: Application to Vehicle Detection , 2012, IEEE Transactions on Vehicular Technology.

[29]  Uwe Stilla,et al.  Automatic vehicle extraction from airborne LiDAR data of urban areas aided by geodesic morphology , 2010, Pattern Recognit. Lett..

[30]  Peng Li,et al.  3-D Point Cloud Object Detection Based on Supervoxel Neighborhood With Hough Forest Framework , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Hong Huo,et al.  Rotation-Invariant Object Detection of Remotely Sensed Images Based on Texton Forest and Hough Voting , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Xavier Descombes,et al.  Author manuscript, published in "Journal of Mathematical Imaging and Vision (2009)" Object , 2008 .

[33]  Bisheng Yang,et al.  Automated registration of dense terrestrial laser-scanning point clouds using curves , 2014 .

[34]  Attila Börcs,et al.  A MARKED POINT PROCESS MODEL FOR VEHICLE DETECTION IN AERIAL LIDAR POINT CLOUDS , 2012 .

[35]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.