A Multiscale and Hierarchical Feature Extraction Method for Terrestrial Laser Scanning Point Cloud Classification

The effective extraction of shape features is an important requirement for the accurate and efficient classification of terrestrial laser scanning (TLS) point clouds. However, the challenge of how to obtain robust and discriminative features from noisy and varying density TLS point clouds remains. This paper introduces a novel multiscale and hierarchical framework, which describes the classification of TLS point clouds of cluttered urban scenes. In this framework, we propose multiscale and hierarchical point clusters (MHPCs). In MHPCs, point clouds are first resampled into different scales. Then, the resampled data set of each scale is aggregated into several hierarchical point clusters, where the point cloud of all scales in each level is termed a point-cluster set. This representation not only accounts for the multiscale properties of point clouds but also well captures their hierarchical structures. Based on the MHPCs, novel features of point clusters are constructed by employing the latent Dirichlet allocation (LDA). An LDA model is trained according to a training set. The LDA model then extracts a set of latent topics, i.e., a feature of topics, for a point cluster. Finally, to apply the introduced features for point-cluster classification, we train an AdaBoost classifier in each point-cluster set and obtain the corresponding classifiers to separate the TLS point clouds with varying point density and data missing into semantic regions. Compared with other methods, our features achieve the best classification results for buildings, trees, people, and cars from TLS point clouds, particularly for small and moving objects, such as people and cars.

[1]  Thomas L. Griffiths,et al.  Hierarchical Topic Models and the Nested Chinese Restaurant Process , 2003, NIPS.

[2]  Katsushi Ikeuchi,et al.  A Spherical Representation for Recognition of Free-Form Surfaces , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  C. Mallet,et al.  AIRBORNE LIDAR FEATURE SELECTION FOR URBAN CLASSIFICATION USING RANDOM FORESTS , 2009 .

[4]  Wolfram Burgard,et al.  Unsupervised discovery of object classes from range data using latent Dirichlet allocation , 2009, Robotics: Science and Systems.

[5]  James R. Lersch,et al.  Context-driven automated target detection in 3D data , 2004, SPIE Defense + Commercial Sensing.

[6]  Berthold K. P. Horn Extended Gaussian images , 1984, Proceedings of the IEEE.

[7]  Alexei A. Efros,et al.  Using Multiple Segmentations to Discover Objects and their Extent in Image Collections , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[8]  Pietro Perona,et al.  Unsupervised learning of visual taxonomies , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Kostas Daniilidis,et al.  Object Detection from Large-Scale 3D Datasets Using Bottom-Up and Top-Down Descriptors , 2008, ECCV.

[10]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[11]  David P. Helmbold,et al.  Aerial Lidar Data Classification using AdaBoost , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[12]  David Suter,et al.  Multi-scale Conditional Random Fields for over-segmented irregular 3D point clouds classification , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[13]  Thomas Hofmann,et al.  Unsupervised Learning by Probabilistic Latent Semantic Analysis , 2004, Machine Learning.

[14]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Katsushi Ikeuchi,et al.  The Complex EGI: A New Representation for 3-D Pose Determination , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  David M. Blei,et al.  Supervised Topic Models , 2007, NIPS.

[17]  Jianxiong Xiao,et al.  Multiple view semantic segmentation for street view images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[18]  Chong-Wah Ngo,et al.  Evaluating bag-of-visual-words representations in scene classification , 2007, MIR '07.

[19]  Hermann Gross,et al.  EXTRACTION OF LINES FROM LASER POINT CLOUDS , 2006 .

[20]  IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, VOL. 34. NO. 4, JULY 1996 Universal Multifractal Scaling of Synthetic , 1996 .

[21]  S. J. Oude Elberink,et al.  Entities and Features for Classifcation of Airborne Laser Scanning Data in Urban Area , 2012 .

[22]  Jonathan Cheung-Wai Chan,et al.  Evaluation of random forest and adaboost tree-based ensemble classification and spectral band selection for ecotope mapping using airborne hyperspectral imagery , 2008 .

[23]  David Suter,et al.  3D terrestrial LIDAR classifications with super-voxels and multi-scale Conditional Random Fields , 2009, Comput. Aided Des..

[24]  Uwe Soergel,et al.  CONDITIONAL RANDOM FIELDS for LIDAR POINT CLOUD CLASSIFICATION in COMPLEX URBAN AREAS , 2012 .

[25]  Zhen Wang,et al.  A Structure-Aware Global Optimization Method for Reconstructing 3-D Tree Models From Terrestrial Laser Scanning Data , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Hao Wang,et al.  Perception-based shape retrieval for 3D building models , 2013 .

[27]  Yanchun Zhang,et al.  AdaBoost algorithm with random forests for predicting breast cancer survivability , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[28]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[29]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[30]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[31]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[32]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Martial Hebert,et al.  3-D scene analysis via sequenced predictions over points and regions , 2011, 2011 IEEE International Conference on Robotics and Automation.

[34]  D. Aldous Exchangeability and related topics , 1985 .

[35]  Martial Hebert,et al.  Parts-based 3D object classification , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[36]  David P. Helmbold,et al.  Aerial LiDAR Data Classification Using Support Vector Machines (SVM) , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[37]  K.C. Slatton,et al.  Improved Classification of Building Infrastructure from Airborne Lidar Data Using Spin Images and Fusion with Ground-Based Lidar , 2007, 2007 Urban Remote Sensing Joint Event.

[38]  Alexei A. Efros,et al.  Unsupervised discovery of visual object class hierarchies , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Boris Jutzi,et al.  Feature relevance assessment for the semantic interpretation of 3D point cloud data , 2013 .

[40]  Jitendra Malik,et al.  Recognizing Objects in Range Data Using Regional Point Descriptors , 2004, ECCV.

[41]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[42]  Frédéric Jurie,et al.  Sampling Strategies for Bag-of-Features Image Classification , 2006, ECCV.

[43]  Andrew E. Johnson,et al.  Toward a General 3-D Matching Engine: Multiple Models, Complex Scenes, and Efficient Data Filtering , 1998 .

[44]  Chao-Hung Lin,et al.  Point Cloud Encoding for 3D Building Model Retrieval , 2014, IEEE Transactions on Multimedia.

[45]  Vladimir G. Kim,et al.  Shape-based recognition of 3D point clouds in urban environments , 2009, 2009 IEEE 12th International Conference on Computer Vision.