3D Point Cloud Classification Based on Discrete Conditional Random Field

The advantage of the conditional random field (CRF) lies in the construction of the discriminant model and efficient parameter optimization. In the topic of the classification of three-dimensional point cloud, the parameters of the CRF are usually learnt through Gradient Descent and Belief Propagation, in order to optimize the objective energy function of the CRF. These optimization methods do not guarantee the highest global classification accuracy with a high classification accuracy on the smaller classes. In addition, differential features of the point cloud are not sufficiently utilized. In this paper, we use the local geometric shape features to construct the CRF, including the nearest neighbor tetrahedral volume, Gaussian curvature, the neighbourhood normal vector consistency and the neighbourhood minimum principal curvature direction consistency. We propose four discrete criteria for CRF parameter optimization to design the explicit functions, and present concrete solution procedures, in which Monte Carlo method and supervised learning method are employed to estimate the CRF parameters iteratively. Experimental results show that our method can be applied to the classification of the scene of 3D point cloud with plants, especially under the proposed second criterion that maximizing the accuracy with interclass weights. It can be used to improve significantly the classification accuracy of small scale point sets when different classes have great disparity in number.

[1]  Roman Shapovalov,et al.  Cutting-Plane Training of Non-associative Markov Network for 3D Point Cloud Segmentation , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[2]  Sungkon Moon,et al.  Discrete Firefly Algorithm for Scaffolding Construction Scheduling , 2017 .

[3]  Markus Hollaus,et al.  Object-Based Point Cloud Analysis of Full-Waveform Airborne Laser Scanning Data for Urban Vegetation Classification , 2008, Sensors.

[4]  Dimitri Lague,et al.  3D Terrestrial LiDAR data classification of complex natural scenes using a multi-scale dimensionality criterion: applications in geomorphology , 2011, ArXiv.

[5]  Maristela Holanda,et al.  Provenance in bioinformatics workflows , 2013, BMC Bioinformatics.

[6]  Heiner Kuhlmann,et al.  Surface feature based classification of plant organs from 3D laserscanned point clouds for plant phenotyping , 2013, BMC Bioinformatics.

[7]  Martial Hebert,et al.  Natural terrain classification using three‐dimensional ladar data for ground robot mobility , 2006, J. Field Robotics.

[8]  O. Barinova,et al.  NON-ASSOCIATIVE MARKOV NETWORKS FOR 3D POINT CLOUD CLASSIFICATION , 2010 .

[9]  Xiangyun Hu,et al.  Deep-Learning-Based Classification for DTM Extraction from ALS Point Cloud , 2016, Remote. Sens..

[10]  Ruofei Zhong,et al.  A Bayesian-Network-Based Classification Method Integrating Airborne LiDAR Data With Optical Images , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Jingdao Chen,et al.  Principal Axes Descriptor for Automated Construction-Equipment Classification from Point Clouds , 2017, J. Comput. Civ. Eng..

[12]  Martial Hebert,et al.  Directional Associative Markov Network for 3-D Point Cloud Classification , 2008 .

[13]  Xun Wang,et al.  Robust 3D face modeling and reconstruction from frontal and side images , 2017, Comput. Aided Geom. Des..

[14]  Pierre Alliez,et al.  A Survey of Surface Reconstruction from Point Clouds , 2017, Comput. Graph. Forum.

[15]  W Chan,et al.  Maximum Likelihood Estimation in Generalized Linear Mixed Models Using Monte Carlo Methods: Application to Small-Area Estimation of Breast Cancer Mortality , 2006 .

[16]  Simon Lacroix,et al.  Classification of Outdoor 3D Lidar Data Based on Unsupervised Gaussian Mixture Models , 2017, IEEE Trans Autom. Sci. Eng..

[17]  D. Lang,et al.  Adaptivity of conditional random field based outdoor point cloud classification , 2016, Pattern Recognition and Image Analysis.

[18]  Zhen Wang,et al.  A Multilevel Point-Cluster-Based Discriminative Feature for ALS Point Cloud Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Lars Petersson,et al.  Non-associative Higher-Order Markov Networks for Point Cloud Classification , 2014, ECCV.

[20]  M. Himmelsbach,et al.  Real-time object classification in 3D point clouds using point feature histograms , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Carme Torras,et al.  Recognizing Point Clouds Using Conditional Random Fields , 2014, 2014 22nd International Conference on Pattern Recognition.

[22]  Jitendra Malik,et al.  Recognizing Objects in Range Data Using Regional Point Descriptors , 2004, ECCV.

[23]  Zhiguo Cao,et al.  A fast and robust local descriptor for 3D point cloud registration , 2016, Inf. Sci..

[24]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[25]  Zhen Wang,et al.  A Multiscale and Hierarchical Feature Extraction Method for Terrestrial Laser Scanning Point Cloud Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Andrew McCallum,et al.  An Introduction to Conditional Random Fields , 2010, Found. Trends Mach. Learn..

[27]  Stefan Hinz,et al.  Semantic point cloud interpretation based on optimal neighborhoods, relevant features and efficient classifiers , 2015 .

[28]  Uwe Soergel,et al.  CONDITIONAL RANDOM FIELDS for LIDAR POINT CLOUD CLASSIFICATION in COMPLEX URBAN AREAS , 2012 .

[29]  Long Quan,et al.  Data-Driven Synthetic Modeling of Trees , 2014, IEEE Transactions on Visualization and Computer Graphics.

[30]  Anthony Mandow,et al.  Voxel-Based Neighborhood for Spatial Shape Pattern Classification of Lidar Point Clouds with Supervised Learning , 2017, Sensors.

[31]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[32]  Martial Hebert,et al.  Discriminative Random Fields , 2006, International Journal of Computer Vision.

[33]  María Concepcion Alonso,et al.  Automatic Detection and Classification of Pole-Like Objects in Urban Point Cloud Data Using an Anomaly Detection Algorithm , 2015, Remote. Sens..

[34]  Xiangguo Lin,et al.  Classification of ALS Point Cloud with Improved Point Cloud Segmentation and Random Forests , 2017, Remote. Sens..

[35]  G. Vosselman Point cloud segmentation for urban scene classification , 2013 .

[36]  Feiping Nie,et al.  Interactive Visual Object Extraction Based on Belief Propagation , 2007, MMM.

[37]  Markus Vincze,et al.  Fast semantic segmentation of 3D point clouds using a dense CRF with learned parameters , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[38]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[39]  Uwe Soergel,et al.  HIERARCHICAL HIGHER ORDER CRF FOR THE CLASSIFICATION OF AIRBORNE LIDAR POINT CLOUDS IN URBAN AREAS , 2016 .

[40]  Xiaopeng Zhang,et al.  Robust curvature estimation and geometry analysis of 3D point cloud surfaces , 2009 .