SMART POINT CLOUD: DEFINITION AND REMAINING CHALLENGES

Dealing with coloured point cloud acquired from terrestrial laser scanner, this paper identifies remaining challenges for a new data structure: the smart point cloud. This concept arises with the statement that massive and discretized spatial information from active remote sensing technology is often underused due to data mining limitations. The generalisation of point cloud data associated with the heterogeneity and temporality of such datasets is the main issue regarding structure, segmentation, classification, and interaction for an immediate understanding. We propose to use both point cloud properties and human knowledge through machine learning to rapidly extract pertinent information, using user-centered information (smart data) rather than raw data. A review of feature detection, machine learning frameworks and database systems indexed both for mining queries and data visualisation is studied. Based on existing approaches, we propose a new 3-block flexible framework around device expertise, analytic expertise and domain base reflexion. This contribution serves as the first step for the realisation of a comprehensive smart point cloud data structure.

[1]  Klaus Schilling,et al.  Evaluation of a Backpack-Mounted 3D Mobile Scanning System , 2015, Remote. Sens..

[2]  Jie Li,et al.  Rethinking big data: A review on the data quality and usage issues , 2016 .

[3]  T. Pock,et al.  Point Clouds: Lidar versus 3D Vision , 2010 .

[4]  Rafael Beserra Gomes,et al.  Efficient 3D object recognition using foveated point clouds , 2013, Comput. Graph..

[5]  Ikujiro Nonaka,et al.  A THEORY OF ORGANIZATIONAL KNOWLEDGE CREATION , 2014 .

[6]  Reinhard Klein,et al.  Automatic reconstruction of parametric building models from indoor point clouds , 2016, Comput. Graph..

[7]  Jürgen Döllner,et al.  Concepts and techniques for integration, analysis and visualization of massive 3D point clouds , 2014, Comput. Environ. Urban Syst..

[8]  M. James,et al.  Ultra‐rapid topographic surveying for complex environments: the hand‐held mobile laser scanner (HMLS) , 2014 .

[9]  Alexander S. Szalay,et al.  Point cloud databases , 2014, SSDBM '14.

[10]  Lawrence A. Klein,et al.  Sensor and Data Fusion: A Tool for Information Assessment and Decision Making , 2004 .

[11]  Zhen Wang,et al.  A Multiscale and Hierarchical Feature Extraction Method for Terrestrial Laser Scanning Point Cloud Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Nico Blodow,et al.  Towards 3D Point cloud based object maps for household environments , 2008, Robotics Auton. Syst..

[13]  Martin Weinmann,et al.  Reconstruction and Analysis of 3D Scenes , 2016, Springer International Publishing.

[14]  Omar El Beqqali,et al.  FROM 3D MODEL DATA TO SEMANTICS , 2011 .

[15]  Michael Wimmer,et al.  Out-of-core selection and editing of huge point clouds , 2011, Comput. Graph..

[16]  Matthias Nießner,et al.  SemanticPaint , 2015, ACM Trans. Graph..

[17]  Dieter Fox,et al.  Object Recognition in 3D Point Clouds Using Web Data and Domain Adaptation , 2010, Int. J. Robotics Res..

[18]  Bertrand Douillard,et al.  On the segmentation of 3D LIDAR point clouds , 2011, 2011 IEEE International Conference on Robotics and Automation.

[19]  George Vosselman,et al.  Segmentation of point clouds using smoothness constraints , 2006 .

[20]  Ahmad Kamal Aijazi,et al.  Segmentation Based Classification of 3D Urban Point Clouds: A Super-Voxel Based Approach with Evaluation , 2013, Remote. Sens..

[21]  Remco C. Veltkamp,et al.  A survey of content based 3D shape retrieval methods , 2004, Proceedings Shape Modeling Applications, 2004..

[22]  Xianfeng Huang,et al.  A Hybrid Spatial Index for Massive Point Cloud Data Management and Visualization , 2014 .

[23]  Peter van Oosterom,et al.  Engineering web maps with gradual content zoom based on streaming vector data , 2016 .

[24]  Kun Liu,et al.  A NEW FRAMEWORK FOR INTERACTIVE SEGMENTATION OF POINT CLOUDS , 2014 .

[25]  Jürgen Döllner,et al.  Out-of-core real-time visualization of massive 3D point clouds , 2010, AFRIGRAPH '10.

[26]  Thorsten Joachims,et al.  Semantic Labeling of 3D Point Clouds for Indoor Scenes , 2011, NIPS.

[27]  Peter van Oosterom,et al.  Massive point cloud data management: Design, implementation and execution of a point cloud benchmark , 2015, Comput. Graph..

[28]  Peter Droege,et al.  Intelligent Environments: Spatial Aspects of the Information Revolution , 1997 .

[29]  Burcu Akinci,et al.  Automatic Creation of Semantically Rich 3D Building Models from Laser Scanner Data , 2013 .

[30]  Gabriele Peters,et al.  Adaptive 3-D object classification with reinforcement learning , 2015, 2015 12th International Conference on Informatics in Control, Automation and Robotics (ICINCO).

[31]  Steven Schockaert,et al.  Inducing semantic relations from conceptual spaces: A data-driven approach to plausible reasoning , 2015, Artif. Intell..

[32]  Mani Golparvar-Fard,et al.  Segmentation of building point cloud models including detailed architectural/structural features and MEP systems , 2015 .

[33]  Christophe Cruz,et al.  Knowledge Base Approach for 3D Objects Detection in Point Clouds Using 3D Processing and Specialists Knowledge , 2013, ArXiv.

[34]  Mariana Belgiu,et al.  Random forest in remote sensing: A review of applications and future directions , 2016 .

[35]  Qing Zhu,et al.  An efficient 3D R-tree spatial index method for virtual geographic environments , 2007 .

[36]  Christophe Cruz,et al.  From Unstructured 3D Point Clouds to Structured Knowledge - A Semantics Approach , 2012 .

[37]  Qing Zhu,et al.  An Efficient Point Cloud Management Method Based on a 3D R-Tree , 2012 .

[38]  Stefan Hinz,et al.  Semantic point cloud interpretation based on optimal neighborhoods, relevant features and efficient classifiers , 2015 .

[39]  D. Girardeau-Montaut,et al.  CHANGE DETECTION ON POINTS CLOUD DATA ACQUIRED W ITH A GROUND LASER SCANNER , 2005 .

[40]  Jan Boehm,et al.  MOBILE LASER SCANNING FOR INDOOR MODELLING , 2013 .

[41]  George Vosselman,et al.  Knowledge based reconstruction of building models from terrestrial laser scanning data , 2009 .

[42]  J. Niemeyer,et al.  Contextual classification of lidar data and building object detection in urban areas , 2014 .

[43]  Reinhard Klein,et al.  Shape Recognition in 3D Point-Clouds , 2008 .