Automatic Generation of Point Cloud Synthetic Dataset for Historical Building Representation

3D point clouds represent a structured collection of elementary geometrical primitives. They can characterize size, shape, orientation and position of objects in space. In the field of building modelling and Cultural Heritage documentation and preservation, the classification and segmentation of point clouds result challenging because of the complexity and variety of point clouds due to irregular sampling, varying density, different types of objects. After moving into the era of multimedia big data, machine-learning approaches evolved into deep learning approaches, which are a more powerful and efficient way of dealing with the complexity of semantic object classification. Despite the great benefits that such approaches brought in automation, a great obstacle is to generate enough training data, which are nowadays manually labeled. This task results time-consuming for two reasons: the variety of point density and geometry, which are typical for the Cultural Heritage domain. In order to accelerate the development of powerful algorithms for CH point cloud classification, in this paper, it is presented a novel framework for automatic generation of synthetic dataset of point clouds. This task is performed using Blender, an open source software which permits to access to each point in an object creating one in a new mesh. The algorithms described allow to create a great number of point cloud synthetically, simulating a virtual laser scanner at a variable distance. Furthermore, these two algorithms not only work with a single object, but it is possible to create simultaneously many point clouds from a scene in Blender also with the use of an existing model of ancient architectures.

[1]  Emanuele Frontoni,et al.  Convolutional Networks for Semantic Heads Segmentation using Top-View Depth Data in Crowded Environment , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[2]  V. S. Gorbatsevich,et al.  THERMALNET: A DEEP CONVOLUTIONAL NETWORK FOR SYNTHETIC THERMAL IMAGE GENERATION , 2017 .

[3]  Sainan Liu,et al.  Attentional ShapeContextNet for Point Cloud Recognition , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Victor S. Lempitsky,et al.  Escape from Cells: Deep Kd-Networks for the Recognition of 3D Point Cloud Models , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[6]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[7]  Thomas Brox,et al.  FlowNet: Learning Optical Flow with Convolutional Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[8]  Thomas Brox,et al.  A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimation , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Ramona Quattrini,et al.  Knowledge-based data enrichment for HBIM: Exploring high-quality models using the semantic-web , 2017 .

[10]  Emanuele Frontoni,et al.  Robotic platform for deep change detection for rail safety and security , 2017, 2017 European Conference on Mobile Robots (ECMR).

[11]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[12]  Thomas Brox,et al.  Inverting Visual Representations with Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[14]  Roberto Pierdicca,et al.  DEEP CONVOLUTIONAL NEURAL NETWORK FOR AUTOMATIC DETECTION OF DAMAGED PHOTOVOLTAIC CELLS , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[15]  Michael J. Black,et al.  A Naturalistic Open Source Movie for Optical Flow Evaluation , 2012, ECCV.

[16]  Ankush Gupta,et al.  Synthetic Data for Text Localisation in Natural Images , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Tao Wang,et al.  End-to-end text recognition with convolutional neural networks , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[18]  Andrew Zisserman,et al.  Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition , 2014, ArXiv.

[19]  Hao Su,et al.  A Point Set Generation Network for 3D Object Reconstruction from a Single Image , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Joshua B. Tenenbaum,et al.  Efficient analysis-by-synthesis in vision: A computational framework, behavioral tests, and modeling neuronal representations , 2015, Annual Meeting of the Cognitive Science Society.

[21]  Eugene W. Myers,et al.  A Dataset Generator for Whole Genome Shotgun Sequencing , 1999, ISMB.

[22]  Yaling Pei,et al.  A Synthetic Data Generator for Clustering and Outlier Analysis , 2006 .

[23]  Ruofei Zhong,et al.  Classification of Urban Point Clouds: A Robust Supervised Approach With Automatically Generating Training Data , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  Marc Pollefeys,et al.  Semantic3D.net: A new Large-scale Point Cloud Classification Benchmark , 2017, ArXiv.

[25]  E. F. Miller,et al.  Automated generation of testcase datasets , 1975 .