Recognizing and Classifying Unknown Object in BIM Using 2D CNN

This paper aims to propose an approach to automated classifying building element instance in BIM using deep learning-based 3D object classification algorithm. Recently, studies related to checking or validating engine of BIM object for ensuring data integrity of BIM instances are getting attention. As a part of this research, this paper train recognition models that are targeted at basic building element and interior element using 3D object recognition technique that uses images of objects as inputs. Object recognition is executed in two stages; (1) class of object (e.g. wall, window, seating furniture, toilet fixture and etc.), (2) sub-type of specific classes (e.g. Toilet or Urinal). Using the trained models, BIM plug-in prototype is developed and the performance of this AI-based approach with test BIM model is checked. We expect this recognition approach to help ensure the integrity of BIM data and contribute to the practical use of BIM.

[1]  M.Weise,et al.  Integrating use case definitions for IFC developments , 2008 .

[2]  Jianxiong Xiao,et al.  3D ShapeNets: A deep representation for volumetric shapes , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[4]  Sebastian Scherer,et al.  VoxNet: A 3D Convolutional Neural Network for real-time object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Bonsang Koo,et al.  Applying novelty detection to identify model element to IFC class misclassifications on architectural and infrastructure Building Information Models , 2018, J. Comput. Des. Eng..

[6]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[7]  Rafael Sacks,et al.  Comparing machine learning and rule-based inferencing for semantic enrichment of BIM models , 2018, Automation in Construction.

[8]  Bonsang Koo,et al.  Using support vector machines to classify building elements for checking the semantic integrity of building information models , 2019, Automation in Construction.

[9]  Subhransu Maji,et al.  Multi-view Convolutional Neural Networks for 3D Shape Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[10]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  André Borrmann,et al.  Semantic Enrichment for Building Information Modeling: Procedure for Compiling Inference Rules and Operators for Complex Geometry , 2017, J. Comput. Civ. Eng..

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Charles M. Eastman,et al.  Validations for ensuring the interoperability of data exchange of a building information model , 2015 .

[14]  Charles M. Eastman,et al.  Automatic rule-based checking of building designs , 2009 .