Image-driven fuzzy-based system to construct as-is IFC BIM objects

Abstract Various new data capturing technologies and object recognition systems have been developed to construct as-is building information models (BIMs) for operations and maintenance (O&M) management of existing buildings. However, a crucial challenge occurs in existing systems when semantic building information is captured under uncontrolled environmental conditions, especially in complex environments with poorly textured features (e.g., no obvious characteristics, edges, points, or lines). This study presents a semiautomatic image-driven system to recognize building objects and their materials and reviews the state-of-the-art object and material recognition methods and systems. A novel semiautomatic image-driven system was developed according to the new neuro-fuzzy framework for recognition of building objects and based on material classification procedures supported by an extensible texture library constructed to recognize their surface materials. More than 600 images were collected for the training process to develop this system, and more than 200 images were used for system verification. The results of the verification experiments show that the developed system can successfully recognize five kinds of building objects (i.e., beams, columns, windows, doors, and walls) and their corresponding surface materials from a single image taken by a handheld digital camera. Furthermore, the recognized building objects are automatically represented in industry foundation classes (IFC), a standard data schema for BIMs. The developed system is highly accurate, robust, and time-efficient for constructing as-is BIM objects in IFC and can help both BIM researchers and practitioners to develop information-rich BIMs in the O&M phase.

[1]  Xiaohua Jin,et al.  Model for Efficient Risk Allocation in Privately Financed Public Infrastructure Projects Using Neuro-Fuzzy Techniques , 2011 .

[2]  Ahmed S. Fahmy,et al.  Fast Localization of the Optic Disc Using Projection of Image Features , 2010, IEEE Transactions on Image Processing.

[3]  Tarek Zayed,et al.  Artificial neural network models for predicting condition of offshore oil and gas pipelines , 2014 .

[4]  Krzysztof Siminski,et al.  Interval type-2 neuro-fuzzy system with implication-based inference mechanism , 2017, Expert Syst. Appl..

[5]  Juan Carlos Niebles,et al.  Vision-based action recognition of earthmoving equipment using spatio-temporal features and support vector machine classifiers , 2013, Adv. Eng. Informatics.

[6]  D. Chua,et al.  IFC-Based Graph Data Model for Topological Queries on Building Elements , 2015, J. Comput. Civ. Eng..

[7]  Ian Flood.  Next Generation Artificial Neural Networks for Civil Engineering , 2006 .

[8]  Lucio Soibelman,et al.  Material-Based Construction Site Image Retrieval , 2005 .

[9]  Dulcy M. Abraham,et al.  NEURO-FUZZY APPROACHES FOR SANITARY SEWER PIPELINE CONDITION ASSESSMENT , 2001 .

[10]  Ernst Rank,et al.  Structural Analysis based on the Product Model Standard IFC , 2004 .

[11]  Eric M. Wetzel,et al.  The use of a BIM-based framework to support safe facility management processes , 2015 .

[12]  Changmin Kim,et al.  Classification of major construction materials in construction environments using ensemble classifiers , 2014, Adv. Eng. Informatics.

[13]  Matthias Klusch,et al.  Towards a definition of robustness for market-style open multi-agent systems , 2001, AGENTS '01.

[14]  Brenda McCabe,et al.  Automated computer vision-based detection of components of under-construction indoor partitions , 2017 .

[15]  Frank Schultmann,et al.  Building Information Modeling (BIM) for existing buildings — Literature review and future needs , 2014 .

[16]  Richard Szeliski,et al.  Reconstructing building interiors from images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[17]  Ibrahim Halil Gerek,et al.  House selling price assessment using two different adaptive neuro-fuzzy techniques , 2014 .

[18]  Lucio Soibelman,et al.  Shape-Based Retrieval of Construction Site Photographs , 2008 .

[19]  Jian Chu,et al.  Forecasting building energy consumption using neural networks and hybrid neuro-fuzzy system: A compa , 2011 .

[20]  Mario Fritz,et al.  Classifying materials in the real world , 2010, Image Vis. Comput..

[21]  Andrey Dimitrov,et al.  Vision-based material recognition for automated monitoring of construction progress and generating building information modeling from unordered site image collections , 2014, Adv. Eng. Informatics.

[22]  Ioannis Brilakis,et al.  Concrete Column Recognition in Images and Videos , 2010, J. Comput. Civ. Eng..

[23]  Petros-Fotios Alvanitopoulos,et al.  Neuro-fuzzy techniques for the classification of earthquake damages in buildings , 2010 .

[24]  Mani Golparvar-Fard,et al.  Evaluation of image-based modeling and laser scanning accuracy for emerging automated performance monitoring techniques , 2011 .

[25]  Francisco Forns-Samso,et al.  PERCEIVED VALUE OF BUILDING INFORMATION MODELING IN FACILITIES OPERATIONS AND MAINTENANCE , 2011 .

[26]  Ioannis Brilakis,et al.  Parameter optimization for automated concrete detection in image data , 2010 .

[27]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[28]  Daniel Huber,et al.  Using Context to Create Semantic 3D Models of Indoor Environments , 2010, BMVC.

[29]  Ebrahim H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Hum. Comput. Stud..

[30]  Lucio Soibelman,et al.  Content-Based Search Engines for Construction Image Databases , 2005 .

[31]  Jochen Teizer,et al.  Status quo and open challenges in vision-based sensing and tracking of temporary resources on infrastructure construction sites , 2015, Adv. Eng. Informatics.

[32]  Shih-Hsu Wang,et al.  Neuro‐Fuzzy Cost Estimation Model Enhanced by Fast Messy Genetic Algorithms for Semiconductor Hookup Construction , 2012, Comput. Aided Civ. Infrastructure Eng..

[33]  Carl T. Haas,et al.  State of research in automatic as-built modelling , 2015, Adv. Eng. Informatics.

[34]  Sylvain Robert,et al.  Automatic reconstruction of 3D building models from scanned 2D floor plans , 2016 .

[35]  Isao Hayashi,et al.  A learning method of fuzzy inference rules by descent method , 1992 .

[36]  Sanghoon Lee,et al.  Image-Based Technologies for Constructing As-Is Building Information Models for Existing Buildings , 2017, J. Comput. Civ. Eng..

[37]  Andrey Dimitrov,et al.  Non‐Uniform B‐Spline Surface Fitting from Unordered 3D Point Clouds for As‐Built Modeling , 2016, Comput. Aided Civ. Infrastructure Eng..

[38]  Wen-der Yu,et al.  A VaFALCON neuro-fuzzy system for mining of incomplete construction databases , 2006 .

[39]  Hyojoo Son,et al.  3D structural component recognition and modeling method using color and 3D data for construction progress monitoring , 2010 .

[40]  Lucio Soibelman,et al.  Construction site image retrieval based on material cluster recognition , 2006, Adv. Eng. Informatics.

[41]  Hongye Su,et al.  Forecasting building energy consumption with hybrid genetic algorithm-hierarchical adaptive network-based fuzzy inference system , 2010 .

[42]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[43]  Tzuu-Hseng S. Li,et al.  Construction of a neuron-fuzzy classification model based on feature-extraction approach , 2011, Expert Syst. Appl..

[44]  Manolis I. A. Lourakis,et al.  Automated as-built 3D reconstruction of civil infrastructure using computer vision: Achievements, opportunities, and challenges , 2015, Adv. Eng. Informatics.

[45]  Behdad Moghtaderi,et al.  A neuro–fuzzy model for prediction of the indoor temperature in typical Australian residential buildings , 2009 .

[46]  Yahachiro Tsukamoto,et al.  AN APPROACH TO FUZZY REASONING METHOD , 1993 .

[47]  Ioannis K. Brilakis,et al.  A videogrammetric as-built data collection method for digital fabrication of sheet metal roof panels , 2013, Adv. Eng. Informatics.

[48]  Nhat-Duc Hoang,et al.  Predicting Colonization Growth of Algae on Mortar Surface with Artificial Neural Network , 2016, J. Comput. Civ. Eng..

[49]  Hyun-Sang Choi,et al.  BIM perspective definition metadata for interworking facility management data , 2015, Adv. Eng. Informatics.

[50]  Farhad Samadzadegan,et al.  Automatic 3D object recognition and reconstruction based on neuro-fuzzy modelling , 2005 .

[51]  Ömer Akin,et al.  Shadowing tradespeople: Inefficiency in maintenance fieldwork , 2009 .

[52]  Paul Fieguth,et al.  Neuro-fuzzy network for the classification of buried pipe defects , 2006 .

[53]  M. Sugeno,et al.  Structure identification of fuzzy model , 1988 .

[54]  Frédéric Bosché,et al.  The value of integrating Scan-to-BIM and Scan-vs-BIM techniques for construction monitoring using laser scanning and BIM: The case of cylindrical MEP components , 2015 .