Semi-automatic geometric digital twinning for existing buildings based on images and CAD drawings

Abstract Despite the emerging new data capturing technologies and advanced modelling systems, the process of geometric digital twin modelling for existing buildings still lacks a systematic and completed framework to streamline. As-is Building Information Model (BIM) is one of the commonly used geometric digital twin modelling approaches. However, the process of as-is BIM construction is time-consuming and needed to improve. To address this challenge, in this paper, a semi-automatic approach is developed to establish a systematic, accurate and convenient digital twinning system based on images and CAD drawings. With this ultimate goal, this paper summarises the state-of-the-art geometric digital twinning methods and elaborates on the methodological framework of this semi-automatic geometric digital twinning approach. The framework consists of three modules. The Building Framework Construction and Geometry Information Extraction (Module 1) defines the locations of each structural component through recognising special symbols in a floor plan and then extracting data from CAD drawings using the Optical Character Recognition (OCR) technology. Meaningful text information is further filtered based on predefined rules. In order to integrate with completed building information, the Building Information Complementary (Module 2) is developed based on neuro-fuzzy system (NFS) and the image processing procedure to supplement additional building components. Finally, the Information Integration and IFC Creation (Module 3) integrates information from Module 1 and 2 and creates as-is Industry Foundation Classes (IFC) BIM based on IFC schema. A case study using part of an office building and the results of its analysis are provided and discussed from the perspectives of applicability and accuracy. Future works and limitations are also addressed.

[1]  Brenda McCabe,et al.  Part based model and spatial–temporal reasoning to recognize hydraulic excavators in construction images and videos , 2012 .

[2]  Youngjib Ham,et al.  An automated vision-based method for rapid 3D energy performance modeling of existing buildings using thermal and digital imagery , 2013, Adv. Eng. Informatics.

[3]  FathiHabib,et al.  Automated as-built 3D reconstruction of civil infrastructure using computer vision , 2015 .

[4]  Manolis I. A. Lourakis,et al.  Automated as-built 3D reconstruction of civil infrastructure using computer vision: Achievements, opportunities, and challenges , 2015, Adv. Eng. Informatics.

[5]  Burcu Akinci,et al.  Technological assessment and process implications of field data capture technologies for construction and facility/infrastructure management , 2008, J. Inf. Technol. Constr..

[6]  Brenda McCabe,et al.  Automated Visual Recognition of Dump Trucks in Construction Videos , 2012, J. Comput. Civ. Eng..

[7]  Liang Yuan,et al.  Time and cost analysis of geometric quality assessment of structural columns based on 3D terrestrial laser scanning , 2020 .

[8]  D. Chua,et al.  IFC-Based Graph Data Model for Topological Queries on Building Elements , 2015, J. Comput. Civ. Eng..

[9]  Nan Yu.  Information Interoperability between Building Information Modeling Authoring Tools and Simulation Tools to Support Energy Efficient Building Design , 2014 .

[10]  Burcu Akinci,et al.  A formalism for utilization of sensor systems and integrated project models for active construction quality control , 2006 .

[11]  Ioannis Brilakis,et al.  Digital twinning of existing reinforced concrete bridges from labelled point clusters , 2019, Automation in Construction.

[12]  Daniel Huber,et al.  Using Context to Create Semantic 3D Models of Indoor Environments , 2010, BMVC.

[13]  Ling Shao,et al.  Building recognition in urban environments: A survey of state-of-the-art and future challenges , 2014, Inf. Sci..

[14]  Thomas H. Kolbe,et al.  Conceptual Requirements for the Automatic Reconstruction of Building Information Models from Uninterpreted 3D Models , 2009 .

[15]  Farhad Samadzadegan,et al.  Automatic 3D object recognition and reconstruction based on neuro-fuzzy modelling , 2005 .

[16]  Wen-der Yu,et al.  Content-based text mining technique for retrieval of CAD documents , 2013 .

[17]  Andrey Dimitrov,et al.  Vision-based material recognition for automated monitoring of construction progress and generating building information modeling from unordered site image collections , 2014, Adv. Eng. Informatics.

[18]  Kire Trivodaliev,et al.  A review of Internet of Things for smart home: Challenges and solutions , 2017 .

[19]  Maurice Murphy,et al.  Semi-automatic generation of as-built BIM façade geometry from laser and image data , 2014, J. Inf. Technol. Constr..

[20]  Enrique Valero,et al.  Automatic Construction of 3D Basic-Semantic Models of Inhabited Interiors Using Laser Scanners and RFID Sensors , 2012, Sensors.

[21]  Francisco R. Feito-Higueruela,et al.  Semiautomatic detection of floor topology from CAD architectural drawings , 2012, Comput. Aided Des..

[22]  DimitrovAndrey,et al.  Non-Uniform B-Spline Surface Fitting from Unordered 3D Point Clouds for As-Built Modeling , 2016 .

[23]  Ioannis K. Brilakis,et al.  Automated vision tracking of project related entities , 2011, Adv. Eng. Informatics.

[24]  Eric M. Wetzel,et al.  The use of a BIM-based framework to support safe facility management processes , 2015 .

[25]  Changmin Kim,et al.  Classification of major construction materials in construction environments using ensemble classifiers , 2014, Adv. Eng. Informatics.

[26]  Juan D. Tardós,et al.  Probabilistic Semi-Dense Mapping from Highly Accurate Feature-Based Monocular SLAM , 2015, Robotics: Science and Systems.

[27]  Sylvain Robert,et al.  Automatic reconstruction of 3D building models from scanned 2D floor plans , 2016 .

[28]  Burcu Akinci,et al.  Symbol recognition using vectorial signature matching for building mechanical drawings , 2019 .

[29]  Sanghoon Lee,et al.  Image-Based Technologies for Constructing As-Is Building Information Models for Existing Buildings , 2017, J. Comput. Civ. Eng..

[30]  Long Chen,et al.  Image-driven fuzzy-based system to construct as-is IFC BIM objects , 2018, Automation in Construction.

[31]  Ioannis Brilakis,et al.  Progressive 3D reconstruction of infrastructure with videogrammetry , 2011 .

[32]  Andrey Dimitrov,et al.  Non‐Uniform B‐Spline Surface Fitting from Unordered 3D Point Clouds for As‐Built Modeling , 2016, Comput. Aided Civ. Infrastructure Eng..

[33]  Burcu Akinci,et al.  Modeling and analyzing the impact of technology on data capture and transfer processes at construction sites: A case study , 2006 .

[34]  Tiantian Guo,et al.  An improved example-driven symbol recognition approach in engineering drawings , 2012, Comput. Graph..

[35]  Manolis I. A. Lourakis,et al.  Toward automated generation of parametric BIMs based on hybrid video and laser scanning data , 2010, Adv. Eng. Informatics.

[36]  Osama Moselhi,et al.  Integrating 3D laser scanning and photogrammetry for progress measurement of construction work , 2008 .

[37]  Mani Golparvar-Fard,et al.  Mapping actual thermal properties to building elements in gbXML-based BIM for reliable building energy performance modeling , 2015 .

[38]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[39]  H. Son,et al.  Automated Color Model-Based Concrete Detection in Construction-Site Images by Using Machine Learning Algorithms , 2012, J. Comput. Civ. Eng..

[40]  Frédéric Bosché,et al.  Automated recognition of 3D CAD model objects in laser scans and calculation of as-built dimensions for dimensional compliance control in construction , 2010, Adv. Eng. Informatics.

[41]  Raja R. A. Issa,et al.  Nongeometric Building Information Needs Assessment for Facilities Management , 2016 .

[42]  Richard Szeliski,et al.  Reconstructing building interiors from images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[43]  Silvio Savarese,et al.  Application of D4AR - A 4-Dimensional augmented reality model for automating construction progress monitoring data collection, processing and communication , 2009, J. Inf. Technol. Constr..

[44]  Frank Schultmann,et al.  Building Information Modeling (BIM) for existing buildings — Literature review and future needs , 2014 .

[45]  Hyoungkwan Kim,et al.  Using Hue, Saturation, and Value Color Space for Hydraulic Excavator Idle Time Analysis , 2007 .

[46]  Christian Ah-Soon,et al.  A complete system for the analysis of architectural drawings , 2000, International Journal on Document Analysis and Recognition.

[47]  Burcu Akinci,et al.  Automatic Reconstruction of As-Built Building Information Models from Laser-Scanned Point Clouds: A Review of Related Techniques | NIST , 2010 .

[48]  Brenda McCabe,et al.  Automated computer vision-based detection of components of under-construction indoor partitions , 2017 .

[49]  Charles M. Eastman,et al.  BIM Handbook: A Guide to Building Information Modeling for Owners, Managers, Designers, Engineers and Contractors , 2008 .

[50]  Francisco Forns-Samso,et al.  PERCEIVED VALUE OF BUILDING INFORMATION MODELING IN FACILITIES OPERATIONS AND MAINTENANCE , 2011 .

[51]  Ioannis Brilakis,et al.  Parameter optimization for automated concrete detection in image data , 2010 .

[52]  E. Ergen,et al.  An Overview of Approaches for Utilizing RFID in Construction Industry , 2007, 2007 1st Annual RFID Eurasia.