Review: reconstruction of 3D building information models from 2D scanned plans

Abstract 3D digital modeling, Building Information Modeling (BIM) and numerical simulation are widely recognized as essential components of building design support tools, but require a significant amount of digital data to truly achieve their potential. Currently, they are mostly applied in the design and construction of new buildings but rarely in renovation projects, since few digital data are available for the majority of existing buildings. It is therefore urgent to devise reliable and effective approaches to the generation of 3D digital (BIM) models of existing buildings. This recognition is widely shared and has resulted in a substantial amount of research work and significant innovations in various fields: 3D laser scanning, images processing, etc. With the aim of bringing some significant contribution to this state-of-the-art, this paper provides a critical review of the methods and tools for generating 3D building models from 2D drawings, developing along two complementary lines: a wide-spectrum assessment of 3D generation techniques, and a more focused, in-depth review of 2D drawings-based approaches (from image processing to BIM creation and validation). The review follows a well-defined methodology and builds on the work of more than 100 relevant references. It includes substantial discussions to highlight the strengths, weaknesses and preferential applications of the reviewed research works, and provides a research agenda. The study particularly highlights that the state-of-the-art is fragmented: most research works focus on specific, limited steps of the 3D models generation process, but no solution has yet been able to tackle the whole generation chain. An additional conclusion is that the selection of the most effective approach largely depends on the intended application, and on project-specific constraints. Also, the study highlights that significant benefits could be drawn from combining existing approaches.

[1]  Tong Lu,et al.  Automatic analysis and integration of architectural drawings , 2007, International Journal of Document Analysis and Recognition (IJDAR).

[2]  Frank Schultmann,et al.  Building Information Modeling (BIM) for existing buildings — Literature review and future needs , 2014 .

[3]  Jane Matthews,et al.  A study of BIM collaboration requirements and available features in existing model collaboration systems , 2013, J. Inf. Technol. Constr..

[4]  Peng Gao,et al.  A hybrid decision support system for sustainable office building renovation and energy performance improvement , 2010 .

[5]  Shijie Cai,et al.  Line net global vectorization: an algorithm and its performance evaluation , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  Yves Bertrand,et al.  Consistency constraints and 3D building reconstruction , 2009, Comput. Aided Des..

[7]  Ernest Valveny,et al.  A Platform to Extract Knowledge from Graphic Documents. Application to an Architectural Sketch Understanding Scenario , 2004, Document Analysis Systems.

[8]  Charles M. Eastman,et al.  Automatic rule-based checking of building designs , 2009 .

[9]  Liping Yang,et al.  A navigation ontology for outdoor-indoor space: (work-in-progress) , 2011, ISA '11.

[10]  Jakob Beetz,et al.  Check-mate: Automatic constraint checking of IFC models , 2009 .

[11]  Eilif Hjelseth,et al.  EXPLORING SEMANTIC BASED MODEL CHECKING , 2010 .

[12]  Achraf Ghorbel Interprétation interactive de documents structurés : application à la rétroconversion de plans d'architecture manuscrits. (Interactive interpretation of structured documents: application to the retro-conversion of handwritten architectural plans) , 2012 .

[13]  Andrey Dimitrov,et al.  Vision-based material recognition for automated monitoring of construction progress and generating building information modeling from unordered site image collections , 2014, Adv. Eng. Informatics.

[14]  Burcu Akinci,et al.  Automatic Creation of Semantically Rich 3D Building Models from Laser Scanner Data , 2013 .

[15]  Bisheng Yang,et al.  Hierarchical extraction of urban objects from mobile laser scanning data , 2015 .

[16]  G. S. Zhi,et al.  Graph theory-based approach for automatic recognition of CAD data , 2008, Eng. Appl. Artif. Intell..

[17]  Brian Okorn,et al.  Methods for Automatically Modeling and Representing As-built Building Information Models , 2011 .

[18]  Pierre Leclercq,et al.  A freehand-sketch environment for architectural design supported by a multi-agent system , 2005, Comput. Graph..

[19]  Shutao Li,et al.  Proposed Methodology for Generation of Building Information Model with Laserscanning , 2008 .

[20]  Jari Puttonen,et al.  The development of constructability using BIM as an intensifying technology , 2012 .

[21]  Jimmie Hinze,et al.  Integration of Safety in Design through the Use of Building Information Modeling , 2011 .

[22]  Charles M. Eastman,et al.  Benchmark tests for BIM data exchanges of precast concrete , 2009 .

[23]  Stéphane Safin,et al.  Errors in architectural design process : towards a cognitive model. , 2008 .

[24]  Peter Wonka,et al.  Generating 3D Building Models from Architectural Drawings: A Survey , 2009, IEEE Computer Graphics and Applications.

[25]  Philip David,et al.  Building facade detection, segmentation, and parameter estimation for mobile robot stereo vision , 2013, Image Vis. Comput..

[26]  Shijie Cai,et al.  A Vectorization System for Architecture Engineering Drawings , 2005, GREC.

[27]  Christian Ah-Soon,et al.  Architectural symbol recognition using a network of constraints , 2001, Pattern Recognit. Lett..

[28]  Tong Lu,et al.  A new recognition model for electronic architectural drawings , 2005, Comput. Aided Des..

[29]  H. Son,et al.  Automated Color Model-Based Concrete Detection in Construction-Site Images by Using Machine Learning Algorithms , 2012, J. Comput. Civ. Eng..

[30]  Bart Lamiroy,et al.  Text/Graphics Separation Revisited , 2002, Document Analysis Systems.

[31]  Karl Tombre,et al.  Robust and accurate vectorization of line drawings , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Carlo H. Séquin,et al.  Generation of 3D building models from 2D architectural plans , 1998, Comput. Aided Des..

[33]  Norbert Haala,et al.  An update on automatic 3D building reconstruction , 2010 .

[34]  Ernest Valveny,et al.  Application of deformable template matching to symbol recognition in handwritten architectural drawings , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[35]  Ernest Valveny,et al.  Statistical segmentation and structural recognition for floor plan interpretation , 2013, International Journal on Document Analysis and Recognition (IJDAR).

[36]  Pierre Leclercq,et al.  Evaluation des échanges au format IFC dans le cadre de la réglementation thermique , 2012 .

[37]  Charles M. Eastman,et al.  Building Information Modeling (BIM) and Safety: Automatic Safety Checking of Construction Models and Schedules , 2013 .

[38]  Stéphane Safin,et al.  Du crayon au stylo numérique: influences des interprétations numériques sur l'activité graphique en tâches de conception , 2008, IHM '08.

[39]  Hua Lu,et al.  ISA 2011 Workshop Report: a report on the Third International Workshop on Indoor Spatial Awareness: (Chicago, Illinois - November 1, 2011) , 2012, SIGSPACIAL.

[40]  Alexander Koutamanis,et al.  Automated recognition of architectural drawings , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[41]  Nuria Aleixos,et al.  A new paradigm based on agents applied to free-hand sketch recognition , 2012, Expert Syst. Appl..

[42]  E. Rank,et al.  Spatial constraints in collaborative design processes , 2009 .

[43]  Marcus Liwicki,et al.  a.SCatch: Semantic Structure for Architectural Floor Plan Retrieval , 2010, ICCBR.

[44]  Taejung Kim,et al.  Development of a graph-based approach for building detection , 1999, Image Vis. Comput..

[45]  Vladlen Koltun,et al.  Computer-generated residential building layouts , 2010, SIGGRAPH 2010.

[46]  Soon Ki Jung,et al.  Practical modeling technique for large-scale 3D building models from ground images , 2009, Pattern Recognit. Lett..

[47]  Michael F. Worboys,et al.  Modeling indoor space , 2011, ISA '11.

[48]  Francisco R. Feito-Higueruela,et al.  Semiautomatic detection of floor topology from CAD architectural drawings , 2012, Comput. Aided Des..

[49]  Christophe Cruz,et al.  Active3D: vector of collaboration, between sharing and data exchange , 2015 .

[50]  Rangachar Kasturi,et al.  A Robust Algorithm for Text String Separation from Mixed Text/Graphics Images , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[51]  Christine Alvarado,et al.  SketchREAD: a multi-domain sketch recognition engine , 2004, UIST '04.

[52]  Christian Ah-Soon,et al.  A complete system for the analysis of architectural drawings , 2000, International Journal on Document Analysis and Recognition.

[53]  Burcu Akinci,et al.  Automatic Reconstruction of As-Built Building Information Models from Laser-Scanned Point Clouds: A Review of Related Techniques | NIST , 2010 .

[54]  Maurice Murphy,et al.  Semi-automatic generation of as-built BIM façade geometry from laser and image data , 2014, J. Inf. Technol. Constr..

[55]  Dong-Chul Park,et al.  Stereoscopic Modeling of Building Rooftop from IKONOS Satellite Image Data , 2011, 2011 International Conference on Information Science and Applications.

[56]  Yasuhiro Aoki,et al.  Sketch Plan: A prototype system for interpreting hand-sketched floor plans , 2000 .

[57]  Yacine Rezgui,et al.  Past, present and future of information and knowledge sharing in the construction industry: Towards semantic service-based e-construction? , 2011, Comput. Aided Des..

[58]  Mani Golparvar-Fard,et al.  Segmentation of building point cloud models including detailed architectural/structural features and MEP systems , 2015 .

[59]  Catherine Faron-Zucker,et al.  Towards the Knowledge Capitalisation and Organisation in the Model of Conformity-Checking Process in Construction , 2008, KES.

[60]  Jim Steel,et al.  Model interoperability in building information modelling , 2009, Software & Systems Modeling.

[61]  Josiane Zerubia,et al.  Automatic Building Extraction from DEMs using an Object Approach and Application to the 3D-city Modeling , 2008 .

[62]  Viviana Mascardi,et al.  Reasoning about Hand-Drawn Sketches: An Approach Based on Intelligent Software Agents , 2008, VISUAL.

[63]  Robin Drogemuller,et al.  Automating code checking for building designs -DesignCheck , 2006 .

[64]  Rudi Goossens,et al.  3D building reconstruction based on given ground plan information and surface models extracted from spaceborne imagery , 2012 .

[65]  Dov Dori,et al.  Sparse Pixel Vectorization: An Algorithm and Its Performance Evaluation , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[66]  Joachim Hertzberg,et al.  Towards semantic maps for mobile robots , 2008, Robotics Auton. Syst..

[67]  Ernest Valveny,et al.  A system to detect rooms in architectural floor plan images , 2010, DAS '10.

[68]  S. M. Lo,et al.  A graph-based algorithm for extracting units and loops from architectural floor plans for a building evacuation model , 2003, Comput. Aided Des..

[69]  Fabio Remondino,et al.  Image‐based 3D Modelling: A Review , 2006 .

[70]  Anil K. Jain,et al.  Text information extraction in images and video: a survey , 2004, Pattern Recognit..

[71]  O. Tournaire,et al.  Extracting polygonal building footprints from digital surface models: A fully-automatic global optimization framework , 2013 .

[72]  Mohamed El-Mekawy,et al.  An Evaluation of IFC-CityGML Unidirectional Conversion , 2012 .

[73]  DoriDov,et al.  Sparse Pixel Vectorization , 1999 .

[74]  Luis Pérez-Lombard,et al.  A review on buildings energy consumption information , 2008 .

[75]  C. Fraser,et al.  Automatic extraction of building roofs using LIDAR data and multispectral imagery , 2013 .

[76]  Nikos Paragios,et al.  High-Level Bottom-Up Cues for Top-Down Parsing of Facade Images , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[77]  Lutz Plümer,et al.  CityGML – Interoperable semantic 3D city models , 2012 .

[78]  Christophe Cruz,et al.  Architectural Reconstruction of 3D Building Objects through Semantic Knowledge Management , 2010, 2010 11th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing.

[79]  Doo Young Kwon,et al.  Real-time management of spatial information of design: A space-based floor plan representation of buildings , 2007 .

[80]  Tong Lu,et al.  3D Reconstruction of Detailed Buildings from Architectural Drawings , 2005 .

[81]  Konrad Schindler,et al.  A model-based method for building reconstruction , 2003, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[82]  Ernest Valveny,et al.  Wall Patch-Based Segmentation in Architectural Floorplans , 2011, 2011 International Conference on Document Analysis and Recognition.

[83]  Laurent Couvreur,et al.  An Agent-Based Multimodal Interface for Sketch Interpretation , 2006, 2006 IEEE Workshop on Multimedia Signal Processing.

[84]  Jaehwa Park,et al.  Main Wall Recognition of Architectural Drawings Using Dimension Extension Line , 2003, GREC.

[85]  Marcus Liwicki,et al.  Improved Automatic Analysis of Architectural Floor Plans , 2011, 2011 International Conference on Document Analysis and Recognition.

[86]  Marcus Liwicki,et al.  Automatic analysis and sketch-based retrieval of architectural floor plans , 2014, Pattern Recognit. Lett..

[87]  Ernest Valveny,et al.  Symbol Recognition: Current Advances and Perspectives , 2001, GREC.

[88]  Jim Steel,et al.  A Transformation Workbench for Building Information Models , 2011, ICMT@TOOLS.

[89]  Q. Z. Yang,et al.  Design knowledge modeling and software implementation for building code compliance checking , 2004 .

[90]  Tiantian Guo,et al.  An improved example-driven symbol recognition approach in engineering drawings , 2012, Comput. Graph..

[91]  Harry Shum,et al.  Sketching reality: Realistic interpretation of architectural designs , 2008, TOGS.

[92]  Dov Dori,et al.  From Raster to Vectors: Extracting Visual Information from Line Drawings , 1999, Pattern Analysis & Applications.

[93]  Ling Shao,et al.  Building recognition in urban environments: A survey of state-of-the-art and future challenges , 2014, Inf. Sci..

[94]  Ireneusz Czmoch,et al.  Traditional Design versus BIM Based Design , 2014 .