Parsing floor plan images

This paper introduces a method for analyzing floor plan images using wall segmentation, object detection, and optical character recognition. We introduce a challenging new real-estate floor plan dataset, R-FP, evaluate different wall segmentation methods, and propose fully convolutional networks (FCN) for this task. We explore architectures with different pixel-stride values and more compact ones with skipped pooling layers. An FCN-2s with a 2-pixel stride layer achieves state-of-the-art performance, obtaining a mean Intersection-over-Union score of 89.9% on R-FP, and 94.4% on the public CVC-FP data set. Using OCR and object detection, we estimate room sizes. Finally, we show applications in automatic 3D model building and interactive furniture fitting.

[1]  Kincho H. Law,et al.  Knowledge-Based Creation of an Architectural 3-D Model from 2-D Drawings , 1993 .

[2]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[3]  Christian Ah-Soon,et al.  A complete system for the analysis of architectural drawings , 2000, International Journal on Document Analysis and Recognition.

[4]  Oriol Ramos Terrades,et al.  CVC-FP and SGT: a new database for structural floor plan analysis and its groundtruthing tool , 2014, International Journal on Document Analysis and Recognition (IJDAR).

[5]  Ernest Valveny,et al.  Statistical segmentation and structural recognition for floor plan interpretation , 2013, International Journal on Document Analysis and Recognition (IJDAR).

[6]  Ernest Valveny,et al.  A system to detect rooms in architectural floor plan images , 2010, DAS '10.

[7]  Peter Wonka,et al.  Generating 3D Building Models from Architectural Drawings: A Survey , 2009, IEEE Computer Graphics and Applications.

[8]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jean-Laurent Hippolyte,et al.  Review: reconstruction of 3D building information models from 2D scanned plans , 2015 .

[10]  Marcus Liwicki,et al.  Automatic Room Detection and Room Labeling from Architectural Floor Plans , 2012, 2012 10th IAPR International Workshop on Document Analysis Systems.

[11]  Ernest Valveny,et al.  Unsupervised Wall Detector in Architectural Floor Plans , 2013, 2013 12th International Conference on Document Analysis and Recognition.

[12]  Carlo H. Séquin,et al.  Generation of 3D building models from 2D architectural plans , 1998, Comput. Aided Des..

[13]  한보형,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015 .

[14]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Sylvain Robert,et al.  Automatic reconstruction of 3D building models from scanned 2D floor plans , 2016 .