Automatic structural scene digitalization

In this paper, we present an automatic system for the analysis and labeling of structural scenes, floor plan drawings in Computer-aided Design (CAD) format. The proposed system applies a fusion strategy to detect and recognize various components of CAD floor plans, such as walls, doors, windows and other ambiguous assets. Technically, a general rule-based filter parsing method is fist adopted to extract effective information from the original floor plan. Then, an image-processing based recovery method is employed to correct information extracted in the first step. Our proposed method is fully automatic and real-time. Such analysis system provides high accuracy and is also evaluated on a public website that, on average, archives more than ten thousands effective uses per day and reaches a relatively high satisfaction rate.

[1]  Marcus Liwicki,et al.  a.SCAtch - A Sketch-Based Retrieval for Architectural Floor Plans , 2010, 2010 12th International Conference on Frontiers in Handwriting Recognition.

[2]  Wenbin Li,et al.  Dense Motion Estimation for Smoke , 2016, ACCV.

[3]  Philippe Dosch,et al.  Reconstruction of the 3D structure of a building from the 2D drawings of its floors , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[4]  Yasuhiro Aoki,et al.  A prototype system for interpreting hand-sketched floor plans , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[5]  Dov Dori,et al.  Sparse Pixel Vectorization: An Algorithm and Its Performance Evaluation , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Ernest Valveny,et al.  A system to detect rooms in architectural floor plan images , 2010, DAS '10.

[7]  Wenbin Li,et al.  Nonrigid Optical Flow Ground Truth for Real-World Scenes With Time-Varying Shading Effects , 2017, IEEE Robotics and Automation Letters.

[8]  Peter Wonka,et al.  Generating 3D Building Models from Architectural Drawings: A Survey , 2009, IEEE Computer Graphics and Applications.

[9]  Kin Hong Wong,et al.  Highly Automatic Approach to Architectural Floorplan Image Understanding & Model Generation , 2005 .

[10]  Tong Lu,et al.  Automatic analysis and integration of architectural drawings , 2007, International Journal of Document Analysis and Recognition (IJDAR).

[11]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[12]  Carlo H. Séquin,et al.  Generation of 3D building models from 2D architectural plans , 1998, Comput. Aided Des..

[13]  Wenbin Li,et al.  Video interpolation using optical flow and Laplacian smoothness , 2016, Neurocomputing.

[14]  Wenbin Li,et al.  Dense Nonrigid Ground Truth for Optical Flow in Real-World Scenes , 2016, ArXiv.

[15]  Wenbin Li,et al.  Drift robust non-rigid optical flow enhancement for long sequences , 2016, J. Intell. Fuzzy Syst..

[16]  Karl Tombre,et al.  Robust and accurate vectorization of line drawings , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  D. Cosker,et al.  Global Alignment for Dynamic 3 D Morphable Model Construction , 2012 .

[18]  Christian Ah-Soon,et al.  Architectural symbol recognition using a network of constraints , 2001, Pattern Recognit. Lett..

[19]  Yan Luo,et al.  Engineering Drawings Recognition Using a Case-based Approach , 2003, ICDAR.

[20]  Ching Y. Suen,et al.  Thinning Methodologies - A Comprehensive Survey , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Wenbin Li,et al.  Optical Flow Estimation Using Laplacian Mesh Energy , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Wenbin Li.  Nonrigid surface tracking, analysis and evaluation , 2013 .

[23]  Gang Ren,et al.  Robust optical flow estimation for continuous blurred scenes using RGB-motion imaging and directional filtering , 2014, IEEE Winter Conference on Applications of Computer Vision.

[24]  Gang Ren,et al.  Blur robust optical flow using motion channel , 2016, Neurocomputing.

[25]  Wenbin Li,et al.  Learn to model blurry motion via directional similarity and filtering , 2018, Pattern Recognit..

[26]  Gang Ren,et al.  Towards the design of effective freehand gestural interaction for interactive TV , 2016, J. Intell. Fuzzy Syst..

[27]  Christian Ah-Soon,et al.  A complete system for the analysis of architectural drawings , 2000, International Journal on Document Analysis and Recognition.

[28]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[29]  George Baciu,et al.  Reconstruction of 3D virtual buildings from 2D architectural floor plans , 1998, VRST '98.

[30]  Reinhard Klein,et al.  The Room Connectivity Graph: Shape Retrieval in the Architectural Domain , 2008 .

[31]  Jaime López-Krahe,et al.  A system to understand hand-drawn floor plans using subgraph isomorphism and Hough transform , 1997, Machine Vision and Applications.

[32]  Su Yang.  Symbol Recognition via Statistical Integration of Pixel-Level Constraint Histograms: A New Descriptor , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Marcus Liwicki,et al.  Improved Automatic Analysis of Architectural Floor Plans , 2011, 2011 International Conference on Document Analysis and Recognition.

[34]  G. McLachlan,et al.  Pattern Classification: A Unified View of Statistical and Neural Approaches. , 1998 .

[35]  Jürgen Schürmann,et al.  Pattern classification , 2008 .

[36]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[37]  Wenbin Li,et al.  An Anchor Patch Based Optimization Framework for Reducing Optical Flow Drift in Long Image Sequences , 2012, ACCV.

[38]  Wenbin Li,et al.  Roto++ , 2016, ACM Trans. Graph..

[39]  Wenbin Li,et al.  Virtual reality geographical interactive scene semantics research for immersive geography learning , 2017, Neurocomputing.

[40]  Ernest Valveny,et al.  A model for image generation and symbol recognition through the deformation of lineal shapes , 2003, Pattern Recognit. Lett..