A Novel Knowledge-Based System for Interpreting Complex Engineering Drawings: Theory, Representation, and Implementation

We present a novel knowledge-based system to automatically convert real-life engineering drawings to content-oriented high-level descriptions. The proposed method essentially turns the complex interpretation process into two parts: knowledge representation and knowledge-based interpretation. We propose a new hierarchical descriptor-based knowledge representation method to organize the various types of engineering objects and their complex high-level relations. The descriptors are defined using an Extended Backus Naur Form (EBNF), facilitating modification and maintenance. When interpreting a set of related engineering drawings, the knowledge-based interpretation system first constructs an EBNF-tree from the knowledge representation file, then searches for potential engineering objects guided by a depth-first order of the nodes in the EBNF-tree. Experimental results and comparisons with other interpretation systems demonstrate that our knowledge-based system is accurate and robust for high-level interpretation of complex real-life engineering projects.

[1]  Karl Tombre,et al.  Robust and accurate vectorization of line drawings , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Jean Camillerapp,et al.  Access by content to handwritten archive documents: generic document recognition method and platform for annotations , 2007, International Journal of Document Analysis and Recognition (IJDAR).

[3]  Tong Lu,et al.  Automatic analysis and integration of architectural drawings , 2007, International Journal of Document Analysis and Recognition (IJDAR).

[4]  K. Tombre,et al.  CELESSTIN IV: knowledge-based analysis of mechanical engineering drawings , 1992, [Proceedings 1992] IEEE International Conference on Systems Engineering.

[5]  Dov Dori,et al.  Sparse Pixel Vectorization: An Algorithm and Its Performance Evaluation , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Karl Tombre.  Analysis of Engineering Drawings: State of the Art and Challenges , 1997, GREC.

[7]  S. M. Lo,et al.  A graph-based algorithm for extracting units and loops from architectural floor plans for a building evacuation model , 2003, Comput. Aided Des..

[8]  Sung-Bae Cho,et al.  Geometric Structure Analysis of Document Images: A Knowledge-Based Approach , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Dov Dori,et al.  Understanding Engineering Drawings: A Survey , 1995 .

[10]  Hiroshi Murase,et al.  Partial eigenvalue decomposition for large image sets using run-length encoding , 1995, Pattern Recognit..

[11]  Raymond W. Smith,et al.  Computer processing of line images: A survey , 1987, Pattern Recognit..

[12]  Dov Dori,et al.  Incremental Arc Segmentation Algorithm and Its Evaluation , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  James R. Gattiker,et al.  A System for Interpretation of Line Drawings , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Fuhua Lin,et al.  Syntactic interpretation approaches for innovative engineering drawings conversion support system , 1998 .

[15]  Shijie Cai,et al.  A Knowledge-Aided Line Network Oriented Vectorisation Method for Engineering Drawings , 2000, Pattern Analysis & Applications.

[16]  Tony P. Pridmore,et al.  Interpreting Line Drawing Images: A Knowledge Level Perspective , 2001, GREC.

[17]  Osamu Hori,et al.  Raster-to-vector conversion by line fitting based on contours and skeletons , 1993, Proceedings of 2nd International Conference on Document Analysis and Recognition (ICDAR '93).

[18]  Shijie Cai,et al.  Line net global vectorization: an algorithm and its performance evaluation , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[19]  Satyandra K. Gupta,et al.  A Survey of Shape Similarity Assessment Algorithms for Product Design and Manufacturing Applications , 2003, J. Comput. Inf. Sci. Eng..

[20]  David S. Doermann,et al.  A parallel-line detection algorithm based on HMM decoding , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Albert M. Vossepoel,et al.  Adaptive Vectorization of Line Drawing Images , 1997, Comput. Vis. Image Underst..

[22]  Richard Lepage,et al.  Knowledge-Based Image Understanding Systems: A Survey , 1997, Comput. Vis. Image Underst..

[23]  Qiang Ji,et al.  Machine interpretation of CAD data for manufacturing applications , 1997, CSUR.

[24]  Morakot Pilouk,et al.  Using local deviations of vectorization to enhance the performance of raster-to-vector conversion systems , 2000, International Journal on Document Analysis and Recognition.

[25]  Nicholas M. Patrikalakis,et al.  Knowledge-based interpretation of architectural drawings , 1992 .

[26]  Michael R. Lyu,et al.  Effective multiresolution arc segmentation: algorithms and performance evaluation , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Shijie Cai,et al.  An Object-Oriented Progressive-Simplification-Based Vectorization System for Engineering Drawings: Model, Algorithm, and Performance , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  John Y. Chiang,et al.  A New Algorithm For Line Image Vectorization , 1998, Pattern Recognit..

[29]  Ashok Samal,et al.  A system for recognizing a large class of engineering drawings , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[30]  Tong Lu,et al.  3D Reconstruction of Detailed Buildings from Architectural Drawings , 2005 .

[31]  Shijie Cai,et al.  Dimension recognition and geometry reconstruction in vectorization of engineering drawings , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[32]  Christian Ah-Soon,et al.  A complete system for the analysis of architectural drawings , 2000, International Journal on Document Analysis and Recognition.

[33]  Bertrand Coüasnon,et al.  Dealing with Noise in DMOS, a Generic Method for Structured Document Recognition: An Example on a Complete Grammar , 2003, GREC.

[34]  James V. Mahoney,et al.  Three main concerns in sketch recognition and an approach to addressing them , 2002 .

[35]  Joaquim A. Jorge,et al.  JavaSketchIt: Issues in Sketching the Look of User Interfaces , 2002 .

[36]  Tong Lu,et al.  A new recognition model for electronic architectural drawings , 2005, Comput. Aided Des..

[37]  Yong-Qing Cheng,et al.  A knowledge-based graphic description tool for understanding engineering drawings , 1990, [1990] Proceedings of the 2nd International IEEE Conference on Tools for Artificial Intelligence.

[38]  Yuan Chen,et al.  Perfecting Vectorized Mechanical Drawings , 1996, Comput. Vis. Image Underst..

[39]  Bertrand Coüasnon.  DMOS, a generic document recognition method: application to table structure analysis in a general and in a specific way , 2005, International Journal of Document Analysis and Recognition (IJDAR).

[40]  Oliver Bimber,et al.  A multi-layered architecture for sketch-based interaction within virtual environments , 2000, Comput. Graph..

[41]  Karl Tombre,et al.  Ten Years of Research in the Analysis of Graphics Documents: Achievements and Open Problems , 1998 .

[42]  Jean-Yves Ramel,et al.  Strategy for Line Drawing Understanding , 2003, GREC.

[43]  Tony P. Pridmore,et al.  Knowledge-Directed Interpretation of Mechanical Engineering Drawings , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  S. S. Pande,et al.  Intelligent interpretation of CADD drawings , 1999, Comput. Graph..