An Industrial Augmented Reality Solution For Discrepancy Check

Construction companies employ CAD software during the planning phase, but what is finally built often does not match the original plan. The procedure of validating the model is called "discrepancy check". The system proposed here allows the user to easily obtain an augmentation in order to find differences between the planned 3D model and the built items. The main difference to previous body of work in this field is the emphasis on usability and acceptance of the solution. While standard image-based solutions use markers or rely on a "perfect" 3D model to find the pose of the camera, our software uses anchor-plates. Anchor-Plates are rectangular structures installed on walls and ceiling in the majority of industrial edifices. We are using them as landmarks because they are the most reliable components often used as reference coordinates by constructors. Furthermore, for real industrial applications, they are the most suitable solutions in terms of general applicability. Unfortunately, they have not been designed with computer vision applications in mind. On the contrary, they are often made or painted in such way that they are not easily popping out. They are therefore difficult targets to segment and to track. This paper proposes a solution to extract and match them to their 3D counterparts. We created a software that uses the detected structures for pose estimation and image augmentation. The software has been successfully employed to find discrepancies in several rooms of two industrial plants.

[1]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[2]  Olivier D. Faugeras,et al.  Determination of Camera Location from 2-D to 3-D Line and Point Correspondences , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Vincent Lepetit,et al.  Stable real-time 3D tracking using online and offline information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  N. Navab,et al.  3D reconstruction from co-registered orthographic and perspective images: theoretical framework and applications , 2002, Object recognition supported by user interaction for service robots.

[6]  Xiang Zhang Projection matrix decomposition in AR - a study with Access3D , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[7]  Nassir Navab,et al.  CyliCon: software package for 3D reconstruction of industrial pipelines , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[8]  Didier Stricker,et al.  Augmented reality for construction tasks: doorlock assembly , 1999 .

[9]  Tim Hauke Heibel,et al.  A mobile markerless AR system for maintenance and repair , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[10]  Gudrun Klinker,et al.  Augmented reality as a comparison tool in automotive industry , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[11]  Wen-Hsiang Tsai,et al.  Reliable Determination of Object Pose from Line Features by Hypothesis Testing , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Mark Fiala,et al.  ARTag, a fiducial marker system using digital techniques , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[14]  Stefan Nölle Stereo augmentation of simulation results on a projection wall by combining two basic ARVIKA systems , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[15]  M. Wagner Building wide-area applications with the ARToolkit , 2002, The First IEEE International Workshop Agumented Reality Toolkit,.

[16]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[17]  Nassir Navab,et al.  Scene augmentation via the fusion of industrial drawings and uncalibrated images with a view to marker-less calibration , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).