Tracking and pose estimation for computer assisted localization in industrial environments

One of the common needs for many real-time augmented reality (AR) applications is the precise 'localization'. Currently at Siemens Corporate Research (SCR), we are developing a real-time system for industrial maintenance assistance. The user is moving within a large industrial site. In order to provide the user with additional information the system needs to locate the user in both real and virtual world. In this scenario, the user is equipped with a mobile computer. The objective is to track and locate the user using a camera attached to the mobile computer. With a set of coded visual markers pre-registered with the global coordinate system, the optical localization could be solved by marker detection, tracking and pose estimation. In this paper, we present the real-time marker detection and pose estimation algorithms used in our mobile localization application. To work in large and complicated industrial environments, our system needs to recover localization information from limited correspondences. We consider two different pose estimation algorithms: the homography based algorithm and the 3-point algorithm. In this paper, we present the results of the numerical experiments comparing these two methods. The experiments are carried out to determine the best approach for our application and to evaluate the accuracy and limitations of the algorithms.

[1]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[2]  Suya You,et al.  Augmented Reality Tracking in Natural Environments , 1998 .

[3]  Kiriakos N. Kutulakos,et al.  Affine object representations for calibration-free augmented reality , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[4]  Ronald Azuma,et al.  A frequency-domain analysis of head-motion prediction , 1995, SIGGRAPH.

[5]  Nassir Navab,et al.  3D Reconstruction from Projection Matrices in a C-Arm Based 3D-Angiography System , 1998, MICCAI.

[6]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[7]  Alex Pentland,et al.  Augmented realities integrating user and physical models , 1999 .

[8]  Serge Beucher,et al.  Use of watersheds in contour detection , 1979 .

[9]  Kiriakos N. Kutulakos,et al.  Calibration-Free Augmented Reality , 1998, IEEE Trans. Vis. Comput. Graph..

[10]  Bill Triggs,et al.  Autocalibration from Planar Scenes , 1998, ECCV.

[11]  Nassir Navab,et al.  Scene augmentation via the fusion of industrial drawings and uncalibrated images with a view to marker-less calibration , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[12]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[13]  David E. Breen,et al.  Real-time vision-based camera tracking for augmented reality applications , 1997, VRST '97.

[14]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[15]  Nassir Navab,et al.  Merging visible and invisible: two Camera-Augmented Mobile C-arm (CAMC) applications , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[16]  Nassir Navab,et al.  E-commerce direct marketing using augmented reality , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[17]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[18]  Andrew W. Fitzgibbon,et al.  Real-time Panoramic Mosaics and Augmented Reality , 1998, BMVC.

[19]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[20]  Olivier Faugeras,et al.  Three-Dimensional Computer Vision , 1993 .

[21]  Alex Pentland,et al.  Stochasticks: augmenting the billiards experience with probabilistic vision and wearable computers , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[22]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  David W. Murray,et al.  Active Camera Calibration for a Head-Eye Platform Using the Variable State-Dimension Filter , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Andrew Zisserman,et al.  Robust Object Tracking , 2001 .

[25]  Ulrich Neumann,et al.  Vision-based pose computation: robust and accurate augmented reality tracking , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).