How to augment the second image? Recovery of the translation scale in image to image registration

In this paper, we present an automatic pose estimation (6 DoF) technique to augment images using keyframes pre-registered to a CAD model. State of the art techniques recover the essential matrix (5 DoF) in an automatic manner, but include a manual step to align the image with the CAD reference system because the essential matrix does not provide the scale of the translation. We propose using planar structures to recover this scale automatically and to offer immediate augmentation. These techniques have been implemented in our augmented reality software. Qualitative tests are performed in an industrial environment.

[1]  Vincent Lepetit,et al.  Fully automated and stable registration for augmented reality applications , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[2]  Roberto Cipolla,et al.  Real-time tracking of complex structures with on-line camera calibration , 2002, Image Vis. Comput..

[3]  Mark Fiala,et al.  ARTag, a fiducial marker system using digital techniques , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Nassir Navab,et al.  CyliCon: a software platform for the creation and update of virtual factories , 1999, 1999 7th IEEE International Conference on Emerging Technologies and Factory Automation. Proceedings ETFA '99 (Cat. No.99TH8467).

[5]  Fabian Doil,et al.  Augmented Reality-based factory planning - an application tailored to industrial needs , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[6]  Didier Stricker,et al.  Identifying differences between CAD and physical mock-ups using AR , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[7]  Nassir Navab,et al.  Scene augmentation via the fusion of industrial drawings and uncalibrated images with a view to marker-less calibration , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[8]  Vincent Lepetit,et al.  Stable real-time 3D tracking using online and offline information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Tim Hauke Heibel,et al.  A mobile markerless AR system for maintenance and repair , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[10]  Nassir Navab,et al.  An Industrial Augmented Reality Solution For Discrepancy Check , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[11]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.