A New 3D Model-Based Tracking Technique for Robust Camera Pose Estimation

In this paper we present a new robust camera pose estimation approach based on 3D lines features. The proposed method is well adapted for mobile augmented reality applications We used an Extended Kalman Filter (EKF) to incrementally update the camera pose in real-time. The principal contributions of our method include first, the expansion of the RANSAC scheme in order to achieve a robust matching algorithm that associates 2D edges from the image with the 3D line segments from the input model. And second, a new powerful framework for camera pose estimation using only 2D-3D straight-lines within an EKF. Experimental results on real image sequences are presented to evaluate the performances and the feasibility of the proposed approach in indoor and outdoor environments.

[1]  Yaakov Bar-Shalom,et al.  Estimation and Tracking: Principles, Techniques, and Software , 1993 .

[2]  David G. Lowe,et al.  Fitting Parameterized Three-Dimensional Models to Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Amarnath Banerjee,et al.  An augmented-reality-based real-time panoramic vision system for autonomous navigation , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[4]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[5]  Bruce H. Thomas,et al.  Emerging technologies of augmented reality - interfaces and design , 2006 .

[6]  Didier Stricker,et al.  Adaptive line tracking with multiple hypotheses for augmented reality , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[7]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[8]  Vincenzo Lippiello,et al.  Adaptive extended Kalman filtering for visual motion estimation of 3D objects , 2007 .

[9]  Allen R. Hanson,et al.  Robust methods for estimating pose and a sensitivity analysis , 1994 .

[10]  Roberto Cipolla,et al.  Real-Time Visual Tracking of Complex Structures , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Xinhua Zhuang,et al.  Pose estimation from corresponding point data , 1989, IEEE Trans. Syst. Man Cybern..

[12]  Hongbin Zha,et al.  Coarse-to-fine vision-based localization by indexing scale-Invariant features , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Kin Hong Wong,et al.  Recursive Camera-Motion Estimation With the Trifocal Tensor , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  Ian D. Reid,et al.  Automatic Relocalisation for a Single-Camera Simultaneous Localisation and Mapping System , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[15]  William J. Wilson,et al.  Relative end-effector control using Cartesian position based visual servoing , 1996, IEEE Trans. Robotics Autom..

[16]  Avinash C. Kak,et al.  A New Approach to the Use of Edge Extremities for Model-based Object Tracking , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[17]  Radu Horaud,et al.  Object pose from 2-D to 3-D point and line correspondences , 1995, International Journal of Computer Vision.

[18]  Bradley M. Bell,et al.  The Iterated Kalman Smoother as a Gauss-Newton Method , 1994, SIAM J. Optim..

[19]  Seth J. Teller,et al.  Wide-Area Egomotion Estimation from Known 3D Structure , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  M. Mallem,et al.  Robust camera pose estimation combining 2D/3D points and lines tracking , 2008, 2008 IEEE International Symposium on Industrial Electronics.

[21]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[22]  Jean-Yves Didier,et al.  Vision-Based Tracking for Mobile Augmented Reality , 2008 .

[23]  Ulrich Neumann,et al.  Extendible tracking by line auto-calibration , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[24]  Éric Marchand,et al.  Real-time markerless tracking for augmented reality: the virtual visual servoing framework , 2006, IEEE Transactions on Visualization and Computer Graphics.

[25]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[27]  Larry S. Davis,et al.  Model-based object pose in 25 lines of code , 1992, International Journal of Computer Vision.

[28]  Gregory D. Hager,et al.  Fast and Globally Convergent Pose Estimation from Video Images , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Jean-Yves Didier,et al.  On the hybrid aid-localization for outdoor augmented reality applications , 2008, VRST '08.

[30]  Kin Hong Wong,et al.  Recursive three-dimensional model reconstruction based on Kalman filtering , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[31]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[32]  Michel Dhome,et al.  Determination of the Attitude of 3D Objects from a Single Perspective View , 1989, IEEE Trans. Pattern Anal. Mach. Intell..