Model Based Markerless 3D Tracking applied to Augmented Reality

This paper presents the implementation of 3D tracking techniques based on natural features for augmented reality. The contemplated techniques are from the model based category, comprising recursive and non-recursive methods, as well as edge and texture based techniques. An evaluation of the implemented 3D trackers was performed regarding performance and accuracy under different scenarios.

[1]  Markus Ulrich,et al.  Recognition and Tracking of 3D Objects , 2008, DAGM-Symposium.

[2]  Vincent Lepetit,et al.  Stable real-time 3D tracking using online and offline information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Gregory D. Hager,et al.  Fast and Globally Convergent Pose Estimation from Video Images , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Alex Pentland,et al.  Motion regularization for model-based head tracking , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[5]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[6]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[7]  Vincent Lepetit,et al.  Monocular Model-Based 3D Tracking of Rigid Objects: A Survey , 2005, Found. Trends Comput. Graph. Vis..

[8]  Veronica Teichrieb,et al.  A CUDA-enabled KLT Tracker for High Definition Images , 2009 .

[9]  Bruce H. Thomas,et al.  Emerging technologies of augmented reality - interfaces and design , 2006 .

[10]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[11]  Michel Dhome,et al.  A simple and efficient template matching algorithm , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[12]  Patrick Bouthemy,et al.  A Maximum Likelihood Framework for Determining Moving Edges , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Dieter Schmalstieg,et al.  ARToolKitPlus for Pose Trackin on Mobile Devices , 2007 .

[14]  Vincent Lepetit,et al.  Combining edge and texture information for real-time accurate 3D camera tracking , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[15]  Vincent Lepetit,et al.  Accurate Non-Iterative O(n) Solution to the PnP Problem , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[16]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[17]  Veronica Teichrieb,et al.  Experiences on the Implementation of a 3D Reconstruction Pipeline , 2008 .

[18]  Didier Stricker,et al.  Adaptive line tracking with multiple hypotheses for augmented reality , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[19]  Tim Hauke Heibel,et al.  A mobile markerless AR system for maintenance and repair , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[20]  Yakup Genc,et al.  GPU-based Video Feature Tracking And Matching , 2006 .

[21]  Veronica Teichrieb,et al.  A Survey of Online Monocular Markerless Augmented Reality , 2007 .

[22]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[23]  James A. Ferwerda,et al.  Three varieties of realism in computer graphics , 2003, IS&T/SPIE Electronic Imaging.

[24]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[25]  David G. Lowe,et al.  Scene modelling, recognition and tracking with invariant image features , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[26]  Roger W. Brockett,et al.  Robotic manipulators and the product of exponentials formula , 1984 .

[27]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[28]  Éric Marchand,et al.  ViSP for visual servoing: a generic software platform with a wide class of robot control skills , 2005, IEEE Robotics & Automation Magazine.

[29]  J. Lima,et al.  APPLICATIONS IN ENGINEERING USING AUGMENTED REALITY TECHNOLOGY , 2008 .