An adaptive training-free feature tracker for mobile phones

While tracking technologies based on fiducial markers have dominated the development of Augmented Reality (AR) applications for almost a decade, various real-time capable approaches to markerless tracking have recently been presented. However, most existing approaches do not yet achieve sufficient frame rates for AR on mobile phones or at least require an extensive training phase in advance. In this paper we will present our approach on feature based tracking applying robust SURF features. The implementation is more than one magnitude faster than previous ones, allowing running even on mobile phones at highly interactive rates. In contrast to other feature based approaches on mobile phones, our implementation may immediately track features captured from a photo without any training. Further, the approach is not restricted to planar surfaces, but may use features of 3D objects.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  Dieter Schmalstieg,et al.  Real-Time Detection and Tracking for Augmented Reality on Mobile Phones , 2010, IEEE Transactions on Visualization and Computer Graphics.

[3]  Rod McCall,et al.  TimeWarp: interactive time travel with a mobile mixed reality game , 2008, Mobile HCI.

[4]  Jan Borchers,et al.  Cell SpellCasting : Designing a Locative and Gesture Recognition Multiplayer Smartphone Game for Tourists , 2006 .

[5]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[6]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[7]  David W. Murray,et al.  Parallel Tracking and Mapping on a camera phone , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[8]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[9]  Didier Stricker,et al.  Advanced tracking through efficient image processing and visual-inertial sensor fusion , 2008, 2008 IEEE Virtual Reality Conference.

[10]  Shane Xie,et al.  Comparison of local descriptors for image registration of geometrically-complex 3D scenes , 2007, 2007 14th International Conference on Mechatronics and Machine Vision in Practice.

[11]  Long Quan,et al.  Linear N-Point Camera Pose Determination , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Tom Drummond,et al.  Fusing points and lines for high performance tracking , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[13]  John Billingsley,et al.  Mechatronics and machine vision in practice , 2008 .

[14]  Bernd Girod,et al.  Outdoors augmented reality on mobile phone using loxel-based visual feature organization , 2008, MIR '08.

[15]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[16]  Tom Drummond,et al.  Going out: robust model-based tracking for outdoor augmented reality , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[17]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[18]  Éric Marchand,et al.  Hybrid tracking algorithms for planar and non-planar structures subject to illumination changes , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[19]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.