Open Augmented Reality System For Mobile Markerless Tracking

The aim of this work is to present an open solution for building an Augmented Reality (AR) system without using any existing SDK. The proposed approach relies upon 2D planar object recognition for mobile real-time tracking applications. The transformation relating the world and the camera coordinate systems is determined using pose estimation. Once the projective transform relating 3D and 2D features is computed, a virtual 3D graphic is registered on the image. Many tests have been performed to show the efficiency of the proposed approach and to prove its relevance in terms of accuracy and time computation. The final application enabled real-time mobile tracking of markerless images augmented with 3D models to enrich the visual perception of the user.

[1]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[2]  Alexander G. Gray,et al.  Efficient exact k-NN and nonparametric classification in high dimensions , 2003, NIPS 2003.

[3]  Madjid Maidi,et al.  Vision-based tracking in large image database for real-time mobile augmented reality , 2014, 2014 IEEE 16th International Workshop on Multimedia Signal Processing (MMSP).

[4]  Madjid Maidi,et al.  Natural feature tracking on a mobile handheld Tablet , 2013, 2013 IEEE International Conference on Signal and Image Processing Applications.

[5]  Clark F. Olson,et al.  An Approximation Algorithm for Least Median of Squares Regression , 1997, Inf. Process. Lett..

[6]  Madjid Maidi,et al.  Markerless identification and tracking for scalable image database , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[7]  Madjid Maidi,et al.  Markerless tracking for mobile augmented reality , 2011, 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA).

[8]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..