Markerless tracking for mobile augmented reality

This work aims to realize a recognition system for markerless tracking in mobile augmented reality. A method based local invariant descriptors is implemented to extract image feature points for natural fiducial identification. This technique is optimized and adapted for a mobile architecture with low resources and deployed on a portable device. Afterwards, a hybrid approach of camera pose estimation is proposed to augment real images with virtual graphics. Experiments and many evaluations are conducted to demonstrate the relevance of the proposed approach. This study enabled to overcome some identification issues for markerless tracking in mobile augmented reality environments.

[1]  Dieter Schmalstieg,et al.  Real-Time Detection and Tracking for Augmented Reality on Mobile Phones , 2010, IEEE Transactions on Visualization and Computer Graphics.

[2]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[3]  Jean-Yves Didier,et al.  A performance study for camera pose estimation using visual marker based tracking , 2010, Machine Vision and Applications.

[4]  Marco Winzker,et al.  2011 IEEE International Conference on Signal and Image Processing Applications, ICSIPA 2011, Kuala Lumpur, Malaysia, November 16-18, 2011 , 2011, International Conference on Signal and Image Processing Applications.

[5]  David W. Murray,et al.  Parallel Tracking and Mapping on a camera phone , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[6]  Madjid Maidi,et al.  Active Contours Motion based on Optical Flow for Tracking in Augmented Reality , 2006 .

[7]  Roberto Cipolla,et al.  Real-Time Visual Tracking of Complex Structures , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Avinash C. Kak,et al.  A New Approach to the Use of Edge Extremities for Model-based Object Tracking , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[9]  Éric Marchand,et al.  Real-time markerless tracking for augmented reality: the virtual visual servoing framework , 2006, IEEE Transactions on Visualization and Computer Graphics.

[10]  Bernd Girod,et al.  Outdoors augmented reality on mobile phone using loxel-based visual feature organization , 2008, MIR '08.

[11]  Vincent Lepetit,et al.  Combining edge and texture information for real-time accurate 3D camera tracking , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[12]  Malik Mallem,et al.  Handling Occlusions for Robust Augmented Reality Systems , 2010, EURASIP J. Image Video Process..

[13]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[14]  Bernd Girod,et al.  Streaming mobile augmented reality on mobile phones , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[15]  J. L. Roux.  An Introduction to the Kalman Filter , 2003 .