Extended panorama tracking algorithm for augmenting virtual 3D objects in outdoor environments

Augmented Reality (AR) is currently gaining popularity in multiple professional use cases. However, applying AR for outdoor environments is still very difficult, especially when targeting customer-grade mobile devices. This paper presents extensions to a previous panoramic tracking algorithm, which is a visual tracking method for unprepared outdoor use cases. The panorama tracker is extended by Unity3D game engine integration, and by implementing two distinct initialization systems based on Global Positioning System (GPS) for the tracker. The enhanced panorama tracker is benchmarked with 30 test videos, and the test results indicate that the accuracy of the tracker is sufficient for visualization tasks in outdoor environments. In addition, performance numbers show that the implemented tracker can often reach real-time performance on some consumer-grade tablets. Accuracies of the new initialization systems seem to be sufficient, as long as previously known accurate GPS locations are used instead of internal sensors from the mobile devices.

[1]  Jan-Michael Frahm,et al.  Development of vision-aided navigation for a wearable outdoor augmented reality system , 2014, 2014 IEEE/ION Position, Location and Navigation Symposium - PLANS 2014.

[2]  Thomas Olsson,et al.  User evaluation of mobile augmented reality in architectural planning , 2012 .

[3]  Vincent Lepetit,et al.  Combining edge and texture information for real-time accurate 3D camera tracking , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[4]  Dieter Schmalstieg,et al.  Global pose estimation using multi-sensor fusion for outdoor Augmented Reality , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[5]  Tom Drummond,et al.  Fusing points and lines for high performance tracking , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[6]  Dieter Schmalstieg,et al.  Real-time panoramic mapping and tracking on mobile phones , 2010, 2010 IEEE Virtual Reality Conference (VR).

[7]  Ronald Azuma,et al.  The Challenge of Making Augmented Reality Work Outdoors , 1999 .

[8]  Dieter Schmalstieg,et al.  Robust detection and tracking of annotations for outdoor augmented reality browsing , 2011, Comput. Graph..

[9]  Tom Drummond,et al.  Going out: robust model-based tracking for outdoor augmented reality , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[10]  Tero Säntti,et al.  Evaluation of the GPS Accuracy of Tablets , 2016 .

[11]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[12]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[13]  Henry Been-Lirn Duh,et al.  Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[14]  Charles Woodward,et al.  Mobile Mixed Reality System for Architectural and Construction Site Visualization , 2011 .