Global pose estimation using multi-sensor fusion for outdoor Augmented Reality

Outdoor Augmented Reality typically requires tracking in unprepared environments. For global registration, Global Positioning System (GPS) is currently the best sensing technology, but its precision and update rate are not sufficient for high quality tracking. We present a system that uses Kalman filtering for fusion of Differential GPS (DGPS) or Real-Time Kinematic (RTK) based GPS with barometric heights and also for an inertial measurement unit with gyroscopes, magnetometers and accelerometers to improve the transient oscillation. Typically, inertial sensors are subjected to drift and magnetometer measurements are distorted by electro-magnetic fields in the environment. For compensation, we additionally apply a visual orientation tracker which is drift-free through online mapping of the unknown environment. This tracker allows for correction of distortions of the 3-axis magnetic compass, which increases the robustness and accuracy of the pose estimates. We present results of applying this approach in an industrial application scenario.

[1]  Steven K. Feiner,et al.  Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system , 1999, Comput. Graph..

[2]  Gérard Lachapelle,et al.  GNSS Indoor Location Technologies , 2004 .

[3]  T. Drummond,et al.  Going out : Robust Tracking for Outdoor Augmented Reality , 2006 .

[4]  Dieter Schmalstieg,et al.  Virtual redlining for civil engineering in real environments , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[5]  Eric Foxlin,et al.  Pedestrian tracking with shoe-mounted inertial sensors , 2005, IEEE Computer Graphics and Applications.

[6]  Xiaoming Hu,et al.  Autocalibration of an electronic compass for augmented reality , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[7]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[8]  Ronald Azuma,et al.  Autocalibration of an electronic compass in an outdoor augmented reality system , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[9]  Simon J. Julier,et al.  BARS: Battlefield Augmented Reality System , 2001 .

[10]  Tom Drummond,et al.  Going out: robust model-based tracking for outdoor augmented reality , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[11]  Eduardo E. Veas,et al.  Vesp'R - Transforming Handheld Augmented Reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[12]  Dieter Schmalstieg,et al.  Interactive Urban Models generated from Context-Preserving Transcoding of Real-World Data , 2008 .

[13]  Stephen DiVerdi,et al.  Envisor: Online Environment Map Construction for Mixed Reality , 2008, 2008 IEEE Virtual Reality Conference.

[14]  Ronald Azuma,et al.  Orientation Tracking for Outdoor Augmented Reality Registration , 1999, IEEE Computer Graphics and Applications.

[15]  Ronald Azuma,et al.  Tracking in unprepared environments for augmented reality systems , 1999, Comput. Graph..

[16]  Brian J. Luzum.  Navigation Principles of Positioning and Guidance , 2004 .

[17]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[18]  Didier Stricker,et al.  Advanced tracking through efficient image processing and visual-inertial sensor fusion , 2008, 2008 IEEE Virtual Reality Conference.

[19]  Bruce H. Thomas,et al.  Tinmith-Metro: new outdoor techniques for creating city models with an augmented reality wearable computer , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[20]  P. Groves.  Principles of GNSS, Inertial, and Multi-Sensor Integrated Navigation Systems , 2007 .

[21]  Javier Civera,et al.  Drift-Free Real-Time Sequential Mosaicing , 2009, International Journal of Computer Vision.