An Augmented Reality Interface for Mobile Information Retrieval

Recent years have seen growing interest in mobile augmented reality. The ability to retrieve information and display it as virtual content overlaid on top of an image of the real world is a natural extension to a mobile device equipped with a camera and wireless connectivity. Such applications need to address a number of technical hurdles including target recognition and camera pose estimation. Beyond these fundamental challenges, however, there is the problem of data connectivity and user interface presentation. How do we connect mobile clients to multiple data sources that may be changing in real time and provide the user with a flexible interface for navigating through the relevant content? We present an AR user interface framework specifically designed to expose disparate data sources through a single application server. Our proposed system uses an multi-tier architecture to separate back-end data retrieval from front-end graphical presentation and UI event handling. We describe how it might be used to build an oil platform equipment maintenance system, as an example of a collaborative, data-driven mobile application.

[1]  Reinhard Koch,et al.  A Mobile Augmented Reality System with Distributed Tracking , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[2]  Suya You,et al.  A robust hybrid tracking system for outdoor augmented reality , 2004, IEEE Virtual Reality 2004.

[3]  Michael Haller,et al.  Mixed reality training application for an oil refinery: user requirements , 2004, VRCAI '04.

[4]  Diego López-de-Ipiña,et al.  TRIP: A Low-Cost Vision-Based Location System for Ubiquitous Computing , 2002, Personal and Ubiquitous Computing.

[5]  Jay David Bolter,et al.  DART: a toolkit for rapid design exploration of augmented reality experiences , 2005, SIGGRAPH 2005.

[6]  Ulrich Neumann,et al.  Multiring Fiducial Systems for Scalable Fiducial-Tracking Augmented Reality , 2001, Presence: Teleoperators & Virtual Environments.

[7]  Jun Rekimoto,et al.  CyberCode: designing augmented reality environments with visual tags , 2000, DARE '00.

[8]  Dieter Schmalstieg,et al.  Towards Massively Multi-user Augmented Reality on Handheld Devices , 2005, Pervasive.

[9]  Suya You,et al.  Camera tracking for augmented reality media , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[10]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[11]  Dieter Schmalstieg,et al.  Collaborative Augmented Reality for Outdoor Navigation and Information Browsing , 2003 .

[12]  Suya You,et al.  Tricodes: A Barcode-Like Fiducial Design for Augmented Reality Media , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[13]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[14]  Mark A. Livingston,et al.  Superior augmented reality registration by integrating landmark tracking and magnetic tracking , 1996, SIGGRAPH.

[15]  Dieter Schmalstieg,et al.  A Handheld Augmented Reality Museum Guide , 2005 .

[16]  Malik Mallem,et al.  Robust camera pose estimation using 2d fiducials tracking for real-time augmented reality systems , 2004, VRCAI '04.

[17]  Andrew W. Fitzgibbon,et al.  Reliable Fiducial Detection in Natural Scenes , 2004, ECCV.