Annotation in outdoor augmented reality

Annotation, the process of adding extra virtual information to an object, is one of the most common uses for augmented reality. Although annotation is widely used in augmented reality, there is no general agreed-upon definition of what precisely constitutes an annotation in this context. In this paper, we propose a taxonomy of annotation, describing what constitutes an annotation and outlining different dimensions along which annotation can vary. Using this taxonomy we also highlight what styles of annotation are used in different types of applications and areas where further work needs to be done to improve annotation. Through our taxonomy we found two primary categories into which annotations in current applications fall. Some annotations present information that is directly related to the object they are annotating, while others are only indirectly related to the object that is being annotated. We also found that there are very few applications that enable the user to either edit or create new annotations online. Instead, most applications rely on content that is created in various offline processes. There are, however, many advantages to online annotation. We summarize and formalize our recent work in this field by presenting the steps needed to build an online annotation system, looking most closely at techniques for placing annotations from a distance.

[1]  Didier Stricker,et al.  Archeoguide: first results of an augmented reality, mobile computing system in cultural heritage sites , 2001, VAST '01.

[2]  Tom Drummond,et al.  Going out: robust model-based tracking for outdoor augmented reality , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[3]  Gudrun Klinker,et al.  Supporting order picking with Augmented Reality , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[4]  Niklas Elmqvist,et al.  A Taxonomy of 3D Occlusion Management Techniques , 2007, 2007 IEEE Virtual Reality Conference.

[5]  Tobias Höllerer,et al.  Evaluating techniques for interaction at a distance , 2004, Eighth International Symposium on Wearable Computers.

[6]  Volker Scholz,et al.  An Augmented Reality museum guide , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[7]  Stephen DiVerdi,et al.  Using aerial photographs for improved mobile AR annotation , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[8]  Werner Hartmann,et al.  Authoring of a mixed reality assembly instructor for hierarchical structures , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[9]  Steven K. Feiner,et al.  View management for virtual and augmented reality , 2001, UIST '01.

[10]  Wei Liu,et al.  Human Pacman: a mobile wide-area entertainment system based on physical, social, and ubiquitous computing , 2004, ACE '04.

[11]  Bruce H. Thomas,et al.  Evaluation of three input techniques for selection and annotation of physical objects through an augmented reality view , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[12]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[13]  Stephen DiVerdi,et al.  Evaluating Display Types for AR Selection and Annotation , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[14]  Bruce H. Thomas,et al.  Interactive augmented reality techniques for construction at a distance of 3D geometry , 2003 .

[15]  Steven K. Feiner,et al.  Visualizing and navigating complex situated hypermedia in augmented and virtual reality , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[16]  Tobias Höllerer,et al.  Fast annotation and modeling with a single-point laser range finder , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[17]  Alex Olwal,et al.  ASTOR: an autostereoscopic optical see-through augmented reality system , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[18]  Dieter Schmalstieg,et al.  Experiences with Handheld Augmented Reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[19]  Bruce H. Thomas,et al.  First Person Indoor/Outdoor Augmented Reality Application: ARQuake , 2002, Personal and Ubiquitous Computing.

[20]  Dieter Schmalstieg,et al.  Towards Massively Multi-user Augmented Reality on Handheld Devices , 2005, Pervasive.

[21]  Bruce H. Thomas,et al.  Evaluation of three wearable computer pointing devices for selection tasks , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[22]  Stephen DiVerdi,et al.  Envisor: Online Environment Map Construction for Mixed Reality , 2008, 2008 IEEE Virtual Reality Conference.

[23]  Simon J. Julier,et al.  Authoring of physical models using mobile computers , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[24]  Steven K. Feiner,et al.  User Interfaces for Mobile Augmented Reality Systems , 2003, VVG.

[25]  Frank Allan Hansen,et al.  Ubiquitous annotation systems: technologies and challenges , 2006, HYPERTEXT '06.

[26]  Steven Feiner Wearing It Out : First Steps Toward Mobile Augmented Reality Systems , 1999 .

[27]  Dieter Schmalstieg,et al.  Collaborative Augmented Reality for Outdoor Navigation and Information Browsing , 2003 .

[28]  Gudrun Klinker,et al.  Visual Longitudinal and Lateral Driving Assistance in the Head-Up Display of Cars , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[29]  Wolfgang Broll,et al.  An Anthropomorphic AR-Based Personal Information Manager and Guide , 2007, HCI.

[30]  Steven K. Feiner,et al.  My own private kiosk: privacy-preserving public displays , 2004, Eighth International Symposium on Wearable Computers.

[31]  Irma Lindt,et al.  A report on the crossmedia game epidemic menace , 2007, CIE.

[32]  Douglas A. Bowman,et al.  Interaction Techniques For Common Tasks In Immersive Virtual Environments - Design, Evaluation, And , 1999 .

[33]  Jun Rekimoto,et al.  Augment-able reality: situated communication through physical and digital spaces , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[34]  Dieter Schmalstieg,et al.  Interactive Focus and Context Visualization for Augmented Reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[35]  Tobias Höllerer,et al.  Pictorial depth cues for outdoor augmented reality , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[36]  Tobias Höllerer,et al.  Interactive tools for virtual x-ray vision in mobile augmented reality , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[37]  H TobiasHans User Interfaces for Mobile Augmented Reality Systems , 2004 .

[38]  Blair MacIntyre,et al.  Presence and engagement in an interactive drama , 2007, CHI.

[39]  Woodrow Barfield,et al.  Fundamentals of Wearable Computers and Augumented Reality , 2000 .

[40]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[41]  Blair MacIntyre,et al.  Exploring spatial narratives and mixed reality experiences in Oakland Cemetery , 2005, ACE '05.

[42]  Woodrow Barfield,et al.  Boeing’s Wire Bundle Assembly Project , 2001 .

[43]  Tim Hauke Heibel,et al.  A mobile markerless AR system for maintenance and repair , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[44]  Nassir Navab,et al.  An Industrial Augmented Reality Solution For Discrepancy Check , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[45]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[46]  Frank Biocca,et al.  Comparative effectiveness of augmented reality in object assembly , 2003, CHI '03.

[47]  Bruce H. Thomas,et al.  ARVino - outdoor augmented reality visualisation of viticulture GIS data , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).