Representing information - Classifying the Augmented Reality presentation space

Augmented Reality has a wide-ranging presentation space. In addition to presenting virtual information in a 3D space, such information can also be placed in relation to physical objects, locations or events. Decomposing this presentation space - or more exactly, the principles of how information is represented in Augmented Reality - into unique and independent dimensions provides a fundamental spectrum of options. First, this decomposition facilitates a fine-grained analysis of effects on human understanding. Second, multiple factors, given by multiple differences between different presentation systems with respect to more than one such principle, can be determined and properly addressed. Third, this decomposition facilitates a determination of new fields of research by identifying not-yet-used concepts. Since the beginning of Augmented Reality research, a growing number of applications have emerged that exploit various ways to represent information. This paper resumes this development and presents a set of independent dimensions covering representation principles of virtual information related to a physical environment: the temporality of virtual information, dimensionality, the frame of reference, mounting/registration and the type of reference. The suitability of the devised dimensions is tested by categorizing a wide variety of AR applications. The categorized data is analyzed for the most-often and less-frequently used combinations of classes. In particular, the classes that have not yet been used exhibit the potential to allow future work that investigates new options for information presentation.

[1]  Patrick Baudisch,et al.  Halo: a Technique for Visualizing Off-Screen Locations , 2003 .

[2]  Wolfgang Broll,et al.  Advanced self-contained object removal for realizing real-time Diminished Reality in unconstrained environments , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[3]  Christopher D. Wickens,et al.  Driving and Side Task Performance: The Effects of Display Clutter, Separation, and Modality , 2004, Hum. Factors.

[4]  Niklas Elmqvist,et al.  A Taxonomy of 3D Occlusion Management for Visualization , 2008, IEEE Transactions on Visualization and Computer Graphics.

[5]  Mark A. Livingston,et al.  The effect of registration error on tracking distant augmented objects , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[6]  Gudrun Klinker,et al.  The Intelligent Welding Gun: Augmented Reality for Experimental Vehicle Construction , 2004 .

[7]  Carl Gutwin,et al.  Wedge: clutter-free visualization of off-screen locations , 2008, CHI.

[8]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[9]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[10]  Bruce H. Thomas,et al.  Target Motion Analysis Visualisation , 2005, APVIS.

[11]  Emmanuel Dubois,et al.  Classification Space for Augmented Surgery, an Augmented Reality Case Study , 1999, INTERACT.

[12]  Robert Spence,et al.  Information Visualization: Design for Interaction (2nd Edition) , 2006 .

[13]  Blair MacIntyre,et al.  Virtual transparency: Introducing parallax view into video see-through AR , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[14]  Fabio Bruno,et al.  Augmented touch without visual obtrusion , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[15]  Adam L. Janin,et al.  Several devils in the details: making an AR application work in the airplane factory , 1999 .

[16]  Volker Scholz,et al.  An Augmented Reality museum guide , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[17]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[18]  Nassir Navab,et al.  Virtually Extended Surgical Drilling Device: Virtual Mirror for Navigated Spine Surgery , 2007, MICCAI.

[19]  Paul Milgram,et al.  Dynamic Tethering for Enhanced Remote Control and Navigation , 2000 .

[20]  Laurence Nigay,et al.  Abstract and Concrete Interaction with Mixed Reality Systems / The case of the mini screen, a new interaction device in Computer-Assisted Surgery , 2004, MIXER.

[21]  Gudrun Klinker,et al.  Visual Longitudinal and Lateral Driving Assistance in the Head-Up Display of Cars , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[22]  Shumin Zhai,et al.  Applications of augmented reality for human-robot communication , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[23]  Timo Engelke,et al.  Generating vision based Lego augmented reality training and evaluation systems , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[24]  Dieter Schmalstieg,et al.  Tracking for Distributed Mixed Reality Environments , 2007 .

[25]  Frank Allan Hansen,et al.  Ubiquitous annotation systems: technologies and challenges , 2006, HYPERTEXT '06.

[26]  Steven K. Feiner,et al.  View management for virtual and augmented reality , 2001, UIST '01.

[27]  Steven K. Feiner,et al.  Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system , 1999, Comput. Graph..

[28]  Steven K. Feiner,et al.  Exploring the Benefits of Augmented Reality Documentation for Maintenance and Repair , 2011, IEEE Transactions on Visualization and Computer Graphics.

[29]  Steve Benford,et al.  A Spatial Model of Interaction in Large Virtual Environments , 1993, ECSCW.

[30]  Martin Wagner,et al.  Herding Sheep: Live System Development for Distributed Augmented Reality , 2003 .

[31]  Blair MacIntyre,et al.  An Evaluation of Graphical Context as a Means for Ameliorating the Effects of Registration Error , 2009, IEEE Transactions on Visualization and Computer Graphics.

[32]  Jacques Bertin,et al.  Semiology of Graphics - Diagrams, Networks, Maps , 2010 .

[33]  Steven K. Feiner,et al.  Dynamic space management for user interfaces , 2000, UIST '00.

[34]  Tobias Höllerer,et al.  Fast annotation and modeling with a single-point laser range finder , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[35]  Steven K. Feiner,et al.  An annotated situation-awareness aid for augmented reality , 2002, UIST '02.

[36]  Steven K. Feiner,et al.  BRIDGING THE GAPS: HYBRID TRACKING FOR ADAPTIVE MOBILE AUGMENTED REALITY , 2004, Appl. Artif. Intell..

[37]  Dieter Schmalstieg,et al.  Comprehensible Visualization for Augmented Reality , 2009, IEEE Transactions on Visualization and Computer Graphics.

[38]  Hiroshi Ishii,et al.  Tangible bits: beyond pixels , 2008, TEI.

[39]  Ramesh Raskar,et al.  Augmented Reality Visualization for Laparoscopic Surgery , 1998, MICCAI.

[40]  Tobias Höllerer,et al.  Resolving multiple occluded layers in augmented reality , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[41]  Frank Biocca,et al.  Extended Abstract Mapping the Semantic Asymmetries of Virtual and Augmented Reality Space , 2001, Cognitive Technology.

[42]  Nassir Navab,et al.  Predicting and estimating the accuracy of n-occular optical tracking systems , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[43]  Blair MacIntyre,et al.  OSGAR: a scene graph with uncertain transformations , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[44]  Nassir Navab,et al.  Contextual Anatomic Mimesis Hybrid In-Situ Visualization Method for Improving Multi-Sensory Depth Perception in Medical Augmented Reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[45]  R W Huey,et al.  Inappropriate , 2020, Encyclopedia of the UN Sustainable Development Goals.

[46]  Patrick Baudisch,et al.  Halo: a technique for visualizing off-screen objects , 2003, CHI '03.

[47]  Mark Weiser The computer for the 21st century , 1991 .

[48]  Stephen DiVerdi,et al.  Annotation in outdoor augmented reality , 2009, Comput. Graph..

[49]  Steven K. Feiner,et al.  Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[50]  Henry Been-Lirn Duh,et al.  Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[51]  Arindam Dey,et al.  An Augmented Reality X-Ray system based on visual saliency , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[52]  Christian Sandor,et al.  Improving Spatial Perception for Augmented Reality X-Ray Vision , 2009, 2009 IEEE Virtual Reality Conference.

[53]  Steven K. Feiner,et al.  Perceptual issues in augmented reality revisited , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[54]  Didier Stricker,et al.  Augmented reality for construction tasks: doorlock assembly , 1999 .

[55]  Justin G. Hollands,et al.  Viewpoint Tethering in Complex Terrain Navigation and Awareness , 2005 .

[56]  Gudrun Klinker,et al.  Effective control of a car driver's attention for visual and acoustic guidance towards the direction of imminent dangers , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[57]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[58]  Tobias Höllerer,et al.  A hand-held AR magic lens with user-perspective rendering , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[59]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[60]  Brian Magerko Measuring Dramatic Believability , 2007, AAAI Fall Symposium: Intelligent Narrative Technologies.

[61]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[62]  Steven K. Feiner,et al.  Information filtering for mobile augmented reality , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[63]  Paul Milgram,et al.  A Taxonomy of Real and Virtual World Display Integration , 1999 .

[64]  Tim Hauke Heibel,et al.  A mobile markerless AR system for maintenance and repair , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[65]  Jarke J. van Wijk,et al.  Bridging the Gaps , 2006, IEEE Computer Graphics and Applications.

[66]  John J. Bertin,et al.  The semiology of graphics , 1983 .

[67]  Mark A. Livingston,et al.  User interface design for military AR applications , 2011, Virtual Reality.

[68]  Steven K. Feiner,et al.  Cutaways and ghosting: satisfying visibility constraints in dynamic 3D illustrations , 1992, The Visual Computer.

[69]  Stefanie Zollmann,et al.  Image-based ghostings for single layer occlusions in augmented reality , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[70]  Steven K. Feiner,et al.  Windows on the world: 2D windows for 3D augmented reality , 1993, UIST '93.

[71]  Ivan Poupyrev,et al.  The MagicBook - Moving Seamlessly between Reality and Virtuality , 2001, IEEE Computer Graphics and Applications.

[72]  Sheng Liu,et al.  An optical see-through head mounted display with addressable focal planes , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[73]  Thomas S. Sheridan,et al.  Human and computer roles in supervisory control and telerobotics: musings about function, language and hierarchy , 1988 .

[74]  Isabel Pedersen Radiating centers: Augmented reality and human-centric design , 2009, 2009 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media and Humanities.

[75]  Gudrun Klinker,et al.  Supporting order picking with Augmented Reality , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[76]  Alex W. Stedmon,et al.  A Taxonomy of Technology: Defining Augmented Reality , 2000 .

[77]  Jock D. Mackinlay,et al.  A morphological analysis of the design space of input devices , 1991, TOIS.

[78]  Christian Sandor,et al.  Social semiotic analysis of the design space of augmented reality , 2011, 2011 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities.

[79]  Emmanuel Dubois,et al.  Augmented reality: which augmentation for which reality? , 2000, DARE '00.

[80]  Andy Cockburn,et al.  Through the looking glass: the use of lenses as an interface tool for Augmented Reality interfaces , 2004, GRAPHITE '04.

[81]  Blair MacIntyre,et al.  An evaluation of graphical context when the graphics are outside of the task area , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[82]  Takeo Kanade,et al.  Dynamic seethroughs: Synthesizing hidden views of moving objects , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[83]  W Barfield,et al.  Situation awareness as a function of frame of reference, computer-graphics eyepoint elevation, and geometric field of view. , 1995, The International journal of aviation psychology.

[84]  Mark Billinghurst,et al.  A 3D Flexible and Tangible Magic Lens in Augmented Reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[85]  Frank Biocca The Space of Cognitive Technology: The Design Medium and Cognitive Properties of Virtual Space , 2001, Cognitive Technology.