Image-driven view management for augmented reality browsers

In this paper, we introduce a novel view management technique for placing labels in Augmented Reality systems. A common issue in many Augmented Reality applications is the absence of knowledge of the real environment, limiting the efficient representation and optimal layout of the digital information augmented onto the real world. To overcome this problem, we introduce an image-based approach, which combines a visual saliency algorithm with edge analysis to identify potentially important image regions and geometric constraints for placing labels. Our proposed solution also includes adaptive rendering techniques that allow a designer to control the appearance of depth cues. We describe the results obtained from a user study considering different scenarios, which we performed for validating our approach. Our technique will provide special benefits to Augmented Reality browsers that usually lack scene knowledge, but also to many other applications in the domain of Augmented Reality such as cultural heritage and maintenance applications.

[1]  Timo Götzelmann,et al.  Metrics for Functional and Aesthetic Label Layouts , 2005, Smart Graphics.

[2]  Xavier Décoret,et al.  Dynamic label placement for improved interactive exploration , 2008, NPAR.

[3]  Tom Drummond,et al.  Real-Time Video Annotations for Augmented Reality , 2005, ISVC.

[4]  Blair MacIntyre,et al.  The Argon AR Web Browser and standards-based AR application environment , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[5]  Mihran Tuceryan,et al.  Automatic determination of text readability over textured backgrounds for augmented reality systems , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[6]  Stephen R. Ellis,et al.  Comparing disparity based label segregation in augmented and virtual reality , 2008, VRST '08.

[7]  Jirí Bittner,et al.  Layout-aware optimization for interactive labeling of 3D models , 2010, Comput. Graph..

[8]  Kiyoshi Kiyokawa,et al.  A study of depth visualization techniques for virtual annotations in augmented reality , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[9]  Kevin Mote,et al.  Fast Point-Feature Label Placement for Dynamic Visualizations , 2008, Information Visualization.

[10]  Steven K. Feiner,et al.  Information filtering for mobile augmented reality , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[11]  Joe Marks,et al.  An empirical study of algorithms for point-feature label placement , 1995, TOGS.

[12]  Stephen DiVerdi,et al.  Annotation in outdoor augmented reality , 2009, Comput. Graph..

[13]  Stefan Decker,et al.  Integrating Text with Video and 3D Graphics: The Effects of Text Drawing Styles on Text Readability , 2010, CHI.

[14]  Naokazu Yokoya,et al.  Annotating user-viewed objects for wearable AR systems , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[15]  Stephen R. Ellis,et al.  Evaluation of Alternative Label Placement Techniques in Dynamic Virtual Environments , 2009, Smart Graphics.

[16]  Klaus Mueller,et al.  Magic Marker: A Color Analytics Interface for Image Annotation , 2011, ISVC.

[17]  Steven M. Drucker,et al.  Annotating gigapixel images , 2008, UIST '08.

[18]  Tobias Höllerer,et al.  Resolving multiple occluded layers in augmented reality , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[19]  Fumihisa Shibata,et al.  A View Management Method for Mobile Mixed Reality Systems , 2008, IPT/EGVE.

[20]  Gunnar W. Klau,et al.  Force-Based Label Number Maximization , 2003 .

[21]  Hongyang Chao,et al.  Annotating and navigating tourist videos , 2010, GIS '10.

[22]  Ronald Azuma,et al.  Evaluating label placement for augmented reality view management , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[23]  Knut Hartmann,et al.  Floating Labels: Applying Dynamic Potential Fields for Label Layout , 2004, Smart Graphics.

[24]  Deborah Hix,et al.  An empirical user-based study of text drawing styles and outdoor background textures for augmented reality , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[25]  Steven K. Feiner,et al.  View management for virtual and augmented reality , 2001, UIST '01.

[26]  Jürgen Döllner,et al.  Dynamic Annotation of Interactive Environments using Object-Integrated Billboards , 2006 .

[27]  Tobias Höllerer,et al.  Semi-automated Placement of Annotations in Videos , 2004 .

[28]  Sabine Süsstrunk,et al.  Saliency detection using maximum symmetric surround , 2010, 2010 IEEE International Conference on Image Processing.

[29]  Dieter Schmalstieg,et al.  Context-Preserving Visual Links , 2011, IEEE Transactions on Visualization and Computer Graphics.

[30]  Tsutomu Terada,et al.  An information layout method for an optical see-through head mounted display focusing on the viewability , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[31]  Dieter Schmalstieg,et al.  Real-time panoramic mapping and tracking on mobile phones , 2010, 2010 IEEE Virtual Reality Conference (VR).

[32]  Jens Grubert,et al.  Augmented Reality Browser Survey , 2012 .

[33]  Jun Park,et al.  Efficient Annotation Visualization Using Distinctive Features , 2009, HCI.

[34]  Blair MacIntyre,et al.  OSGAR: a scene graph with uncertain transformations , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[35]  Jürgen Döllner,et al.  Use of Depth Cues for the Annotation of 3D Geo-Virtual Environments , 2007 .

[36]  Deborah Hix,et al.  The Effects of Text Drawing Styles, Background Textures, and Natural Lighting on Text Legibility in Outdoor Augmented Reality , 2006, Presence: Teleoperators & Virtual Environments.

[37]  Jürgen Döllner,et al.  Efficient View Management for Dynamic Annotation Placement in Virtual Landscapes , 2006, Smart Graphics.

[38]  Naokazu Yokoya,et al.  View management of annotations for wearable augmented reality , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[39]  Hsu-Chun Yen,et al.  A Zone-Based Approach for Placing Annotation Labels on Metro Maps , 2011, Smart Graphics.

[40]  Daniel Vogel,et al.  Specifying label layout style by example , 2007, UIST.

[41]  Deborah Hix,et al.  Active Text Drawing Styles for Outdoor Augmented Reality: A User-Based Study and Design Implications , 2007, 2007 IEEE Virtual Reality Conference.