View Management of Projected Labels on Nonplanar and Textured Surfaces

This paper presents a new label layout technique for projection-based augmented reality (AR) that determines the placement of each label directly projected onto an associated physical object with a surface that is normally inappropriate for projection (i.e., nonplanar and textured). Central to our technique is a new legibility estimation method that evaluates how easily people can read projected characters from arbitrary viewpoints. The estimation method relies on the results of a psychophysical study that we conducted to investigate the legibility of projected characters on various types of surfaces that deform their shapes, decrease their contrasts, or cast shadows on them. Our technique computes a label layout by minimizing the energy function using a genetic algorithm (GA). The terms in the function quantitatively evaluate different aspects of the layout quality. Conventional label layout solvers evaluate anchor regions and leader lines. In addition to these evaluations, we design our energy function to deal with the following unique factors, which are inherent in projection-based AR applications: the estimated legibility value and the disconnection of the projected leader line. The results of our subjective experiment showed that the proposed technique could significantly improve the projected label layout.

[1]  Ronald Azuma,et al.  Evaluating label placement for augmented reality view management , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[2]  Oliver Bimber,et al.  Embedded entertainment with smart projectors , 2005, Computer.

[3]  Steven K. Feiner,et al.  View management for virtual and augmented reality , 2001, UIST '01.

[4]  Oliver Bimber,et al.  Dynamic Adaptation of Projected Imperceptible Codes , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[5]  Deborah Hix,et al.  The Effects of Text Drawing Styles, Background Textures, and Natural Lighting on Text Legibility in Outdoor Augmented Reality , 2006, Presence: Teleoperators & Virtual Environments.

[6]  Fan Zhang,et al.  Dynamic labeling management in virtual and augmented environments , 2005, Ninth International Conference on Computer Aided Design and Computer Graphics (CAD-CG'05).

[7]  Kosuke Sato,et al.  Dynamic defocus and occlusion compensation of projected imagery by model-based optimal projector selection in multi-projection environment , 2011, Virtual Reality.

[8]  Masanori Sugimoto,et al.  Clutter-aware adaptive projection inside a dynamic environment , 2008, VRST '08.

[9]  Joe Marks,et al.  An empirical study of algorithms for point-feature label placement , 1995, TOGS.

[10]  Hiroaki Satoh,et al.  Minimal generation gap model for GAs considering both exploration and exploitation , 1996 .

[11]  Knut Hartmann,et al.  Label Layout for Interactive 3D Illustrations , 2005, J. WSCG.

[12]  Stefan Decker,et al.  Integrating Text with Video and 3D Graphics: The Effects of Text Drawing Styles on Text Readability , 2010, CHI.

[13]  Ramesh Raskar,et al.  Modern approaches to augmented reality: introduction to current approaches , 2006, SIGGRAPH Courses.

[14]  Michael S. Brown,et al.  Projected Imagery in Your "Office of the Future" , 2000, IEEE Computer Graphics and Applications.

[15]  Mihran Tuceryan,et al.  Automatic determination of text readability over textured backgrounds for augmented reality systems , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[16]  Daniel Vogel,et al.  Specifying label layout style by example , 2007, UIST.

[17]  Deborah Hix,et al.  Active Text Drawing Styles for Outdoor Augmented Reality: A User-Based Study and Design Implications , 2007, 2007 IEEE Virtual Reality Conference.

[18]  Gordon Wetzstein,et al.  The Visual Computing of Projector‐Camera Systems , 2008, SIGGRAPH '08.

[19]  Naokazu Yokoya,et al.  View management of annotations for wearable augmented reality , 2009, 2009 IEEE International Conference on Multimedia and Expo.