The Influence of Label Design on Search Performance and Noticeability in Wide Field of View Augmented Reality Displays

In Augmented Reality (AR), search performance for outdoor tasks is an important metric for evaluating the success of a large number of AR applications. Users must be able to find content quickly, labels and indicators must not be invasive but still clearly noticeable, and the user interface should maximize search performance in a variety of conditions. To address these issues, we have set up a series of experiments to test the influence of virtual characteristics such as color, size, and leader lines on the performance of search tasks and noticeability in both real and simulated environments. We evaluate two primary areas, including 1) the effects of peripheral field of view (FOV) limitations and labeling techniques on target acquisition during outdoor mobile search, and 2) the influence of local characteristics such as color, size, and motion on text labels over dynamic backgrounds. The first experiment showed that limited FOV will severely limit search performance, but that appropriate placement of labels and leaders within the periphery can alleviate this problem without interfering with walking or decreasing user comfort. In the second experiment, we found that different types of motion are more noticeable in optical versus video see-through displays, but that blue coloration is most noticeable in both. Results can aid in designing more effective view management techniques, especially for wider field of view displays.

[1]  Michael V. Mclean,et al.  Brightness Contrast, Color Contrast, and Legibility1 , 1965 .

[2]  Sungjae Hwang,et al.  Aroundplot: Focus+context interface for off-screen objects in 3D environments , 2011, Comput. Graph..

[3]  Kiyoshi Kiyokawa,et al.  Analysing the effects of a wide field of view augmented reality display on search performance in divided attention tasks , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[4]  Yasushi Yagi,et al.  Wide Field of View Head Mounted Display for Tele-presence with An Omnidirectional Image Sensor , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[5]  Gudrun Klinker,et al.  Visual Longitudinal and Lateral Driving Assistance in the Head-Up Display of Cars , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[6]  Giuseppe Monno,et al.  Effect of Text Outline and Contrast Polarity on AR Text Readability in Industrial Lighting , 2015, IEEE Transactions on Visualization and Computer Graphics.

[7]  Kiyoshi Kiyokawa.  A Wide Field-of-view Head Mounted Projective Display using Hyperbolic Half-silvered Mirrors , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[8]  Simon J. Julier,et al.  Presence and discernability in conventional and non-photorealistic immersive augmented reality , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[9]  F. Sumner,et al.  Influence of color on legibility of copy. , 1932 .

[10]  Kiyoshi Kiyokawa,et al.  Fisheye vision: peripheral spatial compression for improved field of view in head mounted displays , 2014, SUI.

[11]  Mark T. Bolas,et al.  Vertical Field-of-View Extension and Walking Characteristics in Head-Worn Virtual Environments , 2016, ACM Trans. Appl. Percept..

[12]  Henry Fuchs,et al.  Comparison of optical and video see-through, head-mounted displays , 1995, Other Conferences.

[13]  Patrick Baudisch,et al.  Halo: a technique for visualizing off-screen objects , 2003, CHI '03.

[14]  Mark A. Livingston,et al.  A user study towards understanding stereo perception in head-worn augmented reality displays , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[15]  Jun Rekimoto,et al.  Peripheral vision annotation: noninterference information presentation method for mobile augmented reality , 2011, AH '11.

[16]  Steven K. Feiner,et al.  Perceptual issues in augmented reality revisited , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[17]  S. McKee,et al.  The detection of motion in the peripheral visual field , 1984, Vision Research.

[18]  Erica M. Barhorst-Cates,et al.  The Effects of Restricted Peripheral Field-of-View on Spatial Learning while Navigating , 2016, PloS one.

[19]  J. Wolfe,et al.  Preattentive Object Files: Shapeless Bundles of Basic Features , 1997, Vision Research.

[20]  Miles A. Tinker,et al.  Studies of typographical factors influencing speed of reading. , 1931 .

[21]  I. Rentschler,et al.  Peripheral vision and pattern recognition: a review. , 2011, Journal of vision.

[22]  Marc Alexa,et al.  Pixelated image abstraction with integrated user constraints , 2013, Comput. Graph..

[23]  Constance S. Royden,et al.  Visual search asymmetries in motion and optic flow fields , 2001, Perception & psychophysics.

[24]  J. Wolfe.  Asymmetries in visual search: An introduction , 2001, Perception & psychophysics.

[25]  Benjamin Watson,et al.  A User Study Evaluating Level of Detail Degradation in the Periphery of Head-Mounted Displays , 1995 .

[26]  Bochao Li,et al.  The Effects of Peripheral Vision and Light Stimulation on Distance Judgments Through HMDs , 2018, ACM Trans. Appl. Percept..

[27]  G. Michel,et al.  Restricting the Field of View: Perceptual and Performance Effects , 1990, Perceptual and motor skills.

[28]  Christopher D. Wickens,et al.  The Effects of Head-Up Display Clutter and In-Vehicle Display Separation on Concurrent Driving Performance , 2003 .

[29]  M V McLean,et al.  Brightness contrast, color contrast, and legibility. , 1965, Human factors.

[30]  Jeremy M Wolfe,et al.  Do Intersections Serve as Basic Features in Visual Search? , 2003, Perception.

[31]  F. Previc,et al.  Visual search asymmetries in three-dimensional space , 1993, Vision Research.

[32]  Douglas Lanman,et al.  Pinlight displays , 2014, ACM Trans. Graph..

[33]  Stephen R. Ellis,et al.  Managing Visual Clutter: A Generalized Technique for Label Segregation using Stereoscopic Disparity , 2008, 2008 IEEE Virtual Reality Conference.

[34]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[35]  Lorin J. Elias,et al.  Upper and lower visual field differences in perceptual asymmetries , 2011, Brain Research.

[36]  Ronald Azuma,et al.  Evaluating label placement for augmented reality view management , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[37]  Dieter Schmalstieg,et al.  Image-driven view management for augmented reality browsers , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[38]  Robert Xiao,et al.  Augmenting the Field-of-View of Head-Mounted Displays with Sparse Peripheral Displays , 2016, CHI.

[39]  Yongtian Wang,et al.  Design of a wide-angle, lightweight head-mounted display using free-form optics tiling. , 2011, Optics letters.

[40]  Stephen R. Ellis,et al.  Label segregation by remapping stereoscopic depth in far-field augmented reality , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[41]  Heinrich H. Bülthoff,et al.  Influence of the size of the field of view on motion perception , 2009, Comput. Graph..

[42]  R. Rosenholtz,et al.  The effect of background color on asymmetries in color search. , 2004, Journal of vision.

[43]  Kiyoshi Kiyokawa,et al.  Poster: Investigation on the peripheral visual field for information display with real and virtual wide field-of-view see-through HMDs , 2013, 2013 IEEE Symposium on 3D User Interfaces (3DUI).

[44]  Kiyoshi Kiyokawa,et al.  Subjective Image Quality Assessment of a Wide-view Head Mounted Projective Display with a Semi-transparent Retro-reflective Screen , 2011 .

[45]  J. Edward Swan,et al.  Peripheral visual information and its effect on distance judgments in virtual and augmented environments , 2011, APGV '11.

[46]  J. Dichgans,et al.  Differential effects of central versus peripheral vision on egocentric and exocentric motion perception , 1973, Experimental Brain Research.

[47]  Kiyoshi Kiyokawa,et al.  Managing mobile text in head mounted displays: studies on visual preference and text placement , 2014, MOCO.

[48]  Deborah Hix,et al.  The Effects of Text Drawing Styles, Background Textures, and Natural Lighting on Text Legibility in Outdoor Augmented Reality , 2006, Presence: Teleoperators & Virtual Environments.

[49]  Stefania Serafin,et al.  Establishing the Range of Perceptually Natural Visual Walking Speeds for Virtual Walking-In-Place Locomotion , 2014, IEEE Transactions on Visualization and Computer Graphics.

[50]  Niels Henze,et al.  Visualization of off-screen objects in mobile augmented reality , 2010, Mobile HCI.

[51]  Mark T. Bolas,et al.  Comparability of narrow and wide field-of-view head-mounted displays for medium-field distance judgments , 2012, SAP.

[52]  Eyal Ofek,et al.  FoveAR: Combining an Optically See-Through Near-Eye Display with Projector-Based Spatial Augmented Reality , 2015, UIST.

[53]  J. Edward Swan,et al.  Peripheral Stimulation and its Effect on Perceived Spatial Scale in Virtual Environments , 2013, IEEE Transactions on Visualization and Computer Graphics.

[54]  Mihran Tuceryan,et al.  Automatic determination of text readability over textured backgrounds for augmented reality systems , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[55]  H W Mertens,et al.  EVALUATION OF A RANGE OF TARGET BLINK AMPLITUDES FOR ATTENTION-GETTING VALUE IN A SIMULATED AIR TRAFFIC CONTROL DISPLAY , 1997 .

[56]  Agostinho C. Rosa,et al.  Object Recognition Test in Peripheral Vision: A Study on the Influence of Object Color, Pattern and Shape , 2012, Brain Informatics.

[57]  A. Oliva,et al.  Segmentation of objects from backgrounds in visual search tasks , 2002, Vision Research.

[58]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[59]  Tobias Höllerer,et al.  Evaluating wide-field-of-view augmented reality with mixed reality simulation , 2016, 2016 IEEE Virtual Reality (VR).

[60]  J. J. Higgins,et al.  The aligned rank transform for nonparametric factorial analyses using only anova procedures , 2011, CHI.

[61]  Kiyoshi Kiyokawa,et al.  A study of depth visualization techniques for virtual annotations in augmented reality , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[62]  Valeria Herskovic,et al.  SidebARs: improving awareness of off-screen elements in mobile augmented reality , 2013, ChileCHI '13.

[63]  Carl Gutwin,et al.  Peripheral Popout: The Influence of Visual Angle and Stimulus Intensity on Popout Effects , 2017, CHI.

[64]  Steven K. Feiner,et al.  View management for virtual and augmented reality , 2001, UIST '01.

[65]  Christian Sandor,et al.  Subjective Evaluation of a Semi-Automatic Optical See-Through Head-Mounted Display Calibration Technique , 2015, IEEE Transactions on Visualization and Computer Graphics.