Managing mobile text in head mounted displays: studies on visual preference and text placement

In recent years, the development of wearable displays has seen a drastic increase. However, there is still a strong resistance to using wearable technology for fear of decreased visibility and attention to one's surroundings. To address this concern, this paper describes a series of experiments that study user tendencies related to viewing and placing text in head mounted displays (HMDs). From the results of two pilot experiments, we show that awareness is to some extent better for HMDs compared to smartphones, and find that users would prefer to place text in the background rather than the HMD screen. We then consequently build an intelligent system to manage placement of text such as e-mail and messaging using computer vision algorithms.?? Finally, through two experiments comparing automatic and manual text placement, we show that our system can mimic human tendencies with approximately 70% accuracy.

[1]  Robert S. Bolia,et al.  ASSESSING SIMULATOR SICKNESS IN A SEE-THROUGH HMD: EFFECTS OF TIME DELAY, TIME ON TASK, AND TASK COMPLEXITY , 2000 .

[2]  Tsutomu Terada,et al.  An information layout method for an optical see-through head mounted display focusing on the viewability , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[3]  Jens Grubert,et al.  Perceptual issues in optical-see-through displays , 2010, APGV '10.

[4]  Steven K. Feiner,et al.  View management for virtual and augmented reality , 2001, UIST '01.

[5]  Deborah Hix,et al.  The Effects of Text Drawing Styles, Background Textures, and Natural Lighting on Text Legibility in Outdoor Augmented Reality , 2006, Presence: Teleoperators & Virtual Environments.

[6]  Hendrik Witt,et al.  The Impact of Different Visual Feedback Presentation Methods in a Wearable Computing Scenario , 2009, HCI.

[7]  Kiyoshi Kiyokawa,et al.  Towards intelligent view management: A study of manual text placement tendencies in mobile environments using video see-through displays , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[8]  Mihran Tuceryan,et al.  Automatic determination of text readability over textured backgrounds for augmented reality systems , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[9]  Takashi Kawai,et al.  Ergonomic evaluation of ubiquitous computing with monocular head-mounted display , 2010, Electronic Imaging.

[10]  Mark Billinghurst,et al.  An occlusion capable optical see-through head mount display for supporting co-located collaboration , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[11]  Colin G. Ellard,et al.  Seeing Beyond Your Visual Field , 2014 .

[12]  Naokazu Yokoya,et al.  View management of annotations for wearable augmented reality , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[13]  Carl Gutwin,et al.  Awareness beyond the desktop: exploring attention and distraction with a projected peripheral-vision display , 2010, Graphics Interface.

[14]  Doug A. Bowman,et al.  Testbed evaluation of navigation and text display techniques in an information-rich virtual environment , 2004, IEEE Virtual Reality 2004.

[15]  Penelope M Sanderson,et al.  Monitoring with Head-Mounted Displays: Performance and Safety in a Full-Scale Simulator and Part-Task Trainer , 2009, Anesthesia and analgesia.

[16]  M. Mon-Williams,et al.  Binocular vision in a virtual world: visual deficits following the wearing of a head‐mounted display , 1993, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[17]  Tobias Höllerer,et al.  Semi-automated Placement of Annotations in Videos , 2004 .

[18]  Katerina Mania,et al.  The effect of tracking delay on awareness states in immersive virtual environments: an initial exploration , 2011, VRCAI '11.

[19]  Takashi Kawai,et al.  Visual task performance using a monocular see-through head-mounted display (HMD) while walking. , 2013, Journal of experimental psychology. Applied.

[20]  Stefan Decker,et al.  Integrating Text with Video and 3D Graphics: The Effects of Text Drawing Styles on Text Readability , 2010, CHI.

[21]  Lauren F. V. Scharff,et al.  Discriminability measures for predicting readability , 1999, Electronic Imaging.

[22]  Kosuke Sato,et al.  View Management of Projected Labels on Nonplanar and Textured Surfaces , 2013, IEEE Transactions on Visualization and Computer Graphics.

[23]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[24]  Hakan Urey,et al.  State of the Art in Stereoscopic and Autostereoscopic Displays , 2011, Proceedings of the IEEE.

[25]  Ronald Azuma,et al.  Evaluating label placement for augmented reality view management , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[26]  Dieter Schmalstieg,et al.  Image-driven view management for augmented reality browsers , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[27]  Mark Billinghurst,et al.  A wearable spatial conferencing space , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[28]  Kiyoshi Kiyokawa,et al.  Dynamic text management for see-through wearable and heads-up display systems , 2013, IUI '13.

[29]  Stephen DiVerdi,et al.  Annotation in outdoor augmented reality , 2009, Comput. Graph..

[30]  Jürgen Döllner,et al.  Dynamic Annotation of Interactive Environments using Object-Integrated Billboards , 2006 .