Selection-based Text Entry in Virtual Reality

In recent years, Virtual Reality (VR) and 3D User Interfaces (3DUI) have seen a drastic increase in popularity, especially in terms of consumer-ready hardware and software. While the technology for input as well as output devices is market ready, only a few solutions for text input exist, and empirical knowledge about performance and user preferences is lacking. In this paper, we study text entry in VR by selecting characters on a virtual keyboard. We discuss the design space for assessing selection-based text entry in VR. Then, we implement six methods that span different parts of the design space and evaluate their performance and user preferences. Our results show that pointing using tracked hand-held controllers outperforms all other methods. Other methods such as head pointing can be viable alternatives depending on available resources. We summarize our findings by formulating guidelines for choosing optimal virtual keyboard text entry methods in VR.

[1]  Beat Signer,et al.  SpeeG: a multimodal speech- and gesture-based text input solution , 2012, AVI.

[2]  Brad A. Myers,et al.  An alternative to push, press, and tap-tap-tap: gesturing on an isometric joystick for mobile phone text entry , 2007, CHI.

[3]  Päivi Majaranta,et al.  CHAPTER 9 – Text Entry by Gaze: Utilizing Eye Tracking , 2007 .

[4]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[5]  Jacob O. Wobbrock,et al.  Measures of Text Entry Performance , 2007 .

[6]  Patrick Baudisch,et al.  Imaginary interfaces: spatial interaction with empty hands and without visual feedback , 2010, UIST.

[7]  I. Scott MacKenzie,et al.  The design and evaluation of a high-performance soft keyboard , 1999, CHI '99.

[8]  Anders Markussen,et al.  Selection-Based Mid-Air Text Entry on Large Displays , 2013, INTERACT.

[9]  Kun Chang Lee,et al.  Empirical analysis of consumer reaction to the virtual reality shopping mall , 2008, Comput. Hum. Behav..

[10]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[11]  Antti Oulasvirta,et al.  Investigating the Dexterity of Multi-Finger Input for Mid-Air Text Entry , 2015, CHI.

[12]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[13]  Nellie L. Merrick,et al.  Typewriting Behavior: Psychology Applied to Teaching and Learning Typewriting , 1936 .

[14]  Eric D. Ragan,et al.  Questioning naturalism in 3D user interfaces , 2012, CACM.

[15]  Kent Lyons,et al.  Twiddler typing: one-handed chording text entry for mobile phones , 2004, CHI.

[16]  Jan Noyes,et al.  The QWERTY Keyboard: A Review , 1983, Int. J. Man Mach. Stud..

[17]  Bochao Li,et al.  Efficient Typing on a Visually Occluded Physical Keyboard , 2017, CHI.

[18]  Shumin Zhai,et al.  Touch behavior with different postures on soft smartphone keyboards , 2012, Mobile HCI.

[19]  A BowmanDoug,et al.  A human motor behavior model for distal pointing tasks , 2010 .

[20]  Elisabeth André,et al.  Writing with Your Eye: A Dwell Time Free Writing System Adapted to the Nature of Human Eye Gaze , 2008, PIT.

[21]  Enrico Rukzio,et al.  FaceTouch: Enabling Touch Interaction in Display Fixed UIs for Mobile Virtual Reality , 2016, UIST.

[22]  Doug A. Bowman,et al.  A human motor behavior model for distal pointing tasks , 2010, Int. J. Hum. Comput. Stud..

[23]  Per Ola Kristensson,et al.  Performance comparisons of phrase sets and presentation styles for text entry evaluations , 2012, IUI '12.

[24]  Doug A. Bowman,et al.  Text Input Techniques for Immersive Virtual Environments: An Empirical Comparison , 2002 .

[25]  I. Scott MacKenzie,et al.  KSPC (Keystrokes per Character) as a Characteristic of Text Entry Techniques , 2002, Mobile HCI.

[26]  Kellogg S. Booth,et al.  Mid-air text input techniques for very large wall displays , 2009, Graphics Interface.

[27]  E. Muth,et al.  A questionnaire for the assessment of the multiple dimensions of motion sickness. , 2001, Aviation, space, and environmental medicine.

[28]  Jason Jerald,et al.  The VR Book: Human-Centered Design for Virtual Reality , 2015 .

[29]  Martin Schrepp,et al.  Construction and Evaluation of a User Experience Questionnaire , 2008, USAB.

[30]  Anatole Lécuyer,et al.  Simulating Haptic Feedback Using Vision: A Survey of Research and Applications of Pseudo-Haptic Feedback , 2009, PRESENCE: Teleoperators and Virtual Environments.

[31]  Olivier Chapuis,et al.  Mid-air pan-and-zoom on wall-sized displays , 2011, CHI.

[32]  Jaewoo Ahn,et al.  VirtualPhonepad: A Text Input Tool for Virtual Environments , 2006, ICAT.

[33]  Maneesh Agrawala,et al.  Text entry using a dual joystick game controller , 2006, CHI.

[34]  Yang-Sheng Chen,et al.  Visualizing the keyboard in virtual reality for enhancing immersive experience , 2017, SIGGRAPH Posters.

[35]  M. Pomplun,et al.  A Gaze-Controlled Interface to Virtual Reality Applications for Motor-and Speech-Impaired Users , 2009 .

[36]  Roderick Murray-Smith,et al.  A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays , 2015, CHI Extended Abstracts.

[37]  Robin Kinkead,et al.  Typing Speed, Keying Rates, and Optimal Keyboard Layouts , 1975 .

[38]  Thomas P. Moran,et al.  Questions, Options, and Criteria: Elements of Design Space Analysis , 1991, Hum. Comput. Interact..

[39]  Frank Weichert,et al.  Analysis of the Accuracy and Robustness of the Leap Motion Controller , 2013, Sensors.

[40]  Shumin Zhai,et al.  Human Performance in Six Degree of Freedom Input Control , 2002 .

[41]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[42]  Henry Sowizral,et al.  Embedding the 2D interaction metaphor in a real 3D virtual environment , 1995, Electronic Imaging.

[43]  Gang Ren,et al.  Freehand gestural text entry for interactive TV , 2013, EuroITV.

[44]  Yuanchun Shi,et al.  Tap, Dwell or Gesture?: Exploring Head-Based Text Entry Techniques for HMDs , 2017, CHI.

[45]  Per Ola Kristensson,et al.  A versatile dataset for text entry evaluations based on genuine mobile emails , 2011, Mobile HCI.

[46]  Oleg Spakov,et al.  Comparison of video-based pointing and selection techniques for hands-free text entry , 2012, AVI.

[47]  Mike Sinclair,et al.  Interaction and modeling techniques for desktop two-handed input , 1998, UIST '98.

[48]  Pascual González,et al.  Evaluation of Text Input Techniques in Immersive Virtual Environments , 2007, Interacción.

[49]  Antti Oulasvirta,et al.  Informing the Design of Novel Input Methods with Muscle Coactivation Clustering , 2015, ACM Trans. Comput. Hum. Interact..

[50]  Kumiko Tanaka-Ishii,et al.  Text Entry Systems: Mobility, Accessibility, Universality , 2007 .