Text Entry in Virtual Reality: A Comprehensive Review of the Literature

The availability of consumer-ready Virtual Reality (VR) Head-Mounted Displays (HMDs) has resulted in a surge in VR applications. It has also prompted the design and development of numerous text entry techniques for the paradigm. However, it is difficult to understand the mechanism of these techniques and extract meaningful average performance data from this body of work since they were evaluated in diverse experiment conditions and report different performance metrics. To remedy this, this paper classifies the existing text entry techniques for VR based on their input mechanism and discusses their strengths, limitations, and performance.

[1]  Ahmed Sabbir Arif,et al.  Analysis of text entry performance metrics , 2009, 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH).

[2]  Klaus H. Hinrichs,et al.  DigiTap: an eyes-free VR/AR symbolic input device , 2014, VRST '14.

[3]  Kyungha Min.  Text Input Tool for Immersive VR Based on 3 × 3 Screen Cells , 2011, ICHIT.

[4]  Enrico Rukzio,et al.  FaceTouch: Enabling Touch Interaction in Display Fixed UIs for Mobile Virtual Reality , 2016, UIST.

[5]  Buntarou Shizuki,et al.  Cubic Keyboard for Virtual Reality , 2018, SUI.

[6]  Maneesh Agrawala,et al.  Text entry using a dual joystick game controller , 2006, CHI.

[7]  Yang-Sheng Chen,et al.  Visualizing the keyboard in virtual reality for enhancing immersive experience , 2017, SIGGRAPH Posters.

[8]  Yoshitaka Arahori,et al.  Space Saving Text Input Method for Head Mounted Display with Virtual 12-key Keyboard , 2018, 2018 IEEE 32nd International Conference on Advanced Information Networking and Applications (AINA).

[9]  Ulrich Burgbacher,et al.  Sensing Thumb-to-Finger Taps for Symbolic Input in VR/AR Environments. , 2015, IEEE computer graphics and applications.

[10]  Hongan Wang,et al.  An adaptive sketching user interface for education system in virtual reality , 2009, 2009 IEEE International Symposium on IT in Medicine & Education.

[11]  Roderick Murray-Smith,et al.  A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays , 2015, CHI Extended Abstracts.

[12]  Ivan Poupyrev,et al.  Virtual Notepad: handwriting in immersive VR , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[13]  Falko Kuester,et al.  KITTY: keyboard independent touch typing in VR , 2004, IEEE Virtual Reality 2004.

[14]  Pascual González,et al.  Evaluation of Text Input Techniques in Immersive Virtual Environments , 2007, Interacción.

[15]  Per Ola Kristensson,et al.  The Office of the Future: Virtual, Portable, and Global , 2018, IEEE Computer Graphics and Applications.

[16]  Oleg Spakov,et al.  Fast gaze typing with an adjustable dwell time , 2009, CHI.

[17]  Anders Markussen,et al.  Selection-Based Mid-Air Text Entry on Large Displays , 2013, INTERACT.

[18]  Hai-Ning Liang,et al.  PizzaText: Text Entry for Virtual Reality Systems Using Dual Thumbsticks , 2018, IEEE Transactions on Visualization and Computer Graphics.

[19]  T. Salthouse.  Effects of age and skill in typing. , 1984, Journal of experimental psychology. General.

[20]  Stephen DiVerdi,et al.  CollaVR: Collaborative In-Headset Review for VR Video , 2017, UIST.

[21]  John Paulin Hansen,et al.  Gaze typing in virtual reality: impact of keyboard design, selection method, and motion , 2018, ETRA.

[22]  Niels Henze,et al.  Physical Keyboards in Virtual Reality: Analysis of Typing Performance and Effects of Avatar Hands , 2018, CHI.

[23]  Gerard Jounghyun Kim,et al.  Using keyboards with head mounted displays , 2004, VRCAI '04.

[24]  Doug A. Bowman,et al.  Pinch Keyboard: Natural Text Input for Immersive Virtual Environments , 2001 .

[25]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[26]  Rainer Stiefelhagen,et al.  qVRty: Virtual Keyboard with a Haptic, Real-World Representation , 2018, HCI.

[27]  Bochao Li,et al.  Efficient Typing on a Visually Occluded Physical Keyboard , 2017, CHI.

[28]  Gerard Jounghyun Kim,et al.  HoVR-Type: Smartphone as a typing interface in VR using hovering , 2016, 2017 IEEE International Conference on Consumer Electronics (ICCE).

[29]  Doug A. Bowman,et al.  Text Input Techniques for Immersive Virtual Environments: An Empirical Comparison , 2002 .

[30]  William Buxton,et al.  Experimental study of stroke shortcuts for a touchscreen keyboard with gesture-redundant keys removed , 2014, Graphics Interface.

[31]  Ahmed Sabbir Arif,et al.  Predicting and Reducing the Impact ofErrors in Character-Based Text Entry , 2013 .

[32]  Shana Smith,et al.  A virtual reality keyboard with realistic haptic feedback in a fully immersive virtual environment , 2017, Virtual Reality.

[33]  Yijun Wang,et al.  Combining Brain-Computer Interface and Eye Tracking for High-Speed Text Entry in Virtual Reality , 2018, IUI.

[34]  Jürgen P. Schulze,et al.  Continuous-Motion Text Input in Virtual Reality , 2018 .

[35]  Niels Henze,et al.  "These are not my hands!": Effect of Gender on the Perception of Avatar Hands in Virtual Reality , 2017, CHI.

[36]  Wendy E. Mackay,et al.  Expressive Keyboards: Enriching Gesture-Typing on Mobile Devices , 2016, UIST.

[37]  Yuanchun Shi,et al.  Tap, Dwell or Gesture?: Exploring Head-Based Text Entry Techniques for HMDs , 2017, CHI.

[38]  Aidan Kehoe,et al.  Using Traditional Keyboards in VR: SteamVR Developer Kit and Pilot Game User Study , 2018, 2018 IEEE Games, Entertainment, Media Conference (GEM).

[39]  Antonio Krüger,et al.  Selection-based Text Entry in Virtual Reality , 2018, CHI.

[40]  Buntarou Shizuki,et al.  FistPointer: Target Selection Technique using Mid-air Interaction for Mobile VR Environment , 2017, CHI Extended Abstracts.

[41]  Per Ola Kristensson,et al.  Effects of Hand Representations for Typing in Virtual Reality , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[42]  Per Ola Kristensson,et al.  VelociTap: Investigating Fast Mobile Text Entry using Sentence-Based Decoding of Touchscreen Keyboard Input , 2015, CHI.

[43]  Per Ola Kristensson,et al.  Text Entry in Immersive Head-Mounted Display-Based Virtual Reality Using Standard Keyboards , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).