HawKEY: Efficient and Versatile Text Entry for Virtual Reality

Text entry is still a challenging task in modern Virtual Reality (VR) systems. The lack of efficient text entry methods limits the applications that can be used productively in VR. Previous work has addressed this issue through virtual keyboards or showing the physical keyboard in VR. While physical keyboards afford faster text entry, they usually require a seated user and an instrumented environment. We introduce a new keyboard, worn on a hawker’s tray in front of the user, which affords a compact, simple, flexible, and efficient text entry solution for VR, without restricting physical movement. In our new video condition, we also show the keyboard only when the user is looking down at it. To evaluate our novel solution and to identify good keyboard visualizations, we ran a user study where we asked participants to enter both lowercase sentences as well as complex text while standing. The results show that text entry rates are affected negatively by simplistic keyboard visualization conditions and that our solution affords desktop text entry rates, even when standing.

[1]  I. Scott MacKenzie,et al.  Phrase sets for evaluating text entry techniques , 2003, CHI Extended Abstracts.

[2]  Dongdong Weng,et al.  HiKeyb: High-Efficiency Mixed Reality System for Text Entry , 2018, 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct).

[3]  Yuanchun Shi,et al.  ATK: Enabling Ten-Finger Freehand Typing in Air Based on 3D Hand Tracking Data , 2015, UIST.

[4]  Per Ola Kristensson,et al.  Effects of Hand Representations for Typing in Virtual Reality , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[5]  Kasper Hornbæk,et al.  Vulture: a mid-air word-gesture keyboard , 2014, CHI.

[6]  Per Ola Kristensson,et al.  Text Entry in Immersive Head-Mounted Display-Based Virtual Reality Using Standard Keyboards , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[7]  Costas Boletsis,et al.  Text Input in Virtual Reality: A Preliminary Evaluation of the Drum-Like VR Keyboard , 2019, Technologies.

[8]  Falko Kuester,et al.  Towards keyboard independent touch typing in VR , 2005, VRST '05.

[9]  Antti Jylhä,et al.  Designing a Willing-to-Use-in-Public Hand Gestural Interaction Technique for Smart Glasses , 2016, CHI.

[10]  Niels Henze,et al.  Physical Keyboards in Virtual Reality: Analysis of Typing Performance and Effects of Avatar Hands , 2018, CHI.

[11]  Doug A. Bowman,et al.  Text Input Techniques for Immersive Virtual Environments: An Empirical Comparison , 2002 .

[12]  Yang-Sheng Chen,et al.  Visualizing the keyboard in virtual reality for enhancing immersive experience , 2017, SIGGRAPH Posters.

[13]  Roderick Murray-Smith,et al.  A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays , 2015, CHI Extended Abstracts.

[14]  Ahmed Sabbir Arif,et al.  Analysis of text entry performance metrics , 2009, 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH).

[15]  Enrico Rukzio,et al.  FaceTouch: Enabling Touch Interaction in Display Fixed UIs for Mobile Virtual Reality , 2016, UIST.

[16]  Bochao Li,et al.  Efficient Typing on a Visually Occluded Physical Keyboard , 2017, CHI.

[17]  Per Ola Kristensson,et al.  Fast and Precise Touch-Based Text Entry for Head-Mounted Augmented Reality with Variable Occlusion , 2018, ACM Trans. Comput. Hum. Interact..

[18]  Gerard Jounghyun Kim,et al.  HoVR-Type: Smartphone as a typing interface in VR using hovering , 2016, 2017 IEEE International Conference on Consumer Electronics (ICCE).

[19]  Klaus H. Hinrichs,et al.  Sensing Thumb-to-Finger Taps for Symbolic Input in VR/AR Environments , 2015, IEEE Computer Graphics and Applications.

[20]  Yuanchun Shi,et al.  Tap, Dwell or Gesture?: Exploring Head-Based Text Entry Techniques for HMDs , 2017, CHI.

[21]  Hai-Ning Liang,et al.  PizzaText: Text Entry for Virtual Reality Systems Using Dual Thumbsticks , 2018, IEEE Transactions on Visualization and Computer Graphics.

[22]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[23]  Ellen R. Girden,et al.  ANOVA: Repeated Measures , 1991 .

[24]  Ahmed Sabbir Arif,et al.  Text Entry in Virtual Reality: A Comprehensive Review of the Literature , 2019, HCI.

[25]  J. J. Higgins,et al.  The aligned rank transform for nonparametric factorial analyses using only anova procedures , 2011, CHI.