Exploration of Hands-free Text Entry Techniques For Virtual Reality

Text entry is a common activity in virtual reality (VR) systems. There is a limited number of available hands-free techniques, which allow users to carry out text entry when users’ hands are busy such as holding items or hand-based devices are not available. The most used hands-free text entry technique is DwellType, where a user selects a letter by dwelling over it for a specific period. However, its performance is limited due to the fixed dwell time for each character selection. In this paper, we explore two other hands-free text entry mechanisms in VR: BlinkType and NeckType, which leverage users’ eye blinks and neck’s forward and backward movements to select letters. With a user study, we compare the performance of the two techniques with DwellType. Results show that users can achieve an average text entry rate of 13.47, 11.18 and 11.65 words per minute with BlinkType, NeckType, and DwellType, respectively. Users’ subjective feedback shows BlinkType as the preferred technique for text entry in VR. Index Terms: Human-centered computing—Human computer interaction (HCI)—Interaction paradigms—Virtual reality; Human-centered computing—Human computer interaction (HCI)—Interaction techniques—Text input

[1]  M. Shamim Hossain,et al.  Estimating VR Sickness and user experience using different HMD technologies: An evaluation study , 2019, Future Gener. Comput. Syst..

[2]  I. Scott MacKenzie,et al.  Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric , 2003, CHI '03.

[3]  Harpreet Sareen,et al.  FaceDisplay: Enabling Multi-User Interaction for Mobile Virtual Reality , 2017, CHI Extended Abstracts.

[4]  Hai-Ning Liang,et al.  RingText: Dwell-free and hands-free Text Entry for Mobile Head-Mounted Displays using Head Motions , 2019, IEEE Transactions on Visualization and Computer Graphics.

[5]  Joshua Goodman,et al.  Language modeling for soft keyboards , 2002, IUI '02.

[6]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[7]  Dong Joon Kim,et al.  Rescue localized intra-arterial thrombolysis for hyperacute MCA ischemic stroke patients after early non-responsive intravenous tissue plasminogen activator therapy , 2005, Neuroradiology.

[8]  Hai-Ning Liang,et al.  DepthText: Leveraging Head Movements towards the Depth Dimension for Hands-free Text Entry in Mobile Virtual Reality Systems , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[9]  Hai-Ning Liang,et al.  DMove: Directional Motion-based Interaction for Augmented Reality Head-Mounted Displays , 2019, CHI.

[10]  I. Scott MacKenzie,et al.  BlinkWrite2: an improved text entry method using eye blinks , 2010, ETRA '10.

[11]  Per Ola Kristensson,et al.  The potential of dwell-free eye-typing for fast assistive gaze communication , 2012, ETRA.

[12]  W. P. Smotherman,et al.  Spontaneous eye blinking in human infants: a review. , 2004, Developmental psychobiology.

[13]  Oleg Spakov,et al.  Fast gaze typing with an adjustable dwell time , 2009, CHI.

[14]  Maria da Graça Campos Pimentel,et al.  Filteryedping: Design Challenges and User Performance of Dwell-Free Eye Typing , 2015, TACC.

[15]  Päivi Majaranta,et al.  Twenty years of eye typing: systems and design issues , 2002, ETRA.

[16]  Saeid Nahavandi,et al.  A Review on Ocular Biomechanic Models for Assessing Visual Fatigue in Virtual Reality , 2018, IEEE Access.

[17]  Mao-Jiun J. Wang,et al.  Evaluation of an Augmented Reality Embedded On-line Shopping System , 2015 .

[18]  Sayan Sarcar,et al.  EyeK: an efficient dwell-free eye gaze-based text entry system , 2013, APCHI.

[19]  Marco Porta,et al.  Eye-S: a full-screen input modality for pure eye-based communication , 2008, ETRA.

[20]  Hai-Ning Liang,et al.  Pointing and Selection Methods for Text Entry in Augmented Reality Head Mounted Displays , 2019, 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[21]  John Paulin Hansen,et al.  Gaze typing in virtual reality: impact of keyboard design, selection method, and motion , 2018, ETRA.

[22]  Hai-Ning Liang,et al.  Errata to "RingText: Dwell-Free and Hands-Free Text Entry for Mobile Head-Mounted Displays Using Head Motions" , 2019, IEEE Trans. Vis. Comput. Graph..

[23]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[24]  Jaehyun Park,et al.  Virtual reality sickness questionnaire (VRSQ): Motion sickness measurement index in a virtual reality environment. , 2018, Applied ergonomics.

[25]  Ahmed Sabbir Arif,et al.  Text Entry in Virtual Reality: A Comprehensive Review of the Literature , 2019, HCI.

[26]  I. Scott MacKenzie,et al.  BlinkWrite: efficient text entry using eye blinks , 2011, Universal Access in the Information Society.

[27]  Margrit Betke,et al.  EyeSwipe: Dwell-free Text Entry Using Gaze Paths , 2016, CHI.

[28]  Per Ola Kristensson,et al.  Text Entry in Immersive Head-Mounted Display-Based Virtual Reality Using Standard Keyboards , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[29]  Dil Bahadur Gurung,et al.  Mathematical model of thermal effects of blinking in human eye , 2016 .

[30]  Yuanchun Shi,et al.  Tap, Dwell or Gesture?: Exploring Head-Based Text Entry Techniques for HMDs , 2017, CHI.

[31]  James A. Landay,et al.  Comparing Speech and Keyboard Text Entry for Short Messages in Two Languages on Touchscreen Phones , 2016, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[32]  Antonio Krüger,et al.  Selection-based Text Entry in Virtual Reality , 2018, CHI.

[33]  Jacob O. Wobbrock,et al.  Not Typing but Writing: Eye-based Text Entry Using Letter-like Gestures , 2007 .

[34]  Tianyu Zhang,et al.  DepthMove: Leveraging Head Motions in the Depth Dimension to Interact with Virtual Reality Head-Worn Displays , 2019, 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[35]  I. Scott MacKenzie,et al.  Phrase sets for evaluating text entry techniques , 2003, CHI Extended Abstracts.

[36]  Torsten Kuhlen,et al.  SWIFTER: Design and evaluation of a speech-based text input metaphor for immersive virtual environments , 2016, 2016 IEEE Symposium on 3D User Interfaces (3DUI).

[37]  Barrett Ens,et al.  Modeling endpoint distribution of pointing selection tasks in virtual reality environments , 2019, ACM Trans. Graph..

[38]  Hai-Ning Liang,et al.  PizzaText: Text Entry for Virtual Reality Systems Using Dual Thumbsticks , 2018, IEEE Transactions on Visualization and Computer Graphics.

[39]  Yuanchun Shi,et al.  HeadGesture , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[40]  Hai-Ning Liang,et al.  Evaluating the effects of collaboration and competition in navigation tasks and spatial knowledge acquisition within virtual reality environments , 2019, Future Gener. Comput. Syst..