ReType: Quick Text Editing with Keyboard and Gaze

When a user needs to reposition the cursor during text editing, this is often done using the mouse. For experienced typists especially, the switch between keyboard and mouse can slow down the keyboard editing workflow considerably. To address this we propose ReType, a new gaze-assisted positioning technique combining keyboard with gaze input based on a new 'patching' metaphor. ReType allows users to perform some common editing operations while keeping their hands on the keyboard. We present the result of two studies. A free-use study indicated that ReType enhances the user experience of text editing. ReType was liked by many participants, regardless of their typing skills. A comparative user study showed that ReType is able to match or even beat the speed of mouse-based interaction for small text edits. We conclude that the gaze-augmented user interface can make common interactions more fluent, especially for professional keyboard users.

[1]  Christof Lutteroth,et al.  Eyes Only: Navigating Hypertext with Gaze , 2013, INTERACT.

[2]  John Paulin Hansen,et al.  Command Without a Click: Dwell Time Typing by Mouse and Gaze Selections , 2003, INTERACT.

[3]  Andreas Paepcke,et al.  Gaze-enhanced user interface design , 2007 .

[4]  Chris Lankford.  Effective eye-gaze input into Windows , 2000, ETRA.

[5]  Shari Trewin.  An invisible keyguard , 2002, Assets '02.

[6]  Christof Lutteroth,et al.  Designing for the eye: design parameters for dwell in gaze interaction , 2012, OZCHI.

[7]  Takahiro Hayashi,et al.  Effective gazewriting with support of text copy and paste , 2015, 2015 IEEE/ACIS 14th International Conference on Computer and Information Science (ICIS).

[8]  Franck Dernoncourt.  Replacing the computer mouse , 2014, ArXiv.

[9]  Boris M. Velichkovsky,et al.  Towards gaze-mediated interaction: Collecting solutions of the "Midas touch problem" , 1997, INTERACT.

[10]  Frank Tong,et al.  Foundations of Vision , 2018 .

[11]  Eyal M. Reingold,et al.  Selection By Looking: A Novel Computer Interface And Its Application To Psychological Research , 1995 .

[12]  Terry Winograd,et al.  GUIDe: gaze-enhanced UI design , 2007, CHI Extended Abstracts.

[13]  Chonho Lee,et al.  GazeTry: Swipe Text Typing Using Gaze , 2015, OZCHI.

[14]  Hongbin Zha,et al.  Improving eye cursor's stability for eye pointing tasks , 2008, CHI.

[15]  Roel Vertegaal,et al.  EyeWindows: evaluation of eye-controlled zooming windows for focus selection , 2005, CHI.

[16]  Päivi Majaranta,et al.  Text Editing by Gaze: Static vs. Dynamic Menus , 2009 .

[17]  Author Keywords , 2022 .

[18]  Tommy Strandvall,et al.  Eye Tracking in Human-Computer Interaction and Usability Research , 2009, INTERACT.

[19]  Robert J. K. Jacob,et al.  What you look at is what you get , 2016, Interactions.

[20]  Poika Isokoski,et al.  Now Dasher! Dash away!: longitudinal study of fast text entry by Eye Gaze , 2008, ETRA.

[21]  John Paulin Hansen,et al.  Gaze typing compared with input by head and hand , 2004, ETRA.

[22]  Raimund Dachselt,et al.  Look & touch: gaze-supported target acquisition , 2012, CHI.

[23]  Christof Lutteroth,et al.  Gaze vs. Mouse: A Fast and Accurate Gaze-Only Click Alternative , 2015, UIST.

[24]  Per Ola Kristensson,et al.  The potential of dwell-free eye-typing for fast assistive gaze communication , 2012, ETRA.

[25]  Colin Ware,et al.  An evaluation of an eye tracker as a device for computer input2 , 1987, CHI 1987.

[26]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[27]  Roger Haslam,et al.  Ergonomics of using a mouse or other non-keyboard input device , 2002 .

[28]  C. Ware,et al.  An evaluation of an eye tracker as a device for computer input2 , 1987, CHI '87.

[29]  Oleg Spakov,et al.  Fast gaze typing with an adjustable dwell time , 2009, CHI.

[30]  Stuart K. Card,et al.  Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys, for text selection on a CRT , 1987 .

[31]  Meredith Ringel Morris,et al.  Improving Dwell-Based Gaze Typing with Dynamic, Cascading Dwell Times , 2017, CHI.

[32]  Robert J. K. Jacob,et al.  Evaluation of eye gaze interaction , 2000, CHI.

[33]  Maria da Graça Campos Pimentel,et al.  Filteryedping: Design Challenges and User Performance of Dwell-Free Eye Typing , 2015, TACC.

[34]  Andreas Paepcke,et al.  EyePoint: practical pointing and selection using gaze and keyboard , 2007, CHI.

[35]  Jack T Dennerlein,et al.  Evaluating the effect of four different pointing device designs on upper extremity posture and muscle activity during mousing tasks. , 2015, Applied ergonomics.

[36]  Emil F. Pascarelli,et al.  Repetitive strain injury , 1994 .

[37]  Michael Ortega-Binderberger,et al.  Rake cursor: improving pointing performance with concurrent input channels , 2009, CHI.

[38]  Shumin Zhai,et al.  Manual and gaze input cascaded (MAGIC) pointing , 1999, CHI '99.

[39]  David J. Ward,et al.  Artificial intelligence: Fast hands-free writing by gaze direction , 2002, Nature.

[40]  Alan Hedge,et al.  Multi-Touch: A New Tactile 2-D Gesture Interface for Human-Computer Interaction , 2001 .

[41]  Andrew T. Duchowski,et al.  Efficient eye pointing with a fisheye lens , 2005, Graphics Interface.

[42]  Sayan Sarcar,et al.  EyeK: an efficient dwell-free eye gaze-based text entry system , 2013, APCHI.

[43]  Zhen Li,et al.  Keyboard Surface Interaction: Making the keyboard into a pointing device , 2016, ArXiv.

[44]  Christina Gummesson,et al.  Carpal tunnel syndrome and keyboard use at work: a population-based study. , 2007, Arthritis and rheumatism.

[45]  Oleg Spakov,et al.  Disambiguating ninja cursors with eye gaze , 2009, CHI.

[46]  Jacob O. Wobbrock,et al.  TrueKeys: identifying and correcting typing errors for people with motor impairments , 2008, IUI '08.