Measuring the performance of gaze and speech for text input

A popular word processor application was adapted to include the use of eye gaze and speech as a modality for text entry. An onscreen keyboard was used whereby users were expected to focus on the desired character and then issue a verbal command in order to type the character in the document. Measures of speed and accuracy were captured and analyzed. Results indicate that the keyboard is superior to the gaze and speech entry method in terms of both speed and accuracy. Keyboard button sizes and spacing between the buttons did not affect either measure in any way.

[1]  I. Scott MacKenzie,et al.  Phrase sets for evaluating text entry techniques , 2003, CHI Extended Abstracts.

[2]  Julie C. Sedivy,et al.  Subject Terms: Linguistics Language Eyes & eyesight Cognition & reasoning , 1995 .

[3]  Katsumi Tanaka A robust selection system using real-time multi-modal user-agent interactions , 1998, IUI '99.

[4]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[5]  I. Scott MacKenzie,et al.  A character-level error analysis technique for evaluating text entry methods , 2002, NordiCHI '02.

[6]  Janet C. Read,et al.  Measuring the Usability of Text Input Methods for Children , 2001, BCS HCI/IHM.

[7]  John Paulin Hansen,et al.  Bringing gaze-based interaction back to basics , 2001, HCI.

[8]  Robert J. K. Jacob,et al.  Eye tracking in human-computer interaction and usability research : Ready to deliver the promises , 2002 .

[9]  B. Tatler,et al.  Looking and Acting: Vision and eye movements in natural behaviour , 2009 .

[10]  Keith S. Karn,et al.  Commentary on Section 4. Eye tracking in human-computer interaction and usability research: Ready to deliver the promises. , 2003 .

[11]  Ty Anderson Pro Office 2007 Development with VSTO , 2008 .

[12]  Shumin Zhai,et al.  Gaze and Speech in Attentive User Interfaces , 2000, ICMI.

[13]  Päivi Majaranta,et al.  Text Entry by Eye Gaze , 2009 .

[14]  Jacob O. Wobbrock,et al.  Longitudinal evaluation of discrete consecutive gaze gestures for text entry , 2008, ETRA.

[15]  Janet C. Read On the application of text input metrics to handwritten text input , 2005, Efficient Text Entry.

[16]  Robert J. K. Jacob,et al.  Eye Movement-Based Human-Computer Interaction Techniques: Toward Non-Command Interfaces , 2003 .

[17]  Oleg Spakov,et al.  Symbol Creator: An Alternative Eye-based Text Entry Technique with Low Demand for Screen Space , 2003, INTERACT.

[18]  Keith Vertanen,et al.  Speech dasher: fast writing using speech and gaze , 2010, CHI.

[19]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[20]  Nils Klarlund,et al.  Editing by voice and the role of sequential symbol systems for improved human-to-computer information rates , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[21]  Carlos Hitoshi Morimoto,et al.  Context switching for fast key selection in text entry applications , 2010, ETRA.

[22]  Yeow Kee Tan,et al.  Eye gaze and speech for data entry: a comparison of different data entry methods , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).