Typing Efficiency and Suggestion Accuracy Influence the Benefits and Adoption of Word Suggestions

Suggesting words to complete a given sequence of characters is a common feature of typing interfaces. Yet, previous studies have not found a clear benefit, some even finding it detrimental. We report on the first study to control for two important factors, word suggestion accuracy and typing efficiency. Our accuracy factor is enabled by a new methodology that builds on standard metrics of word suggestions. Typing efficiency is based on device type. Results show word suggestions are used less often in a desktop condition, with little difference between tablet and phone conditions. Very accurate suggestions do not improve entry speed on desktop, but do on tablet and phone. Based on our findings, we discuss implications for the design of automation features in typing systems.

[1]  Mark D. Dunlop,et al.  Multidimensional pareto optimization of touchscreen keyboards for speed, familiarity and improved spell checking , 2012, CHI.

[2]  Kathleen F. McCoy,et al.  Generating text from compressed input: an intelligent interface for people with severe motor impairments , 1992, CACM.

[3]  Krzysztof Z. Gajos,et al.  Predictive text encourages predictable writing , 2020, IUI.

[4]  Shumin Zhai,et al.  Octopus: evaluating touchscreen keyboard correction and recognition algorithms via , 2013, CHI.

[5]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[6]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[7]  Kathleen F. McCoy,et al.  User Interaction with Word Prediction: The Effects of Prediction Quality , 2009, TACC.

[8]  Shwetak N. Patel,et al.  How Good is 85%?: A Survey Tool to Connect Classifier Evaluation to Acceptability of Accuracy , 2015, CHI.

[9]  Andy Cockburn,et al.  When Bad Feels Good: Assistance Failures and Interface Preferences , 2016, CHI.

[10]  Simon P. Levine,et al.  Modeling the speed of text entry with a word prediction interface , 1994 .

[11]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[12]  Ming Yin,et al.  Understanding the Effect of Accuracy on Trust in Machine Learning Models , 2019, CHI.

[13]  Krzysztof Z. Gajos,et al.  On Suggesting Phrases vs. Predicting Words for Mobile Text Composition , 2016, UIST.

[14]  Daniel Vogel,et al.  Automation Accuracy Is Good, but High Controllability May Be Better , 2019, CHI.

[15]  Simon P. Levine,et al.  Effect of a word prediction feature on user performance , 1996 .

[16]  Anind K. Dey,et al.  Quantifying Aversion to Costly Typing Errors in Expert Mobile Text Entry , 2017, CHI.

[17]  James A. Landay,et al.  Comparing Speech and Keyboard Text Entry for Short Messages in Two Languages on Touchscreen Phones , 2016, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[18]  Pradipta De,et al.  Does emotion influence the use of auto-suggest during smartphone typing? , 2019, IUI.

[19]  I. Scott MacKenzie,et al.  Phrase sets for evaluating text entry techniques , 2003, CHI Extended Abstracts.

[20]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[21]  Daniel Vogel,et al.  Shift: a technique for operating pen-based interfaces using touch , 2007, CHI.

[22]  Shumin Zhai,et al.  A Cost-Benefit Study of Text Entry Suggestion Interaction , 2016, CHI.

[23]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[24]  Ahmed Sabbir Arif,et al.  Analysis of text entry performance metrics , 2009, 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH).

[25]  H. S. Venkatagiri,et al.  Effect of window size on rate of communication in a lexical prediction AAC system , 1994 .

[26]  Nestor Garay-Vitoria,et al.  Text prediction systems: a survey , 2006, Universal Access in the Information Society.

[27]  Per Ola Kristensson,et al.  How do People Type on Mobile Devices?: Observations from a Study with 37,000 Volunteers , 2019, MobileHCI.

[28]  J. J. Higgins,et al.  The aligned rank transform for nonparametric factorial analyses using only anova procedures , 2011, CHI.

[29]  Shumin Zhai,et al.  Effects of Language Modeling and its Personalization on Touchscreen Typing Performance , 2015, CHI.

[30]  Brad A. Myers,et al.  From letters to words: efficient stroke-based word completion for trackball text entry , 2006, Assets '06.

[31]  Florian Alt,et al.  ResearchIME: A Mobile Keyboard Application for Studying Free Typing Behaviour in the Wild , 2018, CHI.

[32]  Kathleen F. McCoy,et al.  Word prediction and communication rate in AAC , 2008 .

[33]  J E Gold,et al.  Postures, typing strategies, and gender differences in mobile device usage: an observational study. , 2012, Applied ergonomics.

[34]  Denis Anson,et al.  The Effects of Word Completion and Word Prediction on Typing Rates Using On-Screen Keyboards , 2006, Assistive technology : the official journal of RESNA.

[35]  Per Ola Kristensson,et al.  Uncertain text entry on mobile devices , 2014, CHI.

[36]  Alan F. Newell,et al.  Adaptive and predictive techniques in a communication prosthesis , 1987 .

[37]  Anind K. Dey,et al.  The Limits of Expert Text Entry Speed on Mobile Keyboards with Autocorrect , 2019, MobileHCI.

[38]  Shumin Zhai,et al.  SHARK2: a large vocabulary shorthand writing system for pen-based computers , 2004, UIST '04.

[39]  Robert L. Solso,et al.  Frequency and versatility of letters in the English language , 1976 .