Augmentative and alternative communication: the future of text on the move

The methods currently available for text entry on small mobile devices exhibit poor performance in terms of input speed, which presents a potential barrier to acceptance and growth. This paper presents an analysis of mobile text entry indicating that the likely solution is a combination of the use of language modelling and careful interaction design and verification. The paper argues that research in augmentative and alternative communication (AAC) is highly relevant to the mobile text entry problem and vice versa, and offers the opportunity to research solutions that will be feasible to implement on future generations of mobile devices. In the design of the system presented in this paper, fewer input buttons, natural language processing (NLP) and multimodal inputs are techniques that have been evaluated and applied. Contrary to initial expectations, analysis and evaluation showed that usability and human factors often are more significant factors in performance than the efficiency of the input method. In the conducted study, simplifications of a text-to-talk system increased productivity by 15%. This provides a strong indication that the best way to increase text production rates in realistic scenarios is to strive for simplicity and clarity in the interaction and user interface, rather than opting for including every possible time-saving feature in the system. Empirical validations of potential simplifications are therefore advocated as a general design methodology.

[1]  I. Scott MacKenzie,et al.  LetterWise: prefix-based disambiguation for mobile text input , 2001, UIST '01.

[2]  John Paulin Hansen,et al.  Gaze typing compared with input by head and hand , 2004, ETRA.

[3]  I. Scott MacKenzie,et al.  Measuring errors in text entry tasks: an application of the Levenshtein string distance statistic , 2001, CHI Extended Abstracts.

[4]  I. Witten,et al.  The Reactive Keyboard: a predictive typing aid , 1990, Computer.

[5]  David E. Kieras,et al.  The GOMS family of user interface analysis techniques: comparison and contrast , 1996, TCHI.

[6]  I. Scott MacKenzie,et al.  Auditory and visual feedback during eye typing , 2003, CHI Extended Abstracts.

[7]  Christina L. James,et al.  Text input for mobile devices: comparing model prediction to actual performance , 2001, CHI.

[8]  John Paulin Hansen,et al.  Language Technology in a Predictive, Restricted On-screen Keyboard with Ambiguous Layout for Severely Disabled People , 2003 .

[9]  Steve Krug,et al.  Don't Make Me Think , 2000 .

[10]  Fred Piper Introduction to cryptology , 1997, Inf. Secur. Tech. Rep..

[11]  Simon P. Levine,et al.  A comparison of Mouthstick and Morse code text inputs , 1986 .

[12]  Aaron Marcus,et al.  Babyface Design for Mobile Devices and the Web , 2001 .

[13]  Darius Miniotas Application of Fitts' law to eye gaze interaction , 2000, CHI Extended Abstracts.

[14]  Claude E. Shannon,et al.  Prediction and Entropy of Printed English , 1951 .

[15]  Joseph S. Dumas,et al.  Optimizing a Portable Terminal Keyboard for Combined One-Handed and Two-Handed use , 1987 .

[16]  John L. Arnott,et al.  Probabilistic character disambiguation for reduced keyboards using small text samples , 1992 .

[17]  Henk C. A. van Tilborg,et al.  An Introduction to Cryptology , 1988 .

[18]  Kenji Itoh,et al.  Language Technology in a Predictive, Restricted On-Screen Keyboard with Dynamic Layout for Severely Disabled People , 2003 .

[19]  I. Scott MacKenzie,et al.  Predicting text entry speed on mobile phones , 2000, CHI.

[20]  I. Scott MacKenzie,et al.  An empirical investigation of the novice experience with soft keyboards , 2001, Behav. Inf. Technol..

[21]  R. Hyman Stimulus information as a determinant of reaction time. , 1953, Journal of experimental psychology.

[22]  B. Schneiderman,et al.  Designing the User Interface. Strategies for Effective Human-Computer Interaction , 1992 .

[23]  Shumin Zhai,et al.  The metropolis keyboard - an exploration of quantitative techniques for virtual keyboard design , 2000, UIST '00.

[24]  W. E. Hick Quarterly Journal of Experimental Psychology , 1948, Nature.

[25]  Sheri Hunnicutt,et al.  Design and Implementation of a Probabilistic Word Prediction Program , 1997 .

[26]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[27]  Gregory W. Lesher,et al.  Techniques for augmenting scanning communication , 1998 .

[28]  Nils Klarlund,et al.  Word N-Grams for Cluster Keyboards , 2003 .

[29]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[30]  Steven Skiena,et al.  Dialing for Documents: An Experiment in Information Theory , 1996, J. Vis. Lang. Comput..

[31]  I. Scott MacKenzie,et al.  Theoretical upper and lower bounds on typing speed using a stylus and a soft keyboard , 1995, Behav. Inf. Technol..

[32]  Sarah Parker,et al.  Why are mobile phones annoying? , 2004, Behav. Inf. Technol..

[33]  I. Scott MacKenzie,et al.  A Probabilistic Character Layout Strategy for Mobile Text Entry , 1998, Graphics Interface.

[34]  I. Scott MacKenzie,et al.  Half-QWERTY: a one-handed keyboard facilitating skill transfer from QWERTY , 1993, INTERCHI.

[35]  Ronald Rosenfeld,et al.  A maximum entropy approach to adaptive statistical language modelling , 1996, Comput. Speech Lang..

[36]  G W Lesher,et al.  Optimal character arrangements for ambiguous keyboards. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[37]  John Paulin Hansen,et al.  Bringing gaze-based interaction back to basics , 2001, HCI.

[38]  Howard Gutowitz Barriers to Adoption of Dictionary-Based Text-Entry Methods: A Field Study , 2003 .

[39]  Ian H. Witten,et al.  The Reactive Keyboard: A Predicive Typing Aid , 1990, Computer.

[40]  J. S. Briggs,et al.  Designing the user interface: strategies for effective human-computer interaction: by Ben Schneiderman. Published by Addison-Wesley. 463pp. £17.95 , 1987 .

[41]  Patrick W. Jordan,et al.  An Introduction to Usability , 1998 .

[42]  David J. Ward,et al.  Adaptive Computer Interfaces , 2001 .

[43]  Slava M. Katz,et al.  Estimation of probabilities from sparse data for the language model component of a speech recognizer , 1987, IEEE Trans. Acoust. Speech Signal Process..

[44]  I. Scott MacKenzie,et al.  The Immediate Usability of Graffiti , 1997, Graphics Interface.