Text input for motor-impaired people

This paper provides an overview of 150 publications regarding text input for motor-impaired people and describes current state of the art. It focuses on common techniques of text entry including selection of keys, approaches to character layouts, use of language models, and interaction modalities. These aspects of text entry methods are further analyzed, and examples are given. The paper also focuses on an overview of reported evaluations by describing experiments, which can be conducted, to assess the performance of a text entry method. Following this overview, a summary of 61 text entry methods for motor-impaired people found in the related literature is presented, classifying those methods according to the aforementioned aspects and reported evaluation. This overview was assembled with the aim to provide a starting point to the new researchers in the field of accessible text entry. The text entry methods are also categorized according to the suitability for various conditions of the users.

[1]  Zdenek Míkovec,et al.  Hands free mouse: comparative study on mouse clicks controlled by humming , 2010, CHI EA '10.

[2]  Poika Isokoski,et al.  Continuous edgewrite: dictionary-based disambiguation instead of explicit segmentation by the user , 2012, AVI.

[3]  I. Scott MacKenzie,et al.  SAK: Scanning ambiguous keyboard for efficient one-key text entry , 2010, TCHI.

[4]  Poika Isokoski,et al.  Text input methods for eye trackers using off-screen targets , 2000, ETRA.

[5]  Shumin Zhai,et al.  Shorthand writing on stylus keyboard , 2003, CHI '03.

[6]  I. Scott MacKenzie,et al.  1 thumb, 4 buttons, 20 words per minute: design and evaluation of H4-writer , 2011, UIST.

[7]  Ken Perlin,et al.  Quikwriting: continuous stylus-based text entry , 1998, UIST '98.

[8]  Jorge Igual,et al.  A Prototype Scanning System with an Ambiguous Keyboard and a Predictive Disambiguation Algorithm , 2010, ICCHP.

[9]  Brian Roark,et al.  RSVP keyboard: An EEG based typing interface , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[10]  John Paulin Hansen,et al.  Language Technology in a Predictive, Restricted On-screen Keyboard with Ambiguous Layout for Severely Disabled People , 2003 .

[11]  Kari-Jouko Räihä,et al.  An exploratory study of eye typing fundamentals: dwell time, text entry rate, errors, and workload , 2012, CHI.

[12]  Peng-Yeng Yin,et al.  Optimal character arrangement for ambiguous keyboards using a PSO-based algorithm , 2011, 2011 Seventh International Conference on Natural Computation.

[13]  I. Scott MacKenzie,et al.  BlinkWrite2: an improved text entry method using eye blinks , 2010, ETRA '10.

[14]  Manuel Merino Monge,et al.  Comparison Among Ambiguous Virtual Keyboards For People With Severe Motor Disabilities , 2011 .

[15]  W. Teahan.  Probability estimation for PPM , 1995 .

[16]  Adam J. Sporka.  Czech Technical University in Prague Faculty of Electrical Engineering Department of Computer Science and Engineering Non-speech Sounds for User Interface Control , 2008 .

[17]  Thomas Grechenig,et al.  TwoStick: writing with a game controller , 2007, GI '07.

[18]  Yao-Ming Yeh,et al.  Designing a Scanning On-Screen Keyboard for People with Severe Motor Disabilities , 2008, ICCHP.

[19]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[20]  David A. Huffman,et al.  A method for the construction of minimum-redundancy codes , 1952, Proceedings of the IRE.

[21]  Gregory W. Lesher,et al.  Techniques for augmenting scanning communication , 1998 .

[22]  Miika Silfverberg.  Historical Overview of Consumer Text Entry Technologies , 2007 .

[23]  D. Dours,et al.  VITIPI: versatile interpretation of text input by persons with impairments , 1996 .

[24]  Shumin Zhai,et al.  Optimised Virtual Keyboards with and without Alphabetical Ordering - A Novice User Study , 2001, INTERACT.

[25]  Päivi Majaranta,et al.  Scrollable Keyboards for Eye Typing , 2008 .

[26]  Brad A. Myers,et al.  EdgeWrite: a stylus-based text entry method designed for high accuracy and stability of motion , 2003, UIST '03.

[27]  Cuntai Guan,et al.  P300 Brain-Computer Interface Design for Communication and Control Applications , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[28]  Philippe BOISSIERE boissier.  An Overview of Existing Writing Assistance Systems , 2003 .

[29]  John Paulin Hansen,et al.  Gaze typing compared with input by head and hand , 2004, ETRA.

[30]  Grigori Evreinov,et al.  Four-Key Text Entry for Physically Challenged People , 2004 .

[31]  I. Scott MacKenzie.  The one-key challenge: searching for a fast one-key text entry method , 2009, Assets '09.

[32]  I. Witten,et al.  The Reactive Keyboard: a predictive typing aid , 1990, Computer.

[33]  John Paulin Hansen,et al.  Augmentative and Alternative Communication: The Future of Text on the Move , 2002, User Interfaces for All.

[34]  Saad Mohamed Lafi,et al.  An Adaptive Text Entry Method Based On Single- Key Minimal Scan Matrix for People with Severe Motor Disabilities , 2012 .

[35]  Brad A. Myers,et al.  Joystick text entry with date stamp, selection keyboard, and EdgeWrite , 2004, CHI EA '04.

[36]  Pavel Slavik,et al.  Predictive Scanning Keyboard Operated by Hissing , 2012, BioMed 2012.

[37]  Päivi Majaranta,et al.  Twenty years of eye typing: systems and design issues , 2002, ETRA.

[38]  Frédéric Vella,et al.  Adaptation of AAC to the Context Communication: A Real Improvement for the User Illustration through the VITIPI Word Completion , 2012, ICCHP.

[39]  Pieter J. Blignaut,et al.  Measuring the performance of gaze and speech for text input , 2012, ETRA '12.

[40]  Xiaoyu Zhao,et al.  Typing with eye-gaze and tooth-clicks , 2012, ETRA.

[41]  Brad A. Myers,et al.  Trackball text entry for people with motor impairments , 2006, CHI.

[42]  H H Koester,et al.  Learning and performance of able-bodied individuals using scanning systems with and without word prediction. , 1994, Assistive technology : the official journal of RESNA.

[43]  I. Scott MacKenzie,et al.  CHANTI: predictive text entry using non-verbal vocal input , 2011, CHI.

[44]  Roope Raisamo,et al.  Device independent text input: a rationale and an example , 2000, AVI '00.

[45]  R A Chubon,et al.  An enhanced standard computer keyboard system for single-finger and typing-stick typing. , 1988, Journal of rehabilitation research and development.

[46]  I. Scott MacKenzie,et al.  Movement time prediction in human-computer interfaces , 1992 .

[47]  J Peter Rosenfeld,et al.  Detecting Knowledge of Incidentally Acquired, Real-World Memories Using a P300-Based Concealed-Information Test , 2014, Psychological science.

[48]  Per Ola Kristensson,et al.  The potential of dwell-free eye-typing for fast assistive gaze communication , 2012, ETRA.

[49]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[50]  Robert J. Teather,et al.  FittsTilt: the application of Fitts' law to tilt-based interaction , 2012, NordiCHI.

[51]  Georgios Kouroupetroglou.  Assistive Technologies and Computer Access for Motor Disabilities , 2013 .

[52]  Constantine Stephanidis,et al.  An Accessible and Usable Soft Keyboard , 2007, HCI.

[53]  Young Chol Song.  Joystick text entry with word prediction for people with motor impairments , 2010, ASSETS '10.

[54]  Allen and Rosenbloom Paul S. Newell,et al.  Mechanisms of Skill Acquisition and the Law of Practice , 1993 .

[55]  Shari Trewin.  CHAPTER 15 – Text Entry When Movement is Impaired , 2007 .

[56]  Bill Z. Manaris,et al.  SUITEKeys: a speech understanding interface for the motor-control challenged , 1998, Assets '98.

[57]  Franck Poirier,et al.  Text entry for mobile devices and users with severe motor impairments: handiglyph, a primitive shapes based onscreen keyboard , 2008, Assets '08.

[58]  Rick Kjeldsen.  An On-Screen Keyboard for Users with Poor Pointer Control , 2007, HCI.

[59]  Clare-Marie Karat,et al.  Productivity, satisfaction, and interaction strategies of individuals with spinal cord injuries and traditional users interacting with speech recognition software , 2001, Universal Access in the Information Society.

[60]  Sayan Sarcar,et al.  EyeBoard: A fast and accurate eye gaze-based text entry system , 2012, 2012 4th International Conference on Intelligent Human Computer Interaction (IHCI).

[61]  I. Scott MacKenzie,et al.  LetterWise: prefix-based disambiguation for mobile text input , 2001, UIST '01.

[62]  Brian Roark,et al.  Huffman scanning: Using language models within fixed-grid keyboard emulation , 2013, Comput. Speech Lang..

[63]  Keith Vertanen,et al.  Speech dasher: fast writing using speech and gaze , 2010, CHI.

[64]  I. Scott MacKenzie,et al.  Effects of feedback and dwell time on eye typing speed and accuracy , 2006, Universal Access in the Information Society.

[65]  Constantine Stephanidis,et al.  AN ACCESSIBLE WORD PROCESSOR FOR DISABLED PEOPLE , 2013 .

[66]  Donald A. Norman,et al.  Why Alphabetic Keyboards Are Not Easy to Use: Keyboard Layout Doesn't Much Matter , 1982 .

[67]  Anke Huckauf,et al.  Alternatives to single character entry and dwell time selection on eye typing , 2010, ETRA.

[68]  I. Scott MacKenzie,et al.  The design and evaluation of a high-performance soft keyboard , 1999, CHI '99.

[69]  M. Betke,et al.  The Camera Mouse: visual tracking of body features to provide computer access for people with severe disabilities , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[70]  Alan F. Blackwell,et al.  Dasher—a data entry interface using continuous gestures and language models , 2000, UIST '00.

[71]  Nestor Garay-Vitoria,et al.  Text prediction systems: a survey , 2006, Universal Access in the Information Society.

[72]  Peter E Jones.  Virtual keyboard with scanning and augmented by prediction , 1998 .

[73]  Mathieu Raynal,et al.  Evaluation of SpreadKey System with Motor Impaired Users , 2010, ICCHP.

[74]  Yao-Ming Yeh,et al.  A Flexible On-Screen Keyboard: Dynamically Adapting for Individuals' Needs , 2007, HCI.

[75]  Simon Judge,et al.  Ambiguous keyboards for AAC , 2011 .

[76]  I. Scott MacKenzie.  CHAPTER 4 – Evaluation of Text Entry Techniques , 2007 .

[77]  Rainer Nordmann,et al.  Automatic and self-paced scanning for alternative text entry , 2008 .

[78]  Oleg Spakov,et al.  Fast gaze typing with an adjustable dwell time , 2009, CHI.

[79]  R. Andres,et al.  Prediction of Head Movement Time Using Fitts’ Law , 1989 .

[80]  John L. Arnott.  Text Entry in Augmentative and Alternative Communication , 2005, Efficient Text Entry.

[81]  Jacob O. Wobbrock,et al.  Longitudinal evaluation of discrete consecutive gaze gestures for text entry , 2008, ETRA.

[82]  Stephan Rinderknecht,et al.  Using a game controller for text entry to address abilities and disabilities specific to persons with neuromuscular diseases , 2011, ASSETS '11.

[83]  Andriy Pavlovych,et al.  Less-Tap: A Fast and Easy-to-learn Text Input Technique for Phones , 2003, Graphics Interface.

[84]  I. Scott MacKenzie,et al.  Measuring errors in text entry tasks: an application of the Levenshtein string distance statistic , 2001, CHI Extended Abstracts.

[85]  I. Scott MacKenzie,et al.  BlinkWrite: efficient text entry using eye blinks , 2011, Universal Access in the Information Society.

[86]  Karin Harbusch,et al.  Towards an adaptive communication aid with text input from ambiguous keyboards , 2003 .

[87]  Poika Isokoski,et al.  Now Dasher! Dash away!: longitudinal study of fast text entry by Eye Gaze , 2008, ETRA.

[88]  Kathleen F. McCoy,et al.  Generating text from compressed input: an intelligent interface for people with severe motor impairments , 1992, CACM.

[89]  Jukka Lekkala,et al.  Text Entry by Gazing and Smiling , 2013, Adv. Hum. Comput. Interact..

[90]  Kent Lyons,et al.  Twiddler typing: one-handed chording text entry for mobile phones , 2004, CHI.

[91]  I. Scott MacKenzie,et al.  Half-QWERTY: a one-handed keyboard facilitating skill transfer from QWERTY , 1993, INTERCHI.

[92]  Zdenek Míkovec,et al.  Measuring Performance of a Predictive Keyboard Operated by Humming , 2012, ICCHP.

[93]  Yun Fu,et al.  hMouse: Head Tracking Driven Virtual Computer Mouse , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[94]  Julio Miró-Borrás,et al.  Text Entry in the E-Commerce Age: Two Proposals for the Severely Handicapped , 2009, J. Theor. Appl. Electron. Commer. Res..

[95]  Kumiko Tanaka-Ishii,et al.  Dit4dah: Predictive Pruning for Morse Code Text Entry , 2004, IJCNLP.

[96]  Melanie Baljko,et al.  Indirect text entry using one or two keys , 2006, Assets '06.

[97]  I. Scott MacKenzie,et al.  Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric , 2003, CHI '03.

[98]  Sri Kurniawan,et al.  Non-speech Operated Emulation of Keyboard , 2006 .

[99]  Jun Gong,et al.  Alphabetically constrained keypad designs for text entry on mobile devices , 2005, CHI.

[100]  Tonio Wandmacher,et al.  Sibylle, An Assistive Communication System Adapting to the Context and Its User , 2008, TACC.

[101]  Constantine Stephanidis,et al.  Scanning-Based Interaction Techniques for Motor Impaired Users , 2014 .

[102]  Andrey Ronzhin,et al.  Assistive multimodal system based on speech recognition and head tracking , 2005, 2005 13th European Signal Processing Conference.

[103]  Jacob O. Wobbrock,et al.  Measures of Text Entry Performance , 2007 .

[104]  John Paulin Hansen,et al.  Low-cost gaze interaction: ready to deliver the promises , 2009, CHI Extended Abstracts.

[105]  I. Scott MacKenzie,et al.  Modeling Text Input for Single-Switch Scanning , 2012, ICCHP.

[106]  Yong-Hyuk Kim,et al.  Optimal designs of ambiguous mobile keypad with alphabetical constraints , 2009, GECCO '09.

[107]  Frédéric Maire,et al.  Hands-free mouse-pointer manipulation using motion-tracking and speech recognition , 2007, OZCHI '07.

[108]  Ian H. Witten,et al.  The zero-frequency problem: Estimating the probabilities of novel events in adaptive text compression , 1991, IEEE Trans. Inf. Theory.

[109]  Kenji Itoh,et al.  Language Technology in a Predictive, Restricted On-Screen Keyboard with Dynamic Layout for Severely Disabled People , 2003 .

[110]  I. Scott MacKenzie,et al.  KSPC (Keystrokes per Character) as a Characteristic of Text Entry Techniques , 2002, Mobile HCI.

[111]  Karin Harbusch,et al.  An Evaluation Study of Two–Button Scanning with Ambiguous Keyboards , 2004 .

[112]  Carlos Hitoshi Morimoto,et al.  Context switching for fast key selection in text entry applications , 2010, ETRA.

[113]  Michael Kühn,et al.  Predictive and highly ambiguous typing for a severely speech and motion impaired user , 2001, HCI.

[114]  D Anson,et al.  Efficiency of the Chubon versus the QWERTY Keyboard , 2001, Assistive technology : the official journal of RESNA.

[115]  Niels Birbaumer,et al.  On the building of binary spelling interfaces for augmentative communication , 2005, IEEE Transactions on Biomedical Engineering.

[116]  Stuart M. Shieber,et al.  Abbreviated text input , 2003, IUI '03.

[117]  R. Likert.  “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[118]  I. Scott MacKenzie,et al.  Eye typing using word and letter prediction and a fixation algorithm , 2008, ETRA.

[119]  Nellie L. Merrick,et al.  Typewriting Behavior: Psychology Applied to Teaching and Learning Typewriting , 1936 .

[120]  Robert J. K. Jacob,et al.  Evaluation of eye gaze interaction , 2000, CHI.

[121]  Brian Roark,et al.  An ERP-based Brain-Computer Interface for text entry using Rapid Serial Visual Presentation and Language Modeling , 2011, ACL.

[122]  Zdenek Míkovec,et al.  Humsher: a predictive keyboard operated by humming , 2011, ASSETS.

[123]  Cliff Kushler.  AAC: Using a Reduced Keyboard. , 1998 .

[124]  Maneesh Agrawala,et al.  Text entry using a dual joystick game controller , 2006, CHI.

[125]  Bill Z. Manaris,et al.  An Intelligent Interface for Keyboard and Mouse Control -- Providing Full Access to PC Functionality via Speech , 2001, FLAIRS Conference.

[126]  Kumiko Tanaka-Ishii,et al.  Entering Text with a Four-Button Device , 2002, COLING.

[127]  G W Lesher,et al.  Optimal character arrangements for ambiguous keyboards. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[128]  Julio Miró,et al.  Text Entry System Based on a Minimal Scan Matrix for Severely Physically Handicapped People , 2008, ICCHP.

[129]  Howard Gutowitz.  Barriers to Adoption of Dictionary-Based Text-Entry Methods: A Field Study , 2003 .

[130]  Thomas S. Huang,et al.  Face as mouse through visual face tracking , 2007, Comput. Vis. Image Underst..

[131]  Foad Hamidi,et al.  CanSpeak: A Customizable Speech Interface for People with Dysarthric Speech , 2010, ICCHP.

[132]  Girijesh Prasad,et al.  Designing a virtual keyboard with multi-modal access for people with disabilities , 2011, 2011 World Congress on Information and Communication Technologies.

[133]  Jorge Igual,et al.  Evaluation of an ambiguous-keyboard prototype scanning-system with word and character disambiguation , 2010, BCS HCI.

[134]  I. Scott MacKenzie,et al.  Qanti: A Software Tool for Quick Ambiguous Non-standard Text Input , 2010, ICCHP.

[135]  Jan Silovský,et al.  Challenges in Speech Processing of Slavic Languages (Case Studies in Speech Recognition of Czech and Slovak) , 2009, COST 2102 Training School.

[136]  Bernd Freisleben,et al.  HaWCoS: the "hands-free" wheelchair control system , 2002, ASSETS.

[137]  Shumin Zhai,et al.  The metropolis keyboard - an exploration of quantitative techniques for virtual keyboard design , 2000, UIST '00.

[138]  Fernando G. Lobo,et al.  A virtual logo keyboard for people with motor disabilities , 2007, ITiCSE.

[139]  I. Scott MacKenzie,et al.  DualScribe: A Keyboard Replacement for Those with Friedreich's Ataxia and Related Diseases , 2012, ICCHP.

[140]  Brian Roark,et al.  Scanning methods and language modeling for binary switch typing , 2010, SLPAT@NAACL.

[141]  Stephan Rinderknecht,et al.  3DScan: an environment control system supporting persons with severe motor impairments , 2009, Assets '09.

[142]  Rainer Nordmann,et al.  Alternative text entry using different input methods , 2006, Assets '06.

[143]  I. Scott MacKenzie,et al.  The Immediate Usability of Graffiti , 1997, Graphics Interface.