Mobile device impairment … similar problems, similar solutions?

Previous studies have defined a new type of impairment in which an able-bodied user's behaviour is impaired by both the characteristics of a device and the environment in which it is used. This behavioural change is defined as a situationally-induced impairment and is often associated with small devices used in a mobile setting or constrained environment. Relatively little is known of its extent or the magnitude of the problems faced by the user. Here, we place the work that has been undertaken into a comparative framework of impairment in the context of data input. Our survey finds that 12 problems exist which define all impaired input and we look to understand the similarities and possible solutions in the new impairment group of small device users. For instance, from the literature, we find that users who are both situationally and motor impaired: press keys more than once, do not use enough force and so a key is not activated, and accidentally type keys in reverse order. A wealth of other errors exist in the motor impaired domain but work does not exist to support their existence in the situational domain. However, if commonalities exist for some – it seems work should be enacted to uncover the commonalities of all. Establishing these possible commonalities is important because solutions from one domain can be leveraged into another thereby saving the need to reinvent interventions which already exist elsewhere.

[1]  Ben Shneiderman,et al.  Is Bigger Better? The Effects of Display Size on Program Reading , 1987, HCI.

[2]  Vicki L. Hanson,et al.  COMPUTING TECHNOLOGIES FOR DEAF AND HARD OF HEARING USERS , 2009 .

[3]  I. Scott MacKenzie,et al.  One-Handed Touch Typing on a QWERTY keyboard , 1996, Hum. Comput. Interact..

[4]  B Phillips,et al.  Predictors of assistive technology abandonment. , 1993, Assistive technology : the official journal of RESNA.

[5]  Stephen A. Brewster,et al.  Feeling what you hear: tactile feedback for navigation of audio graphs , 2006, CHI.

[6]  S. Sivadas,et al.  Short message dictation on Symbian series 60 mobile phones , 2006, ICMI '06.

[7]  Andy Cockburn,et al.  An Evaluation of Mobile Phone Text Input Methods , 2002, AUIC.

[8]  Simeon Keates,et al.  Effect of age and Parkinson's disease on cursor positioning using a mouse , 2005, Assets '05.

[9]  T. Landauer,et al.  Handbook of Human-Computer Interaction , 1997 .

[10]  Brad A. Myers,et al.  Integrating isometric joysticks into mobile phones for text entry , 2006, CHI EA '06.

[11]  Dennis E. Egan,et al.  Handbook of Human Computer Interaction , 1988 .

[12]  Rhys Lewis,et al.  The meaning of 'life': capturing intent from web authors , 2006, W4A '06.

[13]  Andrew Dillon,et al.  The effects of display size and text splitting on reading lengthy text from screen , 1990 .

[14]  Roderick Murray-Smith,et al.  Shoogle: excitatory multimodal interaction on mobile devices , 2007, CHI.

[15]  Brad A. Myers,et al.  Text entry from power wheelchairs: edgewrite for joysticks and touchpads , 2004, Assets '04.

[16]  Armando Barreto,et al.  Low vision: the role of visual acuity in the efficiency of cursor movement , 2000, Assets '00.

[17]  Andrew Sears,et al.  How do people tap when walking? An empirical investigation of nomadic data entry , 2007, Int. J. Hum. Comput. Stud..

[18]  I. Scott MacKenzie,et al.  LetterWise: prefix-based disambiguation for mobile text input , 2001, UIST '01.

[19]  Stephen A. Brewster,et al.  Multimodal 'eyes-free' interaction techniques for wearable devices , 2003, CHI '03.

[20]  David R. Morse,et al.  Using while moving: HCI issues in fieldwork environments , 2000, TCHI.

[21]  Mark D. Dunlop,et al.  Predictive text entry methods for mobile phones , 2000, Personal Technologies.

[22]  I. Scott MacKenzie,et al.  Predicting text entry speed on mobile phones , 2000, CHI.

[23]  K. Hinckley Input technologies and techniques , 2002 .

[24]  Christina L. James,et al.  Text input for mobile devices: comparing model prediction to actual performance , 2001, CHI.

[25]  Sang D. Choi,et al.  The impact of age on computer input device use:: Psychophysical and physiological measures , 1999 .

[26]  Yeliz Yesilada,et al.  What input errors do you experience? Typing and pointing errors of mobile Web users , 2010, Int. J. Hum. Comput. Stud..

[27]  Yeliz Yesilada,et al.  Proceedings of the 2006 international cross-disciplinary workshop on Web accessibility (W4A): Building the mobile web: rediscovering accessibility? , 2006 .

[28]  Xiao Li,et al.  The vocal joystick:: evaluation of voice-based cursor control techniques , 2006, Assets '06.

[29]  Brad A. Myers,et al.  An alternative to push, press, and tap-tap-tap: gesturing on an isometric joystick for mobile phone text entry , 2007, CHI.

[30]  J. Jacko,et al.  The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications , 2002 .

[31]  Jeffrey Nichols,et al.  Using handhelds to help people with motor impairments , 2002, Assets '02.

[32]  Virpi Roto,et al.  Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI , 2005, CHI.

[33]  Peter Gregor,et al.  Human Computer Interfaces for People with Disabilities , 1997 .

[34]  Jon Froehlich,et al.  Barrier pointing: using physical edges to assist target acquisition on mobile device touch screens , 2007, Assets '07.

[35]  Ian Oakley,et al.  Putting the feel in ’look and feel‘ , 2000, CHI.

[36]  Stephen A. Brewster,et al.  Gestural and audio metaphors as a means of control for mobile devices , 2002, CHI.

[37]  Chieko Asakawa What's the web like if you can't see it? , 2005, W4A '05.

[38]  Vicki L. Hanson,et al.  General writing guidelines for technology and people with disabilities , 2008, ASAC.

[39]  Carole A. Goble,et al.  Building the Mobile Web: rediscovering accessibility? , 2007, Universal Access in the Information Society.

[40]  Marilyn Tremaine,et al.  Bullseye! when Fitts' law doesn't fit , 1998, CHI '98.

[41]  Tovi Grossman,et al.  The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area , 2005, CHI.

[42]  Carole A. Goble,et al.  Building the mobile web: rediscovering accessibility?: W4A - International Cross-Disciplinary Workshop on Web Accessibility workshop report -- 2006 , 2006, ASAC.

[43]  R. Adkins,et al.  The Effects of Aging on Employment of People With and Without Disabilities , 2006 .

[44]  Stephen A. Brewster,et al.  Tac-tiles: multimodal pie charts for visually impaired users , 2006, NordiCHI '06.

[45]  Joseph Sharit,et al.  Aging, Motor Control, and the Performance of Computer Mouse Tasks , 1999, Hum. Factors.

[46]  Melissa Dawe,et al.  Understanding mobile phone requirements for young adults with cognitive disabilities , 2007, Assets '07.

[47]  David Maxwell Chickering,et al.  Improving command and control speech recognition on mobile devices: using predictive user models for language modeling , 2006, User Modeling and User-Adapted Interaction.

[48]  P A Kolers,et al.  Readability of Text Scrolled on Visual Display Terminals as a Function of Window Size , 1983, Human factors.

[49]  Joanna McGrenere,et al.  Slipping and drifting: using older users to uncover pen-based target acquisition difficulties , 2007, Assets '07.

[50]  Chris Schmandt,et al.  Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments , 2000, TCHI.

[51]  Etsuya Shibayama,et al.  The migratory cursor: accurate speech-based cursor movement by moving multiple ghost cursors using non-verbal vocalizations , 2005, Assets '05.

[52]  A. D. Fisk,et al.  Age-related differences in movement control: adjusting submovement structure to optimize performance. , 1997, The journals of gerontology. Series B, Psychological sciences and social sciences.

[53]  John L. Arnott,et al.  Probabilistic character disambiguation for reduced keyboards using small text samples , 1992 .

[54]  SearsAndrew,et al.  An empirical comparison of use-in-motion evaluation scenarios for mobile computing devices , 2005 .

[55]  Patrick Langdon,et al.  Multiple haptic targets for motion-impaired computer users , 2003, CHI '03.

[56]  Carl Gutwin,et al.  A framework of assistive pointers for low vision users , 2000, Assets '00.

[57]  James A. Landay,et al.  Voicedraw: a hands-free voice-driven drawing application for people with motor impairments , 2007, Assets '07.

[58]  Arthur D. Fisk,et al.  Designing for Older Adults: Principles and Creative Human Factors Approaches , 2004 .

[59]  Stephen A. Brewster,et al.  Overcoming the Lack of Screen Space on Mobile Computers , 2002, Personal and Ubiquitous Computing.

[60]  Joseph Sharit,et al.  Understanding sources of user variability in computer-based data entry performance , 1998, Behav. Inf. Technol..

[61]  Anind K. Dey,et al.  Web accessibility for low bandwidth input , 2002, ASSETS.

[62]  Jack Li,et al.  Dynamically adapting GUIs to diverse input devices , 2006, Assets '06.

[63]  Paul B. Kissinger A Human Computer. , 1970 .

[64]  Brad A. Myers,et al.  Trackball text entry for people with motor impairments , 2006, CHI.

[65]  Melissa Dawe,et al.  Desperately seeking simplicity: how young adults with cognitive disabilities and their families adopt assistive technologies , 2006, CHI.

[66]  Andrew Sears,et al.  Speech-based cursor control: a study of grid-based solutions , 2003, ASSETS.

[67]  William Buxton,et al.  ThinSight: versatile multi-touch sensing for thin form-factor displays , 2007, UIST.

[68]  Nestor Garay-Vitoria,et al.  Text prediction systems: a survey , 2006, Universal Access in the Information Society.

[69]  D. Hawthorn,et al.  Possible implications of aging for interface designers , 2000, Interact. Comput..

[70]  Joel S. Greenstein Chapter 55 – Pointing Devices , 1997 .

[71]  Päivi Majaranta,et al.  Twenty years of eye typing: systems and design issues , 2002, ETRA.

[72]  Rainer Malkewitz,et al.  Head pointing and speech control as a hands-free interface to desktop computing , 1998, Assets '98.

[73]  Joseana Macêdo Fechine,et al.  MATRACA: a tool to provide support for people with impaired vision when using the computer for simple tasks , 2009, SAC '09.

[74]  Jun Rekimoto,et al.  Ambient touch: designing tactile interfaces for handheld devices , 2002, UIST '02.

[75]  Marcos Serrano,et al.  Multimodal interaction on mobile phones: development and evaluation using ACICARE , 2006, Mobile HCI.

[76]  Yeliz Yesilada,et al.  Web accessibility guideline aggregation for older users and its validation , 2011, Universal Access in the Information Society.

[77]  Toshiyuki Masui,et al.  An efficient text input method for pen-based computers , 1998, CHI.

[78]  Timothy A. Nichols,et al.  How Old are your Participants? , 2001 .

[79]  François Guimbretière,et al.  Techniques , 2011, Laboratory Investigation.

[80]  Anthony J. Hornof,et al.  EyeDraw: enabling children with severe motor impairments to draw with their eyes , 2005, CHI.

[81]  George Buchanan,et al.  Improving Web Interaction on Small Displays , 1999, Comput. Networks.

[82]  Daniel J. Wigdor,et al.  A comparison of consecutive and concurrent input text entry techniques for mobile phones , 2004, CHI.

[83]  Rick Kjeldsen,et al.  Improvements in vision-based pointer control , 2006, Assets '06.

[84]  Shari Trewin,et al.  Keyboard and mouse errors due to motor disabilities , 1999, Int. J. Hum. Comput. Stud..

[85]  F. Schieber Aging and the Senses , 1992 .

[86]  Mireia Ribera Turró Web Content Accessibility Guidelines 1.0 , 2001 .

[87]  M. Rockstein,et al.  Biology of Aging , 1958 .

[88]  Carl Brown,et al.  Assistive technology computers and persons with disabilities , 1992, CACM.

[89]  Rainer Nordmann,et al.  Alternative text entry using different input methods , 2006, Assets '06.

[90]  Gavriel Salvendy,et al.  Modelling of Menu Design in Computerized Work , 1995, Interact. Comput..

[91]  Andrew Sears,et al.  Physical disabilities and computing technologies: an analysis of impairments , 2002 .

[92]  H. Johnson,et al.  A comparison of 'traditional' and multimedia information systems development practices , 2003, Inf. Softw. Technol..

[93]  Kent Lyons,et al.  Twiddler typing: one-handed chording text entry for mobile phones , 2004, CHI.

[94]  Simeon Keates,et al.  Developing steady clicks:: a method of cursor assistance for people with motor impairments , 2006, Assets '06.

[95]  Patrick Langdon,et al.  Movement time for motion-impaired users assisted by force-feedback: effects of movement amplitude, target width, and gravity well width , 2005, Universal Access in the Information Society.

[96]  Sharon L. Oviatt,et al.  Multimodal system processing in mobile environments , 2000, UIST '00.

[97]  Lorna M. Brown,et al.  Tactile feedback for mobile interactions , 2007, CHI.

[98]  Gregg C. Vanderheiden,et al.  Web content accessibility guidelines 1.0 , 2001, INTR.

[99]  C. Riviere,et al.  Effects of age and disability on tracking tasks with a computer mouse: accuracy and linearity. , 1996, Journal of rehabilitation research and development.

[100]  Roy Want,et al.  Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces , 1998, CHI.

[101]  Jun Rekimoto,et al.  Dual touch: a two-handed interface for pen-based PDAs , 2000, UIST '00.

[102]  Jinwoo Kim,et al.  Do size and structure matter to mobile users? An empirical study of the effects of screen size, information structure, and task complexity on user activities with standard web phones , 2004, Behav. Inf. Technol..

[103]  Paul Blenkhorn,et al.  Six-In - Braille Input from a QWERTY Keyboard , 2004, ICCHP.

[104]  I. Scott MacKenzie,et al.  Text Entry for Mobile Computing: Models and Methods,Theory and Practice , 2002, Hum. Comput. Interact..

[105]  I. Scott MacKenzie,et al.  The design and evaluation of a high-performance soft keyboard , 1999, CHI '99.

[106]  Patrick Langdon,et al.  Mouse movements of motion-impaired users: a submovement analysis , 2003, ASSETS.

[107]  Krzysztof Z. Gajos,et al.  A comparison of area pointing and goal crossing for people with and without motor impairments , 2007, Assets '07.

[108]  Shari Trewin Automating accessibility: the dynamic keyboard , 2003, Assets '04.

[109]  Gregg C. Vanderheiden,et al.  Web Content Accessibility Guidelines 1.0 W3C DRAFT Proposed Recommendation , 1999 .

[110]  Julie A. Jacko,et al.  A review and reappraisal of information technologies within a conceptual framework for individuals with disabilities , 2001, Universal Access in the Information Society.

[111]  Shari Trewin,et al.  Physical usability and the mobile web , 2006, W4A '06.

[112]  Daniel J. Wigdor,et al.  TiltText: using tilt for text input to mobile phones , 2003, UIST '03.

[113]  Peter Gregor,et al.  Information technology for cognitive support , 2002 .

[114]  Andrew Sears,et al.  An empirical comparison of use-in-motion evaluation scenarios for mobile computing devices , 2005, Int. J. Hum. Comput. Stud..

[115]  Marti L. Riemer-Reiss,et al.  Factors Associated with Assistive Technology Discontinuance among Individuals with Disabilities , 2000 .

[116]  Krishna Bharat,et al.  Making computers easier for older adults to use: area cursors and sticky icons , 1997, CHI.

[117]  Armando Barreto,et al.  Visual Impairments , 2008, Web Accessibility.

[118]  Max A. Dixon,et al.  Visual profiles: a critical component of universal access , 1999, CHI '99.

[119]  Bill Z. Manaris,et al.  SUITEKeys: a speech understanding interface for the motor-control challenged , 1998, Assets '98.

[120]  Harold Thimbleby,et al.  Analysis and Simulation of User Interfaces , 2000, BCS HCI.

[121]  Yeliz Yesilada,et al.  Guideline aggregation: web accessibility evaluation for older users , 2009, W4A.