What Frustrates Screen Reader Users on the Web: A Study of 100 Blind Users

Abstract In previous research, the computer frustrations of student and workplace users have been documented. However, the challenges faced by blind users on the Web have not been previously examined. In this study, 100 blind users, using time diaries, recorded their frustrations using the Web. The top causes of frustration reported were (a) page layout causing confusing screen reader feedback; (b) conflict between screen reader and application; (c) poorly designed/unlabeled forms; (d) no alt text for pictures; and (e) 3-way tie between misleading links, inaccessible PDF, and a screen reader crash. Most of the causes of frustration, such as inappropriate form and graphic labels and confusing page layout, are relatively simple to solve if Webmasters and Web designers focus on this effort. In addition, the more technically challenging frustrations, such as screen reader crashes and conflicts, need to be addressed by the screen reader developers. Blind users in this study were likely to repeatedly attempt to solve a frustration, not give up, and not reboot the computer. In this study, the blind users reported losing, on average, 30.4% of time due to these frustrating situations. Implications for Web developers, screen reader developers, and screen reader users are discussed in this article.

[1]  A. Murrell,et al.  The impact of negative attitudes toward computers on employees' satisfaction and commitment within a small company , 1993 .

[2]  Jonathan Lazar,et al.  Improving web accessibility: a study of webmaster perceptions , 2004, Comput. Hum. Behav..

[3]  Rebecca Matson,et al.  Barriers to use: usability and content accessibility on the Web's most popular sites , 2000, CUU '00.

[4]  LazarJonathan,et al.  A taxonomy of novice user perception of error on the Web , 2004 .

[5]  Donald A. Norman,et al.  Design rules based on analyses of human error , 1983, CACM.

[6]  Michael G. Paciello.  Web Accessibility for People with Disabilities , 2000 .

[7]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[8]  Claude Ghaoui,et al.  Designing a humane multimedia interface for the visually impaired , 2001 .

[9]  Ben Shneiderman,et al.  Determining Causes and Severity of End-User Frustration , 2004, Int. J. Hum. Comput. Interact..

[10]  Philip Calvert,et al.  Evaluating Networked Information Services: Techniques, Policy and Issues , 2003 .

[11]  Michael Frese,et al.  Error training: Replication and the function of exploratory behavior , 1994, Int. J. Hum. Comput. Interact..

[12]  Jonathan Lazar,et al.  One year older, but not necessarily wiser: an evaluation of homepage accessibility problems over time , 2006, Universal Access in the Information Society.

[13]  Irina Ceaparu,et al.  Governmental Statistical Data on the Web: A case study of FedStats , 2003 .

[14]  B. Shneiderman.  Universal Usability: Pushing Human-Computer Interaction Research to Empower Every Citizen , 1999 .

[15]  B. Shneiderman,et al.  A Framework for Auditory Data Exploration and Evaluation with Geo-referenced Data Sonification , 2005 .

[16]  Dieter Zapf,et al.  Age differences in reactions to errors in computer-based work , 1997, Behav. Inf. Technol..

[17]  Scott McCoy,et al.  Web site accessibility: an online sector analysis , 2004, Inf. Technol. People.

[18]  Ben Shneiderman,et al.  Severity and impact of computer user frustration: A comparison of student and workplace users , 2006, Interact. Comput..

[19]  John P. Robinson,et al.  Time for Life: The Surprising Ways Americans Use Their Time , 1998 .

[20]  Xiaomin Zhu,et al.  Web usability: A user-centered design approach , 2007, J. Assoc. Inf. Sci. Technol..

[21]  Ard W. Lazonder,et al.  Error-information in tutorial documentation: Supporting users' errors to facilitate initial skill learning , 1995, Int. J. Hum. Comput. Stud..

[22]  Ben Shneiderman,et al.  Finding governmental statistical data on the Web: A study of categorically organized links for the FedStats topics page , 2004, J. Assoc. Inf. Sci. Technol..

[23]  Michael Frese,et al.  Errors in Training Computer Skills: on the Positive Function of Errors , 1991, Hum. Comput. Interact..

[24]  Mary Zajicek,et al.  A Web navigation tool for the blind , 1998, Assets '98.

[25]  Ben Shneiderman,et al.  Universal usability , 2000, Commun. ACM.

[26]  Jonathan Klein,et al.  Frustrating the user on purpose: using biosignals in a pilot study to detect the user's emotional state , 1998, CHI Conference Summary.

[27]  Jonathan Lazar,et al.  A taxonomy of novice user perception of error on the Web , 2004, Universal Access in the Information Society.

[28]  Ben Shneiderman,et al.  Finding Governmental Statistical Data on the Web: Three Empirical Studies of the FedStats Topics Page (2003) , 2005 .

[29]  Ben Shneiderman,et al.  Workplace user frustration with computers: an exploratory investigation of the causes and severity , 2006, Behav. Inf. Technol..

[30]  Richard L. Hazlett,et al.  Measurement of user frustration: a biologic approach , 2003, CHI Extended Abstracts.

[31]  Jonathan Lazar,et al.  Training Novice Users in Developing Strategies for Responding to Errors When Browsing the Web , 2003, Int. J. Hum. Comput. Interact..

[32]  Shari Trewin,et al.  Keyboard and mouse errors due to motor disabilities , 1999, Int. J. Hum. Comput. Stud..

[33]  Mary Czerwinski,et al.  A diary study of task switching and interruptions , 2004, CHI.

[34]  Jonathan Lazar,et al.  Web accessibility in the Mid-Atlantic United States: a study of 50 homepages , 2003, Universal Access in the Information Society.

[35]  John M. Carroll,et al.  Blocking Learner Error States in a Training-Wheels System , 1984 .

[36]  Bambang Parmanto,et al.  Accessibility of Internet websites through time , 2004, Assets '04.

[37]  C. Nordstrom,et al.  “To Err is Human”: An Examination of the Effectiveness of Error Management Training , 1998 .