Reliability Aware Web Accessibility Experience Metric

Web accessibility metrics can measure the accessibility levels of websites. Although many metrics with different motivations have been proposed, current metrics are limited in their applicability when considering user experience. This study proposes Reliability Aware Web Accessibility Experience Metric (RA-WAEM), a novel Web accessibility metric which considers the user experience of people with disabilities and their reliability in objectively assessing the severity of accessibility barriers. We present an optimization algorithm based on Expectation Maximization to derive the parameters of RA-WAEM efficiently. Moreover, we conduct an extensive accessibility study on 46 websites with 323,098 Web pages and collect the user experience of 122 people. An evaluation on this dataset shows that RA-WAEM outperforms state of the art accessibility metrics in reflecting the user experience.

[1]  Jiajun Bu,et al.  WAEM: A Web Accessibility Evaluation Metric Based on Partial User Experience Order , 2017, W4A.

[2]  Markel Vigo,et al.  Quantitative metrics for measuring web accessibility , 2007, W4A '07.

[3]  Luís Carriço,et al.  Web not for all: a large scale study of web accessibility , 2010, W4A.

[4]  Yeliz Yesilada,et al.  The Expertise Effect on Web Accessibility Evaluation Methods , 2011, Hum. Comput. Interact..

[5]  Emmanuel J. Candès,et al.  Templates for convex cone problems with applications to sparse signal recovery , 2010, Math. Program. Comput..

[6]  Nils Ulltveit-Moe,et al.  Interpreting Results from Large Scale Automatic Evaluation of Web Accessibility , 2006, ICCHP.

[7]  Xiaoming Zeng.  EVALUATION AND ENHANCEMENT OF WEB CONTENT ACCESSIBILITY FOR PERSONS WITH DISABILITIES , 2004 .

[8]  Fernando Sánchez-Figueroa,et al.  Accessibility Metrics of Web Pages for Blind End-Users , 2003, ICWE.

[9]  Yeliz Yesilada,et al.  Testability and validity of WCAG 2.0: the expertise effect , 2010, ASSETS '10.

[10]  Rebecca Matson,et al.  Barriers to use: usability and content accessibility on the Web's most popular sites , 2000, CUU '00.

[11]  Gregg C. Vanderheiden,et al.  Web Content Accessibility Guidelines 1.0 W3C DRAFT Proposed Recommendation , 1999 .

[12]  C. Michael Sperberg-McQueen,et al.  World Wide Web Consortium , 2009, Encyclopedia of Database Systems.

[13]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .