Rich Representations of Visual Content for Screen Reader Users

Alt text (short for "alternative text") is descriptive text associated with an image in HTML and other document formats. Screen reader technologies speak the alt text aloud to people who are visually impaired. Introduced with HTML 2.0 in 1995, the alt attribute has not evolved despite significant changes in technology over the past two decades. In light of the expanding volume, purpose, and importance of digital imagery, we reflect on how alt text could be supplemented to offer a richer experience of visual content to screen reader users. Our contributions include articulating the design space of representations of visual content for screen reader users, prototypes illustrating several points within this design space, and evaluations of several of these new image representations with people who are blind. We close by discussing the implications of our taxonomy, prototypes, and user study findings.

[1]  Jian Sun,et al.  Rich Image Captioning in the Wild , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[2]  Nadine Vigouroux,et al.  Accessibility for the blind: An automated audio/tactile description of pictures in digital documents , 2009, 2009 International Conference on Advances in Computational Tools for Engineering Applications.

[3]  Susumu Harada,et al.  Accessible photo album: enhancing the photo sharing experience for people with visual impairment , 2013, CHI.

[4]  André Pimenta Freire,et al.  Guidelines are only half of the story: accessibility problems encountered by blind users on the web , 2012, CHI.

[5]  Yuquan Shi,et al.  E-Government Web Site Accessibility in Australia and China , 2006 .

[6]  Tim Berners-Lee,et al.  Hypertext Markup Language - 2.0 , 1995, RFC.

[7]  Meredith Ringel Morris,et al.  Understanding Blind People's Experiences with Computer-Generated Captions of Social Media Images , 2017, CHI.

[8]  Ella Tallyn,et al.  Audiophotography: practice and prospects , 1999, CHI EA '99.

[9]  S. Pemberton,et al.  Accessible Rich Internet Applications (WAI-ARIA) 1.0 , 2014 .

[10]  Meredith Ringel Morris,et al.  "With most of it being pictures now, I rarely use it": Understanding Twitter's Evolving Accessibility to Blind Users , 2016, CHI.

[11]  Meredith Ringel Morris,et al.  Toward Scalable Social Alt Text: Conversational Crowdsourcing as a Tool for Refining Vision-to-Language Technology for the Blind , 2017, HCOMP.

[12]  Scott McCoy,et al.  The state of corporate website accessibility , 2009, CACM.

[13]  Meredith Ringel Morris,et al.  Eyes-Free Art , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[14]  Morten Goodwin,et al.  Global Web Accessibility Analysis of National Government Portals and Ministry Web Sites , 2011 .

[15]  Manuel Blum,et al.  Improving accessibility of the web with a computer game , 2006, CHI.

[16]  Geoffrey Zweig,et al.  From captions to visual concepts and back , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  John M. Slatin,et al.  Maximum Accessibility: Making Your Web Site More Usable for Everyone , 2002 .

[18]  Richard E. Ladner,et al.  WebInSight:: making web images accessible , 2006, Assets '06.

[19]  Sri Hastuti Kurniawan,et al.  Blind Photographers and VizSnap: A Long-Term Study , 2016, ASSETS.

[20]  Valerie Morash,et al.  Guiding Novice Web Workers in Making Image Descriptions Using Templates , 2015, ACM Trans. Access. Comput..

[21]  Meredith Ringel Morris,et al.  Gauging Receptiveness to Social Microvolunteering , 2015, CHI.

[22]  Jonathan Lazar,et al.  Accessibility of U.S. federal government home pages: Section 508 compliance and site accessibility statements , 2011, Gov. Inf. Q..

[23]  Gilly Leshed,et al.  How Blind People Interact with Visual Content on Social Networking Services , 2016, CSCW.

[24]  Scott C. LaBarre ABA resolution and report on website accessibility. , 2007, Mental and physical disability law reporter.

[25]  Jeffrey P. Bigham,et al.  VizWiz: nearly real-time answers to visual questions , 2010, W4A.

[26]  Walter S. Lasecki,et al.  RegionSpeak: Quick Comprehensive Spatial Descriptions of Complex Images for Blind Users , 2015, CHI.

[27]  Shaomei Wu,et al.  Automatic Alt-text: Computer-generated Image Descriptions for Blind Users on a Social Network Service , 2017, CSCW.

[28]  Meredith Ringel Morris,et al.  Investigating the appropriateness of social network question asking as a resource for blind users , 2013, CSCW.

[29]  Jock D. Mackinlay,et al.  The design space of input devices , 1990, CHI '90.