Designing Tools for High-Quality Alt Text Authoring

Alternative (alt) text provides access to descriptions of digital images for people who use screen readers. While prior work studied screen reader users’ (SRUs’) preferences about alt text and automatic alt text (i.e., alt text generated by artificial intelligence), little work examined the alt text author’s experience composing or editing these descriptions. We built two types of prototype interfaces for two tasks: authoring alt text and providing feedback on automatic alt text. Through combined interview-usability testing sessions with alt text authors and interviews with SRUs, we tested the effectiveness of our prototypes in the context of Microsoft PowerPoint. Our results suggest that authoring interfaces that support authors in choosing what to include in their descriptions result in higher quality alt text. The feedback interfaces highlighted considerable differences in the perceptions of authors and SRUs regarding “high-quality” alt text. Finally, authors crafted significantly lower quality alt text when starting from the automatic alt text compared to starting from a blank box. We discuss the implications of these results on applications that support alt text.

[1]  Meredith Ringel Morris,et al.  Rich Representations of Visual Content for Screen Reader Users , 2018, CHI.

[2]  Meredith Ringel Morris,et al.  “It's almost like they're trying to hide it”: How User-Provided Image Descriptions Have Failed to Make Twitter Accessible , 2019, WWW.

[3]  Virginia Braun,et al.  Reflecting on reflexive thematic analysis , 2019, Qualitative Research in Sport, Exercise and Health.

[4]  Jeffrey P. Bigham,et al.  Twitter A11y: A Browser Extension to Make Twitter Images Accessible , 2020, CHI.

[5]  Valerie Morash,et al.  Guiding Novice Web Workers in Making Image Descriptions Using Templates , 2015, ACM Trans. Access. Comput..

[6]  Meredith Ringel Morris,et al.  Understanding Blind People's Experiences with Computer-Generated Captions of Social Media Images , 2017, CHI.

[7]  Jutta Treviranus,et al.  ChartMaster: A Tool for Interacting with Stock Market Charts using a Screen Reader , 2015, ASSETS.

[8]  Meredith Ringel Morris,et al.  "With most of it being pictures now, I rarely use it": Understanding Twitter's Evolving Accessibility to Blind Users , 2016, CHI.

[9]  Abigale Stangl,et al.  "Person, Shoes, Tree. Is the Person Naked?" What People with Vision Impairments Want in Image Descriptions , 2020, CHI.

[10]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[11]  Gilly Leshed,et al.  How Blind People Interact with Visual Content on Social Networking Services , 2016, CSCW.

[12]  Trisha O'Connell,et al.  Audible Image Description as an Accommodation in Statewide Assessments for Students with Visual and Print Disabilities , 2017 .

[13]  Peng Wang,et al.  Ask Me Anything: Free-Form Visual Question Answering Based on Knowledge from External Sources , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Shaomei Wu,et al.  Automatic Alt-text: Computer-generated Image Descriptions for Blind Users on a Social Network Service , 2017, CSCW.

[15]  Lydia B. Chilton,et al.  Making Memes Accessible , 2019, ASSETS.

[16]  Jeffrey P. Bigham,et al.  “It’s Complicated”: Negotiating Accessibility and (Mis)Representation in Image Descriptions of Race, Gender, and Disability , 2021, CHI.

[17]  Darren Guinness,et al.  EyeDescribe: Combining Eye Gaze and Speech to Automatically Create Accessible Touch Screen Artwork , 2019, ISS.

[18]  Darren Guinness,et al.  Caption Crawler: Enabling Reusable Alternative Text Descriptions using Reverse Image Search , 2018, CHI.

[19]  Yuhang Zhao,et al.  The Effect of Computer-Generated Descriptions on Photo-Sharing Experiences of People with Visual Impairments , 2017, Proc. ACM Hum. Comput. Interact..