Accessibility of UI Frameworks and Libraries for Programmers with Visual Impairments

—The availability of numerous UI components, the promise of accessibility, and cross-platform support have made UI frameworks (e.g., Flutter, Xamarin, React Native) and libraries (e.g., wxPython) quite popular among software developers. However, their widespread use also highlights the need to understand the experiences of programmers with visual impairments with them. We adopted a mixed-methods design comprising two stud- ies to understand the accessibility and challenges of developing interfaces with UI frameworks and libraries. In Study 1, we analyzed 96 randomly-sampled archived threads of Program-L, a mailing list primarily comprising programmers with visual impairments. In Study 2, we interviewed 18 programmers with visual impairments to confirm the findings from Study 1 and gain a deeper understanding of their motivations and experiences in using UI frameworks. Our participants considered UI development essential to their programming responsibilities and sought to acquire relevant skills and expertise. However, accessibility barriers in programming tools and UI frameworks complicated the processes of writing UI code, debugging, testing, and collaborating with sighted colleagues. Our paper concludes with recommendations grounded in empirical findings to improve the accessibility of frameworks and libraries.

[1]  Michael Longley,et al.  Accessibility Support in Web Frameworks , 2021, ASSETS.

[2]  Kevin M. Storer,et al.  ”It’s Just Everything Outside of the IDE that’s the Problem”:: Information Seeking by Software Developers with Visual Impairments , 2021, CHI.

[3]  Jon E. Froehlich,et al.  Examining Visual Semantic Understanding in Blind and Low-Vision Technology Users , 2021, CHI.

[4]  Andrew Macvean,et al.  Accessibility of Command Line Interfaces , 2021, CHI.

[5]  M. Sile O'Modhrain,et al.  Understanding Accessibility and Collaboration in Programming for People with Visual Impairments , 2021, Proc. ACM Hum. Comput. Interact..

[6]  Claire Kearney-Volpe,et al.  Making the elusive more tangible: remote tools & techniques for teaching web development to screen reader users , 2021, W4A.

[7]  Huaishu Peng,et al.  Tangible Web Layout Design for Blind and Visually Impaired People: An Initial Investigation , 2020, UIST.

[8]  Paige Rodeghero,et al.  Examining The Work Experience of Programmers with Visual Impairments , 2020, 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME).

[9]  2020 IEEE International Conference on Software Maintenance and Evolution (ICSME) , 2020 .

[10]  Dragan Ahmetovic,et al.  Developing Accessible Mobile Applications with Cross-Platform Development Frameworks , 2020, ASSETS.

[11]  Christine Chen,et al.  A Multi-Modal Approach for Blind and Visually Impaired Developers to Edit Webpage Designs , 2019, ASSETS.

[12]  Frode Eika Sandnes,et al.  Still Not Readable? An Interactive Tool for Recommending Color Pairs with Sufficient Contrast based on Existing Visual Designs , 2019, ASSETS.

[13]  Sean Follmer,et al.  Editing Spatial Layouts through Tactile Templates for People with Visual Impairments , 2019, CHI.

[14]  Richard E. Ladner,et al.  Educational Experiences of Blind Programmers , 2019, SIGCSE.

[15]  Shriram Krishnamurthi,et al.  Accessible AST-Based Programming for Visually-Impaired Programmers , 2019, SIGCSE.

[16]  Collin McMillan,et al.  AudioHighlight: Code Skimming for Blind Programmers , 2018, 2018 IEEE International Conference on Software Maintenance and Evolution (ICSME).

[17]  Manohar Swaminathan,et al.  CodeTalk: Improving Programming Environment Accessibility for Visually Impaired Developers , 2018, International Conference on Human Factors in Computing Systems.

[18]  Oussama Metatla,et al.  An Initial Investigation into Non-visual Code Structure Overview Through Speech, Non-speech and Spearcons , 2018, CHI Extended Abstracts.

[19]  Stephanie Ludi,et al.  Interviews and Observation of Blind Software Developers at Work to Understand Code Navigation Challenges , 2017, ASSETS.

[20]  Stephanie Ludi,et al.  Eliciting Programming Challenges Faced by Developers with Visual Impairments: Exploratory Study , 2016, 2016 IEEE/ACM Cooperative and Human Aspects of Software Engineering (CHASE).

[21]  Richard E. Ladner,et al.  StructJumper: A Tool to Help Blind Programmers Navigate and Understand the Structure of Code , 2015, CHI.

[22]  Ravi Kuber,et al.  How accessible is the process of web interface design? , 2013, ASSETS.

[23]  Yagiz Onat Yazir,et al.  Tradeoffs in cross platform solutions for mobile assistive technology , 2013, 2013 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM).

[24]  Emerson R. Murphy-Hill,et al.  An exploratory study of blind software developers , 2012, 2012 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[25]  Tim A. Majchrzak,et al.  Evaluating Cross-Platform Development Approaches for Mobile Applications , 2012, WEBIST.

[26]  Andreas Stefik,et al.  Using spoken text to aid debugging: An empirical study , 2009, 2009 IEEE 17th International Conference on Program Comprehension.

[27]  Johnny Saldaña,et al.  The Coding Manual for Qualitative Researchers , 2009 .

[28]  Robert M. Siegfried Visual programming and the blind: the challenge and the opportunity , 2006, SIGCSE '06.

[29]  Ann C. Smith,et al.  Computer science accessibility for students with visual disabilities , 2002, SIGCSE '02.

[30]  T. V. Raman,et al.  Emacspeak—direct speech access , 1996, Assets '96.

[31]  J. Morse The Significance of Saturation , 1995 .

[32]  Claudia Loitsch,et al.  Accessibility Analysis of the Eclipse IDE for Users with Visual Impairment , 2017, AAATE Conf..

[33]  Chris Aldrich,et al.  Stack Overflow Developer Survey 2015 , 2015 .

[34]  Daniel D. Garcia,et al.  SODBeans , 2009, 2009 IEEE 17th International Conference on Program Comprehension.