An Initial Investigation into Non-visual Code Structure Overview Through Speech, Non-speech and Spearcons

We investigate a novel, non-visual approach to overviewing object-oriented source code and evaluate the efficiency of different categories of sounds for the purpose of getting an overview of source code structure for a visually-impaired computer programmer. A user-study with ten sighted and three non-sighted participants compared the effectiveness of speech, non-speech and spearcons on measures of accuracy and enjoyment for the task of quickly overviewing a class file. Results showed positive implications for the use of non-speech sounds in identifying programming constructs and for aesthetic value, although the effectiveness of the other sound categories in these measurements are not ruled out. Additionally, various design choices of the application impacted results, which should be of interest to designers of auditory display, accessibility and education.

[1]  Ben Shneiderman,et al.  Sonification of Geo-Referenced Data for Auditory Information Seeking: Design Principle and Pilot Study , 2004, ICAD.

[2]  Emerson R. Murphy-Hill,et al.  An exploratory study of blind software developers , 2012, 2012 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[3]  Myounghoon Jeon,et al.  Ergonomics Society of the Human Factors and Human Factors: The Journal , 2012 .

[4]  Stephanie Ludi,et al.  Exploration of the Use of Auditory Cues in Code Comprehension and Navigation for Individuals with Visual Impairments in a Visual Programming Environment , 2016, ASSETS.

[5]  Lewis Irwin Berman,et al.  Using sound to understand software architecture , 2009, SIGDOC '09.

[6]  Marilyn Tremaine CHI '01 Extended Abstracts on Human Factors in Computing Systems , 2001, CHI Extended Abstracts.

[7]  Stephanie Ludi,et al.  Eliciting Programming Challenges Faced by Developers with Visual Impairments: Exploratory Study , 2016, 2016 IEEE/ACM Cooperative and Human Aspects of Software Engineering (CHASE).

[8]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[9]  Tony Stockman,et al.  A comparative analysis of the information-seeking behavior of visually impaired and sighted searchers , 2012, J. Assoc. Inf. Sci. Technol..

[10]  Stephen A. Brewster,et al.  Non-visual overviews of complex data sets , 2006, CHI EA '06.

[11]  Oussama Metatla,et al.  The Influence of Screen-Readers on Web Cognition , 2008 .

[12]  Ben Matthews,et al.  Designing for visually impaired developers , 2015 .

[13]  Richard E. Ladner,et al.  StructJumper: A Tool to Help Blind Programmers Navigate and Understand the Structure of Code , 2015, CHI.