Combinatorial graph creation and navigation for blind people

Blind individuals have been deprived of the use of diagrams as a form of knowledge representation and an aid to problem solving as well as a means of communication. Our focus is on providing them with access to a specific type of diagram – the node-link diagram, also known as a combinatorial graph. Graphs figure prominently in computer science and software engineering as well as chemistry and other fields. Our goal is to provide blind students and professionals with graph representations that approach the computational equivalence of those available to sighted people. A number of applications have been developed specifically and exclusively to give blind users access to graphs, but separate applications are often not equal. We have worked instead to include them in our graph-based application known as ProofChecker which is intended for universal use. In this paper, we provide examples of general diagram accessibility efforts on behalf of blind people, a discussion of important issues in conveying graphs nonvisually, and a review of the work to date in this area. We also describe how ProofChecker has been made accessible to blind users and how these techniques were applied to a commercial graph-based application. Lastly, we propose the development of an universally accessible graph sketching tool. This tool would allow blind and sighted people to work alone or together using the same interface to create and/or examine graphs and use them for design, problem solving, and teaching/learning.

[1]  Robert F. Cohen,et al.  Teaching graphs to visually impaired students using an active auditory interface , 2006, SIGCSE '06.

[2]  David Stotts,et al.  Can We Work Together? , 1905, The Biblical World.

[3]  James A. Landay,et al.  A study of blind drawing practice: creating graphical information without the visual channel , 2000, Assets '00.

[4]  Carole A. Goble,et al.  Rendering tables in audio: the interaction of structure and reading styles , 2003, Assets '04.

[5]  Robert F. Cohen,et al.  PLUMB:: an interface for users who are blind to display, create, and modify graphs , 2006, Assets '06.

[6]  Robert D. Rodman,et al.  ProofChecker: an accessible environment for automata theory correctness proofs , 2007, ITiCSE.

[7]  Susan H. Rodger,et al.  Using JFLAP to interact with theorems in automata theory , 1999, SIGCSE '99.

[8]  Ken Wakita,et al.  SmartColor: disambiguation framework for the colorblind , 2005, Assets '05.

[9]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987, Cogn. Sci..

[10]  Enrico Pontelli,et al.  Non-visual Navigation of Spreadsheet Tables , 2010, ICCHP.

[11]  James L. Alty,et al.  Exploring the use of structured musical stimuli to communicate simple diagrams: the role of context , 2005, Int. J. Hum. Comput. Stud..

[12]  Enrico Pontelli,et al.  Intelligent non-visual navigation of complex HTML structures , 2002, Universal Access in the Information Society.

[13]  Robert F. Cohen,et al.  Accessibility in introductory computer science , 2005, SIGCSE '05.

[14]  Paul Ward,et al.  Structured Development for Real-Time Systems , 1986 .

[15]  James L. Alty,et al.  The rising pitch metaphor: an empirical study , 2005, Int. J. Hum. Comput. Stud..

[16]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[17]  G. Bishop,et al.  BATS: The Blind Audio Tactile Mapping System , 2003 .

[18]  Richard E. Ladner,et al.  Automated tactile graphics translation: in the field , 2007, Assets '07.

[19]  Ravin Balakrishnan,et al.  Fitts' law and expanding targets: Experimental studies and designs for user interfaces , 2005, TCHI.

[20]  Emden R. Gansner,et al.  An open graph visualization system and its applications to software engineering , 2000 .

[21]  Paul Blenkhorn,et al.  Using speech and touch to enable blind people to access schematic diagrams , 1998, J. Netw. Comput. Appl..

[22]  Prasun Dewan,et al.  Sync: A Java Framework for Mobil Collaborative Applications , 1997, Computer.

[23]  Enrico Pontelli,et al.  A domain specific language framework for non-visual browsing of complex HTML structures , 2000, Assets '00.

[24]  Paul Blenkhorn,et al.  Architectures of assistive software applications for Windows-based computers , 2003, J. Netw. Comput. Appl..

[25]  Andrea R. Kennel Audiograf: a diagram-reader for the blind , 1996, Assets '96.

[26]  Ben Shneiderman,et al.  Data Sonification for Users with Visual Impairment: A Case Study with Georeferenced Data , 2008, TCHI.

[27]  Pierluigi Crescenzi,et al.  Making turing machines accessible to blind students , 2012, SIGCSE '12.

[28]  Caroline Jay,et al.  End User Evaluations , 2008, Web Accessibility.

[29]  Susan H. Rodger,et al.  Increasing interaction and support in the formal languages and automata theory course , 2007, ITiCSE '07.

[30]  D A Sumikawa GUIDELINES FOR THE INTEGRATION OF AUDIO CUES INTO COMPUTER USER INTERFACES , 1985 .

[31]  James A. Landay,et al.  Sketching images eyes-free: a grid-based dynamic drawing tool for the blind , 2002, Assets '02.

[32]  Robert F. Cohen,et al.  Teaching data structures to students who are blind , 2007, ITiCSE '07.

[33]  Andy Schürr,et al.  GXL: A graph-based standard exchange format for reengineering , 2006, Sci. Comput. Program..

[34]  Emden R. Gansner,et al.  An open graph visualization system and its applications to software engineering , 2000, Softw. Pract. Exp..

[35]  Jonathan Frank,et al.  Web Accessibility for the Blind: Corporate Social Responsibility  or Litigation Avoidance? , 2008, Proceedings of the 41st Annual Hawaii International Conference on System Sciences (HICSS 2008).

[36]  Jonathan Lazar,et al.  Developing usable CAPTCHAs for blind users , 2007, Assets '07.

[37]  Christopher D. Hundhausen,et al.  On the design of an educational infrastructure for the blind and visually impaired in computer science , 2011, SIGCSE.

[38]  John Langford,et al.  Telling humans and computers apart automatically , 2004, CACM.

[39]  Richard E. Ladner,et al.  Automating tactile graphics translation , 2005, Assets '05.

[40]  Robert F. Cohen,et al.  Using an audio interface to assist users Who are visually impaired with steering tasks , 2006, Assets '06.

[41]  Robert D. Rodman,et al.  GSK: universally accessible graph sketching , 2013, SIGCSE '13.

[42]  James L. Alty,et al.  Communicating graphical information to blind users using music: the role of context , 1998, CHI.

[43]  N. Di Spigna,et al.  The integration of novel EAP-based Braille cells for use in a refreshable tactile display , 2010, Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[44]  Steve Pettifer,et al.  Making Graph-Based Diagrams Work in Sound: The Role of Annotation , 2013, Hum. Comput. Interact..

[45]  Susan H. Rodger,et al.  Increasing visualization and interaction in the automata theory course , 2000, SIGCSE '00.

[46]  Jeffrey P. Bigham,et al.  Evaluating existing audio CAPTCHAs and an interface optimized for non-visual use , 2009, CHI.

[47]  Florbela Pereira,et al.  NavMol 2.0 – A Molecular Structure Navigator/Editor for Blind and Visually Impaired Users† , 2013 .

[48]  Sheryl Burgstahler,et al.  Universal Design in Higher Education: From Principles to Practice. Second Edition. , 2008 .

[49]  Enrico Pontelli,et al.  Mathematics and Accessibility: a Survey , 2007 .

[50]  Rui Yu,et al.  PLUMB: displaying graphs to the blind using an active auditory interface , 2005, Assets '05.

[51]  Christoph Schlieder,et al.  TeDUB: A System for Presenting and Exploring Technical Drawings for Blind People , 2002, ICCHP.

[52]  Cornelius Hagen,et al.  TeDUB: Automatic interpretation and presentation of technical diagrams for blind people , 2004 .

[53]  Helmut Jürgensen,et al.  Setting the table for the blind , 2011, PETRA '11.

[54]  Manuel Blum,et al.  reCAPTCHA: Human-Based Character Recognition via Web Security Measures , 2008, Science.

[55]  Kenneth H. Rosen,et al.  Discrete Mathematics and its applications , 2000 .

[56]  Steve Pettifer,et al.  Issues in the non-visual presentation of graph based diagrams , 2004, Proceedings. Eighth International Conference on Information Visualisation, 2004. IV 2004..

[57]  David Crombie,et al.  TEDUB : PROVIDING ACCESS TO TECHNICAL DRAWINGS FOR PRINT IMPAIRED PEOPLE , 2002 .

[58]  Alasdair King,et al.  Presenting UML Software Engineering Diagrams to Blind People , 2004, ICCHP.

[59]  James H. Aylor,et al.  Can We Work Together? , 2001, Computer.

[60]  Steve Pettifer,et al.  Audio Representation of Graphs: A Quick Look , 2006 .

[61]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[62]  Steve Pettifer,et al.  Evaluation of a non-visual molecule browser , 2003, Assets '04.

[63]  Florbela Pereira,et al.  MOLinsight: A Web Portal for the Processing of Molecular Structures by Blind Students , 2011 .

[64]  Julian R. Ullmann,et al.  An Algorithm for Subgraph Isomorphism , 1976, J. ACM.

[65]  Tanya Orlov,et al.  Superior Serial Memory in the Blind: A Case of Cognitive Compensatory Adjustment , 2007, Current Biology.