AUDiaL: A Natural Language Interface to Make Statistical Charts Accessible to Blind Persons

This paper discusses the design and evaluation of AUDiaL (Accessible Universal Diagrams through Language). AUDiaL is a web-based, accessible natural language interface (NLI) prototype that allows blind persons to access statistical charts, such as bar and line charts, by means of free-formed analytical and navigational queries expressed in natural language. Initial evaluation shows that NLIs are an innovative, promising approach to accessibility of knowledge representation graphics, since, as opposed to traditional approaches, they do not require of additional software/hardware nor user training while allowing users to carry out most tasks commonly supported by data visualization techniques in an efficient, natural manner.

[1]  Gordon E. Legge,et al.  Designing Media for Visually-Impaired Users of Refreshable Touch Displays: Possibilities and Pitfalls , 2015, IEEE Transactions on Haptics.

[2]  Kim Marriott,et al.  GraVVITAS: Generic Multi-touch Presentation of Accessible Graphics , 2011, INTERACT.

[3]  Kalina Bontcheva,et al.  Improving habitability of natural language interfaces for querying ontologies with feedback and clarification dialogues , 2013, J. Web Semant..

[4]  Andrew Sears,et al.  Speech Input to Support Universal Access , 2009, The Universal Access Handbook.

[5]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[6]  Gitte Lindgaard,et al.  Evaluating a tool for improving accessibility to charts and graphs , 2010, ASSETS '10.

[7]  J. B. Brooke,et al.  SUS: a retrospective , 2013 .

[8]  Klaus Miesenberger,et al.  Techniques for Improved Speech-Based Access to Diagrammatic Representations , 2018, ICCHP.

[9]  Kathleen F. McCoy,et al.  Interactive SIGHT into information graphics , 2010, W4A.

[10]  Danica Damljanovic,et al.  Natural language interfaces to conceptual models , 2011 .

[11]  John A. Gardner.  Can Mainstream Graphics Be Accessible , 2014 .

[12]  Roel Wieringa,et al.  Design Science Methodology for Information Systems and Software Engineering , 2014, Springer Berlin Heidelberg.

[13]  Klaus Miesenberger,et al.  Ontology-based Semantic Support to Improve Accessibility of Graphics , 2015, AAATE Conf..

[14]  Mihai Surdeanu,et al.  The Stanford CoreNLP Natural Language Processing Toolkit , 2014, ACL.

[15]  Klaus Miesenberger,et al.  Authoring Semantic Annotations for Non-Visual Access to Graphics , 2018 .

[16]  Klaus Miesenberger,et al.  Non-Visually Performing Analytical Tasks on Statistical Charts , 2017, AAATE Conf..

[17]  Thomas S. Tullis,et al.  A Comparison of Questionnaires for Assessing Website Usability , 2004 .