Evaluating a tool for improving accessibility to charts and graphs

We discuss factors in the design and evaluation of natural language-driven assistive technologies that generate descriptions of, and allow interaction with, graphical representations of numerical data. In particular, we provide data in favor of 1) screen-reading technologies as a usable, useful, and cost-effective means of interacting with graphs. The data also show that by carrying out evaluation of Assistive Technologies on populations other than the target communities, certain subtleties of navigation and interaction may be lost or distorted.

[1]  Guy Lapalme,et al.  Intentions in the Coordinated Generation of Graphics and Text from Tabular Data , 2000, Knowledge and Information Systems.

[2]  Steven F. Roth,et al.  Graphics and Natural Language as Components of Automatic Explanation , 1988, SGCH.

[3]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[4]  Stephan Kerpedjiev.  Model-Driven, Assertion-Based Generation of Multimedia Weather Information , 1995 .

[5]  Ehud Reiter,et al.  Lessons from Deploying NLG Technology for Marine Weather Forecast Text Generation , 2004, ECAI.

[6]  Michel Dumontier,et al.  Semantic Query Answering with Time-Series Graphs , 2007, 2007 Eleventh International IEEE EDOC Conference Workshop.

[7]  Kenneth E. Barner,et al.  Data visualization methods for the blind using force feedback and sonification , 1998, Other Conferences.

[8]  Johanna D. Moore,et al.  AutoBrief: an experimental system for the automatic generation of briefings in integrated text and information graphics , 2004, Int. J. Hum. Comput. Stud..

[9]  Stephen A. Brewster,et al.  SoundBar: exploiting multiple views in multimodal graph browsing , 2006, NordiCHI '06.

[10]  Stephen A. Brewster,et al.  Evaluation of multimodal graphs for blind people , 2003, Universal Access in the Information Society.

[11]  Jim Hunter,et al.  Choosing words in computer-generated weather forecasts , 2005, Artif. Intell..

[12]  Guy Lapalme,et al.  Integrated generation of graphics and text- a corpus study , 1998 .

[13]  Edward Rolf Tufte,et al.  The visual display of quantitative information , 1985 .

[14]  Kathleen F. McCoy,et al.  Interactive SIGHT demo: textual summaries of simple bar charts , 2010, ASSETS '10.

[15]  Michael Kipp,et al.  ANVIL - a generic annotation tool for multimodal dialogue , 2001, INTERSPEECH.

[16]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[17]  Ehud Reiter,et al.  An Architecture for Data-to-Text Systems , 2007, ENLG.

[18]  Stephen A. Brewster,et al.  Interactive generation of overview information using speech , 2007, CHI Extended Abstracts.

[19]  Gitte Lindgaard,et al.  Improving accessibility to statistical graphs: the iGraph-Lite system , 2007, Assets '07.

[20]  John H. Flowers,et al.  Data sonification from the desktop: Should sound be part of standard data analysis software? , 2005, TAP.

[21]  Somayajulu Sripada,et al.  Summarizing Dive Computer Data: A Case Study in Integrating Textual and Graphical Presentations of Numerical Data , 2007 .

[22]  Avi Parush,et al.  Helping People with Visual Impairments Gain Access to Graphical Information Through Natural Language: The iGraph System , 2006, ICCHP.

[23]  Jim Hunter,et al.  Automatic Generation of Textual Summaries from Neonatal Intensive Care Data , 2007, AIME.

[24]  Roope Raisamo,et al.  Non-visual interaction with graphs assisted with directional-predictive sounds and vibrations: a comparative study , 2007, Universal Access in the Information Society.

[25]  Michel Dumontier,et al.  Modeling and querying graphical representations of statistical data , 2010, J. Web Semant..

[26]  Johanna D. Moore,et al.  Describing Complex Charts in Natural Language: A Caption Generation System , 1998, CL.

[27]  Enrico Pontelli,et al.  Making Microsoft Excel™ Accessible: Multimodal Presentation of Charts , 2009 .

[28]  Peng Wu,et al.  A Browser Extension for Providing Visually Impaired Users Access to the Content of Bar Charts on the Web , 2018, WEBIST.

[29]  Emiel Krahmer,et al.  Squibs and Discussions: Real versus Template-Based Natural Language Generation: A False Opposition? , 2005, CL.

[30]  Stephen A. Brewster,et al.  Comparing two haptic interfaces for multimodal graph rendering , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[31]  Stephen A. Brewster,et al.  Haptic Graphs for Blind Computer Users , 2000, Haptic Human-Computer Interaction.

[32]  Guy Lapalme,et al.  PostGraphe: A System for the Generation of Statistical Graphics and Text , 1996, INLG.

[33]  Vicki L. Hanson,et al.  What can the 'ash cloud' tell us about older adults' technology adoption , 2010, ASSETS '10.

[34]  Enrico Pontelli,et al.  Making Microsoft Excel™: multimodal presentation of charts , 2009, Assets '09.

[35]  Rui Yu,et al.  PLUMB: displaying graphs to the blind using an active auditory interface , 2005, Assets '05.

[36]  Ehud Reiter,et al.  Book Reviews: Building Natural Language Generation Systems , 2000, CL.

[37]  M. Corio,et al.  Generation of texts for information graphics , 1999 .

[38]  John B. Hinkel.  Head-guided wheelchair control system , 2010, ASSETS '10.

[39]  Beate Riedel,et al.  Perception of Gradient in Haptic Graphs : a Comparison of Virtual and Physical Stimuli , 2001 .

[40]  Jonathan Berger,et al.  SONART : THE SONIFICATION APPLICATION RESEARCH TOOLBOX , 2002 .

[41]  Johanna D. Moore,et al.  AutoBrief: a multimedia presentation system for assisting data analysis , 1997, Comput. Stand. Interfaces.

[42]  Stephen A. Brewster,et al.  Non-visual overviews of complex data sets , 2006, CHI EA '06.

[43]  R. Mayer,et al.  Domain specificity of spatial expertise: The case of video game players. , 2002 .

[44]  Stephen A. Brewster,et al.  Feeling what you hear: tactile feedback for navigation of audio graphs , 2006, CHI.

[45]  Edward R. Tufte,et al.  The Visual Display of Quantitative Information , 1986 .

[46]  John J. Bertin,et al.  The semiology of graphics , 1983 .

[47]  Ehud Reiter,et al.  Generating Spatio-Temporal Descriptions in Pollen Forecasts , 2006, EACL.

[48]  Kathleen F. McCoy,et al.  Interactive SIGHT into information graphics , 2010, W4A.

[49]  B. Abernethy,et al.  Transfer of pattern recall skills may contribute to the development of sport expertise , 2005 .

[50]  Tsvetoslava Vateva-Gurova,et al.  Using the phone with a single input signal only: evaluation of 3dscan's telephone module , 2010, ASSETS '10.

[51]  Daniel L. Chester,et al.  Getting Computers to See Information Graphics So Users Do Not Have to , 2005, ISMIS.

[52]  Gitte Lindgaard,et al.  A syntactic analysis of accessibility to a corpus of statistical graphs , 2008, W4A '08.

[53]  Ehud Reiter,et al.  NLG vs. Templates , 1995, ArXiv.

[54]  Ehud Reiter,et al.  SumTime-Mousam: Configurable marine weather forecast generator , 2003 .

[55]  Lorna M. Brown,et al.  DRAWING BY EAR: INTERPRETING SONIFIED LINE GRAPHS , 2003 .

[56]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987, Cogn. Sci..

[57]  K. A. Ericsson,et al.  Recent advances in expertise research: a commentary on the contributions to the special issue , 2005 .

[58]  Andrea R. Kennel.  Audiograf: a diagram-reader for the blind , 1996, Assets '96.

[59]  Anna S. Law,et al.  A Comparison of Graphical and Textual Presentations of Time Series Data to Support Medical Decision Making in the Neonatal Intensive Care Unit , 2005, Journal of Clinical Monitoring and Computing.

[60]  John H. Flowers,et al.  Cross-Modal Equivalence of Visual and Auditory Scatterplots for Exploring Bivariate Data Samples , 1997, Hum. Factors.