Access overlays: improving non-visual access to large touch screens for blind users

Many touch screens remain inaccessible to blind users, and those approaches to providing access that do exist offer minimal support for interacting with large touch screens or spatial data. In this paper, we introduce a set of three software-based access overlays intended to improve the accessibility of large touch screen interfaces, specifically interactive tabletops. Our access overlays are called edge projection, neighborhood browsing, and touch-and-speak. In a user study, 14 blind users compared access overlays to an implementation of Apple's VoiceOver screen reader. Our results show that two of our techniques were faster than VoiceOver, that participants correctly answered more questions about the screen's layout using our techniques, and that participants overwhelmingly preferred our techniques. We developed several applications demonstrating the use of access overlays, including an accessible map kiosk and an accessible board game.

[1]  Richard E. Ladner,et al.  Freedom to roam: a study of mobile device adoption and accessibility for people with visual and motor disabilities , 2009, Assets '09.

[2]  Richard E. Ladner,et al.  Usable gestures for blind people: understanding preference and performance , 2011, CHI.

[3]  William Buxton,et al.  Issues and techniques in touch-sensitive tablet input , 1985, SIGGRAPH '85.

[4]  Jacob O. Wobbrock,et al.  Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques , 2008, Assets '08.

[5]  James D. Hollan,et al.  SLAP widgets: bridging the gap between virtual and physical controls on tabletops , 2009, CHI.

[6]  Robert F. Cohen,et al.  PLUMB:: an interface for users who are blind to display, create, and modify graphs , 2006, Assets '06.

[7]  Roberta L. Klatzky,et al.  Navigation System for the Blind: Auditory Display Modes and Guidance , 1998, Presence.

[8]  Gregg C. Vanderheiden,et al.  Use of Audio-Haptic Interface Techniques to Allow Nonvisual Access to Touchscreen Appliances , 1996 .

[9]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[10]  Tovi Grossman,et al.  The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area , 2005, CHI.

[11]  Eyal de Lara,et al.  Timbremap: enabling the visually-impaired to use maps on touch-enabled devices , 2010, Mobile HCI.

[12]  Daniel J. Wigdor,et al.  Ripples: utilizing per-contact visualizations to improve user interaction with touch displays , 2009, UIST '09.

[13]  K. Salter,et al.  The ART test of interaction: a robust and powerful rank test of interaction in factorial models , 1993 .

[14]  Steven Fortune,et al.  A sweepline algorithm for Voronoi diagrams , 1986, SCG '86.

[15]  Krishna Bharat,et al.  Making computers easier for older adults to use: area cursors and sticky icons , 1997, CHI.

[16]  Joaquim A. Jorge,et al.  From Tapping to Touching: Making Touch Screens Accessible to Blind Users , 2008, IEEE MultiMedia.

[17]  Beryl Plimmer,et al.  Multimodal collaborative handwriting training for visually-impaired people , 2008, CHI.

[18]  Stephen A. Brewster,et al.  Feeling what you hear: tactile feedback for navigation of audio graphs , 2006, CHI.

[19]  Grigori E. Evreinov,et al.  Adaptive blind interaction technique for touchscreens , 2006, Universal Access in the Information Society.

[20]  W. Buxton,et al.  Human interface design and the handicapped user , 1986, CHI '86.

[21]  Clifton Forlines,et al.  Exploring non-speech auditory feedback at an interactive multi-user tabletop , 2005, Graphics Interface.

[22]  William Cowan,et al.  On the audio representation of distance for blind users , 2009, CHI.

[23]  Gregory D. Abowd,et al.  No-Look Notes: Accessible Eyes-Free Multi-touch Text Entry , 2010, Pervasive.

[24]  J. J. Higgins,et al.  The aligned rank transform for nonparametric factorial analyses using only anova procedures , 2011, CHI.

[25]  Saul Greenberg,et al.  Speech-filtered bubble ray: improving target acquisition on display walls , 2007, ICMI '07.

[26]  Rahul Sawhney,et al.  Sonic Grid: an auditory interface for the visually impaired to navigate GUI-based environments , 2008, IUI '08.

[27]  Patrick Baudisch,et al.  Starburst: a target expansion algorithm for non-uniform target distributions , 2008, AVI '08.

[28]  Dan Morris,et al.  Individual audio channels with single display groupware: effects on communication and task strategy , 2004, CSCW.

[29]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[30]  Ali Israr,et al.  TeslaTouch: electrovibration for touch surfaces , 2010, UIST.

[31]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..