A user-centered design and analysis of an electrostatic haptic touchscreen system for students with visual impairments

Abstract Students who are visually impaired face unique challenges when learning mathematical concepts due to the visual nature of graphs, charts, tables, and plots. While touchscreens have been explored as a means to assist people with visual impairments in learning mathematical concepts, many devices are not standalone, were not developed with a user-centered design approach, and have not been tested with users who are visually impaired. This research details the user-centered design and analysis of an electrostatic touchscreen system for displaying graph-based visual information to individuals who are visually impaired. Feedback from users and experts within the visually-impaired community informed the iterative development of our software. We conducted a usability study consisting of locating haptic points in order to test the efficacy and efficiency of the system and to determine patterns of user interactions with the touchscreen. The results showed that: (1) participants correctly located haptic points with an accuracy rate of 69.83% and an average time of 15.34 s out of 116 total trials, (2) accuracy increased across trials, (3) efficient patterns of user interaction involved either a systematic approach or a rapid exploration of the screen, and (4) haptic elements placed near the corners of the screen were more easily located. Our user-centered design approach resulted in an intuitive interface for people with visual impairments and laid the foundation for demonstrating this device's potential to depict mathematical data shown in graphs.

[1]  Donald E. Troxel,et al.  An Electrotactile Display , 1970 .

[2]  Enrico Pontelli,et al.  Multimodal Presentation of Two-Dimensional Charts: An Investigation Using Open Office XML and Microsoft Excel , 2010, TACC.

[3]  Tonya L. Smith-Jackson,et al.  Haptic User Interfaces for the Visually Impaired: Implications for Haptically Enhanced Science Learning Systems , 2012, Int. J. Hum. Comput. Interact..

[4]  Jane N. Erin,et al.  Use of the Talking Tactile Tablet in Mathematics Testing , 2003 .

[5]  Stephen A. Brewster,et al.  Haptic Graphs for Blind Computer Users , 2000, Haptic Human-Computer Interaction.

[6]  Carter C. Collins,et al.  Tactile Television - Mechanical and Electrical Image Projection , 1970 .

[7]  Robert J. Webster,et al.  Toward haptic/aural touchscreen display of graphical mathematics for the education of blind students , 2011, 2011 IEEE World Haptics Conference.

[8]  Ali Israr,et al.  Feel Effects , 2014, ACM Trans. Appl. Percept..

[9]  Amy Zhang,et al.  A review of principles in design and usability testing of tactile technology for individuals with visual impairments , 2017, Assistive technology : the official journal of RESNA.

[10]  Jakob Nielsen,et al.  A mathematical model of the finding of usability problems , 1993, INTERCHI.

[11]  Ali Israr,et al.  TeslaTouch: electrovibration for touch surfaces , 2010, UIST.

[12]  Ali Israr,et al.  Tactile display for the visually impaired using TeslaTouch , 2011, CHI Extended Abstracts.

[13]  J. C. Bliss,et al.  A direct translation reading aid for the blind , 1966 .

[14]  L. Faulkner Beyond the five-user assumption: Benefits of increased sample sizes in usability testing , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[15]  Robert J. Webster,et al.  Initial Experiences Using Vibratory Touchscreens to Display Graphical Math Concepts to Students with Visual Impairments , 2014 .

[16]  Derrick W. Smith,et al.  The Role and Characteristics of Tactile Graphics in Secondary Mathematics and Science Textbooks in Braille , 2012 .

[17]  Bruce J. P. Mortimer,et al.  Vibrotactile transduction and transducers. , 2007, The Journal of the Acoustical Society of America.