The Graphical Access Challenge for People with Visual Impairments: Positions and Pathways Forward

Graphical access is one of the most pressing challenges for individuals who are blind or visually impaired. This chapter discusses some of the factors underlying the graphics access challenge, reviews prior approaches to addressing this longstanding information access barrier, and describes some promising new solutions. We specifically focus on touchscreen-based smart devices, a relatively new class of information access technologies, which our group believes represent an exemplary model of user-centered, needs-based design. We highlight both the challenges and the vast potential of these technologies for alleviating the graphics accessibility gap and share the latest results in this line of research. We close with recommendations on ideological shifts in mindset about how we approach solving this vexing access problem, which will complement both technological and perceptual advancements that are rapidly being uncovered through a growing research community in this domain.

[1]  Bruce N. Walker,et al.  Auditory Interfaces and Sonification , 2009, The Universal Access Handbook.

[2]  Tae-Gyung Kang,et al.  Mobility Device Use in the United States , 2003 .

[3]  Susan Haag,et al.  Delayed memory for visual—haptic exploration of familiar objects , 2008, Psychonomic bulletin & review.

[4]  M. Sile O'Modhrain,et al.  The design of pressure-controlled valves for a refreshable tactile display , 2015, 2015 IEEE World Haptics Conference (WHC).

[5]  Wolff-Michael Roth,et al.  Differences in graph-related practices between high school biology textbooks and scientific ecology journals , 1999 .

[6]  J. Loomis.  Tactile Pattern Perception , 1981, Perception.

[7]  Benjamin Friedman,et al.  MECHANICS OF OPTIC NERVE TRACTION ON THE RETINA DURING OCULAR ROTATION: WITH SPECIAL REFERENCE TO RETINAL DETACHMENT , 1941 .

[8]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[9]  Roope Raisamo,et al.  Methods for Presenting Braille Characters on a Mobile Device with a Touchscreen and Tactile Feedback , 2009, IEEE Transactions on Haptics.

[10]  J. Craig,et al.  Grating orientation as a measure of tactile spatial acuity. , 1999, Somatosensory & motor research.

[11]  Michael E. Hahn,et al.  The Comprehension of STEM Graphics via a Multisensory Tablet Electronic Device by Students with Visual Impairments , 2019, Journal of Visual Impairment & Blindness.

[12]  P. Pietrini,et al.  Neural correlates of spatial working memory in humans: A functional magnetic resonance imaging study comparing visual and tactile processes , 2006, Neuroscience.

[13]  Anke M. Brock,et al.  Accessible Interactive Maps for Visually Impaired Users , 2022, ArXiv.

[14]  Nicholas A. Giudice,et al.  Learning non-visual graphical information using a touch-based vibro-audio interface , 2012, ASSETS '12.

[15]  Hari Prasath Palani.  Principles and Guidelines for Advancement of Touchscreen-Based Non-visual Access to 2D Spatial Information , 2018 .

[16]  F. Vidal-Verdu,et al.  Graphical Tactile Displays for Visually-Impaired People , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Christopher R. Bennett,et al.  Touch-screen technology for the dynamic display of -2D spatial information without vision: promise and progress. , 2014, Multisensory research.

[18]  Gordon E. Legge,et al.  Designing Media for Visually-Impaired Users of Refreshable Touch Displays: Possibilities and Pitfalls , 2015, IEEE Transactions on Haptics.

[19]  P. Mitchell,et al.  Consequences of amblyopia on education, occupation, and long term vision loss , 2004, British Journal of Ophthalmology.

[20]  N. Giudice.  Navigating without vision: principles of blind spatial cognition , 2018 .

[21]  Luís Carriço,et al.  UbiBraille: designing and evaluating a vibrotactile Braille-reading device , 2013, ASSETS.

[22]  Jun Rekimoto,et al.  Ambient touch: designing tactile interfaces for handheld devices , 2002, UIST '02.

[23]  Stephen A. Brewster,et al.  Mobile Multi-actuator Tactile Displays , 2007, HAID.

[24]  Koji Yatani,et al.  SemFeel: a user interface with semantic tactile feedback for mobile touch-screen devices , 2009, UIST '09.

[25]  C. Victor,et al.  Psychosocial impact of visual impairment in working-age adults , 2009, British Journal of Ophthalmology.

[26]  C I Howarth,et al.  The efficiency and walking speed of visually impaired people. , 1986, Ergonomics.

[27]  Martin Pielot,et al.  TouchOver map: audio-tactile exploration of interactive maps , 2011, Mobile HCI.

[28]  Stephen A. Brewster,et al.  Crossmodal congruence: the look, feel and sound of touchscreen widgets , 2008, ICMI '08.

[29]  Avi Parush,et al.  Helping People with Visual Impairments Gain Access to Graphical Information Through Natural Language: The iGraph System , 2006, ICCHP.

[30]  Oussama Metatla,et al.  Inclusive Education Technologies: Emerging Opportunities for People with Visual Impairments , 2018, CHI Extended Abstracts.

[31]  Benita J. O’Colmain,et al.  Prevalence of age-related macular degeneration in the United States. , 2004, Archives of ophthalmology.

[32]  S. Lederman,et al.  TACTUAL PERCEPTION , 2003 .

[33]  Bruce N. Walker,et al.  Universal Design of Auditory Graphs: A Comparison of Sonification Mappings for Visually Impaired and Sighted Listeners , 2010, TACC.

[34]  K O Johnson,et al.  Tactile spatial resolution. I. Two-point discrimination, gap detection, grating resolution, and letter recognition. , 1981, Journal of neurophysiology.

[35]  Sean Follmer,et al.  shapeShift: 2D Spatial Manipulation and Self-Actuation of Tabletop Shape Displays for Tangible and Haptic Interaction , 2018, CHI.

[36]  Richard E. Ladner,et al.  V-braille: haptic braille perception using a touch-screen and vibration on mobile phones , 2010, ASSETS '10.

[37]  Eelke Folmer,et al.  Accessible Touchscreen Technology for People with Visual Impairments , 2017, ACM Trans. Access. Comput..

[38]  Seungmoon Choi,et al.  Vibrotactile Display: Perception, Technology, and Applications , 2013, Proceedings of the IEEE.

[39]  Jenna L. Gorlewicz,et al.  Toward Non-visual Graphics Representations on Vibratory Touchscreens: Shape Exploration and Identification , 2016, EuroHaptics.

[40]  L. Marks,et al.  Cross-Modal Interaction between Vision and Touch: The Role of Synesthetic Correspondence , 2000, Perception.

[41]  Nicholas A. Giudice,et al.  Evaluation of Non-visual Zooming Operations on Touchscreen Devices , 2016, HCI.

[42]  Jonas F. Vibell,et al.  Neuroimaging of multisensory processing in vision, audition, touch, and olfaction , 2004, Cognitive Processing.

[43]  Robert J. Webster,et al.  Initial Experiences Using Vibratory Touchscreens to Display Graphical Math Concepts to Students with Visual Impairments , 2014 .

[44]  Constance S. Hawke,et al.  Accommodating students with disabilities , 2004 .

[45]  Stephen A. Brewster,et al.  Investigating the effectiveness of tactile feedback for mobile touchscreens , 2008, CHI.

[46]  Bruce N. Walker,et al.  SONIFICATION SANDBOX: A GRAPHICAL TOOLKIT FOR AUDITORY GRAPHS , 2003 .

[47]  R. Klatzky,et al.  - Sensory Substitution of Vision: Importance of Perceptual and Cognitive Processing , 2018, Assistive Technology for Blindness and Low Vision.

[48]  Iyad Abu Doush,et al.  Reading Braille on mobile phones: A fast method with low battery power consumption , 2011, 2011 International Conference on User Science and Engineering (i-USEr ).

[49]  Amy Hurst,et al.  ABC and 3D: opportunities and obstacles to 3D printing in special education environments , 2014, ASSETS.

[50]  Nicholas A Giudice,et al.  Comparing Haptic Pattern Matching on Tablets and Phones: Large Screens Are Not Necessarily Better. , 2018, Optometry and vision science : official publication of the American Academy of Optometry.

[51]  Gitte Lindgaard,et al.  Evaluating a tool for improving accessibility to charts and graphs , 2010, ASSETS '10.