Accessible Interactive Maps for Visually Impaired Users

Tactile maps are commonly used to give visually impaired users access to geographical representations. Although those relief maps are efficient tools for acquisition of spatial knowledge, they present several limitations and issues such as the need to read braille. Several research projects have been led during the past three decades in order to improve access to maps using interactive technologies. In this chapter, we present an exhaustive review of interactive map prototypes. We classified existing interactive maps into two categories: Digital Interactive Maps (DIMs) that are displayed on a flat surface such as a screen; and Hybrid Interactive Maps (HIMs) that include both a digital and a physical representation. In each family, we identified several subcategories depending on the technology being used. We compared the categories and subcategories according to cost, availability, and technological limitations, but also in terms of content, comprehension, and interactivity. Then we reviewed a number of studies showing that those maps can support spatial learning for visually impaired users. Finally, we identified new technologies and methods that could improve the accessibility of graphics for visually impaired users in the future.

[1]  Saiganesh Swaminathan,et al.  Linespace: A Sensemaking Platform for the Blind , 2016, CHI.

[2]  Baoxin Li,et al.  Fast and independent access to map directions for people who are blind , 2012, Interact. Comput..

[3]  Martin Pielot,et al.  TouchOver map: audio-tactile exploration of interactive maps , 2011, Mobile HCI.

[4]  Dimitrios Tzovaras,et al.  A mobile interactive maps application for a visually impaired audience , 2013, W4A.

[5]  Jonathan Lazar,et al.  Designing Accessible Visualizations: The Case of Designing a Weather Map for Blind Users , 2013, HCI.

[6]  Barbara Leporini,et al.  Enriching Graphic Maps to Enable Multimodal Interaction by Blind People , 2013, HCI.

[7]  M. Heller Picture and Pattern Perception in the Sighted and the Blind: The Advantage of the Late Blind , 1989, Perception.

[8]  Marcos Serrano,et al.  From tactile to virtual: using a smartwatch to improve spatial map exploration for visually impaired users , 2016, MobileHCI.

[9]  Vincent Hayward,et al.  Refreshable tactile graphics applied to schoolbook illustrations for students with visual impairment , 2008, Assets '08.

[10]  Lorenzo Picinali,et al.  A Prototype Interactive Tactile Display with Auditory Feedback , 2014 .

[11]  David McGookin,et al.  Graph Builder: Constructing Non-visual Visualizations , 2007 .

[12]  Megan M. Lawrence,et al.  A Haptic Soundscape Map of the University of Oregon , 2009 .

[13]  Michal Young,et al.  The MGIS: a minimal geographic information system accessible to users who are blind , 2013, SIGSPATIAL/GIS.

[14]  Martin Pielot,et al.  PocketNavigator: vibro-tactile waypoint navigation for everyday mobile devices , 2010, Mobile HCI.

[15]  Anke M. Brock,et al.  Interactivity Improves Usability of Geographic Maps for Visually Impaired People , 2015, Hum. Comput. Interact..

[16]  Timo Götzelmann,et al.  Towards Automatically Generated Tactile Detail Maps by 3D Printers for Blind Persons , 2014, ICCHP.

[17]  Cristian Bernareggi,et al.  Towards Large Scale Evaluation of Novel Sonification Techniques for Non Visual Shape Exploration , 2015, ASSETS.

[18]  Dragan Ahmetovic,et al.  AudioFunctions: Eyes-Free Exploration of Mathematical Functions on Tablets , 2014, ICCHP.

[19]  A. Streri,et al.  Touching for knowing : cognitive psychology of haptic manual perception , 2003 .

[20]  Thomas Ertl,et al.  An OpenStreetMap Editing Interface for Visually Impaired Users Based on Geo-semantic Information , 2014, ICCHP.

[21]  Jacques Tisseau,et al.  SeaTouch: A Haptic and Auditory Maritime Environment for Non Visual Cognitive Mapping of Blind Sailors , 2009, COSIT.

[22]  Mathieu Simonnet,et al.  GeoTablet, une application cartographique pour les personnes déficientes visuelles , 2012 .

[23]  Gunnar Jansson,et al.  Reading virtual maps with a haptic mouse: Effects of some modifications of the tactile and audio-tactile information , 2006 .

[24]  Deborah Gilden,et al.  Talking TMAP: Automated generation of audio-tactile maps using Smith-Kettlewell's TMAP software , 2006 .

[25]  Giovanni Fusco,et al.  The Tactile Graphics Helper: Providing Audio Clarification for Tactile Graphics Using Machine Vision , 2015, ASSETS.

[26]  Hiroshi Ishii,et al.  The metaDESK: models and prototypes for tangible user interfaces , 1997, UIST '97.

[27]  R. Klatzky,et al.  Haptic perception: A tutorial , 2009, Attention, perception & psychophysics.

[28]  Abdulmotaleb El Saddik,et al.  Haptics Technologies: Bringing Touch to Multimedia , 2011 .

[29]  Hiroshi Ishii,et al.  inFORM: dynamic physical affordances and constraints through shape and object actuation , 2013, UIST.

[30]  Nicholas A. Giudice,et al.  Learning non-visual graphical information using a touch-based vibro-audio interface , 2012, ASSETS '12.

[31]  Thomas Strothotte,et al.  Constructive exploration of spatial information by blind users , 2000, Assets '00.

[32]  Bernhard E. Riecke,et al.  Tangible and body-based interaction with auditory maps , 2011, CHI EA '11.

[33]  M. A. Espinosa,et al.  Comparing Methods for Introducing Blind and Visually Impaired People to Unfamiliar Urban Environments , 1998 .

[34]  Hideki Koike,et al.  EdgeSonic: image feature sonification for the visually impaired , 2011, AH '11.

[35]  Thomas Ertl,et al.  Making Digital Maps Accessible Using Vibrations , 2010, ICCHP.

[36]  Minoru Kamata,et al.  Expression of paths and buildings for universal designed interactive map with due consideration for visually impaired people , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[37]  Koji Yatani,et al.  SpaceSense: representing geographical information to visually impaired people using spatial tactile feedback , 2012, CHI.

[38]  Rüdiger Hoffmann,et al.  Cognitive Behavioural Systems , 2012, Lecture Notes in Computer Science.

[39]  Stephen A. Brewster,et al.  Clutching at straws: using tangible interaction to provide non-visual access to graphs , 2010, CHI.

[40]  Joaquim Lloveras,et al.  Three-dimensional tactile symbols produced by 3D Printing: Improving the process of memorizing a tactile map key , 2014 .

[41]  H. Holone,et al.  Users Are Doing It For Themselves: Pedestrian Navigation With User Generated Content , 2007, The 2007 International Conference on Next Generation Mobile Applications, Services and Technologies (NGMAST 2007).

[42]  M. Bergamasco,et al.  Computer graphics access for blind people through a haptic and audio virtual environment , 2004, Proceedings. Second International Conference on Creating, Connecting and Collaborating through Computing.

[43]  Jacques Tisseau,et al.  Comparing Tactile Maps and Haptic Digital Representations of a Maritime Environment , 2011 .

[44]  Roope Raisamo,et al.  The micole architecture: multimodal support for inclusion of visually impaired children , 2007, ICMI '07.

[45]  LazarJonathan,et al.  Data Sonification for Users with Visual Impairment , 2008 .

[46]  Gerhard Weber,et al.  Audio-Haptic Browser for a Geographical Information System , 2010, ICCHP.

[47]  Sina Bahram Multimodal eyes-free exploration of maps: TIKISI for maps , 2013, ASAC.

[48]  Rob Kitchin,et al.  Assessing the configurational knowledge of people with visual impairments or blindness , 1995 .

[49]  Ferdinando Fornara,et al.  Wayfinding tasks in visually impaired people: the role of tactile maps , 2006, Cognitive Processing.

[50]  Ben Shneiderman,et al.  Data Sonification for Users with Visual Impairment: A Case Study with Georeferenced Data , 2008, TCHI.

[51]  Constantine Stephanidis,et al.  User-Centered Interaction Paradigms for Universal Access in the Information Society , 2004, Lecture Notes in Computer Science.

[52]  Charles Lenay,et al.  Designing interactive content with blind users for a perceptual supplementation system , 2013, TEI '13.

[53]  Vincent Hayward,et al.  Tactile Graphics Rendering Using Three Laterotactile Drawing Primitives , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[54]  Thomas F. Shipley,et al.  Spatial Cognition VII, International Conference, Spatial Cognition 2010, Mt. Hood/Portland, OR, USA, August 15-19, 2010. Proceedings , 2010, Spatial Cognition.

[55]  Stephen A. Brewster,et al.  Evaluation of multimodal graphs for blind people , 2003, Universal Access in the Information Society.

[56]  Matthew T. Rice,et al.  Design Considerations for Haptic and Auditory Map Interfaces , 2005 .

[57]  Margherita Antona,et al.  Universal Access in Human-Computer Interaction. Design Methods, Tools, and Interaction Techniques for eInclusion , 2013, Lecture Notes in Computer Science.

[58]  Yusuke Uchida,et al.  Development of Directly Manipulable Tactile Graphic System with Audio Support Function , 2010, ICCHP.

[59]  Alistair D. N. Edwards,et al.  Facilitating route learning using interactive audio-tactile maps for blind and visually impaired people , 2013, CHI Extended Abstracts.

[60]  C. Thinus-Blanc,et al.  Representation of space in blind persons: vision as a spatial sense? , 1997, Psychological bulletin.

[61]  Baoxin Li,et al.  On presenting audio-tactile maps to visually impaired users for getting directions , 2010, CHI Extended Abstracts.

[62]  David Mioduser,et al.  Construction of cognitive maps of unknown spaces using a multi-sensory virtual environment for people who are blind , 2008, Comput. Hum. Behav..

[63]  Baoxin Li,et al.  Instant tactile-audio map: enabling access to digital maps for people with visual impairment , 2009, Assets '09.

[64]  Hiroshi Ishii,et al.  Relief: a scalable actuated shape display , 2010, TEI '10.

[65]  Piero Mussio,et al.  A multimodal interactive system to create and explore graph structures , 2008, CHI Extended Abstracts.

[66]  Enrico Pontelli,et al.  Trackable Interactive Multimodal Manipulatives: Towards a Tangible User Environment for the Blind , 2012, ICCHP.

[67]  Stephen A. Brewster,et al.  Creating Usable Pin Array Tactons for Nonvisual Information , 2009, IEEE Transactions on Haptics.

[68]  Marcos Serrano,et al.  Tangible Reels: Construction and Exploration of Tangible Maps by Visually Impaired Users , 2016, CHI.

[69]  Marcos Serrano,et al.  Quick-glance and in-depth exploration of a tabletop map for visually impaired people , 2014, IHM.

[70]  Suranjan Chakraborty,et al.  Development and Evaluation of Sonified Weather Maps for Blind Users , 2012 .

[71]  Daniel R. Montello,et al.  Scale and Multiple Psychologies of Space , 1993, COSIT.

[72]  Amy Hurst,et al.  ABC and 3D: opportunities and obstacles to 3D printing in special education environments , 2014, ASSETS.

[73]  Scott E. Hudson,et al.  A Layered Fabric 3D Printer for Soft Interactive Objects , 2015, CHI.

[74]  Han Qin,et al.  Crowdsourcing techniques for augmenting traditional accessibility maps with transitory obstacle information , 2013 .

[75]  Harald Reiterer,et al.  Does (multi-)touch aid users' spatial memory and navigation in 'panning' and in 'zooming & panning' UIs? , 2012, AVI.

[76]  Dimitrios Tzovaras,et al.  HapticRiaMaps: towards interactive exploration of web world maps for the visually impaired , 2011, W4A.

[77]  Thorsten Schwarz,et al.  Towards Displaying Graphics on a Cheap, Large-Scale Braille Display , 2014, ICCHP.

[78]  Matthew T. Rice,et al.  A Commentary on the Use of Touch for Accessing On-Screen Spatial Representations: The Process of Experiencing Haptic Maps and Graphics , 2005 .

[79]  A. Kappers,et al.  Look what I have felt: unidentified haptic line drawings are identified after sketching. , 2008, Acta psychologica.

[80]  Jun Rekimoto,et al.  Lumen: interactive visual and shape display for calm computing , 2004, SIGGRAPH '04.

[81]  Jon Froehlich,et al.  Improving public transit accessibility for blind riders by crowdsourcing bus stop landmark locations with Google street view , 2013, ASSETS.

[82]  Michel Denis,et al.  Exploration of architectural spaces by blind people using auditory virtual reality for the construction of spatial knowledge , 2014, Int. J. Hum. Comput. Stud..

[83]  A. Kappers,et al.  The Influence of Picture Size on Recognition and Exploratory Behaviour in Raised-Line Drawings , 2008, Perception.

[84]  Jonathan Lazar,et al.  Development and evaluation of two prototypes for providing weather map data to blind users through sonification , 2013 .

[85]  Fabio De Felice,et al.  A haptic/acoustic application to allow blind the access to spatial information , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[86]  Lorna M. Brown,et al.  Tactons: Structured Tactile Messages for Non-Visual Information Display , 2004, AUIC.

[87]  T. Vecchi,et al.  Blind Vision: The Neuroscience of Visual Impairment , 2011 .

[88]  Stephen A. Brewster,et al.  Tac-tiles: multimodal pie charts for visually impaired users , 2006, NordiCHI '06.

[89]  Dimitrios Tzovaras,et al.  Open Touch/Sound Maps: A system to convey street data through haptic and auditory feedback , 2013, Comput. Geosci..

[90]  Eyal de Lara,et al.  Timbremap: enabling the visually-impaired to use maps on touch-enabled devices , 2010, Mobile HCI.

[91]  Daniel R. Montello,et al.  You Are Where? The Function and Frustration of You-Are-Here (YAH) Maps , 2010, Spatial Cogn. Comput..

[92]  Christophe Jouffrais,et al.  FROM OPEN GEOGRAPHICAL DATA TO TANGIBLE MAPS: IMPROVING THE ACCESSIBILITY OF MAPS FOR VISUALLY IMPAIRED PEOPLE , 2015 .

[93]  R. Klatzky,et al.  Similarity of Tactual and Visual Picture Recognition with Limited Field of View , 1991, Perception.

[94]  Martin Pielot,et al.  A Tactile Compass for Eyes-Free Pedestrian Navigation , 2011, INTERACT.

[95]  Faisal Taher,et al.  Exploring Interactions with Physically Dynamic Bar Charts , 2015, CHI.

[96]  Stephen A. Brewster,et al.  A generic approach for augmenting tactile diagrams with spatial non-speech sounds , 2002, CHI Extended Abstracts.

[97]  Christopher R. Bennett,et al.  Touch-screen technology for the dynamic display of -2D spatial information without vision: promise and progress. , 2014, Multisensory research.

[98]  Romedi Passini,et al.  Wayfinding without Vision , 1988 .

[99]  Ikuko Eguchi Yairi,et al.  The one octave scale interface for graphical representation for visually impaired people , 2009, Assets '09.

[100]  Anke M. Brock,et al.  Making Gestural Interaction Accessible to Visually Impaired People , 2014, EuroHaptics.

[101]  Timo Götzelmann,et al.  SmartTactMaps: a smartphone-based approach to support blind persons in exploring tactile maps , 2015, PETRA.

[102]  Niels Henze,et al.  Interactive exploration of city maps with auditory torches , 2007, CHI Extended Abstracts.

[103]  Bill Buxton,et al.  Multi-Touch Systems that I Have Known and Loved , 2009 .

[104]  Richard E. Ladner,et al.  Access overlays: improving non-visual access to large touch screens for blind users , 2011, UIST.

[105]  Gerhard Weber,et al.  Interactive Audio-haptic Map Explorer on a Tactile Display , 2015, Interact. Comput..

[106]  Jacob O. Wobbrock,et al.  Access lens: a gesture-based screen reader for real-world documents , 2013, CHI.

[107]  Frédéric Valentin,et al.  MapSense: Multi-Sensory Interactive Maps for Children Living with Visual Impairments , 2016, CHI.

[108]  Christophe Jouffrais,et al.  Empowering Low-Vision Rehabilitation Professionals with "Do-It-Yourself" Methods , 2016, ICCHP.

[109]  Susanna Millar,et al.  External and body-centered frames of reference in spatial memory: Evidence from touch , 2004, Perception & psychophysics.

[110]  Catherine Plaisant,et al.  Non-visual exploration of geographic maps: Does sonification help? , 2010, Disability and rehabilitation. Assistive technology.

[111]  Cyrill Stachniss,et al.  Spatial Cognition VIII , 2012, Lecture Notes in Computer Science.

[112]  F. Vidal-Verdu,et al.  Graphical Tactile Displays for Visually-Impaired People , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[113]  Hiroshi Ishii,et al.  Emerging frameworks for tangible user interfaces , 2000, IBM Syst. J..

[114]  Gordon E. Legge,et al.  Designing Media for Visually-Impaired Users of Refreshable Touch Displays: Possibilities and Pitfalls , 2015, IEEE Transactions on Haptics.

[115]  Vincent Hayward,et al.  Adaptive level of detail in dynamic, refreshable tactile graphics , 2012, 2012 IEEE Haptics Symposium (HAPTICS).