Non-visual exploration of geographic maps: Does sonification help?

Purpose. This study aims at evaluating the effectiveness of sonification as a mean to provide access to geo-referenced information to users with visual impairments. Method. Thiry-five participants (10 congenitally blind, 10 with acquired blindness and 15 blindfolded sighted) completed four tasks of progressive difficulty. During each task, participants first explored a sonified map by using either a tablet or a keyboard to move across regions and listened to sounds giving information about the current location. Then the participants were asked to identify, among four tactile maps, the one that crossmodally corresponds to the sonifed map they just explored. Finally, participants answered a self-report questionnaire of understanding and satisfaction. Results. Participants achieved high accuracy in all of the four tactile map discrimination tasks. No significant performance difference was found neither between subjects that used keyboard or tablet, nor between the three groups of blind and sighted participants. Differences between groups and interfaces were found in the usage strategies. High levels of satisfaction and understanding of the tools and tasks emerged from users' reports.

[1]  T. Vecchi,et al.  Visuo-spatial imagery in congenitally totally blind people. , 1998, Memory.

[2]  C. Thinus-Blanc,et al.  Representation of space in blind persons: vision as a spatial sense? , 1997, Psychological bulletin.

[3]  John G. Neuhoff,et al.  Sonification Report: Status of the Field and Research Agenda Prepared for the National Science Foundation by members of the International Community for Auditory Display , 1999 .

[4]  Cesare Cornoldi,et al.  Spatial memory and integration processes in congenital blindness , 2004, Neuroreport.

[5]  C. Rainville,et al.  Impact of vision on the development of topographical orientation abilities , 2006, Neuroreport.

[6]  Christian Jacquemin,et al.  A Study of Spatial Cognition in an Immersive Virtual Audio Environment: Comparing Blind and Blindfolded Individuals , 2005 .

[7]  Florence Gaunet,et al.  Early-Blind Subjects' Spatial Representation of Manipulatory Space: Exploratory Strategies and Reaction to Change , 1997, Perception.

[8]  E. D. de Haan,et al.  Visual imagery without visual experience: evidence from congenitally totally blind people , 2001, Neuroreport.

[9]  Terri L. Bonebright,et al.  Sonific ation Report: Status of the Field and Research Agenda , 2010 .

[10]  Ben Shneiderman,et al.  Data Sonification for Users with Visual Impairment: A Case Study with Georeferenced Data , 2008, TCHI.

[11]  Myron W. Krueger Know Where : An Audio/Spatial Interface for Blind People , 1997 .

[12]  Kenneth I. Joy,et al.  Sound graphs: A numerical data analysis method for the blind , 1985, Journal of Medical Systems.

[13]  Wai Yu,et al.  Using Non-speech Sounds to Improve Access to 2D Tabular Numerical Information for Visually Impaired Users , 2001, BCS HCI/IHM.

[14]  Marco Tamietto,et al.  Visual Experience is not Necessary for Efficient Survey Spatial Cognition: Evidence from Blindness , 2006, Quarterly journal of experimental psychology.

[15]  Hubert D. Zimmer,et al.  The interface between language and visuo-spatial representations , 2012 .

[16]  Joseph W. Wiedel International Symposium on Maps and Graphics for the Visually Handicapped , 1983 .

[17]  J. C. Sherman Needs and Resources in Maps for the Blind , 1965 .

[18]  S. Ungar,et al.  The Construction of Cognitive Maps by Children with Visual Impairments , 1996 .

[19]  Susanna Millar,et al.  Theory, experiment and practical application in research on visual impairment , 1997 .

[20]  Roberta L Klatzky,et al.  Functional equivalence of spatial representations derived from vision and language: evidence from allocentric judgments. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[21]  Rick Grush,et al.  The emulation theory of representation: Motor control, imagery, and perception , 2004, Behavioral and Brain Sciences.

[22]  Ben Shneiderman,et al.  Interactive sonification of choropleth maps , 2005, IEEE MultiMedia.

[23]  David Mioduser,et al.  A blind person's cognitive mapping of new spaces using a haptic virtual environment , 2003 .

[24]  N H Kerr,et al.  The role of vision in "visual imagery" experiments: evidence from the congenitally blind. , 1983, Journal of experimental psychology. General.

[25]  K. Kaga,et al.  Sound lateralization test in adolescent blind individuals , 2005, Neuroreport.

[26]  G. Bishop,et al.  BATS: The Blind Audio Tactile Mapping System , 2003 .

[27]  Othmar Schimmel,et al.  Auditory displays , 2001 .

[28]  Jerry Clark,et al.  Creating Tactile Maps For the Blind Using a GIS , 1993 .

[29]  M. Lassonde,et al.  Blind subjects process auditory spectral cues more efficiently than sighted individuals , 2004, Experimental Brain Research.

[30]  R. Klatzky,et al.  COGNITIVE MAPPING AND WAYFINDING BY ADULTS WITHOUT VISION , 1996 .

[31]  Makoto Kobayashi,et al.  A Support System for Visually Impaired Persons using Three-Dimensional Virtual Sound , 2000 .

[32]  M. Potegal Spatial abilities : development and physiological foundations , 1982 .

[33]  Susanna Millar,et al.  Understanding and representing spatial information , 1995 .

[34]  Susanna Millar,et al.  Crossmodal and Intersensory Perception and the Blind , 1981 .

[35]  A S Kirkland,et al.  New Brunswick. , 1944, Canadian Medical Association journal.

[36]  Joseph W. Wiedel,et al.  Tactual Mapping: Design, Reproduction, Reading and Interpretation. Final Report. , 1969 .

[37]  S. Millar Understanding and Representing Space: Theory and Evidence from Studies with Blind and Sighted Children , 1994 .

[38]  R. Dan Jacobson Navigating maps with little or no sight: An audio-tactile approach , 1998 .