Sonification of Spatial Information: Audio-Tactile Exploration Strategies by Normal and Blind Subjects

On the basis of a meta-analysis of existing literature about sonification technologies, new experimental results on audio-tactile exploration strategies of georeferenced sonificated data by sighted and blind subjects are presented, discussing: technology suitability, subjects' performances, accessibility and usability in the user/technology interaction.

[1]  L. Kay.  Bioacoustic spatial perception by humans: a controlled laboratory measurement of spatial resolution without distal cues. , 2001, The Journal of the Acoustical Society of America.

[2]  James L. Alty,et al.  Communicating graphical information to blind users using music: the role of context , 1998, CHI.

[3]  Catherine Plaisant,et al.  Interactive Sonification of Geographical Maps: a Behavioural Study with Blind Subjects , 2007 .

[4]  S. Zuidhoek,et al.  Representations of space based on haptic input , 2005 .

[5]  Matthijs L. Noordzij,et al.  Keep an eye on your hands: on the role of visual mechanisms in processing of haptic space , 2008, Cognitive Processing.

[6]  M. Poguntke,et al.  Auditory attention control for human-computer interaction , 2008, 2008 Conference on Human System Interactions.

[7]  Andy Hunt,et al.  A Toolkit for Interactive Sonification , 2004, ICAD.

[8]  Ben Shneiderman,et al.  Universal usability , 2000, Commun. ACM.

[9]  Marc Mersiol,et al.  The impact of the sonification of a vocal server on its usability and its user-friendliness , 2002 .

[10]  Miguel Vargas Martin,et al.  Using Sonification to Teach Network Intrusion Detection: A Preliminary Usability Study , 2007 .

[11]  Raja Parasuraman,et al.  Varieties of attention , 1984 .

[12]  Kenneth I. Joy,et al.  Sound graphs: A numerical data analysis method for the blind , 1985, Journal of Medical Systems.

[13]  R. Klatzky,et al.  Performance of Blind and Sighted Persons on Spatial Tasks , 1995 .

[14]  G. Bishop,et al.  BATS: The Blind Audio Tactile Mapping System , 2003 .

[15]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[16]  S. Millar.  Understanding and Representing Space: Theory and Evidence from Studies with Blind and Sighted Children , 1994 .

[17]  Ag Asri Ag Ibrahim.  Task analysis for sonification applications usability evaluation , 2006, Assets '06.

[18]  Lewis Irwin Berman,et al.  The Sound of Software: Using Sonification to Aid Comprehension , 2006, 14th IEEE International Conference on Program Comprehension (ICPC'06).

[19]  Terri L. Bonebright,et al.  Sonific ation Report: Status of the Field and Research Agenda , 2010 .

[20]  Catherine Plaisant,et al.  Interactive sonification for blind people exploration of geo-referenced data: comparison between a keyboard-exploration and a haptic-exploration interfaces , 2006, Cognitive Processing.

[21]  Susanne Boll,et al.  Interactive 3D sonification for the exploration of city maps , 2006, NordiCHI '06.

[22]  S. Lakatos.  Recognition of Complex Auditory-Spatial Patterns , 1993, Perception.

[23]  Ioulia Guizatdinova,et al.  Sonification of Facial Expressions , 2003 .

[24]  Roberta L Klatzky,et al.  Functional equivalence of spatial representations derived from vision and language: evidence from allocentric judgments. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[25]  Xiao-Li Yang,et al.  Designing a personal guidance system to aid navigation without sight: progress on the GIS component , 1991, Int. J. Geogr. Inf. Sci..

[26]  B. Kapralos,et al.  Sonification of range information for 3‐D space perception , 1999 .

[27]  Ben Shneiderman,et al.  Sonification of Geo-Referenced Data for Auditory Information Seeking: Design Principle and Pilot Study , 2004, ICAD.

[28]  Simon Ungar,et al.  Cognitive mapping without visual experience , 2018, Cognitive Mapping.

[29]  R. M. Candey,et al.  XSONIFY SONIFICATION TOOL FOR SPACE PHYSICS , 2006 .

[30]  Makoto Kobayashi,et al.  A Support System for Visually Impaired Persons using Three-Dimensional Virtual Sound , 2000 .

[31]  David G. Pfeiffer.  Listen and learn: An investigation of sonification as an instructional variable to improve understanding of complex environments , 2008, Comput. Hum. Behav..

[32]  Ben Shneiderman,et al.  Interactive sonification of choropleth maps , 2005, IEEE MultiMedia.

[33]  Wai Yu,et al.  Using Non-speech Sounds to Improve Access to 2D Tabular Numerical Information for Visually Impaired Users , 2001, BCS HCI/IHM.

[34]  Charalambos Vrasidas,et al.  Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications , 2008 .

[35]  Roope Raisamo,et al.  Exploration of directional-predictive sounds for nonvisual interaction with graphs , 2006, Knowledge and Information Systems.

[36]  William M. Stern,et al.  Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex , 2007, Nature Neuroscience.

[37]  L. Kay.  Auditory perception of objects by blind persons, using a bioacoustic high resolution air sonar. , 2000, The Journal of the Acoustical Society of America.