Using sound to represent spatial data in ArcGIS

An extension to ESRI's, ArcGIS was created to allow spatial data to be represented using sound. A number of previous studies have used sound in combination with visual stimuli, but only a limited selection have looked at this with explicit reference to spatial data and none have created an extension for industry standard GIS software. The extension can sonify any raster data layer and represent this using piano notes. The user can choose from a number of different scales of piano notes and decide how the program plays the sound; this flexibility allows the extension to effectively represent a number of different types of data. The extension was evaluated in one-to-one semi-structured interviews with geographical information professionals, who explored aspects of a number of different data sets. Further research is needed to discover the best use of sound in a spatial data context, both in terms of which sounds to use and what data are most effectively represented using those sounds.

[1]  M. Goodchild,et al.  Uncertainty in geographical information , 2002 .

[2]  John W. Tukey,et al.  Data-Based Graphics: Visual Display in the Decades to Come , 1990 .

[3]  Deborah Gilden,et al.  Talking TMAP: Automated generation of audio-tactile maps using Smith-Kettlewell's TMAP software , 2006 .

[4]  Wooseob Jeong,et al.  Multimodal Geographic Information Systems: Adding Haptic and Auditory Display , 2003, J. Assoc. Inf. Sci. Technol..

[5]  Myke Gluck.  The Use of Sound for Data Exploration , 2005 .

[6]  Thomas Hermann,et al.  TAXONOMY AND DEFINITIONS FOR SONIFICATION AND AUDITORY DISPLAY , 2008 .

[7]  John Krygier,et al.  Sound and Geographic Visualization , 1994 .

[8]  R. Myke Gluck.  The use of sound for data exploration : Sound and speech in information retrieval , 2000 .

[9]  Christopher Miller,et al.  Olfoto: designing a smell-based interaction , 2006, CHI.

[10]  P. Fisher.  Hearing the Reliability In Classified Remotely Sensed Images , 1994 .

[11]  Xiaohui Liu,et al.  An Integrated Approach for Modeling Learning Patterns of Students in Web-Based Instruction: A Cognitive Style Perspective , 2008, TCHI.

[12]  Bruno L. Giordano,et al.  Spatial representation of pitch height: the SMARC effect , 2006, Cognition.

[13]  R. Jacobson,et al.  Increasing the dimensionality of a Geographic Information System (GIS) Using Auditory Display , 2007 .

[14]  John H. Flowers,et al.  Data sonification from the desktop: Should sound be part of standard data analysis software? , 2005, TAP.

[15]  Maryse Lassonde,et al.  Perte sensorielle et réorganisation cérébrale , 2007 .

[16]  Nick Bearman,et al.  Using Sound to Represent Positional Accuracy of Address Locations , 2010 .

[17]  Roberto Bresin,et al.  Sonification of Physical Quantities Throughout History: A Meta-Study of Previous Mapping Strategies , 2011, icad 2011.

[18]  Andy Hunt,et al.  Interactive sonification of complex data , 2009, Int. J. Hum. Comput. Stud..

[19]  Suresh K. Lodha,et al.  MUSE: A musical data sonification toolkit , 1997 .

[20]  Daniel A. Keim,et al.  Geovisual analytics for spatial decision support: Setting the research agenda , 2007, Int. J. Geogr. Inf. Sci..

[21]  Menno-Jan Kraak,et al.  Exploring geovisualization : also as e-book , 2005 .

[22]  K. Barriball,et al.  Collecting data using a semi-structured interview: a discussion paper. , 1994, Journal of advanced nursing.

[23]  John G. Neuhoff,et al.  PITCH CHANGE, SONIFICATION, AND MUSICAL EXPERTISE: WHICH WAY IS UP? , 2002 .

[24]  D. Unwin.  Geographical information systems and the problem of 'error and uncertainty' , 1995 .

[25]  Mark Gahegan,et al.  Using Metadata to Link Uncertainty and Data Quality Assessments , 2006 .

[26]  William W. Gaver.  The SonicFinder: An Interface That Uses Auditory Icons , 1989, Hum. Comput. Interact..

[27]  Suresh K. Lodha,et al.  LISTEN: sounding uncertainty visualization , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[28]  A. Lovett,et al.  REPRESENTING UNCERTAINTY IN VISUALISATIONS OF FUTURE LANDSCAPES , 2004 .

[29]  Ben Shneiderman,et al.  Data Sonification for Users with Visual Impairment: A Case Study with Georeferenced Data , 2008, TCHI.

[30]  Rob Kitchin,et al.  Multi-modal virtual reality for presenting geographic information , 2002 .