Using sonification

Abstract. The idea behind sonification is that synthetic non-verbal sounds can represent numerical data and provide support for information processing activities of many different kinds. This article describes some of the ways that sonification has been used in assistive technologies, remote collaboration, engineering analyses, scientific visualisations, emergency services and aircraft cockpits. Approaches for designing sonifications are surveyed, and issues raised by the existing approaches and applications are outlined. Relations are drawn to other areas of knowledge where similar issues have also arisen, such as human-computer interaction, scientific visualisation, and computer music. At the end is a list of resources that will help you delve further into the topic.

[1]  Jacques Bertin,et al.  Graphics and graphic information-processing , 1981 .

[2]  William W. Gaver,et al.  Effective sounds in complex systems: the ARKOLA simulation , 1991, CHI.

[3]  Stephen M. Casner,et al.  Task-analytic approach to the automated design of graphic presentations , 1991, TOGS.

[4]  S. Backhaus,et al.  Quantum oscillations between two weakly coupled reservoirs of superfluid 3He , 1997, Nature.

[5]  Roberta L. Klatzky,et al.  Personal guidance system for the visually impaired , 1994, ASSETS.

[6]  Stephen Brewster,et al.  A Detailed Investigation into the Effectiveness of Earcons , 1997 .

[7]  Tom Dougherty.  What does pink sound like? Designing the audio interface for the TaIOS , 1996 .

[8]  Rangaraj M. Rangayyan,et al.  Auditory display and sonification of textured image , 1996 .

[9]  Youichi Horry.  A graphical user interface for MIDI Signal Generation and sound synthesis , 1994, ICMC.

[10]  Insook Choi,et al.  Investigating geometric data with sound , 1996 .

[11]  Meera Blattner,et al.  Earcons and Icons: Their Structure and Common Design Principles , 1989, Hum. Comput. Interact..

[12]  R. R. Patterson,et al.  Guidelines for auditory warning systems on civil aircraft , 1982 .

[13]  Frankie James.  Presenting HTML Structure in Audio: User Satisfaction with Audio Hypertext , 1998 .

[14]  Stephen Barrass,et al.  Auditory information design , 1998 .

[15]  Elizabeth D. Mynatt.  Designing with auditory icons , 1994 .

[16]  Gregory Kramer,et al.  Auditory Display: Sonification, Audification, And Auditory Interfaces , 1994 .

[17]  Paul A Lucas,et al.  An evaluation of the communicative ability of auditory icons and earcons , 1994 .

[18]  Stephen Brewster,et al.  Design and Evaluation of an Auditory Glance at Algebra for Blind Readers , 1994 .

[19]  Durand R. Begault,et al.  A Virtual Audio Guidance and Alert System for Commercial Aircraft Operations , 1996 .

[20]  Gary S. Kendall.  Visualization by Ear: Auditory Imagery for Scientific Visualization and Virtual Reality , 1991 .

[21]  D. Knight.  Ways of seeing , 2015, Nature.

[22]  Philip K. Robertson.  Visualizing color gamuts: a user interface for the effective use of perceptual color spaces in data displays , 1988, IEEE Computer Graphics and Applications.

[23]  Andrea R. Kennel.  Audiograf: a diagram-reader for the blind , 1996, Assets '96.

[24]  V. Michael Bove,et al.  Television Sound and Viewer Perceptions , 1991 .

[25]  Marti A. Hearst.  Trends & Controversies: Dissonance on Audio Interfaces , 1997, IEEE Expert.

[26]  John A. Gardner,et al.  TRIANGLE: A practical application of non-speech audio for imparting information , 1996 .

[27]  James L. Alty,et al.  Experiments using multimedia interfaces in process control: Some initial results , 1993, Comput. Graph..