Design Patterns for Auditory Displays

This paper proposes the use of patterns in the design process for auditory displays and /or interfaces realized in other modalities. We introduce a meta-domain in which user interfaces can be designed using these patterns without determining their means of realization. The mode-independent description of such interfaces can then be used to create the real interface maintaining the strengths of the different interaction channels. While this work is focused on how this approach can be applied on auditory displays, we keep in mind that the approach shall be applicable on other interaction modalities equally. The development of a set of mode independent interaction patterns is shown along with descriptions of their representations in the auditory domain. A real world application was chosen to evaluate the approach; Microsoft Explorer was analysed, described through the mode independent interaction patterns Open image in new window Figure 1: The meta domain as common ground for different representations of user interface. and transformed into the auditory domain making extensive use of 3D audio rendering techniques. The result, a file manager created in a virtual audio environment, was evaluated with sighted persons as well as visually impaired and blind participants showing the feasibility and usability of the approach.

[1]  David McGookin,et al.  AN INVESTIGATION INTO THE IDENTIFICATION OF CONCURRENTLY PRESENTED EARCONS , 2003 .

[2]  Chris Schmandt,et al.  Dynamic Soundscape: mapping time to space for audio browsing , 1997, CHI.

[3]  John G. Neuhoff,et al.  Sonification Report: Status of the Field and Research Agenda Prepared for the National Science Foundation by members of the International Community for Auditory Display , 1999 .

[4]  David McGookin,et al.  Diary in the Sky: A Spatial Audio Display for a Mobile Calendar , 2001, BCS HCI/IHM.

[5]  W. Keith Edwards,et al.  The Mercator project: a nonvisual interface to the X Window system , 1993 .

[6]  Chris Schmandt,et al.  Audio hallway: a virtual acoustic environment for browsing , 1998, UIST '98.

[7]  Robert Höldrich,et al.  A 3D Ambisonic Based Binaural Sound Reproduction System , 2003 .

[8]  Stephen Barrass,et al.  SONIFICATION DESIGN PATTERNS , 2003 .

[9]  Robert Höldrich,et al.  A Spatial Audio Interface for Desktop Applications , 2003 .

[10]  Tapio Lokki,et al.  Creating Interactive Virtual Auditory Environments , 2002, IEEE Computer Graphics and Applications.

[11]  Elizabeth D. Mynatt.  Transforming graphical interfaces into auditory interfaces , 1995, CHI 95 Conference Companion.

[12]  D. Norman.  The psychology of everyday things , 1990 .

[13]  Jakob Nielsen,et al.  Chapter 4 – The Usability Engineering Lifecycle , 1993 .

[14]  E. Verheijen.  Sound reproduction by wave field synthesis , 1998 .

[15]  Martin Kaltenbrunner.  Y-Windows: Proposal for a Standard AUI Environment , 2002 .

[16]  Elizabeth D. Mynatt,et al.  Metaphors for nonvisual computing , 1995 .

[17]  Meera Blattner,et al.  Earcons and Icons: Their Structure and Common Design Principles , 1989, Hum. Comput. Interact..

[18]  Robert Höldrich,et al.  3D binaural sound reproduction using a virtual ambisonic approach , 2003, IEEE International Symposium on Virtual Environments, Human-Computer Interfaces and Measurement Systems, 2003. VECIMS '03. 2003.

[19]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[20]  Ville Pulkki,et al.  Virtual Sound Source Positioning Using Vector Base Amplitude Panning , 1997 .

[21]  D. Norman.  The psychology of everyday things", Basic Books Inc , 1988 .

[22]  Matt Adcock,et al.  Cultivating Design Patterns for Auditory Displays , 2004, ICAD.

[23]  Gregory Kramer,et al.  Auditory Display: Sonification, Audification, And Auditory Interfaces , 1994 .

[24]  R A Lutfi,et al.  Informational masking by everyday sounds. , 1999, The Journal of the Acoustical Society of America.

[25]  Stephen Brewster,et al.  Providing a Structured Method for Integrating Non-Speech Audio into Human-Computer Interfaces , 1994 .

[26]  Tapio Lokki,et al.  Comparison of auditory, visual, and audiovisual navigation in a 3D space , 2005, TAP.

[27]  Christopher Frauenberger,et al.  A Generic, Semantically-Based Design Approach for Spatial Auditory Computer Displays , 2004, ICAD.

[28]  Hallvard Trætteberg,et al.  Interaction Patterns in User Interfaces. , 2000 .

[29]  Christopher Frauenberger,et al.  SPATIAL AUDITORY DISPLAYS A STUDY ON THE USE OF VIRTUAL AUDIO ENVIRONMENTS AS INTERFACES FOR USERS WITH VISUAL DISABILITIES , 2004 .