Human-Computer Interaction Design based on Interactive Sonification - Hearing Actions or Instruments/Agents.

this paper outlines a number of steps for human- computer interaction design using sound as representation - auditory icons. The design process is based on listening tests, gathering free-text identification responses from participants. These responses and their classifications can then suggest how accurately the sounds can be identified and possible metaphors and mappings of sound to human action and system status. Finally, we conclude with a practical design example, providing a pesudo-haptic user experience through sound to convey information about software-defined user interface components.

[1]  Vom Fachbereich,et al.  Sounds@Work - Akustische Repräsentationen für die Mensch-Computer Interaktion in kooperativen und hybriden Arbeitsumgebungen , 2003 .

[2]  Eric Somers.  Abstract Sound Objects to Expand the Vocabulary of Sound Design for Visual and Theatrical Media , 2000 .

[3]  Gregory Kramer,et al.  Auditory Display: Sonification, Audification, And Auditory Interfaces , 1994 .

[4]  Bruce N. Walker,et al.  Mappings and metaphors in auditory displays: An experimental assessment , 2005, TAP.

[5]  Effects of Context on the Identification of Everyday Sounds , 1991 .

[6]  J. H. Howard,et al.  Interpreting the Language of Environmental Sounds , 1987 .

[7]  Davide Rocchesso,et al.  The Sounding Object , 2002 .

[8]  Davide Rocchesso,et al.  Sounding Objects , 2003, IEEE Multim..

[9]  Stephen Brewster,et al.  A Detailed Investigation into the Effectiveness of Earcons , 1997 .

[10]  Stephen Brewster,et al.  Nonspeech auditory output , 2002 .

[11]  J. Ballas.  Common factors in the identification of an assortment of brief everyday sounds , 1993 .

[12]  Christian Müller-Tomfelde,et al.  Sounds_372work - akustische Repräsentationen für die Mensch-Computer-Interaktion in kooperativen und hybriden Arbeitsumgebungen , 2003 .

[13]  William W. Gaver.  How Do We Hear in the World?: Explorations in Ecological Acoustics , 1993 .

[14]  William W. Gaver.  What in the World Do We Hear? An Ecological Approach to Auditory Event Perception , 1993 .

[15]  D. Norman,et al.  Everyday listening and auditory icons , 1988 .

[16]  Stephen Barrass,et al.  Auditory information design , 1998 .

[17]  Jakob Nielsen,et al.  Information Appliances and Beyond , 2000 .

[18]  Howard Rheingold,et al.  Smart Mobs: The Next Social Revolution , 2002 .

[19]  Ben Shneiderman,et al.  Leonardo's laptop: human needs and the new computing technologies , 2005, CIKM '05.