Parameter-mapping sonification for manual control task: Timbre and intensity manupluration to sonify dynamic system state

This study empirically examines parameter-mapping sonifications which generate non-speech audio to represent the gap between the current and the desired state of the system being controlled. Focusing on manipulations of sound timbre and intensity, several data-to-sound mappings to transform the gap or system error into audible sound are compared in order to induce general knowledge of sonification design. Two experiments, using a one-dimensional tracking task, confirmed that timbre variation is useful in conveying categorical information about the target direction, and that scaling functions to produce no audible sound at the goal state with a relatively large dead zone are advantageous.

[1]  H. Olson The Measurement of Loudness , 1972 .

[2]  Philip Kortum,et al.  HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces , 2008 .

[3]  Jiajie Zhang,et al.  A representational analysis of relational information displays , 1996, Int. J. Hum. Comput. Stud..

[4]  S. Camille Peres,et al.  Sonification of statistical graphs , 2003 .

[5]  Gregory Kramer,et al.  An introduction to auditory display , 1994 .

[6]  Tetsuo Sawaragi,et al.  Data-To-Sound Mapping To Sonify Ongoing System Status In Continuous Manual Control Task , 2011 .

[7]  David M. Lane,et al.  SONIFICATION OF ABSOLUTE VALUES WITH SINGLE AND MULTIPLE DIMENSIONS , 2003 .

[8]  Bruce N. Walker,et al.  Mappings and metaphors in auditory displays: An experimental assessment , 2005, TAP.

[9]  Bruce N. Walker,et al.  Psychophysical scaling of sonification mappings , 2000 .

[10]  S. Camille Peres,et al.  Auditory graphs: The effects of redundant dimensions and divided attention , 2005 .

[11]  S S Stevens,et al.  On the Theory of Scales of Measurement. , 1946, Science.

[12]  R W Proctor,et al.  Auditory stimulus-response compatibility: Is there a contribution of stimulus-hand correspondence? , 2000, Psychological research.

[13]  Gregory Kramer,et al.  Pitch and loudness interact in auditory displays: can the data get lost in the map? , 2002, Journal of experimental psychology. Applied.

[14]  Alice C. Eldridge Issues in Auditory Display , 2006, Artificial Life.

[15]  L E Marks,et al.  Perceptual primacy of dimensions: support for a model of dimensional interaction. , 1990, Journal of experimental psychology. Human perception and performance.

[16]  Stephen Barrass,et al.  Using sonification , 1999, Multimedia Systems.