Evaluation of Spatial Presentation in Sonification for Identifying Concurrent Audio Streams

The ultimate goal of sonification is to transfer information effectively to listeners. While there is a large amount of multidisciplinary investigation in the field of psychoacoustic, psychology, cognition and human computer interaction, sonification design still lacks empirical evidence on which to base design decisions [1]. This paper presents an empirical investigation of spatialization, which can provide one or more dimensions for auditory display. It focuses, in particular, on evaluating spatial presentation in sonification so as to enhance pattern identification when two audio streams are played simultaneously. Hence it aims to develop design decisions that benefit from effective information representation. The sounds were created for binaural reproduction using nonindividual head-related transfer functions. The results reported are based on the listeners’ performance within two display modes: (i) two co-located streams and (ii) two streams spatially separated at static locations. It concludes with ideas for future improvements and developments for this type of sonification. [

[1]  John C. Webster,et al.  Responding to One of Two Simultaneous Messages , 1954 .

[2]  Helge Ritter,et al.  Look & listen: sonification and visualization of multiparameter micrographs , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[3]  André van Schaik,et al.  Auditory spatial perception with sources overlapping in frequency and time , 2005 .

[4]  E. Owens,et al.  An Introduction to the Psychology of Hearing , 1997 .

[5]  W. K. Taylor,et al.  Some Further Experiments upon the Recognition of Speech, with One and with Two Ears , 1954 .

[6]  Barry Arons,et al.  A Review of The Cocktail Party Effect , 1992 .

[7]  G. Woodman,et al.  Visual search is slowed when visuospatial working memory is occupied , 2004, Psychonomic bulletin & review.

[8]  Jean-Marc Jot,et al.  Spat~ : A Spatial Processor for Musicians and Sound Engineers , 1995 .

[9]  J. Michon,et al.  Attentional Effort and Cognitive Strategies in the Processing of Temporal Information a , 1984, Annals of the New York Academy of Sciences.

[10]  E. Terhardt Pitch, consonance, and harmony. , 1974, The Journal of the Acoustical Society of America.

[11]  B. Shinn-Cunningham,et al.  Influences of spatial cues on grouping and understanding sound , 2005 .

[12]  Lorna M. Brown,et al.  DESIGN GUIDELINES FOR AUDIO PRESENTATION OF GRAPHS AND TABLES , 2003 .

[13]  André van Schaik,et al.  7TWO-POINT DISCRIMINATION IN AUDITORY DISPLAYS , 2003 .

[14]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[15]  Pavel Zahorik,et al.  LOCALIZATION ACCURACY IN 3-D SOUND DISPLAYS: THE ROLE OF VISUAL-FEEDBACK TRAINING , 2001 .

[16]  John G. Neuhoff,et al.  PITCH CHANGE, SONIFICATION, AND MUSICAL EXPERTISE: WHICH WAY IS UP? , 2002 .

[17]  Stephen McAdams,et al.  Caractérisation du timbre des sons complexes.II. Analyses acoustiques et quantification psychophysique , 1994 .

[18]  Barbara G. Shinn-Cunningham,et al.  Perceptual plasticity in spatial auditory displays , 2005, TAP.

[19]  Gregory Kramer,et al.  An introduction to auditory display , 1994 .

[20]  Virginia Best,et al.  THE EFFECT OF AUDITORY SPATIAL LAYOUT IN A DIVIDED ATTENTION TASK , 2005 .

[21]  André van Schaik,et al.  TWO-POINT DISCRIMINATION IN AUDITORY DISPLAYS , 2003 .

[22]  Min-Shik Kim,et al.  The role of spatial working memory in visual search efficiency , 2004, Psychonomic bulletin & review.

[23]  Harold L. Hawkins,et al.  Auditory information processing. , 1986 .

[24]  Rosane Minghim,et al.  An illustrated analysis of sonification for scientific visualisation , 1995, Proceedings Visualization '95.

[25]  Jonathan C. Roberts,et al.  Pie chart sonification , 2003, Proceedings on Seventh International Conference on Information Visualization, 2003. IV 2003..

[26]  Janet E. Anderson Sonification design for complex work domains : streams, mappings and attention , 2004 .

[27]  Densil Cabrera,et al.  Reproduction of Auditorium Spatial Impression with Binaural and Stereophonic Sound System , 2005 .

[28]  Barbara G. Shinn-Cunningham,et al.  Selective and Divided Attention: Extracting Information from Simultaneous Sound Sources , 2004, ICAD.

[29]  Stephen McAdams,et al.  Recognition of sound sources and events , 1993 .

[30]  A. Baddeley,et al.  The multi-component model of working memory: Explorations in experimental cognitive psychology , 2006, Neuroscience.

[31]  Bill Gardner,et al.  HRTF Measurements of a KEMAR Dummy-Head Microphone , 1994 .

[32]  J. C. Webster,et al.  Responding to Both of Two Overlapping Messages , 1954 .

[33]  E. C. Cherry Some Experiments on the Recognition of Speech, with One and with Two Ears , 1953 .

[34]  Robens Anderson,et al.  Creating an Empirical Framework for Sonification Design , 2005 .

[35]  David McGookin,et al.  ADVANTAGES AND ISSUES WITH CONCURRENT AUDIO PRESENTATION AS PART OF AN AUDITORY DISPLAY , 2006 .

[36]  Bruce N. Walker,et al.  Individual Differences, Cognitive Abilities, and the Interpretation of Auditory Graphs , 2004, ICAD.

[37]  Virginia Best,et al.  Binaural interference and auditory grouping. , 2007, The Journal of the Acoustical Society of America.

[38]  A. Mills On the minimum audible angle , 1958 .

[39]  J. Blauert Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[40]  Simon Haykin,et al.  The Cocktail Party Problem , 2005, Neural Computation.

[41]  Beverly A. Wright,et al.  Sound-discrimination learning and auditory displays , 2003 .