Exploring non-speech auditory feedback at an interactive multi-user tabletop

We present two experiments on the use of non-speech audio at an interactive multi-touch, multi-user tabletop display. We first investigate the use of two categories of reactive auditory feedback: affirmative sounds that confirm user actions and negative sounds that indicate errors. Our results show that affirmative auditory feedback may improve one's awareness of group activity at the expense of one's awareness of his or her own activity. Negative auditory feedback may also improve group awareness, but simultaneously increase the perception of errors for both the group and the individual. In our second experiment, we compare two methods of associating sounds to individuals in a co-located environment. Specifically, we compare localized sound, where each user has his or her own speaker, to coded sound, where users share one speaker, but the waveform of the sounds are varied so that a different sound is played for each user. Results of this experiment reinforce the presence of tension between group awareness and individual focus found in the first experiment. User feedback suggests that users are more easily able to identify who caused a sound when either localized or coded sound is used, but that they are also more able to focus on their individual work. Our experiments show that, in general, auditory feedback can be used in co-located collaborative applications to support either individual work or group awareness, but not both simultaneously, depending on how it is presented.

[1]  Adrian Bullock,et al.  H.5.3 [Information Interfaces and Presentation (e.g. HCI)]: , 2022 .

[2]  M. Sheelagh T. Carpendale,et al.  Territoriality in collaborative tabletop workspaces , 2004, CSCW.

[3]  Jonathan Grudin,et al.  Human Computer Interaction: The Year 2000 and Beyond , 1995, HCI.

[4]  Norbert A. Streitz,et al.  i-LAND: an interactive landscape for creativity and innovation , 1999, CHI '99.

[5]  Jonathan Grudin,et al.  Speech, language, and audition , 1995 .

[6]  Stephen A. Brewster,et al.  An evaluation of earcons for use in auditory human-computer interfaces , 1993, INTERCHI.

[7]  William W. Gaver,et al.  Effective sounds in complex systems: the ARKOLA simulation , 1991, CHI.

[8]  Tomas Sokoler,et al.  AROMA: abstract representation of presence supporting mutual awareness , 1997, CHI.

[9]  Dan Morris,et al.  Individual audio channels with single display groupware: effects on communication and task strategy , 2004, CSCW.

[10]  Meredith Ringel Morris,et al.  Exploring the effects of group size and table size on interactions with tabletop shared-display groupware , 2004, CSCW.

[11]  Meredith Ringel Morris,et al.  Beyond "social protocols": multi-user coordination policies for co-located groupware , 2004, CSCW.

[12]  Carl Gutwin,et al.  Awareness support in a groupware widget toolkit , 2003, GROUP.

[13]  Elizabeth D. Mynatt,et al.  Designing audio aura , 1998, CHI.

[14]  Paul M. C. Lemmens,et al.  EFFECTS OF AUDITORY ICONS AND EARCONS ON VISUAL CATEGORIZATION: THE BIGGER PICTURE , 2001 .

[15]  Brad A. Myers,et al.  Collaboration using multiple PDAs connected to a PC , 1998, CSCW '98.

[16]  Yvonne Rogers,et al.  Finger talk: collaborative decision-making using talk and fingertip interaction around a tabletop display , 2004, CHI EA '04.

[17]  Meredith Ringel Morris,et al.  DiamondSpin: an extensible toolkit for around-the-table interaction , 2004, CHI.

[18]  Allison Woodruff,et al.  Sotto voce: exploring the interplay of conversation and mobile audio spaces , 2002, CHI.

[19]  Paul Dourish,et al.  Awareness and coordination in shared workspaces , 1992, CSCW '92.

[20]  Christian Muller-Tomfelde,et al.  Audio-enhanced collaboration at an interactive electronic whiteboard , 2001 .

[21]  Abigail Sellen,et al.  The Prevention of Mode Errors Through Sensory Feedback , 1992, Hum. Comput. Interact..

[22]  Carl Gutwin,et al.  Design for individuals, design for groups: tradeoffs between power and workspace awareness , 1998, CSCW '98.

[23]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[24]  Tina Blaine,et al.  The Jam-O-Drum interactive music system: a study in interaction design , 2000, DIS '00.

[25]  Clifton Forlines,et al.  Observations of a Shared Tabletop User Study , 2004 .