Exploration of sonification design process through an interdisciplinary workshop

In sonification of scientific data, designers know very little about the domain science and domain scientists are not familiar with the sonification methodology. The knowledge about the domain science is not given, but evolved during the problem-solving process. We discuss design challenges in auditory display design regarding user-centered approaches and suggest a method to involve domain scientists throughout sonification designs. We explore this within a workshop in which sonification experts, domain experts, and programmers worked together to better understand and solve problems collaboratively. The sonification framework that is used during the workshops is briefly described and the workshop process and how each group worked together during the workshop sessions are examined. Participants worked on pre-defined and exploratory tasks to sonify climate data. Furthermore, they grasped each other's domains; climate scientists especially became more open to use auditory display and sonification as a tool in their data mining tasks. Resulting sonification prototypes and workshop sessions are documented on a wiki to be used by the sonification community. To get started, we used some of the sonification designs created during the workshop for an online study where participants from science, engineering, and humanities were asked questions about the data behavior by listening to sonifcations of bivariate time series. Results indicate that sonic representation of data from resulting sonification allows most users (even with little or no knowledge of sound and music) to successfully complete some common data exploration tasks.

[1]  Bruce N. Walker,et al.  SONIFICATION SANDBOX: A GRAPHICAL TOOLKIT FOR AUDITORY GRAPHS , 2003 .

[2]  Alberto de Campo,et al.  Toward a data sonification design space map , 2007 .

[3]  Mary Beth Rosson,et al.  The development of cooperation: five years of participatory design in the virtual school , 2000, DIS '00.

[4]  Georgios C. Anagnostopoulos,et al.  Knowledge-Based Intelligent Information and Engineering Systems , 2003, Lecture Notes in Computer Science.

[5]  Stephen Barrass,et al.  Auditory information design , 1998 .

[6]  Douglas Schuler,et al.  Participatory Design: Principles and Practices , 1993 .

[7]  Christopher Frauenberger,et al.  Auditory display design - An investigation of a design pattern approach , 2009, Int. J. Hum. Comput. Stud..

[8]  Ron Wakkary,et al.  Sound intensity gradients in an ambient intelligence audio display , 2006, CHI EA '06.

[9]  Stephen Barrass,et al.  SONIFICATION DESIGN PATTERNS , 2003 .

[10]  Simon Fraser,et al.  The Role of Participatory Workshops in Investigating Narrative and Sound Ecologies in the Design of an Ambient Intelligence Audio Display , 2006 .

[11]  Wendy A. Kellogg,et al.  Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques , 2000 .

[12]  Gustav Taxén,et al.  Introducing participatory design in museums , 2004, PDC 04.

[13]  Gerhard Fischer,et al.  Creativity and evolution: a metadesign perspective , 2008, Digit. Creativity.

[14]  A. de Campo,et al.  SONIFICATION AS AN INTERDISCIPLINARY WORKING PROCESS , 2006 .

[15]  Dag Svanæs,et al.  Putting the users center stage: role playing and low-fi prototyping enable end users to design mobile systems , 2004, CHI.

[16]  Jan Gulliksen,et al.  User-centered System Design , 2011 .

[17]  Desktop data sonification: Comments on Flowers et al., ICAD 1996 , 2005, TAP.

[18]  Jonathan Berger,et al.  SONART : THE SONIFICATION APPLICATION RESEARCH TOOLBOX , 2002 .

[19]  Andrew Sears,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 2002, CHI 2002.

[20]  Mina Akaishi,et al.  Participatory Workshop as a Creativity Support System , 2008, KES.

[21]  R. Scheines,et al.  Organizational Behavior and Human Decision Processes , 1977 .

[22]  Andrew Clement,et al.  Proceedings of the eighth conference on Participatory design: Artful integration: interweaving media, materials and practices - Volume 1 , 2004 .

[23]  Visda Goudarzi Designing an Interactive Audio Interface for Climate Science , 2015, IEEE MultiMedia.

[24]  Michael Sannella,et al.  Constraint satisfaction and debugging for interactive user interfaces , 1994 .