A design-driven sonification process for supporting expert users in real-time anomaly detection: Towards applied guidelines

INTRODUCTION: We present early results of an ongoing investigation into the use of sound for real-time monitoring of anomalous behaviour in digital and digital/physical systems. OBJECTIVES: We aim to define design guidelines to both support authors in the process of creating sonifications that are both efficient and engaging and the transition of sonification into a mass medium for the representation of data in everyday life. METHODS: Through two Design Actions, we apply Design Research to the definition of the use case, the interaction paradigm and the experimental protocol for real-world evaluation of sonification tools. RESULTS: Two Design Actions are described. Methodologies and results of the first experimental phase are presented in detail along with their influence on the second phase, currently ongoing. CONCLUSION: We sketch a tentative design-driven process for sonifications for the real-time monitoring of anomalous behaviour in digital and digital/physical systems.

[1]  Christian Dayé,et al.  Sounds sequential: sonification in the social sciences , 2006 .

[2]  Allison Druin,et al.  Technology probes: inspiring design for and with families , 2003, CHI '03.

[3]  Elise van den Hoven,et al.  Knowing by ear: leveraging human attention abilities in interaction design , 2012, Journal on Multimodal User Interfaces.

[4]  Andrea Ballatore,et al.  Sonifying data uncertainty with sound dimensions , 2018, Cartography and Geographic Information Science.

[5]  Lev Manovich.  Introduction to Info-Aesthetics , 2008 .

[6]  Paul Vickers,et al.  Sonification Abstraite/Sonification Concrète: An 'Aesthetic Perspective Space' for Classifying Auditory Displays in the Ars Musica Domain , 2006, ArXiv.

[7]  Andrew Vande Moere,et al.  Towards a Model of Information Aesthetics in Information Visualization , 2007, 2007 11th International Conference Information Visualization (IV '07).

[8]  Stefanie Rinderle-Ma,et al.  A sonification system for process monitoring as secondary task , 2014, 2014 5th IEEE Conference on Cognitive Infocommunications (CogInfoCom).

[9]  Richard Buchanan,et al.  Wicked Problems in Design Thinking , 1992 .

[10]  William W. Gaver,et al.  Design: Cultural probes , 1999, INTR.

[11]  Bruce N. Walker,et al.  Sonification design and metaphors: Comments on Walker and Kramer, ICAD 1996 , 2005, TAP.

[12]  Schloss Birlinghoven,et al.  USING AUDIFICATION IN PLANETARY SEISMOLOGY , 2001 .

[13]  Sara Adhitya.  London Bus Tunes: Using Sound to Improve the Safe Navigation of London’s Bus System , 2019 .

[14]  Paul Vickers,et al.  Sonification for Process Monitoring , 2011 .

[15]  Paul Vickers,et al.  Sonification of network traffic flow for monitoring and situational awareness , 2017, PloS one.

[16]  Jason R. C. Nurse,et al.  A Formalised Approach to Designing Sonification Systems for Network−Security Monitoring , 2017 .

[17]  Thomas Hermann,et al.  Evaluation of Auditory Display , 2011 .

[18]  Sadie Creese,et al.  Hearing attacks in network data: An effectiveness study , 2019, Comput. Secur..

[19]  Paul Vickers,et al.  Sonification Aesthetics and Listening for Network Situational Awareness , 2014, ArXiv.

[20]  Andrew Vande Moere,et al.  On the role of design in information visualization , 2011, Inf. Vis..

[21]  S. Roddy,et al.  Embodied Aesthetics in Auditory Display , 2014, Organised Sound.

[22]  Stephen Roddy,et al.  Sonification listening: An empirical embodied approach , 2015, ICAD.

[23]  Robert Höldrich,et al.  A Metaphoric Sonification Method - Towards the Acoustic Standard Model of Particle Physics , 2010 .

[24]  Bruce N. Walker,et al.  Mappings and metaphors in auditory displays: An experimental assessment , 2005, TAP.

[25]  Brijesh Singh,et al.  The Lean Startup:How Today's Entrepreneurs Use Continuous Innovation to Create Radically Successful Businesses , 2016 .

[26]  John Zimmerman,et al.  Research through design as a method for interaction design research in HCI , 2007, CHI.

[27]  Mj Marina Toeters,et al.  Research through design , 2012 .

[28]  Gregory Kramer,et al.  An introduction to auditory display , 1994 .

[29]  K. Friedman.  Research into, by and for design , 2008 .

[30]  Paul Vickers,et al.  Sonification Design and Aesthetics , 2011 .

[31]  Paolo Ciuccarelli,et al.  Disclosing Cyber Attacks on Water Distribution Systems. An Experimental Approach to the Sonification of Threats and Anomalous Data , 2019, Proceedings of the 25th International Conference on Auditory Display (ICAD 2019).

[32]  Wanda Liz Diaz Merced,et al.  Sound for the exploration of space physics data , 2013 .

[33]  Stefanie Rinderle-Ma,et al.  Server sounds and network noises , 2015, 2015 6th IEEE International Conference on Cognitive Infocommunications (CogInfoCom).

[34]  Stephen Roddy,et al.  Sounding Human with Data: The Role of Embodied Conceptual Metaphors and Aesthetics in Representing and Exploring Data Sets , 2016 .

[35]  G. Lakoff,et al.  Metaphors We Live by , 1982 .

[36]  P. Roetzel,et al.  Information overload in the information age: a review of the literature from business administration, business psychology, and related disciplines with a bibliometric approach and framework development , 2018, Business Research.

[37]  Sandra Pauletto,et al.  The Craftsman: The use of sound design to elicit emotions , 2014 .

[38]  R. Fay.  Acoustic Communication , 2003, Springer Handbook of Auditory Research.

[39]  Bruce N. Walker,et al.  Hearing Artificial Intelligence: Sonification Guidelines & Results From a Case-study in Melanoma Diagnosis , 2019 .

[40]  N WalkerBruce,et al.  Sonification design and metaphors , 2005 .

[41]  Stephen Barrass.  The aesthetic turn in sonification towards a social and cultural medium , 2011, AI & SOCIETY.

[42]  P. Ciuccarelli,et al.  Intentionality and design in the data sonification of social issues , 2020, Big Data & Society.