Sound Information: Sonification in the Age of Complex Data and Digital Audio

In recent years, sonification—the auditory display of data—has received increasing media attention and been presented as a solution to the challenges posed by large, complex datasets. By analyzing the development of the sonification research community, this article shows that specific historical configurations have led the community to concentrate on technical solutions for the design of sonification technology rather than on analyzing and interpreting sonified data. Consequently, sonification still struggles for scientific acceptance and does not offer any ready-made solutions to the problems posed by complex data; indeed, it echoes, rather than solves, these problems.

[1]  J. Lachmund,et al.  Making Sense of Sound: Auscultation and Lung Sound Codification in Nineteenth-Century French and German Medicine , 1999 .

[2]  Christopher Frauenberger,et al.  Auditory display design - An investigation of a design pattern approach , 2009, Int. J. Hum. Comput. Stud..

[3]  Thomas Hermann,et al.  Sonification for Exploratory Data Analysis , 2002 .

[4]  Sebastian Korff,et al.  Das Geiger-Müller-Zählrohr , 2012, NTM Zeitschrift für Geschichte der Wissenschaften, Technik und Medizin.

[5]  A. Beaulieu.  Images Are Not the (Only) Truth: Brain Mapping, Visual Knowledge, and Iconoclasm , 2002 .

[6]  Jonathan Sterne,et al.  The mp3 as cultural artifact , 2006, New Media Soc..

[7]  Linda Dalrymple Henderson,et al.  From Energy to Information: Representation in Science and Technology, Art, and Literature , 2002 .

[8]  A. Supper.  Sublime frequencies:  The construction of sublime listening experiences in the sonification of scientific data , 2014, Social studies of science.

[9]  Melissa Van Drie,et al.  Training the Auscultative Ear: Medical Textbooks and Teaching Tapes (1950–2010) , 2013 .

[10]  K. Bijsterveld.  Listening to machines: industrial noise, hearing loss and the cultural meaning of sound , 2006 .

[11]  Karin Bijsterveld,et al.  The Oxford Handbook of Sound Studies , 2011 .

[12]  Axel Volmar.  Listening to the Cold War: The Nuclear Test Ban Negotiations, Seismology, and Psychoacoustics, 1958–1963 , 2013, Osiris.

[13]  Loren R. Graham,et al.  Functions and uses of disciplinary histories , 1983 .

[14]  Ted Striphas.  Acknowledged Goods: Cultural Studies and the Politics of Academic Journal Publishing , 2010 .

[15]  Axel Volmar.  Sonic Facts for Sound Arguments: Medicine, Experimental Physiology, and the Auditory Construction of Knowledge in the 19th Century , 2013 .

[16]  Davide Rocchesso,et al.  The Sonification Handbook , 2011 .

[17]  Stefan Krebs.  “Sobbing, Whining, Rumbling”: Listening to Automobiles as Social Practice , 2012 .

[18]  Kelly Joyce.  Magnetic Appeal: MRI and the Myth of Transparency , 2008 .

[19]  George Basalla,et al.  Instruments and the Imagination , 1995 .

[20]  Thomas Hermann,et al.  TAXONOMY AND DEFINITIONS FOR SONIFICATION AND AUDITORY DISPLAY , 2008 .

[21]  Karin Bijsterveld,et al.  Acoustic Cocooning , 2010 .

[22]  Das geschulte Ohr : eine Kulturgeschichte der Sonifikation , 2012 .

[23]  T. Rice.  ‘The hallmark of a doctor’: the stethoscope and the making of medical identity , 2010 .

[24]  L Back,et al.  The auditory culture reader , 2003 .

[25]  A. Secord.  Botany on a Plate , 2002, Isis.

[26]  S. Tyler.  The Vision Quest in the West, or What the Mind's Eye Sees , 1984, Journal of Anthropological Research.

[27]  M. Lynch,et al.  The handbook of science and technology studies , 2008 .

[28]  John G. Neuhoff,et al.  Sonification Report: Status of the Field and Research Agenda Prepared for the National Science Foundation by members of the International Community for Auditory Display , 1999 .

[29]  Peter Brannen.  Microbial Muse: Drawing on Microbes for Inspiration: Through music, graphic design, poetry, photography, and metabolic alchemy, microbiology elicits distinctive artistic creativity , 2013 .

[30]  D. Boyd,et al.  CRITICAL QUESTIONS FOR BIG DATA , 2012 .

[31]  W. Bynum,et al.  Medicine and the Five Senses , 2005 .

[32]  J D Spikes.  Sounds of Science , 1975, Science.

[33]  Jodi Forlizzi,et al.  TIMELINESSound in computing: a short history , 2009, INTR.

[34]  Yadira Espinal.  Viktor Mayer-Schonberger and Kenneth Cukier, Big Data: A Revolution That Will Transform How We Live, Work and Think , 2013 .

[35]  Till Bovermann.  Tangible auditory interfaces: combining auditory displays and tangible interfaces , 2009 .

[36]  Bruce N Walker,et al.  Magnitude estimation of conceptual data dimensions for use in sonification. , 2002, Journal of experimental psychology. Applied.

[37]  Lissa Roberts,et al.  The Death of the Sensuous Chemist: The 'New' Chemistry and the Transformation of Sensuous Technology , 1995 .

[38]  R. Burri,et al.  Introduction: The Five Senses of Science Making Sense of Senses , 2011 .

[39]  Commemorative Practices at CERN: Between Physicists' Memories and Historians' Narratives , 1999, Osiris.

[40]  Julia Kursell.  Sounds of Science – Schall im Labor (1800–1930) , 2008 .

[41]  Alberto Cambrosio,et al.  Visual cultures of science : rethinking representational practices in knowledge building and science communication , 2005 .

[42]  Gregory Kramer,et al.  Auditory Display: Sonification, Audification, And Auditory Interfaces , 1994 .

[43]  Florian Dombois.  Sonifikation: Ein Plädoyer, dem naturwissenschaftlichen Verfahren eine kulturhistorische Einschätzung zukommen zu lassen , 2008 .

[44]  Sara A. Bly,et al.  Communicating with sound (panel session , 1985, CHI '85.

[45]  Stefan Krebs,et al.  The Art of Stethoscope Use: Diagnostic Listening Practices of Medical Physicians and "Auto Doctors" , 2014 .

[46]  Worlds of Wonder: Sensation and the Victorian Scientific Performance , 2010, Isis.

[47]  J. Sterne.  The Sound Studies Reader , 2012 .

[48]  Stefan Helmreich,et al.  An anthropologist underwater: Immersive soundscapes, submarine cyborgs, and transductive ethnography , 2007 .

[49]  Viktor Mayer-Schnberger,et al.  Big Data: A Revolution That Will Transform How We Live, Work, and Think , 2013 .

[50]  E. Brady.  A Spiral Way: How the Phonograph Changed Ethnography , 1999 .

[51]  B. Latour.  Drawing Things Together , 2011 .

[52]  John H. Flowers,et al.  THIRTEEN YEARS OF REFLECTION ON AUDITORY GRAPHING: PROMISES, PITFALLS, AND POTENTIAL NEW DIRECTIONS , 2005 .

[53]  S. Woolgar,et al.  Representation in Scientific Practice , 1990 .

[54]  Andy Hunt,et al.  Interactive sonification of complex data , 2009, Int. J. Hum. Comput. Stud..

[55]  Cyrus C. M. Mody.  The Sounds of Science: Listening to Laboratory Practice , 2005 .

[56]  S. Korff.  How the Geiger Counter started to crackle: Electrical counting methods in early radioactivity research , 2013 .

[57]  Christian Dayé,et al.  Sounds sequential: sonification in the social sciences , 2006 .