Sonification Report: Status of the Field and Research Agenda Prepared for the National Science Foundation by members of the International Community for Auditory Display

The purpose of this paper is to provide an overview of sonification research, including the current status of the field and a proposed research agenda. This paper was prepared by an interdisciplinary group of researchers gathered at the request of the National Science Foundation in the fall of 1997 in association with the International Conference on Auditory Display (ICAD).

[1]  Max V. Mathews,et al.  The Technology Of Computer Music , 1970 .

[2]  John M. Chowning,et al.  The Synthesis of Complex Audio Spectra by Means of Frequency Modulation , 1973 .

[3]  W R Thurlow,et al.  Certain Determinants of the “Ventriloquism Effect” , 1973, Perceptual and motor skills.

[4]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[5]  E. Owens,et al.  An Introduction to the Psychology of Hearing , 1997 .

[6]  J. Grey,et al.  Perceptual evaluations of synthesized musical instrument tones , 1977 .

[7]  J. Grey.  Multidimensional perceptual scaling of musical timbres. , 1977, The Journal of the Acoustical Society of America.

[8]  David Wessel,et al.  Timbre Space as a Musical Control Structure , 1979 .

[9]  Robert C. Morrison,et al.  High technology laboratory aids for visually handicapped chemistry students , 1981 .

[10]  James A. Ballas,et al.  Acquisition of acoustic pattern categories by exemplar observation , 1982 .

[11]  J. Blauert.  Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[12]  Kevin Karplus,et al.  Digital Synthesis of Plucked-String and Drum Timbers , 1983 .

[13]  John R. Pierce,et al.  The science of musical sound , 1983 .

[14]  William L. Martens.  Palette: An Environment for Developing an Individualized Set of Psychophysically Scaled Trimbres , 1985, ICMC.

[15]  Edward Rolf Tufte,et al.  The visual display of quantitative information , 1985 .

[16]  S. Handel.  Listening As Introduction to the Perception of Auditory Events , 1989 .

[17]  Xavier Serra,et al.  A system for sound analysis/transformation/synthesis based on a deterministic plus stochastic decomposition , 1989 .

[18]  George A. Gescheider,et al.  Hearing: Physiological Acoustics, Neural Coding, and Psychoacoustics , 1989 .

[19]  Steven K. Feiner,et al.  Computer graphics: principles and practice (2nd ed.) , 1990 .

[20]  Edward R. Tufte,et al.  Envisioning Information , 1990 .

[21]  William W. Gaver,et al.  Effective sounds in complex systems: the ARKOLA simulation , 1991, CHI.

[22]  Alan B. Craig,et al.  Using sound to extract meaning from complex data , 1991, Electronic Imaging.

[23]  Elizabeth M. Wenzel,et al.  Localization in Virtual Acoustic Displays , 1992, Presence: Teleoperators & Virtual Environments.

[24]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[25]  Tapio Takala,et al.  Sound rendering , 1992, SIGGRAPH.

[26]  L D Rosenblum,et al.  Visual influences on auditory pluck and bow judgments , 1993, Perception & psychophysics.

[27]  S. McAdams,et al.  Auditory Cognition. (Book Reviews: Thinking in Sound. The Cognitive Psychology of Human Audition.) , 1993 .

[28]  F L Wightman,et al.  Localization using nonindividualized head-related transfer functions. , 1993, The Journal of the Acoustical Society of America.

[29]  Xavier Rodet,et al.  Synthesis and Control of Hundreds of Sinusoidal Partials on a Desktop Computer without Custom Hardware , 1993, ICMC.

[30]  Gregory Kramer,et al.  Auditory Display: Sonification, Audification, And Auditory Interfaces , 1994 .

[31]  D. A. Duce,et al.  Visualization in Scientific Computing , 1994, Focus on Computer Graphics.

[32]  Gregory Kramer,et al.  Sound and communication in virtual reality , 1995 .

[33]  Perry R. Cook,et al.  A Hierarchical System for Controlling Synthesis by Phyical Modeling , 1995, International Conference on Mathematics and Computing.

[34]  John R. Pierce,et al.  A passive nonlinear digital filter design which facilitates physics-based sound synthesis of highly nonlinear musical instruments , 1995 .

[35]  John A. Gardner,et al.  TRIANGLE: A practical application of non-speech audio for imparting information , 1996 .

[36]  Julius O. Smith,et al.  Physical Modeling Synthesis Update , 1996 .

[37]  Simon Carlile,et al.  Virtual Auditory Space: Generation and Applications , 2013, Neuroscience Intelligence Unit.

[38]  Greg Kramer,et al.  Mapping a Single Data Stream to Multiple Auditory Variables: A Subjective Approach to Creating a Compelling Design , 1996 .

[39]  Stephen Barrass.  Sculpting a sound space with information properties , 1996 .

[40]  Dinesh K. Pai,et al.  Synthesis of shape dependent sounds with physical modeling , 1996 .

[41]  John H. Flowers,et al.  Cross-Modal Equivalence of Visual and Auditory Scatterplots for Exploring Bivariate Data Samples , 1997, Hum. Factors.

[42]  Alistair D. N. Edwards,et al.  Access to Mathematics for Visually Disabled Students through Multi-modal Interaction , 1997 .

[43]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[44]  Alistair D. N. Edwards,et al.  Access to Mathematics for Visually Disabled Students Through Multimodal Interaction , 1997, Hum. Comput. Interact..

[45]  Myke Gluck,et al.  Visual Explanations: Images and Quantities, Evidence and Narrative , 1997, Inf. Process. Manag..

[46]  Jennifer Lawrence,et al.  Communication in the Age of Virtual Reality. , 1997 .

[47]  Perry R. Cook,et al.  Physically Informed Sonic Modeling (PhISM): Synthesis of percussive sounds , 1997 .

[48]  Christopher D. Wickens,et al.  An introduction to human factors engineering , 1997 .

[49]  S. Backhaus,et al.  Quantum oscillations between two weakly coupled reservoirs of superfluid 3He , 1997, Nature.

[50]  John G. Neuhoff,et al.  Perceptual bias for rising tones , 1998, Nature.

[51]  B. Shinn-Cunningham.  Applications of virtual auditory displays , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[52]  R. Duda,et al.  Range dependence of the response of a spherical head model , 1998 .

[53]  Thomas P. Caudell,et al.  Creating wavelet-based models for real-time synthesis of perceptually convincing environmental sounds , 1998 .

[54]  Rick L. Jenison,et al.  Synthesis of virtual motion in 3D auditory space , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[55]  D. S. Brungart.  Control of perceived distance in virtual audio displays , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[56]  Charles Earl,et al.  A Survey of Windows Screen Reader Users: Recent Improvements in Accessibility , 1999 .

[57]  A. Bregman.  Auditory Scene Analysis , 2001 .