A Systematic Review of Mapping Strategies for the Sonification of Physical Quantities

The field of sonification has progressed greatly over the past twenty years and currently constitutes an established area of research. This article aims at exploiting and organizing the knowledge accumulated in previous experimental studies to build a foundation for future sonification works. A systematic review of these studies may reveal trends in sonification design, and therefore support the development of design guidelines. To this end, we have reviewed and analyzed 179 scientific publications related to sonification of physical quantities. Using a bottom-up approach, we set up a list of conceptual dimensions belonging to both physical and auditory domains. Mappings used in the reviewed works were identified, forming a database of 495 entries. Frequency of use was analyzed among these conceptual dimensions as well as higher-level categories. Results confirm two hypotheses formulated in a preliminary study: pitch is by far the most used auditory dimension in sonification applications, and spatial auditory dimensions are almost exclusively used to sonify kinematic quantities. To detect successful as well as unsuccessful sonification strategies, assessment of mapping efficiency conducted in the reviewed works was considered. Results show that a proper evaluation of sonification mappings is performed only in a marginal proportion of publications. Additional aspects of the publication database were investigated: historical distribution of sonification works is presented, projects are classified according to their primary function, and the sonic material used in the auditory display is discussed. Finally, a mapping-based approach for characterizing sonification is proposed.

[1]  Bruce N. Walker,et al.  AQUARIUM SONIFICATION: SOUNDSCAPES FOR ACCESSIBLE DYNAMIC INFORMAL LEARNING ENVIRONMENTS , 2006 .

[2]  Florian Grand,et al.  Sumo. A Sonification Utility for Molecules , 2008 .

[3]  Aniruddh D. Patel Music, Language, and the Brain , 2007 .

[4]  Charles O'Neill,et al.  Hearing Images: Interactive Sonification Interface for Images , 2008, 2008 International Conference on Automated Solutions for Cross Media Content and Multi-Channel Distribution.

[5]  Christoph Henkelmann,et al.  Improving the Aesthetic Quality of Realtime Motion Data Sonification , 2007 .

[6]  Bruce N. Walker,et al.  Consistency of magnitude estimations with conceptual data dimensions used for sonification , 2007 .

[7]  Jonathan Berger,et al.  THE SOUND OF ONE ARM SWINGING: A MODEL FOR MULTIDIMENSIONAL AUDITORY DISPLAY OF PHYSICAL MOTION , 2006 .

[8]  L. Kay Auditory perception and its relation to ultrasonic blind guidance aids , 1962 .

[9]  Lorenzo Chiari,et al.  Audio-biofeedback for balance improvement: an accelerometry-based system , 2005, IEEE Transactions on Biomedical Engineering.

[10]  Marcus Watson Scalable earcons: Bridging the gap between intermittent and continuous auditory displays , 2006 .

[11]  Gerold Baier,et al.  MULTI-CHANNEL SONIFICATION OF HUMAN EEG , 2007 .

[12]  Feng Zhou,et al.  An outdoor navigation aid system for the visually impaired , 2010, 2010 IEEE International Conference on Industrial Engineering and Engineering Management.

[13]  Miguel Ángel García-Ruíz,et al.  An overview of auditory display to assist comprehension of molecular information , 2006, Interact. Comput..

[14]  Jun Munemori,et al.  Development and trial of groupware for organizational design and management: distributed and cooperative KJ method support system , 1991 .

[15]  Rangaraj M. Rangayyan,et al.  Audification and sonification of texture in images , 2001, J. Electronic Imaging.

[16]  M. Garcia,et al.  Multi-Modal Interface for a Real-Time CFD Solver , 2006, 2006 IEEE International Workshop on Haptic Audio Visual Environments and their Applications (HAVE 2006).

[17]  Ben Shneiderman,et al.  Interactive sonification of choropleth maps , 2005, IEEE MultiMedia.

[18]  Helge J. Ritter,et al.  Sound and meaning in auditory data display , 2004, Proceedings of the IEEE.

[19]  Guido Bologna,et al.  On the use of the auditory pathway to represent image scenes in real-time , 2009, Neurocomputing.

[20]  Martha Cleveland-Innes,et al.  Revisiting methodological issues in transcript analysis: Negotiated coding and reliability , 2006, Internet High. Educ..

[21]  Terri L. Bonebright,et al.  Sonific ation Report: Status of the Field and Research Agenda , 2010 .

[22]  Katharina Vogt,et al.  A QUANTITATIVE EVALUATION APPROACH TO SONIFICATIONS , 2011 .

[23]  Helge Ritter,et al.  Kernel Regression Mapping for Vocal Eeg Sonification , 2008 .

[24]  William W. Gaver What in the World Do We Hear? An Ecological Approach to Auditory Event Perception , 1993 .

[25]  Densil Cabrera,et al.  Using sonification for teaching acoustics and audio , 2006 .

[26]  Thomas Hermann,et al.  An introduction to interactive sonification , 2005 .

[27]  Daniel Jones AtomSwarm: A Framework for Swarm Improvisation , 2008, EvoWorkshops.

[28]  E. Jovanov,et al.  Perceptualization of biomedical data. An experimental environment for visualization and sonification of brain electrical activity , 1999, IEEE Engineering in Medicine and Biology Magazine.

[29]  Ville Pulkki,et al.  USING MULTI-CHANNEL SPATIALIZATION IN SONIFICATION: A CASE STUDY WITH METEOROLOGICAL DATA , 2003 .

[30]  Richard Kronland-Martinet,et al.  Real-Time Perceptual Simulation of Moving Sources: Application to the Leslie Cabinet and 3D Sound Immersion , 2008, EURASIP J. Audio Speech Music. Process..

[31]  Claude Vallée The Cosmophone: Toward a Sensuous Insight into Hidden Reality , 2002 .

[32]  Andy Hunt,et al.  Guest Editors' Introduction: An Introduction to Interactive Sonification , 2005, IEEE Multim..

[33]  Guido Bologna,et al.  Multisource Sonification for Visual Substitution in an Auditory Memory Game: One, or Two Fingers? , 2011 .

[34]  Jeffrey E. Boyd,et al.  CORRECTIVE SONIC FEEDBACK FOR SPEED SKATING: A CASE STUDY , 2010 .

[35]  Bruce N. Walker,et al.  PSYCHOPHYSICAL SCALING OF SONIFICATION MAPPINGS: A COMPARISION OF VISUALLY IMPAIRED AND SIGHTED LISTENERS , 2001 .

[36]  Richard Kronland-Martinet,et al.  Cosmic ray sonification: the COSMOPHONE , 2011, AI & SOCIETY.

[37]  Bruce N Walker,et al.  Magnitude estimation of conceptual data dimensions for use in sonification. , 2002, Journal of experimental psychology. Applied.

[38]  Guido Bologna,et al.  PAIRING COLORED SOCKS AND FOLLOWING A RED SERPENTINE WITH SOUNDS OF MUSICAL INSTRUMENTS , 2008 .

[39]  Sandra Pauletto,et al.  The sonification of EMG data , 2006 .

[40]  Rolf Drechsler,et al.  Applications of Evolutionary Computing, EvoWorkshops 2008: EvoCOMNET, EvoFIN, EvoHOT, EvoIASP, EvoMUSART, EvoNUM, EvoSTOC, and EvoTransLog, Naples, Italy, March 26-28, 2008. Proceedings , 2008, EvoWorkshops.

[41]  Sigurd Saue,et al.  A model for interaction in exploratory sonification displays , 2000 .

[42]  William A. Sethares,et al.  Rhythm and Transforms , 2007 .

[43]  Bruce N. Walker,et al.  Musical soundscapes for an Accessible Aquarium: Bringing Dynamic Exhibits to the Visually Impaired , 2007, ICMC.

[44]  Helge J. Ritter,et al.  Crystallization sonification of high-dimensional datasets , 2005, TAP.

[45]  Bee Ong,et al.  SONIFICATION OF BOWING FEATURES FOR STRING INSTRUMENT TRAINING , 2008 .

[46]  Gerold Baier,et al.  Event-based sonification of EEG rhythms in real time , 2007, Clinical Neurophysiology.

[47]  Haixia Zhao Interactive sonification of geo-referenced data , 2005, CHI EA '05.

[48]  Guido Bologna,et al.  Sonification of Colour and Depth in a Mobility Aid for Blind People , 2010 .

[49]  Paul Vickers,et al.  Sonification Abstraite/Sonification Concrète: An 'Aesthetic Perspective Space' for Classifying Auditory Displays in the Ars Musica Domain , 2006, ArXiv.

[50]  Roderick Murray-Smith,et al.  Model-based Target Sonification on Mobile Devices , 2004 .

[51]  Bruce N. Walker,et al.  Mappings and metaphors in auditory displays: An experimental assessment , 2005, TAP.

[52]  Nick Bearman,et al.  Using Sound to Represent Positional Accuracy of Address Locations , 2010 .

[53]  Nina Schaffert,et al.  A SOUND DESIGN FOR THE PURPOSES OF MOVEMENT OPTIMISATION IN ELITE SPORT (USING THE EXAMPLE OF ROWING) , 2009 .

[54]  L. Kay,et al.  A sonar aid to enhance spatial perception of the blind: engineering design and evaluation , 1974 .

[55]  Thomas Hermann,et al.  Neural gas sonification - growing adaptive interfaces for interacting with data , 2004 .

[56]  Helge Ritter,et al.  Principal Curve Sonification , 2000 .

[57]  Nicu Sebe,et al.  Sonify your face: facial expressions for sound generation , 2010, ACM Multimedia.

[58]  Christian Jacquemin,et al.  Real-Time Sonification of Physiological Data in an Artistic Performance Context , 2008 .

[59]  Antti Pirhonen,et al.  Sonification of directional and emotional content: Description of design challenges , 2008 .

[60]  Alexandra Supper,et al.  The Search for the “Killer Application”: Drawing the Boundaries around the Sonification of Scientific Data , 2011 .

[61]  Marcus Watson,et al.  Sonification Supports Eyes-Free Respiratory Monitoring and Task Time-Sharing , 2004, Hum. Factors.

[62]  Helge Ritter,et al.  Real-Time Control of Sonification Models with an Audio-Haptic Interface , 2002 .

[63]  Guido Bologna,et al.  Toward local and global perception modules for vision substitution , 2011, Neurocomputing.

[64]  Dan Overholt,et al.  The Allobrain: An interactive, stereographic, 3D audio, immersive virtual world , 2009, Int. J. Hum. Comput. Stud..

[65]  Metin Akay,et al.  Perceptualization of Biomedical Data , 2001 .

[66]  Danielle Wilde,et al.  The hipdiskettes: learning (through) wearables , 2008, OZCHI '08.

[67]  Jérôme Joy What NMSAT says about sonification , 2011, AI & SOCIETY.

[68]  Guido Bologna,et al.  A perceptual interface for vision substitution in a color matching experiment , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[69]  P. M. Sanderson,et al.  The effects of ambient music on simulated anaesthesia monitoring , 2005, Anaesthesia.

[70]  Helge Ritter,et al.  SONIFICATIONS FOR EEG DATA ANALYSIS , 2002 .

[71]  Tillman Weyde,et al.  3d augmented mirror: a multimodal interface for string instrument learning and teaching with gesture support , 2007, ICMI '07.

[72]  Sigurd Saue,et al.  A platform for audiovisual seismic interpretation , 1997 .

[73]  Jeremy R. Cooperstock,et al.  Eyes-free environmental awareness for navigation , 2012, Journal on Multimodal User Interfaces.

[74]  Marcus Watson,et al.  The effect of music on monitoring a simulated anaesthetised patient with sonfication , 2004 .

[75]  William W. Gaver Auditory Icons: Using Sound in Computer Interfaces , 1986, Hum. Comput. Interact..

[76]  Andy Hunt,et al.  Interactive sonification of complex data , 2009, Int. J. Hum. Comput. Stud..

[77]  Lukas Scheef,et al.  Multimodal motion processing in area V5/MT: Evidence from an artificial class of audio-visual events , 2009, Brain Research.

[78]  Tooba Nasir,et al.  Geo-sonf: Spatial sonification of contour maps , 2009, 2009 IEEE International Workshop on Haptic Audio visual Environments and Games.

[79]  Thilo Hinterberger,et al.  The Thought Translation Device: structure of a multimodal brain-computer communication system , 2003, First International IEEE EMBS Conference on Neural Engineering, 2003. Conference Proceedings..

[80]  Stephen A. Boppart,et al.  Sonification of optical coherence tomography data and images , 2010, Optics express.

[81]  Ivan Kope Hybrid Approach to Sonification of Color Images , 2008 .

[82]  Bruce N. Walker,et al.  Universal Design of Auditory Graphs: A Comparison of Sonification Mappings for Visually Impaired and Sighted Listeners , 2010, TACC.

[83]  I. Kopecek,et al.  Hybrid Approach to Sonification of Color Images , 2008, 2008 Third International Conference on Convergence and Hybrid Information Technology.

[84]  Guido Bologna,et al.  Color-audio encoding interface for visual substitution: see color matlab-based demo , 2010, ASSETS '10.

[85]  Tiziano Agostini,et al.  Using auditory stimulation to enhance athletes’ strength: An experimental study in weightlifting , 2012 .

[86]  Robert L. Alexander,et al.  Sonification of Ace Level 2 Solar Wind Data , 2010 .

[87]  Allan D. Pierce,et al.  Acoustical Society of America , 2005 .

[88]  Richard Kronland-Martinet,et al.  Designing Musical Interfaces with Composition in Mind , 2003, CMMR.

[89]  Kirsty Beilharz Wireless gesture controllers to affect information sonification , 2005 .

[90]  Davide Rocchesso,et al.  A toolkit for explorations in sonic interaction design , 2010, Audio Mostly Conference.

[91]  H. Flor,et al.  A multimodal brain-based feedback and communication system , 2004, Experimental Brain Research.

[92]  Penelope M. Sanderson,et al.  Monitoring the Anesthetized Patient: An Analysis of Confusions in Vital Sign Reports , 2003 .

[93]  Shannon C. McMullen,et al.  The elocuter: I must remind you we live in Dada times , 2010, CHI EA '10.

[94]  Nina Schaffert,et al.  Examining effects of acoustic feedback on perception and modification of movement patterns in on-water rowing training , 2011, AM '11.

[95]  Sven Sahle,et al.  SONIFIED EPILEPTIC RHYTHMS , 2006 .

[96]  S. Stergiopoulos,et al.  Sonification of range information for 3-D space perception , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[97]  Marcus Watson,et al.  Designing Auditory Displays for Team Environments , 2000 .

[98]  Thilo Hinterberger,et al.  Auditory Feedback of Human EEG for Direct Brain-Computer Communication , 2004, ICAD.

[99]  Thomas Hermann,et al.  Sonification of Pressure Changes in Swimming for Analysis and Optimization , 2012 .

[100]  Roberto Bresin,et al.  Improving Running Mechanics by Use of Interactive Sonification , 2010 .

[101]  Nina Schaffert,et al.  A Sound Design for Acoustic Feedback in Elite Sports , 2009, CMMR/ICAD.

[102]  Nina Schaffert,et al.  Listen to the boat motion: acoustic information for elite rowers , 2010 .

[103]  Marcus Watson,et al.  Work domain analysis for the evaluation of human interaction with anaesthesia alarm systems , 1998, Proceedings 1998 Australasian Computer Human Interaction Conference. OzCHI'98 (Cat. No.98EX234).

[104]  Jiping He,et al.  Interactive Multimodal Biofeedback for Task-Oriented Neural Rehabilitation , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[105]  Alfred O. Effenberg MULTIMODAL CONVERGENT INFORMATION ENHANCES PERCEPTION ACCURACY OF HUMAN MOVEMENT PATTERNS , 2001 .

[106]  Rangaraj M. Rangayyan,et al.  Aural analysis of image texture via cepstral filtering and sonification , 1996, Electronic Imaging.

[107]  Marcus Watson,et al.  Multimodal displays for anaesthesia sonification: timesharing, workload, and expertise , 2002 .

[108]  Marcus Watson,et al.  Tailoring reveals information requirements: the case of anaesthesia alarms , 2004, Interact. Comput..

[109]  Thomas Hermann,et al.  Aesthetic strategies in sonification , 2011, AI & SOCIETY.

[110]  Ioannis A. Kakadiaris,et al.  A Multimodal User Interface for Geoscientific Data Investigation , 2000, ICMI.

[111]  Rangaraj M. Rangayyan,et al.  Auditory display and sonification of textured image , 1996 .

[112]  Bruce N. Walker,et al.  The accessible aquarium: identifying and evaluating salient creature features for sonification , 2008, Assets '08.

[113]  Davide Rocchesso,et al.  The Sonification Handbook , 2011 .

[114]  Helge Ritter,et al.  Interactive Sonification for exploring Single Molecule Properties with AFM based Force Spectroscopy , 2004 .

[115]  Ioannis A. Kakadiaris,et al.  A multi-sensory system for the investigation of geoscientific data , 2002, Comput. Graph..

[116]  Helge Ritter,et al.  Listen to your Data: Model-Based Sonification for Data Analysis , 1999 .

[117]  Mika Kuuskankare,et al.  The Sonified Urban Masterplan (Sum) Tool: Sonification for Urban Planning and Design , 2011 .

[118]  Gerold Baier,et al.  SONIC TRIPTYCHON OF THE HUMAN BRAIN , 2010 .

[119]  Thomas Hermann,et al.  Die Sonifikation des menschlichen EEG , 2008 .

[120]  Danielle Wilde,et al.  hipDisk: understanding the value of ungainly, embodied, performative, fun , 2012, CHI Extended Abstracts.

[121]  Stephen Barrass,et al.  Probing Preferences between Six Designs of Interactive Sonifications for Recreational Sports, Health and Fitness , 2010 .

[122]  Bob L. Sturm Sonification of particle systems via de Broglie's Hypothesis , 2000 .

[123]  Bruce N. Walker,et al.  SONIFICATION MAPPINGS DATABASE ON THE WEB , 2001 .

[124]  Sambit Bakshi,et al.  Review on image sonification: A non-visual scene representation , 2012, 2012 1st International Conference on Recent Advances in Information Technology (RAIT).

[125]  Roberto Bresin,et al.  Sonification of Physical Quantities Throughout History: A Meta-Study of Previous Mapping Strategies , 2011, icad 2011.

[126]  Lennart Gullstrand,et al.  Immediate effect of visual and auditory feedback to control the running mechanics of well-trained athletes , 2011, Journal of sports sciences.

[127]  Rangaraj M. Rangayyan,et al.  Experimental evaluation of auditory display and sonification of textured images , 1997 .

[128]  L. Kay,et al.  Electronic Aids for Blind Persons : an Interdisciplinary Subject , 1984 .

[129]  Nick Bearman,et al.  Who's sonifying data and how are they doing it? A comparison of ICAD and other venues since 2009 , 2012 .

[130]  Sylvie Gibet Sensorimotor Control of Sound-Producing Gestures, Musical Gestures - Sound, Movement, and Meaning , 2009 .

[131]  A Cappello,et al.  Energetic assessment of trunk postural modifications induced by a wearable audio-biofeedback system. , 2009, Medical engineering & physics.

[132]  L. Kay An ultrasonic sensing probe as a mobility aid for the blind , 1964 .

[133]  Marcus Watson,et al.  Designing for Attention With Sound: Challenges and Extensions to Ecological Interface Design , 2007, Hum. Factors.

[134]  Luca Benini,et al.  Bio-feedback system for rehabilitation based on a wireless body area network , 2006, Fourth Annual IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOMW'06).

[135]  Myounghoon Jeon,et al.  Aquarium fugue: interactive sonification for children and visually impaired audience in informal learning environments , 2012 .

[136]  Barbara R. Gaizauskas Harmony of the spheres , 1974 .

[137]  Monique Noirhomme-Fraiture,et al.  Complementing Visual Data Mining with the Sound Dimension: Sonification of Time Dependent Data , 2008, Visual Data Mining.

[138]  Roderick Murray-Smith,et al.  Multimodal Excitatory Interfaces with Automatic Content Classification , 2010, The Engineering of Mixed Reality Systems.

[139]  Ben Shneiderman,et al.  Data Sonification for Users with Visual Impairment: A Case Study with Georeferenced Data , 2008, TCHI.

[140]  I. Pollack,et al.  The Information of Elementary Multidimensional Auditory Displays , 1954 .

[141]  Gregory Kramer,et al.  Auditory Display: Sonification, Audification, And Auditory Interfaces , 1994 .

[142]  Kenneth I. Joy,et al.  Sound graphs: A numerical data analysis method for the blind , 1985, Journal of Medical Systems.

[143]  Myounghoon Jeon,et al.  Ergonomics Society of the Human Factors and Human Factors: The Journal , 2012 .

[144]  Bernd Fröhlich,et al.  Exploring geo-scientific data in virtual environments , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[145]  Guido Bologna,et al.  Transforming 3D Coloured Pixels into Musical Instrument Notes for Vision Substitution Applications , 2007, EURASIP J. Image Video Process..

[146]  Danielle Wilde,et al.  Extending body and imagination: moving to move , 2011 .

[147]  R. Riener,et al.  Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review , 2012, Psychonomic Bulletin & Review.

[148]  Nina Schaffert,et al.  Modeling the Rowing Stroke Cycle Acoustically , 2012 .

[149]  Penelope M. Sanderson Exploring auditory displays to support anaesthesia monitoring: Six questions from a research program , 2003 .

[150]  Helge J. Ritter,et al.  Identification of discriminative features in the EEG , 2004, Intell. Data Anal..

[151]  E. Jovanov,et al.  Multi modal presentation in virtual telemedical environments , 1999, Conference Proceedings IT IS-ITAB '99. Joint Meeting. Second International Workshop On the Telemedical Information Society (IT IS '99)/Second IEEE EMBS International Workshop on Information Technology.

[152]  Nina Schaffert,et al.  The sound of Rowing Stroke Cycles as Acoustic Feedback , 2011 .

[153]  David Edward Hughes III. Molecular magnetism , 1881, Proceedings of the Royal Society of London.

[154]  Jun Munemori,et al.  The effect to quality of creativity with sampling partial data from a large number of idea cards , 2012, CSCW.

[155]  Gerold Baier,et al.  The Sonification of Rhythms in Human Electroencephalogram , 2004, ICAD.

[156]  Guido Bologna,et al.  Eye Tracking in Coloured Image Scenes Represented by Ambisonic Fields of Musical Instrument Sounds , 2005, IWINAC.

[157]  Antti Pirhonen Semantics of Sounds and Images - Can They Be Paralleled? , 2007 .

[158]  Bruce N. Walker,et al.  Psychophysical scaling of sonification mappings , 2000 .

[159]  Nina Schaffert,et al.  An investigation of online acoustic information for elite rowers in on-water training conditions , 2011 .

[160]  Edward S. Yeung,et al.  Pattern recognition by audio representation of multivariate analytical data , 1980 .

[161]  S. S. Stevens,et al.  The Relation of Pitch to Frequency: A Revised Scale , 1940 .

[162]  Thomas M. Gable,et al.  A sonification of Kepler space telescope star data , 2012 .

[163]  Vesa Välimäki,et al.  Interactive sonification of synchronisation of motoric behaviour in social active listening to music with mobile devices , 2011, Journal on Multimodal User Interfaces.

[164]  Marcus Watson,et al.  Visual and auditory attention in patient monitoring: a formative analysis , 2004, Cognition, Technology & Work.

[165]  Jiping He,et al.  Journal of Neuroengineering and Rehabilitation Open Access Recent Developments in Biofeedback for Neuromotor Rehabilitation Review of Early Biofeedback Therapy Current Developments in Biofeedback in Neurorehabilitation Table 1: Function of Basic Modules in Multisensing Biofeedback Systems for Task T , 2022 .

[166]  Thierry Pun,et al.  Identifying Major Components of Pictures by Audio Encoding of Colours , 2007, IWINAC.

[167]  B. Kapralos,et al.  Sonification of range information for 3‐D space perception , 1999 .

[168]  Ben Shneiderman,et al.  Sonification of Geo-Referenced Data for Auditory Information Seeking: Design Principle and Pilot Study , 2004, ICAD.

[169]  Marco Dozza,et al.  Audio-biofeedback improves balance in patients with bilateral vestibular loss. , 2005, Archives of physical medicine and rehabilitation.

[170]  Susumu Harada,et al.  On the audio representation of radial direction , 2011, CHI.

[171]  Sridhar Krishnan,et al.  Sonification of knee-joint vibration signals , 2000, Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cat. No.00CH37143).

[172]  Laurence T. Maloney,et al.  Human perception and visualization , 1990, VIS '90.

[173]  Penelope M Sanderson,et al.  Advanced Auditory Displays and Head-Mounted Displays: Advantages and Disadvantages for Monitoring by the Distracted Anesthesiologist , 2008, Anesthesia and analgesia.

[174]  Loïc Kessous,et al.  Strategies of mapping between gesture data and synthesis model parameters using perceptual spaces , 2002, Organised Sound.

[175]  Nick Bearman,et al.  USING SOUND TO REPRESENT UNCERTAINTY IN FUTURE CLIMATE PROJECTIONS FOR THE UNITED KINGDOM , 2011 .

[176]  Mika Kuuskankare,et al.  Composing Graphic Scores and Sonifying Visual Music with the SUM Tool , 2012 .

[177]  Marcus Watson,et al.  Earcon for intermittent information in monitoring environments , 2004 .

[178]  Thomas Hermann,et al.  TAXONOMY AND DEFINITIONS FOR SONIFICATION AND AUDITORY DISPLAY , 2008 .

[179]  Gerold Baier,et al.  Polyrhythm in the Human Brain , 2004, ICAD.

[180]  Bruce N. Walker,et al.  Individual Differences, Cognitive Abilities, and the Interpretation of Auditory Graphs , 2004, ICAD.

[181]  Penelope M. Sanderson,et al.  Operating Theatre Patient Monitoring: The Effects of Self Paced Distracter Tasks and Experimental Control on Sonification Evaluations , 2003 .

[182]  Andy Hunt,et al.  A Toolkit for Interactive Sonification , 2004, ICAD.

[183]  Guido Bologna,et al.  See ColOr: Seeing Colours with an Orchestra , 2009, Human Machine Interaction.

[184]  Nina Schaffert,et al.  Acoustic feedback training in adaptive rowing , 2012 .

[185]  Thilo Hinterberger,et al.  Parametric orchestral sonification of EEG in real time , 2005, IEEE MultiMedia.

[186]  Danielle Wilde,et al.  hipDisk: Using sound to encourage physical extension, exploring humour in interface design , 2008 .

[187]  Helge Ritter,et al.  Vocal sonification of pathologic EEG features , 2006 .

[188]  Beilharz Kirsty Responsive Sensate Environments: Past and Future Directions , 2005 .

[189]  Marcus Watson,et al.  Ecological Interface Design for Anaesthesia Monitoring , 2000, Australas. J. Inf. Syst..

[190]  Angelo Cappello,et al.  Influence of a portable audio-biofeedback device on structural properties of postural sway , 2005, Journal of NeuroEngineering and Rehabilitation.

[191]  Peter F. Fisher,et al.  Using sound to represent spatial data in ArcGIS , 2012, Comput. Geosci..

[192]  Emil Jovanov,et al.  Tactical audio and acoustic rendering in biomedical applications , 1999, IEEE Transactions on Information Technology in Biomedicine.

[193]  Kirsty Beilharz Gesture-controlled interaction with aesthetic information sonification , 2005 .

[194]  Guido Bologna,et al.  Blind Navigation along a Sinuous Path by Means of the See ColOr Interface , 2009, IWINAC.

[195]  R. Jacobson,et al.  Increasing the dimensionality of a Geographic Information System (GIS) Using Auditory Display , 2007 .

[196]  Emil Jovanov,et al.  EEG analysis in a telemedical virtual world , 1999, Future Gener. Comput. Syst..

[197]  Alfred Effenberg,et al.  Movement sonification: Effects on perception and action , 2005, IEEE MultiMedia.

[198]  Stephen Barrass,et al.  Exploring Function and Aesthetics in Sonifications for Elite sports , 2009 .

[199]  Nick Bearman,et al.  Listening to uncertainty: Information that sings , 2012 .