Using Virtual Acoustic Space to Investigate Sound Localisation

It is an important task for the future to further close the gap between basic and applied science, in other words to make our understanding of the basic principles of auditory processing available for applications in medicine or information technology. Current examples are hearing aids (Dietz et al., 2009) or sound-localising robots (Calmes et al., 2007). This effort will be helped by better quantitative data resulting from more and more sophisticated experimental approaches. Despite new methodologies and techniques, the complex human auditory system is only accessible in a restricted way to many experimental approaches. This gap is closed by animal model systems that allow a more focused analysis of single aspects of auditory processing than human studies. The most commonly used animals in auditory research are birds (barn owls, chicken) and mammals (monkeys, cats, bats, ferrets, guinea pigs, rats and gerbils). When these animals are tested with various auditory stimuli in behavioural experiments, the accuracy (distance of a measured value to the true value) and precision (repeatability of a given measured value) of the animal’s behavioural response allows to draw conclusions on the difficulty with which the animal can use the stimulus to locate sound sources. An example is the measurement of minimum audible angles (MAA) to reveal the resolution threshold of the auditory system for the horizontal displacement of a sound source (Bala et al., 2007). Similarly, one can exploit the head-turn amplitude of humans or animals in response to narrowband or broadband sounds as a measure for the relevance of specific frequency bands, as well as binaural and monaural cues or perception thresholds (e.g. May & Huang, 1995; Poganiatz et al., 2001; Populin, 2006). The barn owl (Tyto alba) is an auditory specialist, depending to a large extent on listening while localising potential prey. In the course of evolution, the barn owl has developed several morphological and neuronal adaptations, which may be regarded as more optimal solutions to problems than the structures and circuits found in generalists. The owl has a characteristic facial ruff, which amplifies sound and is directionally sensitive for frequencies above 4 kHz (Coles & Guppy, 1988). Additionally, the left and right ear openings and flaps are asymmetrically with the left ear lying slightly higher than the right one. This asymmetry creates a steep gradient of interaural level differences (ILDs) in the owl’s frontal field (Campenhausen & Wagner, 2006). These adaptations to sound localisation are one of the reasons why barn owl hearing was established as an important model system during the last decades.

[1]  Ramani Duraiswami,et al.  Fast head-related transfer function measurement via reciprocity. , 2006, The Journal of the Acoustical Society of America.

[2]  Simon Carlile,et al.  The nature and distribution of errors in sound localization by human listeners , 1997, Hearing Research.

[3]  Fan-Gang Zeng,et al.  Effects of simulated spectral holes on speech intelligibility and spatial release from masking under binaural and monaural listening. , 2010, The Journal of the Acoustical Society of America.

[4]  Davide Rocchesso,et al.  A structural approach to distance rendering in personal auditory displays , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[5]  Hermann Wagner,et al.  Influence of the facial ruff on the sound-receiving characteristics of the barn owl’s ears , 2006, Journal of Comparative Physiology A.

[6]  S. Carlile,et al.  Enabling Individualized Virtual Auditory Space using Morphological Measurments , 2000 .

[7]  Pavel Zahorik,et al.  Assessing auditory distance perception using virtual acoustics. , 2002, The Journal of the Acoustical Society of America.

[8]  B. Stein,et al.  Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. , 1986, Journal of neurophysiology.

[9]  B. Delgutte,et al.  Receptive fields and binaural interactions for virtual-space stimuli in the cat inferior colliculus. , 1999, Journal of neurophysiology.

[10]  Klaus Hartung,et al.  Head-related transfer functions of the barn owl: measurement and neural responses , 1998, Hearing Research.

[11]  J. C. Middlebrooks,et al.  A neural code for auditory space in the cat's superior colliculus , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  L. Populin Monkey Sound Localization: Head-Restrained versus Head-Unrestrained Orienting , 2006, The Journal of Neuroscience.

[13]  Daniel J Tollin,et al.  Spectral cues explain illusory elevation effects with stereo sounds in cats. , 2003, Journal of neurophysiology.

[14]  Bruce N. Walker,et al.  Navigation Performance With a Virtual Auditory Display: Effects of Beacon Sound, Capture Radius, and Practice , 2006, Hum. Factors.

[15]  M. Konishi,et al.  Selectivity for interaural time difference in the owl's midbrain , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  K. Koka,et al.  Postnatal development of sound pressure transformations by the head and pinnae of the cat: Binaural characteristics. , 2009, The Journal of the Acoustical Society of America.

[17]  K. Saberi,et al.  Neural bases of an auditory illusion and its elimination in owls , 1999, Nature Neuroscience.

[18]  Pavel Zahorik,et al.  Perceptual recalibration in human sound localization: learning to remediate front-back reversals. , 2006, The Journal of the Acoustical Society of America.

[19]  F L Wightman,et al.  Headphone simulation of free-field listening. I: Stimulus synthesis. , 1989, The Journal of the Acoustical Society of America.

[20]  Paul M. Hofman,et al.  Relearning sound localization with new ears , 1998, Nature Neuroscience.

[21]  E. Knudsen The Hearing of the Barn Owl , 1981 .

[22]  Heinrich Hertz,et al.  On the differences between localization and lateralization. , 1974, The Journal of the Acoustical Society of America.

[23]  C. Köppl Phase Locking to High Frequencies in the Auditory Nerve and Cochlear Nucleus Magnocellularis of the Barn Owl, Tyto alba , 1997, The Journal of Neuroscience.

[24]  W M Hartmann,et al.  On the externalization of sound images. , 1996, The Journal of the Acoustical Society of America.

[25]  J. Hebrank,et al.  Are two ears necessary for localization of sound sources on the median plane? , 1974, The Journal of the Acoustical Society of America.

[26]  D. Butts,et al.  Tuning Curves, Neuronal Variability, and Sensory Coding , 2006, PLoS biology.

[27]  K Saberi,et al.  How do owls localize interaurally phase-ambiguous signals? , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[28]  B. May,et al.  Sound orientation behavior in cats. I. Localization of broadband noise. , 1996, The Journal of the Acoustical Society of America.

[29]  Laurence R. Harris,et al.  Integration of visual and auditory space in the mammalian superior colliculus , 1980, Nature.

[30]  S. Carlile The auditory periphery of the ferret. II: The spectral transformations of the external ear and their implications for sound localization. , 1990, The Journal of the Acoustical Society of America.

[31]  Hermann Wagner,et al.  Sound-localization experiments with barn owls in virtual space: influence of broadband interaural level difference on head-turning behavior , 2001, Journal of Comparative Physiology A.

[32]  H. Wagner,et al.  Improvements of Sound Localization Abilities by the Facial Ruff of the Barn Owl (Tyto alba) as Demonstrated by Virtual Ruff Removal , 2009, PloS one.

[33]  Richard G. Lanyon,et al.  Effects of altering spectral cues in infancy on horizontal and vertical sound localization by adult ferrets. , 1999, Journal of neurophysiology.

[34]  Avinash D. S. Bala,et al.  Auditory Spatial Acuity Approximates the Resolving Power of Space-Specific Neurons , 2007, PloS one.

[35]  Gerhard Lakemeyer,et al.  Azimuthal sound localization using coincidence of timing across frequency on a robotic platform. , 2007, The Journal of the Acoustical Society of America.

[36]  J. C. Middlebrooks,et al.  Two-dimensional sound localization by human listeners. , 1990, The Journal of the Acoustical Society of America.

[37]  Andrew J. King,et al.  How Plastic Is Spatial Hearing? , 2001, Audiology and Neurotology.

[38]  R. Marrocco,et al.  Head-related transfer functions of the Rhesus monkey , 2000, Hearing Research.

[39]  L D Braida,et al.  Binaural pinna disparity: another auditory localization cue. , 1975, The Journal of the Acoustical Society of America.

[40]  E I Knudsen,et al.  Neural maps of head movement vector and speed in the optic tectum of the barn owl. , 1990, Journal of neurophysiology.

[41]  Stephan Paul,et al.  Binaural Recording Technology: A Historical Review and Possible Future Developments , 2009 .

[42]  D. Kurylo,et al.  Effects of eye position on auditory localization and neural representation of space in superior colliculus of cats , 2004, Experimental Brain Research.

[43]  R L Jenison,et al.  Listening through different ears alters spatial response fields in ferret primary auditory cortex. , 2001, Journal of neurophysiology.

[44]  Adelbert W. Bronkhorst,et al.  Application of a Three-Dimensional Auditory Display in a Flight Task , 1996, Hum. Factors.

[45]  M. Gardner,et al.  Problem of localization in the median plane: effect of pinnae cavity occlusion. , 1973, The Journal of the Acoustical Society of America.

[46]  William L. Martens,et al.  PERCEIVED NATURALNESS OF SPEECH SOUNDS PRESENTED USING PERSONALIZED VERSUS NON-PERSONALIZED HRTFS , 2007 .

[47]  H. Wagner,et al.  Representation of interaural time difference in the central nucleus of the barn owl's inferior colliculus , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  Hermann Wagner,et al.  Properties of low-frequency head-related transfer functions in the barn owl (Tyto alba) , 2010, Journal of Comparative Physiology A.

[49]  Martin Vetterli,et al.  Dynamic measurement of room impulse responses using a moving microphone. , 2007, The Journal of the Acoustical Society of America.

[50]  D. Hubel,et al.  Physiology of visual cells in mouse superior colliculus and correlation with somatosensory and auditory input , 1975, Nature.

[51]  T C Yin,et al.  Pinna Movements of the Cat during Sound Localization , 1998, The Journal of Neuroscience.

[52]  L. Rayleigh,et al.  XII. On our perception of sound direction , 1907 .

[53]  A. King,et al.  Multisensory integration: perceptual grouping by eye and ear , 2001, Current Biology.

[54]  S. Carlile,et al.  The localisation of spectrally restricted sounds by human listeners , 1999, Hearing Research.

[55]  F L Wightman,et al.  Headphone simulation of free-field listening. II: Psychophysical validation. , 1989, The Journal of the Acoustical Society of America.

[56]  M J Steinbach,et al.  Eye movements of the owl. , 1973, Vision research.

[57]  Masakazu Konishi,et al.  Mechanisms of sound localization in the barn owl (Tyto alba) , 1979, Journal of comparative physiology.

[58]  R. B. Coles,et al.  Directional hearing in the barn owl (Tyto alba) , 1988, Journal of Comparative Physiology A.

[59]  Daniel J Tollin,et al.  Influence of sound source location on the behavior and physiology of the precedence effect in cats. , 2009, Journal of neurophysiology.

[60]  J A Mazer,et al.  How the owl resolves auditory coding ambiguity. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[61]  David B Pisoni,et al.  Perceptual learning of spectrally degraded speech and environmental sounds. , 2008, The Journal of the Acoustical Society of America.

[62]  O. Kirkeby,et al.  Resolution of front-back confusion in virtual acoustic imaging systems. , 2000, The Journal of the Acoustical Society of America.

[63]  J. Blauert Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[64]  M. Konishi,et al.  Neuronal and behavioral sensitivity to binaural time differences in the owl , 1981, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[65]  Henrik Møller,et al.  Audibility of direct switching between head-related transfer functions , 2008 .

[66]  F L Wightman,et al.  Localization using nonindividualized head-related transfer functions. , 1993, The Journal of the Acoustical Society of America.

[67]  Youn-sik Park,et al.  Modeling and Customization of Head-Related Impulse Responses Based on General Basis Functions in Time Domain , 2008 .

[68]  J. E. Hind,et al.  Direction-dependent spectral properties of cat external ear: new data and cross-species comparisons. , 1990, The Journal of the Acoustical Society of America.

[69]  Norman Lee,et al.  A precedence effect resolves phantom sound source illusions in the parasitoid fly Ormia ochracea , 2009, Proceedings of the National Academy of Sciences.

[70]  G. Blasdel,et al.  Sound localization by the barn owl (Tyto alba) measured with the search coil technique , 1979, Journal of comparative physiology.

[71]  Daniel J. Tollin,et al.  The acoustical cues to sound location in the rat: measurements of directional transfer functions. , 2008, The Journal of the Acoustical Society of America.

[72]  Roberta L. Klatzky,et al.  Navigation System for the Blind: Auditory Display Modes and Guidance , 1998, Presence.

[73]  Naomi Inoue,et al.  Interpolation of head-related transfer functions by spatial linear prediction , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[74]  Israel Nelken,et al.  Sound-Localization Experiments with Barn Owls in Virtual Space: Influence of Interaural Time Difference on Head-Turning Behavior , 2000, Journal of the Association for Research in Otolaryngology.

[75]  William L. Martens,et al.  PSYCHOPHYSICAL CALIBRATION FOR CONTROLLING THE RANGE OF A VIRTUAL SOUND SOURCE: MULTIDIMENSIONAL COMPLEXITY IN SPATIAL AUDITORY DISPLAY , 2001 .

[76]  R. Klatzky,et al.  Assessing auditory distance perception using perceptually directed action , 1998, Perception & psychophysics.

[77]  Volker Hohmann,et al.  Lateralization of stimuli with independent fine-structure and envelope-based temporal disparities. , 2008, The Journal of the Acoustical Society of America.

[78]  T. Yin,et al.  The Coding of Spatial Location by Single Units in the Lateral Superior Olive of the Cat. I. Spatial Receptive Fields in Azimuth , 2002, The Journal of Neuroscience.

[79]  Zhenyang Wu,et al.  HRTF personalization based on artificial neural network in individual virtual auditory space , 2008 .