A system to simulate and reproduce audio–visual environments for spatial hearing research

The article reports the experience gained from two implementations of the "Simulated Open-Field Environment" (SOFE), a setup that allows sounds to be played at calibrated levels over a wide frequency range from multiple loudspeakers in an anechoic chamber. Playing sounds from loudspeakers in the free-field has the advantage that each participant listens with their own ears, and individual characteristics of the ears are captured in the sound they hear. This makes an easy and accurate comparison between various listeners with and without hearing devices possible. The SOFE uses custom calibration software to assure individual equalization of each loudspeaker. Room simulation software creates the spatio-temporal reflection pattern of sound sources in rooms which is played via the SOFE loudspeakers. The sound playback system is complemented by a video projection facility which can be used to collect or give feedback or to study auditory-visual interaction. The article discusses acoustical and technical requirements for accurate sound playback against the specific needs in hearing research. An introduction to software concepts is given which allow easy, high-level control of the setup and thus fast experimental development, turning the SOFE into a "Swiss army knife" tool for auditory, spatial hearing and audio-visual research.

[1]  B. Seeber,et al.  Localization cues with bilateral cochlear implants. , 2008, The Journal of the Acoustical Society of America.

[2]  Hugo Fastl,et al.  Localization ability with bimodal hearing aids and bilateral cochlear implants. , 2004, The Journal of the Acoustical Society of America.

[3]  Alam,et al.  Direct photon production at the psi , 1981 .

[4]  Jason E. Summers.  Auralization: Fundamentals of Acoustics, Modelling, Simulation, Algorithms, and Acoustic Virtual Reality , 2008 .

[5]  Hugo Fastl,et al.  Psychoacoustics: Facts and Models , 1990 .

[6]  R. H. Bolt,et al.  Pulse Statistics Analysis of Room Acoustics , 1950 .

[7]  R. L. Wegel,et al.  The Auditory Masking of One Pure Tone by Another and its Probable Relation to the Dynamics of the Inner Ear , 1924 .

[8]  John Vanderkooy,et al.  Transfer-Function Measurement with Maximum-Length Sequences , 1989 .

[9]  Heewon Lee,et al.  An efficient algorithm for the image model technique , 1988 .

[10]  Richard H. Small.  Closed-Box Loudspeaker Systems-Part 1: Analysis , 1972 .

[11]  Bernhard U. Seeber,et al.  Precedence-effect with cochlear implant simulation , 2007 .

[12]  Bernhard U. Seeber,et al.  Perceptual equalization in near-speaker panning , 2007 .

[13]  Bernhard U. Seeber,et al.  Subjective selection of non-individual head-related transfer functions , 2003 .

[14]  Mendel Kleiner,et al.  Auralization-An Overview , 1993 .

[15]  William M. Hartmann,et al.  Psychoacoustics: Facts and Models , 2001 .

[16]  Peter Svensson,et al.  Auralization. Fundmamentals of Acoustics, Modelling, Simulation, Algorithms and Acoustic Virtual Reality by Michael Vorländer , 2008 .

[17]  G. C. Stecker,et al.  Temporal weighting in sound localization. , 2002, The Journal of the Acoustical Society of America.

[18]  Ville Pulkki,et al.  Virtual Sound Source Positioning Using Vector Base Amplitude Panning , 1997 .

[19]  W. M. Rabinowitz,et al.  Auditory localization of nearby sources. Head-related transfer functions. , 1999, The Journal of the Acoustical Society of America.

[20]  H S Colburn,et al.  The precedence effect. , 1999, The Journal of the Acoustical Society of America.

[21]  J. Kirszenstein,et al.  An image source computer model for room acoustics analysis and electroacoustic simulation , 1984 .

[22]  A. Berkhout,et al.  Acoustic control by wave field synthesis , 1993 .

[23]  B. R. Shelton,et al.  The influence of vision on the absolute identification of sound-source position , 1980, Perception & psychophysics.

[24]  Richard H. Small.  Closed-Box Loudspeaker Systems-Part 2: Synthesis , 1973 .

[25]  Bernhard U. Seeber,et al.  The Simulated Open Field Environment for auditory localization research , 2004 .

[26]  Heinrich Kuttruff,et al.  Acoustics: An Introduction , 2006 .

[27]  Bernhard U. Seeber,et al.  A New Method for Localization Studies , 2002 .

[28]  Michael J. Gerzon.  Periphony: With-Height Sound Reproduction , 1973 .