Transforming Object Locations on a 2D Visual Display into Cued Locations in 3D Auditory Space

An empirical study explored the extent to which people can map locations in auditory space to locations on a visual display for four different transformations (or mappings) between auditory and visual surfaces. Participants were trained in each of four transformations: horizontal square, horizontal arc, vertical square, and vertical spherical surface. On each experimental trial, a sound was played through headphones connected to a spatialized sound system that uses a non-individualized head-related transfer function. The participant's task was to determine, using one transformation at a time, which of two objects on a visual display corresponded to the location of the sound. Though the two vertical transformations provided a more direct stimulus-response compatibility with the visual display, the two horizontal transformations made better use of the human auditory system's ability to localize sound, and resulted in better performance. Eye movements were analyzed, and it was found that the horizontal arc transformation provided the best auditory cue for moving the eyes to the correct visual target location with a single saccade.

[1]  Densil Cabrera,et al.  Considerations arising from the development of auditory alerts for air traffic control consoles , 2005 .

[2]  F L Wightman,et al.  Headphone simulation of free-field listening. II: Psychophysical validation. , 1989, The Journal of the Acoustical Society of America.

[3]  Douglas S. Brungart,et al.  In-Flight Navigation Using Head-Coupled and Aircraft-Coupled Spatial Audio Cues , 2007 .

[4]  D. Grantham,et al.  Auditory spatial resolution in horizontal, vertical, and diagonal planes. , 2003, The Journal of the Acoustical Society of America.

[5]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[6]  W. C. Howell.  of the Human Factors and Ergonomics Society , 2010 .

[7]  William W. Gaver,et al.  Chapter 42 – Auditory Interfaces , 1997 .

[8]  T. Landauer,et al.  Handbook of Human-Computer Interaction , 1997 .

[9]  T Z Strybel,et al.  Aurally Aided Visual Search in the Central Visual Field: Effects of Visual Load and Visual Enhancement of the Target , 1991, Human factors.

[10]  Robert W. Proctor,et al.  Effects of Displacement Magnitude and Direction of Auditory Cues on Auditory Spatial Facilitation of Visual Search , 2006, Hum. Factors.

[11]  F L Wightman,et al.  Localization using nonindividualized head-related transfer functions. , 1993, The Journal of the Acoustical Society of America.

[12]  Harvey S. Smallman,et al.  'Symbicons': A Hybrid Symbology That Combines the Best Elements of Symbols and Icons , 2001 .