Virtual-Audio Aided Visual Search on a Desktop Display

As visual display complexity grows, visual cues and alerts may become less salient and therefore less effective. Although the auditory system’s resolution is rather coarse relative to the visual system, there is some evidence for virtual spatialized audio to benefit visual search on a small frontal region, such as a desktop monitor. Two experiments examined if search times could be reduced compared to visual-only search through spatial auditory cues rendered using one of two methods: individualized or generic head-related transfer functions. Results showed the cue type interacted with display complexity, with larger reductions compared to visual-only search as set size increased. For larger set sizes, individualized cues were significantly better than generic cues overall. Across all set sizes, individualized cues were better than generic cues for cueing eccentric elevations (>± 8 °). Where performance must be maximized, designers should use individualized virtual audio if at all possible, even in small frontal region within the field of view.

[1]  A. Mills.  On the minimum audible angle , 1958 .

[2]  Brian D. Simpson,et al.  Do you hear where I hear?: isolating the individualized sound localization cues , 2014, Front. Neurosci..

[3]  Richard L. McKinley,et al.  Aurally Aided Visual Search under Virtual and Free-Field Listening Conditions , 1996, Hum. Factors.

[4]  References , 1971 .

[5]  John P. McIntire,et al.  Visual Search Performance With 3-D Auditory Cues: Effects of Motion, Target Location, and Practice , 2010, Hum. Factors.

[6]  S. Klein,et al.  Vernier acuity, crowding and cortical magnification , 1985, Vision Research.

[7]  Douglas S. Brungart,et al.  3D Audio Cueing for Target Identification in a Simulated Flight Task , 2004 .

[8]  Robert W. Proctor,et al.  Effects of Displacement Magnitude and Direction of Auditory Cues on Auditory Spatial Facilitation of Visual Search , 2006, Hum. Factors.

[9]  F L Wightman,et al.  Localization using nonindividualized head-related transfer functions. , 1993, The Journal of the Acoustical Society of America.

[10]  D R Begault,et al.  Head-Up Auditory Displays for Traffic Collision Avoidance System Advisories: A Preliminary Investigation , 1993, Human factors.

[11]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[12]  Richard L. McKinley,et al.  The Impact of Hearing Protection on Sound Localization and Orienting Behavior , 2005, Hum. Factors.

[13]  Richard D. Morey,et al.  Confidence Intervals from Normalized Data: A correction to Cousineau (2005) , 2008 .

[14]  Robert S. Bolia,et al.  Aurally Aided Visual Search in Three-Dimensional Space , 1999, Hum. Factors.

[15]  Jordan M Haggit.  Cued Visual Search and Multisensory Enhancement , 2014 .

[16]  Spatial Multisensory Cueing to Support Visual Target-Acquisition Performance , 2012 .

[17]  Brian D. Simpson,et al.  Free-Field Localization Performance With a Head-Tracked Virtual Auditory Display , 2015, IEEE Journal of Selected Topics in Signal Processing.

[18]  D W Grantham,et al.  Detection and discrimination of simulated motion of auditory targets in the horizontal plane. , 1986, The Journal of the Acoustical Society of America.

[19]  T Z Strybel,et al.  Aurally Aided Visual Search in the Central Visual Field: Effects of Visual Load and Visual Enhancement of the Target , 1991, Human factors.