A Generic Evaluation Model for Auditory Feedback in Complex Visual Searches

This paper proposes a method of evaluating the effect of auditory display techniques on a complex visual search task. The approach uses a pre-existing visual search task (conjunction search) to create a standardized model for audio, and non-audio assisted visual search tasks. A pre-existing auditory display technique is evaluated to test the system. Using randomly generated images, participants were asked to undertake a series of visual search tasks of set complexities, with and without audio. It was shown that using the auditory feedback improved the participant’s visual search times considerably, with statistically significant results. Additionally, it was shown that there was a larger difference between audio and non-audio when the complexity of the images was increased. The same auditory display techniques were then applied to an example of a real complex visual search task, the results of which imply a significant improvement in visual search efficiency when using auditory feedback.

[1]  Hideki Koike,et al.  EdgeSonic: image feature sonification for the visually impaired , 2011, AH '11.

[2]  Abdelhak M. Zoubir,et al.  Bootstrap Methods in Signal Processing [From the Guest Editors] , 2007 .

[3]  Guido Bologna,et al.  Sonification of Colour and Depth in a Mobility Aid for Blind People , 2010 .

[4]  Alistair D. N. Edwards,et al.  SONIFICATION STRATEGIES FOR EXAMINATION OF BIOLOGICAL CELLS , 2010 .

[5]  Eric R. Ziegel,et al.  Engineering Statistics , 2004, Technometrics.

[6]  Bill Gardner,et al.  HRTF Measurements of a KEMAR Dummy-Head Microphone , 1994 .

[7]  Timothy Neate,et al.  Interactive Spatial Auditory Display of Graphical Data , 2013 .

[8]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[9]  Pawel Strumillo,et al.  Naviton—A Prototype Mobility Aid for Auditory Presentation of Three-Dimensional Scenes to the Visually Impaired , 2012 .

[10]  Markus Rupp,et al.  Reproducible research in signal processing , 2009, IEEE Signal Processing Magazine.

[11]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[12]  Jian Yang,et al.  Comparison of Navigation Techniques for Large Digital Images , 2008, Journal of Digital Imaging.

[13]  Guido Bologna,et al.  Blind Navigation along a Sinuous Path by Means of the See ColOr Interface , 2009, IWINAC.

[14]  Susanne Boll,et al.  Interactive 3D sonification for the exploration of city maps , 2006, NordiCHI '06.

[15]  Christopher Stachowiak,et al.  Audio Cues to Assist Visual Search in Robotic System Operator Control Unit Displays , 2005 .

[16]  Amitabh Varshney,et al.  Saliency-Assisted Navigation of Very Large Landscape Images , 2011, IEEE Transactions on Visualization and Computer Graphics.

[17]  Luca Chittaro,et al.  Visualizing locations of off-screen objects on mobile devices: a comparative evaluation of three approaches , 2006, Mobile HCI.