The Effects of 3D Audio on Hologram Localization in Augmented Reality Environments

Currently available augmented reality systems have a narrow field of view, giving users only a small window to look through to find holograms in the environment. The challenge for developers is to direct users’ attention to holograms outside this window. To alleviate this field of view constraint, most research has focused on hardware improvements to the head mounted display. However, incorporating 3D audio cues into programs could also aid users in this localization task. This paper investigates the effectiveness of 3D audio on hologram localization. A comparison of 3D audio, visual, and mixed-mode stimuli shows that users are able to localize holograms significantly faster under conditions that include 3D audio. To our knowledge, this is the first study to explore the use of 3D audio in localization tasks using augmented reality systems. The results provide a basis for the incorporation of 3D audio in augmented reality applications.

[1]  Eyal Ofek,et al.  SnapToReality: Aligning Augmented Reality to the Real World , 2016, CHI.

[2]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[3]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[4]  Soh-Khim Ong,et al.  Virtual and Augmented Reality Applications in Manufacturing , 2004, MIM.

[5]  Hong Hua,et al.  Head-Mounted Display Systems , 2005 .

[6]  Gang Luo,et al.  Use of an augmented-vision device for visual search by patients with tunnel vision. , 2006, Investigative ophthalmology & visual science.

[7]  V. Lahanas,et al.  A novel augmented reality simulator for skills assessment in minimal invasive surgery , 2015, Surgical Endoscopy.

[8]  Supun Samarasekera,et al.  Augmented Reality Binoculars , 2013, IEEE Transactions on Visualization and Computer Graphics.

[9]  Radu-Daniel Vatavu.  Tools for Designing for Home Entertainment: Gesture Interfaces, Augmented Reality, and Smart Spaces , 2016, CHI Extended Abstracts.

[10]  Douglas S. Brungart,et al.  3D Audio Cueing for Target Identification in a Simulated Flight Task , 2004 .

[11]  Noor Christoph,et al.  Augmented reality in medical education? , 2014, Perspectives on Medical Education.

[12]  Robert Xiao,et al.  Augmenting the Field-of-View of Head-Mounted Displays with Sparse Peripheral Displays , 2016, CHI.

[13]  Sharon L. Oviatt,et al.  When do we interact multimodally?: cognitive load and multimodal communication patterns , 2004, ICMI '04.

[14]  J. Rolland,et al.  Head-worn displays: a review , 2006, Journal of Display Technology.

[15]  Hrvoje Benko,et al.  Dyadic projected spatial augmented reality , 2014, UIST.

[16]  F L Wightman,et al.  Headphone simulation of free-field listening. II: Psychophysical validation. , 1989, The Journal of the Acoustical Society of America.