AudioTorch: using a smartphone as directional microphone in virtual audio spaces

Mobile audio augmented reality systems can be used in a series of applications, e.g., as a navigational aid for visually impaired or as audio guide in museums. The implementation of such systems usually relies on head orientation data, requiring additional hardware in form of a digital compass in the headphones. As an alternative we propose AudioTorch, a system that turns a smartphone into a virtual directional microphone. This metaphor, where users move the device to detect virtual sound sources, allows quick orientation and easy discrimination between proximate sources, even with simplified rendering algorithms. We compare the navigation performance of head orientation measurement to AudioTorch. A lab study with 18 users showed the rate of correctly recognized sources to be significantly higher with AudioTorch than with head-tracking, while task completion times did not differ significantly. The presence in the virtual environment received similar ratings for both conditions.

[1]  Stephen A. Brewster,et al.  Effects of feedback, mobility and index of difficulty on deictic spatial audio target acquisition in the horizontal plane , 2006, CHI.

[2]  Nicholas Mariette Navigation Performance Effects of Render Method and Head-Turn Latency in Mobile Audio Augmented Reality , 2009, CMMR/ICAD.

[3]  Jacques Lemordant,et al.  An Interactive Audio System for Mobiles , 2009 .

[4]  Tapio Lokki,et al.  Eyes-free Methods for Accessing Large Auditory Menus , 2010 .

[5]  Jan O. Borchers,et al.  Multi-user interaction in virtual audio spaces , 2009, CHI Extended Abstracts.

[6]  Mads Haahr,et al.  Design, implementation and evaluation of audio for a location aware augmented reality game , 2010, Fun and Games '10.

[7]  Marek Hatala,et al.  ec(h)o: situated play in a tangible and audio museum guide , 2006, DIS '06.

[8]  Jan O. Borchers,et al.  Simplifying orientation measurement for mobile audio augmented reality applications , 2014, CHI.

[9]  Dieter Leckschat,et al.  Scalable Binaural Synthesis on Mobile Devices , 2012 .

[10]  Benjamin B. Bederson,et al.  Audio augmented reality: a prototype automated tour guide , 1995, CHI 95 Conference Companion.

[11]  Stephen A. Brewster,et al.  Audio Bubbles: Employing Non-speech Audio to Support Tourist Wayfinding , 2009, HAID.

[12]  David R. Morse,et al.  AudioGPS: Spatial Audio Navigation with a Minimal Attention Interface , 2002, Personal and Ubiquitous Computing.

[13]  Christoph Stahl The roaring navigator: a group guide for the zoo with shared auditory landmark display , 2007, Mobile HCI.

[14]  J M Loomis,et al.  Active localization of virtual sounds. , 1990, The Journal of the Acoustical Society of America.

[15]  Lucia Terrenghi,et al.  Tailored audio augmented environments for museums , 2004, IUI '04.

[16]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.