Attracktion: Field Evaluation of Multi-Track Audio as Unobtrusive Cues for Pedestrian Navigation

Listening to music while being on the move is common in our headphone society. However, if we want assistance in navigation from our smartphone, existing approaches either demand exclusive playback through the headphones or impact the listening experience of the music. We present a field evaluation of Attracktion, a spatial audio navigation system that leverages the access to single stems in a multi-track recording to minimize the impact on the listening experience. We compared Attracktion against current turn-by-turn navigation instructions in a field-study with 22 users and found that users perceived acoustic overlays with additional navigation information to have no impact on the listening experience. In terms of path efficiency, errors, and mental workload, Attracktion is on par with spoken turn-by-turn navigation instructions, and users liked it for the aspect of serendipity.

[1]  Jan O. Borchers,et al.  Simplifying orientation measurement for mobile audio augmented reality applications , 2014, CHI.

[2]  Raymond M. Stanley,et al.  Lateralization of Sounds Using Bone-Conduction Headsets , 2006 .

[3]  Jacob B. Madsen,et al.  Differences in human audio localization performance between a HRTF- and a non-HRTF audio system , 2013, AM '13.

[4]  Matt Jones,et al.  ONTRACK: Dynamically adapting music playback to support navigation , 2008, Personal and Ubiquitous Computing.

[5]  Jan O. Borchers,et al.  Where are we?: evaluating the current rendering fidelity of mobile audio augmented reality systems , 2016, MobileHCI.

[6]  David R. Morse,et al.  AudioGPS: Spatial Audio Navigation with a Minimal Attention Interface , 2002, Personal and Ubiquitous Computing.

[7]  Keita Higuchi,et al.  EyeSound: single-modal mobile navigation using directionally annotated music , 2012, AH '12.

[8]  Michael Vorlnder,et al.  Auralization: Fundamentals of Acoustics, Modelling, Simulation, Algorithms and Acoustic Virtual Reality , 2020 .

[9]  Elizabeth M. Wenzel,et al.  Localization with non-individualized virtual acoustic display cues , 1991, CHI.

[10]  Matthijs Jan Zwinderman,et al.  Oh music, where art thou? , 2011, Mobile HCI.

[11]  Nicholas Mariette Navigation Performance Effects of Render Method and Head-Turn Latency in Mobile Audio Augmented Reality , 2009, CMMR/ICAD.

[12]  Johannes Schöning,et al.  NavigaTone: Seamlessly Embedding Navigation Cues in Mobile Music Listening , 2018, CHI.

[13]  F L Wightman,et al.  Localization using nonindividualized head-related transfer functions. , 1993, The Journal of the Acoustical Society of America.

[14]  Francis M. Boland,et al.  Efficient Encoding and Decoding of Binaural Sound with Resonance Audio , 2019 .

[15]  Stephen A. Brewster,et al.  Audio or tactile feedback: which modality when? , 2009, CHI.

[16]  T Letowski,et al.  Evaluation of acoustic beacon characteristics for navigation tasks , 2000, Ergonomics.

[17]  M. Sile O'Modhrain,et al.  GpsTunes: controlling navigation via audio feedback , 2005, Mobile HCI.

[18]  Andreas Komninos,et al.  Urban exploration using audio scents , 2012, Mobile HCI.

[19]  D. Kimura Left-right Differences in the Perception of Melodies , 1964 .

[20]  Robert Hardy,et al.  Design, implementation and evaluation of a novel public display for pedestrian navigation: the rotating compass , 2009, CHI.

[21]  Chulhong Min,et al.  Earables for Personal-Scale Behavior Analytics , 2018, IEEE Pervasive Computing.

[22]  Tillman Weyde,et al.  Singing Voice Separation with Deep U-Net Convolutional Networks , 2017, ISMIR.

[23]  Johannes Schöning,et al.  StripeMaps: Improving Map-based Pedestrian Navigation for Smartwatches , 2015, MobileHCI.

[24]  François Pachet,et al.  Automatic extraction of drum tracks from polyphonic music signals , 2002, Second International Conference on Web Delivering of Music, 2002. WEDELMUSIC 2002. Proceedings..

[25]  Anupriya Ankolekar,et al.  Play it by ear: a case for serendipitous discovery of places with musicons , 2013, CHI.

[26]  Tapio Lokki,et al.  Guided by music: pedestrian and cyclist navigation with route and beacon guidance , 2016, Personal and Ubiquitous Computing.

[27]  Marcus Specht,et al.  MELODIOUS WALKABOUT: IMPLICIT NAVIGATION WITH CONTEXTUALIZED PERSONAL AUDIO CONTENTS , 2005 .

[28]  Bruce N. Walker,et al.  Navigation Performance With a Virtual Auditory Display: Effects of Beacon Sound, Capture Radius, and Practice , 2006, Hum. Factors.

[29]  Andreas Kratky,et al.  Walking in the Head: Methods of Sonic Augmented Reality Navigation , 2019, HCI.

[30]  Enrico Rukzio,et al.  Can't You Hear Me?: Investigating Personal Soundscape Curation , 2018, MUM.

[31]  Frank Dellaert,et al.  SWAN: System for Wearable Audio Navigation , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[32]  Ian Oakley,et al.  Auditory display design for exploration in mobile audio-augmented reality , 2012, Personal and Ubiquitous Computing.

[33]  Stephen A. Brewster,et al.  Social gravity: a virtual elastic tether for casual, privacy-preserving pedestrian rendezvous , 2010, CHI.