On the audio representation of radial direction

We present and evaluate an approach towards eyes-free auditory display of spatial information that considers radial direction as a fundamental type of value primitive. There are many benefits to being able to sonify radial directions, such as indicating the heading towards a point of interest in a direct and dynamic manner, rendering a path or shape outline by sonifying a continual sequence of tangent directions as the path is traced, and providing direct feedback of the direction of motion of the user in a physical space or a pointer in a virtual space. We propose a concrete mapping of vowel-like sounds to radial directions as one potential method to enable sonification of such information. We conducted a longitudinal study with five sighted and two blind participants to evaluate the learnability and effectiveness of this method. Results suggest that our directional sound mapping can be learned within a few hours and be used to aurally perceive spatial information such as shape outlines and path contours.

[1]  Jeff A. Bilmes,et al.  Longitudinal study of people learning to use continuous voice-based cursor control , 2009, CHI.

[2]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[3]  Stephen A. Brewster,et al.  Multimodal Trajectory Playback for Teaching Shape Information and Trajectories to Visually Impaired Computer Users , 2008, TACC.

[4]  Kees van den Doel,et al.  SOUNDVIEW: SENSING COLOR IMAGES BY KINESTHETIC AUDIO , 2003 .

[5]  Jonathan Berger,et al.  Auditory Display of Hyperspectral Colon Tissue Images Using Vocal Synthesis Models , 2004, ICAD.

[6]  Lorna M. Brown,et al.  DRAWING BY EAR: INTERPRETING SONIFIED LINE GRAPHS , 2003 .

[7]  Stephen A. Brewster,et al.  Constructing sonified haptic line graphs for the blind student: first steps , 2000, Assets '00.

[8]  David R. Morse,et al.  AudioGPS: Spatial Audio Navigation with a Minimal Attention Interface , 2002, Personal and Ubiquitous Computing.

[9]  Ben Shneiderman,et al.  "I hear the pattern": interactive sonification of geographical data patterns , 2005, CHI EA '05.

[10]  Jonathan Berger,et al.  Sonimime: Sonification of fine motor skills , 2005 .

[11]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[12]  Beryl Plimmer,et al.  Multimodal collaborative handwriting training for visually-impaired people , 2008, CHI.

[13]  Jonathan Berger,et al.  THE SOUND OF ONE ARM SWINGING: A MODEL FOR MULTIDIMENSIONAL AUDITORY DISPLAY OF PHYSICAL MOTION , 2006 .

[14]  James A. Landay,et al.  Voicedraw: a hands-free voice-driven drawing application for people with motor impairments , 2007, Assets '07.

[15]  James L. Alty,et al.  The rising pitch metaphor: an empirical study , 2005, Int. J. Hum. Comput. Stud..

[16]  Frank Dellaert,et al.  SWAN: System for Wearable Audio Navigation , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[17]  Robert F. Cohen,et al.  Using an audio interface to assist users Who are visually impaired with steering tasks , 2006, Assets '06.

[18]  William Cowan,et al.  On the audio representation of distance for blind users , 2009, CHI.

[19]  Gregory Kramer,et al.  An introduction to auditory display , 1994 .

[20]  J. Blauert Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[21]  Jessica Hummel,et al.  Interactive sonification of German wheel sports movements , 2009 .

[22]  Roberta L. Klatzky,et al.  Navigation System for the Blind: Auditory Display Modes and Guidance , 1998, Presence.

[23]  Kenneth I. Joy,et al.  Sound graphs: A numerical data analysis method for the blind , 1985, Journal of Medical Systems.

[24]  Helge Ritter,et al.  Kernel Regression Mapping for Vocal Eeg Sonification , 2008 .

[25]  Interactive sonification of German wheel sports , 2010 .

[26]  Xiao Li,et al.  The Vocal Joystick Engine v1.0 , 2011, Comput. Speech Lang..

[27]  M. Capp,et al.  The optophone: an electronic blind aid , 2000 .