Sound of Vision - Spatial Audio Output and Sonification Approaches

The paper summarizes a number of audio-related studies conducted by the Sound of Vision consortium, which focuses on the construction of a new prototype electronic travel aid for the blind. Different solutions for spatial audio were compared by testing sound localization accuracy in a number of setups, comparing plain stereo panning with generic and individual HRTFs, as well as testing different types of stereo headphones vs custom designed quadrophonic proximaural headphones. A number of proposed sonification approaches were tested by sighted and blind volunteers for accuracy and efficiency in representing simple virtual environments.

[1]  Örjan Johansson,et al.  Relationship between HRFT's and anthropometric data , 2000 .

[2]  Pawel Strumillo,et al.  Sound of Vision - 3D Scene Reconstruction from Stereo Vision in an Electronic Travel Aid for the Visually Impaired , 2016, ICCHP.

[3]  Florica Moldoveanu,et al.  AUDIO GAMES- A NOVEL APPROACH TOWARDS EFFECTIVE LEARNING IN THE CASE OF VISUALLY-IMPAIRED PEOPLE , 2014 .

[4]  Kyriaki Kalimeri,et al.  Identifying Urban Mobility Challenges for the Visually Impaired with Mobile Monitoring of Multimodal Biosignals , 2016, HCI.

[5]  Pawel Strumillo,et al.  Naviton—A Prototype Mobility Aid for Auditory Presentation of Three-Dimensional Scenes to the Visually Impaired , 2012 .

[6]  Larry S. Davis,et al.  HRTF personalization using anthropometric measurements , 2003, 2003 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (IEEE Cat. No.03TH8684).

[7]  Pawel Strumillo,et al.  A Mobile Phone Application for Recognizing Objects as a Personal Aid for the Visually Impaired Users , 2014 .

[8]  N. A. Bradley,et al.  Assistive Technology For Visually Impaired And Blind People , 2008 .

[9]  Timothy R. Anderson,et al.  Factors Affecting the Relative Salience of Sound Localization Cues , 2014 .

[10]  Bettina Pressl,et al.  ODILIA - A Mobility Concept for the Visually Impaired , 2008, ICCHP.

[11]  A. Moldoveanu,et al.  THE ROLE OF PERCEPTUAL FEEDBACK TRAINING ON SOUND LOCALIZATION ACCURACY IN AUDIO EXPERIMENTS , 2015 .

[12]  Milos Klima,et al.  New possibilities for blind people navigation , 2011, 2011 International Conference on Applied Electronics.

[13]  Simone Spagnol,et al.  Enhancing vertical localization with image-guided selection of non-individual head-related transfer functions , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Y. Bellik,et al.  Locomotion Assistance for the Blind , 2002 .

[15]  Shraga Shoval,et al.  Auditory guidance with the Navbelt-a computerized travel aid for the blind , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[16]  Roberto Manduchi,et al.  Search Strategies of Visually Impaired Persons Using a Camera Phone Wayfinding System , 2008, ICCHP.

[17]  Piotr Korbel,et al.  POI explorer - A sonified mobile application aiding the visually impaired in urban navigation , 2014, 2014 Federated Conference on Computer Science and Information Systems.

[18]  Federico Avanzini,et al.  Frequency Estimation Of The First Pinna Notch In Head-Related Transfer Functions With A Linear Anthropometric Model , 2015 .

[19]  Pawel Strumillo,et al.  Measurement System for Personalized Head-Related Transfer Functions and Its Verification by Virtual Source Localization Trials with Visually Impaired and Sighted Individuals , 2010 .

[20]  Pawel Strumillo,et al.  Obstacle localization in 3D scenes from stereoscopic sequences , 2007, 2007 15th European Signal Processing Conference.

[21]  Eveline Januário Ferreira NAVMETRO®: PRELIMINARY STUDY APPLICATIONS OF USABILITY ASSESSMENT METHODS , 2013 .

[22]  José L. González-Mora,et al.  Development of a New Space Perception System for Blind People, Based on the Creation of a Virtual Acoustic Space , 1999, IWANN.

[23]  Paweł. Strumiłło Elektroniczne systemy nawigacji osobistej dla niewidomych i słabowidzących , 2012 .

[24]  Andrzej Dobrucki,et al.  Computational modelling of head-related transfer function , 2007 .

[25]  J. C. Middlebrooks,et al.  Psychophysical customization of directional transfer functions for virtual sound localization. , 2000, The Journal of the Acoustical Society of America.

[26]  Davide Rocchesso,et al.  The Sonification Handbook , 2011 .

[27]  W. G. Gardner,et al.  HRTF measurements of a KEMAR , 1995 .