Developing a navigational 3D audio game with hierarchical levels of difficulty for the visually impaired players

The Binaural Navigation Game is a 3D audio game with hierarchical levels of difficulty that can be used by both normal sighted or visually impaired players. The purpose of the game is to test and train the sound localization skills, to entertain and to provide an alternative to the common video games available on the market nowadays. The sonification technique is based on the perception of 3D binaural sounds synthesized with non-individualized Head Related Transfer Functions (HRTFs) and on the inversely proportional sound intensity encoding of distance. Furthermore, we use an original method based on the simultaneous perception of two types of noise that aims to reduce the incidence of front-back confusions. This game has been tested in an experimental procedure (comprised of a pre-test, a hapticauditory feedback based training and a post-test session) in which 10 visually impaired subjects (with a percent of residual vision ranging from 0% to 15%) have participated. This paper aims to present the design and development of the Binaural Navigation Game, the Game Editor (an application that allows the experimenter to set the layout of new sets of levels) and the Binaural Game Analyzer, a tool used to visualize and evaluate the players’ performances..

[1]  O. Kirkeby,et al.  Resolution of front-back confusion in virtual acoustic imaging systems. , 2000, The Journal of the Acoustical Society of America.

[2]  Thomas Westin,et al.  Game accessibility case study : Terraformers - a real-time 3D graphic game , 2004 .

[3]  Jaime Sánchez,et al.  Action video game play and transfer of navigation and spatial cognition skills in adolescents who are blind , 2014, Front. Hum. Neurosci..

[4]  A. Moldoveanu,et al.  Navigational audio games: an effective approach toward improving spatial contextual learning for blind people , 2015 .

[5]  John C. Platt,et al.  HRTF magnitude synthesis via sparse representation of anthropometric features , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Jan-Michael Frahm,et al.  P-HRTF: Efficient personalized HRTF computation for high-fidelity spatial sound , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[7]  Florica Moldoveanu,et al.  AUDIO GAMES- A NOVEL APPROACH TOWARDS EFFECTIVE LEARNING IN THE CASE OF VISUALLY-IMPAIRED PEOPLE , 2014 .

[8]  Lotfi B. Merabet,et al.  Audio-Based Navigation Using Virtual Environments: Combining Technology and Neuroscience , 2009 .

[9]  F L Wightman,et al.  Resolution of front-back ambiguity in spatial hearing by listener and source movement. , 1999, The Journal of the Acoustical Society of America.

[10]  Victor Lazzarini,et al.  New Csound Opcodes for Binaural Processing , 2008 .

[11]  Tomasz R Letowski,et al.  Localization Error: Accuracy and Precision of Auditory Localization , 2011 .

[12]  H. Wallach,et al.  The role of head movements and vestibular and visual cues in sound localization. , 1940 .

[13]  Jaime Sánchez,et al.  Usability and Cognitive Impact of the Interaction with 3D Virtual Interactive Acoustic Environments by Blind Children , 2000 .

[14]  Mta Sztaki,et al.  Overview of Auditory Representations in Human-Machine Interfaces , 2013 .

[15]  Sebastian Brieger SOUND HUNTER : Developing a Navigational HRTF-Based Audio Game for People with Visual Impairments , 2013 .

[16]  Dan Gärdenfors,et al.  Audio games: new perspectives on game audio , 2004, ACE '04.

[17]  Davide Rocchesso,et al.  Extraction of Pinna Features for Customized Binaural Audio Delivery on Mobile Devices , 2013, MoMM '13.