3D sound interactive environments for blind children problem solving skills

Audio-based virtual environments have been increasingly used to foster cognitive and learning skills. A number of studies have also highlighted that the use of technology can help learners to develop effective skills such as motivation and self-esteem. This study presents the design and usability of 3D interactive environments for children with visual disabilities to help them solve problems in Chilean geography and culture. We introduce AudioChile, a virtual environment that can be navigated through 3D sound to enhance spatiality and immersion throughout the environment. 3D sound is used to orientate, avoid obstacles, and identify the positions of various characters and objects within the environment. We have found during the usability evaluation that sound can be fundamental for attention and motivation purposes during interaction. Learners identified and clearly discriminated environmental sounds to solve everyday problems, spatial orientation, and laterality.

[1]  Rick Kazman,et al.  Audio enhanced 3D interfaces for visually impaired users , 1997 .

[2]  Sri Kurniawan,et al.  Design and user evaluation of a spatial audio system for blind users , 2004 .

[3]  Jessica J. Baldis Effects of spatial audio on memory, comprehension, and preference during desktop conferences , 2001, CHI.

[4]  David Mioduser,et al.  Multi-sensory virtual environment for supporting blind persons' acquisition of spatial cognitive mapping, orientation, and mobility skills , 2000 .

[5]  Thomas Westin,et al.  Game accessibility case study : Terraformers - a real-time 3D graphic game , 2004 .

[6]  Roberta L Klatzky,et al.  Spatial updating of locations specified by 3-d sound and spatial language. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[7]  Jaime Sánchez,et al.  Interactive 3D sound hyperstories for blind children , 1999, CHI '99.

[8]  Nelson Baloian,et al.  Modeling Audio-Based Virtual Environments for Children with Visual Disabilities , 2005 .

[9]  M Cooper,et al.  Ambisonic sound in virtual environments and applications for blind people , 1998 .

[10]  Jaime Sánchez,et al.  Blind learners programming through audio , 2005, CHI EA '05.

[11]  Jaime Sánchez,et al.  Interactive virtual acoustic environments for blind children: computing, usability, and cognition , 2001, CHI Extended Abstracts.

[12]  Jaime Sánchez,et al.  Developing Mathematics Skills through Audio Interfaces , 2005 .

[13]  Jaime Sánchez,et al.  Memory enhancement through audio , 2004, ACM SIGACCESS Access. Comput..

[14]  Heinz Ulrich Hoppe,et al.  AudioBattleship: blind learners collaboration through sound , 2003, CHI Extended Abstracts.

[15]  Rachel McCrindle,et al.  Audio space invaders , 2000 .

[16]  Jaime Sánchez,et al.  AudioMath: Blind children learning mathematics through audio , 2005 .

[17]  Jaime Sánchez,et al.  Hyperstories: a model to specify and design interactive educational stories , 1997, Proceedings 17th International Conference of the Chilean Computer Science Society.

[18]  Héctor Flores,et al.  A methodology for developing audio-based interactive environments for learners with visual disabilities , 2004 .

[19]  Jaime Sánchez,et al.  Blind to Sighted Children Interaction Through Collaborative Environments , 2004, CRIWG.