Using Audemes as a Learning Medium for the Visually Impaired

In this paper we demonstrate the utility of short, nonverbal sound symbols—called “audemes”—in the encoding and recalling of text-based educational materials. In weekly meetings over a school year with blind and visually impaired pre-college students, we explored their capacity for long-term memory of individual audemes, audeme sequences, and textual content presented in conjunction with these. Through interviews and group discussions, we also explored the ability of these students to create intuitive narratives enabling memory of complex audemes and series of audemes. Further, we explored the mnemonic power of positive affect in audemes, and the impact of thematic association of information-to-audeme. Our results showed that the use of audemes can improve encoding and recall of educational content in the visually impaired population. The ultimate goal of our work is implementation of an “acoustic interface” allowing users to access a database of audemes and associated text-to-speech content.

[1]  Elizabeth D. Mynatt Designing with auditory icons: how well do we identify auditory cues? , 1994, CHI Conference Companion.

[2]  Roman Vilimek,et al.  Effects of Speech and Non-Speech Sounds on Short-Term Memory and Possible Implications for In-Vehicle Use Research paper for the ICAD05 workshop "Combining Speech and Sound in the User Interface" , 2005 .

[3]  M. Lassonde,et al.  Blind subjects process auditory spectral cues more efficiently than sighted individuals , 2004, Experimental Brain Research.

[4]  Douglas Turnbull,et al.  Modeling the Semantics of Sound , 2007 .

[5]  Jaime Sánchez,et al.  Memory enhancement through audio , 2004, ACM SIGACCESS Access. Comput..

[6]  Stéphane Conversy Ad-hoc synthesis of auditory icons , 1998 .

[7]  Stephen Brewster,et al.  Providing an audio glance at algebra for blind readers , 1994 .

[8]  Jaime Sánchez Interactive virtual environments for blind children : usability and cognition , 2003 .

[9]  William W. Gaver The SonicFinder: An Interface That Uses Auditory Icons , 1989, Hum. Comput. Interact..

[10]  Stephen Brewster,et al.  Providing a Structured Method for Integrating Non-Speech Audio into Human-Computer Interfaces , 1994 .

[11]  Alistair D. N. Edwards,et al.  Modelling Blind Users' Interactions with an Auditory Computer Interface , 1989, Int. J. Man Mach. Stud..

[12]  Maribeth Back,et al.  Micro-narratives in sound design: Context, character, and caricature in waveform manipulation , 1996 .

[13]  Meera Blattner,et al.  Earcons and Icons: Their Structure and Common Design Principles , 1989, Hum. Comput. Interact..

[14]  Janan Al-Awar Smither Short term memory demands in processing synthetic speech by old and young adults , 1993, Behav. Inf. Technol..

[15]  Jaime Sánchez,et al.  AudioMath: Blind children learning mathematics through audio , 2005 .