Screen-readers-computer software that enables a visually impaired user to read the contents of a visual display-have been available for more than a decade. Screen-readers are separate from the user application. Consequently, they have little or no contextual information about the contents of the display. The author has used traditional screen-reading applications for the last five years. The design of the speech-enabling approach described here has been implemented in Emacspeak to overcome many of the shortcomings he has encountered with traditional screen-readers. The approach used by Emacspeak is very different from that of traditional screen-readers. Screen-readers allow the user to listen to the contents appearing in different parts of the display; but the user is entirely responsible for building a mental model of the visual display in order to interpret what an application is trying to convey. Emacspeak, on the other hand, does not speak the screen. Instead, applications provide both visual and speech feedback, and the speech feedback is designed to be sufficient by itself: This approach reduces cognitive load on the user and is relevant to providing general spoken access to information. Producing spoken output from within the application, rather than speaking the visually displayed information, vastly improves the quality of the spoken feedback. Thus, an application can display its results in a visually pleasing manner; the speech-enabling component renders the same in an aurally pleasing way. Permission to make digital/hard copies of all or parl of this material for personal or classroom use is granted without fee provided that the copies are not made or distributed for profit or commercial advantage, the copyright notice, the title of the publication and its date appear, and notice is Introduetlon A screen-reader is a computer application designed to provide spoken feedback to a visually impaired user. Screen-readers have been available since the mid-80's. During the 80's, such applications relied on the character representation of the contents of the screen to produce the spoken feedback. The advent of bitmap displays led to a complete breakdown of this approach, since the contents of the screen were now light and dark pixels. A significant amount of research and development has been carried out to overcome this problem and provide speech-access to the Graphical User Interface (GUI). The best and perhaps the most complete speech access system to the GUI is Screenreader/2 (ScreenReader For OS/2) developed by Dr. Jim Thatcher at the IBM Wat-son Research …
[1]
R. M. Greenberg,et al.
Guidelines for the syntactic design of audio cues in computer interfaces
,
1985
.
[2]
James Thatcher.
Screen reader/2: access to OS/2 and the graphical user interface
,
1994,
Assets '94.
[3]
Elizabeth D. Mynatt,et al.
Mapping GUIs to auditory interfaces
,
1992,
UIST '92.
[4]
Meera M. Blattner,et al.
Earcons and Icons: Their Structure and Common Design Principles (Abstract only)
,
1989,
SGCH.
[5]
Meera Blattner,et al.
Earcons and Icons: Their Structure and Common Design Principles
,
1989,
Hum. Comput. Interact..
[6]
Elizabeth D. Mynatt,et al.
Nonvisual presentation of graphical user interfaces: contrasting two approaches
,
1994,
CHI Conference Companion.
[7]
T. V. Raman,et al.
Audio System for Technical Readings
,
1998,
Lecture Notes in Computer Science.
[8]
Richard E. Ladner,et al.
Auditory Presentation of Graphical User Interfaces
,
1992
.
[9]
Gina-Anne Levow,et al.
Designing SpeechActs: issues in speech user interfaces
,
1995,
CHI '95.
[10]
William W. Gaver.
Synthesizing auditory icons
,
1993,
INTERCHI.
[11]
Elizabeth D. Mynatt,et al.
Providing access to graphical user interfaces—not graphical screens
,
1994,
Assets '94.
[12]
William Buxton,et al.
The use of non-speech audio at the interface
,
1988,
CHI 1988.