Comparing effects of navigational interface modalities on speaker prosodics

Displayless interface technology must address issues similar to those of GUI access technology for users with visual impairments. Both must address the issue of providing nonvisual access to spatial data. This research examined the hypothesis that strictly verbal access to spatial datsi places a cognitive burden on the user, which in turn impacts the prosodies, i.e., nonverbal aspects, of the user?s speech. The hypothesis was tested through experiments in which subjects used speech-based, displayless interface followed by a multimodal interface to perform a series of navigational tasks. Their speech was recorded during the experiments and post-processed for prosodic content. Statistical analysis of the post-processed data showed significant differences in subjects? prosodies when using the displayless versus the multimodal interface.

[1]  Elizabeth D. Mynatt,et al.  The design and evaluation of an auditory-enhanced scrollbar , 1994, CHI '94.

[2]  Chris Schmandt Voice communication with computers , 1993 .

[3]  J. Picone,et al.  Issues in generating pronunciation dictionaries for voice interfaces to spatial databases , 1997, Proceedings IEEE SOUTHEASTCON '97. 'Engineering the New Century'.

[4]  C Kamm,et al.  User Interfaces for voice applications , 1994 .

[5]  J.R. Davis,et al.  The Back Seat Driver: real time spoken driving instructions , 1989, Conference Record of papers presented at the First Vehicle Navigation and Information Systems Conference (VNIS '89).

[6]  Stefanie Shattuck-Hufnagel,et al.  The Use of Prosody in Syntactic Disambiguation , 1991, HLT.

[7]  Chris Schmandt Voice communication with computers: conversational systems , 1994 .

[8]  Julie Baca,et al.  Displayless interface access to spatial data: effects on speaker prosodics , 1997, CHI Extended Abstracts.

[9]  W. Jacobson The Art and Science of Teaching Orientation and Mobility to Persons With Visual Impairments , 1993 .

[10]  Roberta L. Klatzky,et al.  Personal guidance system for the visually impaired , 1994, ASSETS.

[11]  James H. Bradford,et al.  The human factors of speech-based interfaces: a research agenda , 1995, SGCH.

[12]  Gina-Anne Levow,et al.  Designing SpeechActs: issues in speech user interfaces , 1995, CHI '95.

[13]  Mari Ostendorf,et al.  Automatic labeling of prosodic patterns , 1994, IEEE Trans. Speech Audio Process..