论文信息 - Subjective Evaluation Method for Speech-Based Uni- and Multimodal Applications

Subjective Evaluation Method for Speech-Based Uni- and Multimodal Applications

Questionnaires are a widespread method for subjective usability evaluation. Concerning speech-based systems the SASSI questionnaire is probably the most common one. This paper examines SASSI results obtained by different studies in order to evaluate its reliability and validity. Furthermore, it is investigated if SASSI is appropriate also for multimodal systems. The results indicate that some SASSI sub-scales need a revision.

Sebastian Möller | Ina Wechsung | Anja Naumann | Benjamin Weiss

[1] Robert Graham,et al. Towards a tool for the Subjective Assessment of Speech System Interfaces (SASSI) , 2000, Natural Language Engineering.

[2] Klaus-Peter Engelbrecht,et al. Study of a Speech-based Smart Home System with Older Users , 2008 .

[3] Lars Bo Larsen,et al. Issues in the evaluation of spoken dialogue systems using objective and subjective measures , 2003, 2003 IEEE Workshop on Automatic Speech Recognition and Understanding (IEEE Cat. No.03EX721).

[4] Sebastian Möller,et al. Evaluating spoken dialogue systems according to de-facto standards: A case study , 2007, Comput. Speech Lang..

[5] Sebastian Möller,et al. Predicting the quality and usability of spoken dialogue services , 2008, Speech Commun..