Quality Aspects of Multimodal Dialog Systems: Identity, Stimulation and Success

So far, not much is known on the relationship of quality aspects of multimodal dialog systems. This paper aims at closing this gap by analyzing the influence of input and output modalities on the systems’ usability. The underlying study has been carried out with a smart-home system offering speech, gesture and touch as well as the combination of these three for input and a speech-to-text system, a TV screen and a smartphone screen for output. The results indicate that the usability of a multimodal system is composed of hedonic and pragmatic aspects. The hedonic aspects are influenced by the identity transported by the output channels and the stimulation of the input modalities. A measure for task success was sufficient to describe the pragmatic aspect.

[1]  Sebastian Möller,et al.  Evaluating multimodal systems: a comparison of established questionnaires and interaction parameters , 2010, NordiCHI.

[2]  Masahiro Araki,et al.  Spoken, Multilingual and Multimodal Dialogue Systems: Development and Assessment , 2005 .

[3]  Niels Ole Bernsen,et al.  Evaluation and usability of multimodal spoken language dialogue systems , 2004, Speech Commun..

[4]  Sebastian Möller,et al.  Predicting the quality of multimodal systems based on judgments of single modalities , 2009, INTERSPEECH.

[5]  Sharon Oviatt,et al.  Multimodal Interfaces , 2008, Encyclopedia of Multimedia.

[6]  Michael Burmester,et al.  Hedonic and ergonomic quality aspects determine a software's appeal , 2000, CHI.

[7]  Sebastian Möller,et al.  Quantifying the impact of system characteristics on perceived quality dimensions of a spoken dialogue service , 2003, INTERSPEECH.

[8]  Nigel Bevan,et al.  What is the difference between the purpose of usability and user experience evaluation methods , 2009 .

[9]  Sebastian Möller,et al.  Talking heads for interacting with spoken dialog smart-home systems , 2009, INTERSPEECH.

[10]  Sebastian Möller,et al.  Parameters describing multimodal interaction - definitions and three usage scenarios , 2010, INTERSPEECH.

[11]  Marc Hassenzahl,et al.  User experience (UX): towards an experiential perspective on product quality , 2008, IHM '08.

[12]  Marc Hassenzahl,et al.  The Interplay of Beauty, Goodness, and Usability in Interactive Products , 2004, Hum. Comput. Interact..

[13]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[14]  N. Tractinsky,et al.  What is beautiful is usable , 2000, Interact. Comput..

[15]  Marc Hassenzahl,et al.  The importance of a software's pragmatic quality depends on usage modes , 2002 .

[16]  Sebastian Möller,et al.  Chapter 14 – Evaluation of Multimodal Interfaces for Ambient Intelligence , 2010, AmI 2010.

[17]  Marc Hassenzahl,et al.  The Inference of Perceived Usability From Beauty , 2010, Hum. Comput. Interact..

[18]  Noam Tractinsky,et al.  Evaluating the consistency of immediate aesthetic perceptions of web pages , 2006, Int. J. Hum. Comput. Stud..