A Usability Framework for the Design and Evaluation of Multimodal Interaction: Application to a Multimodal Mobile Phone

Multimodal interfaces, characterized by multiple parallel recognition-based input modes such as speech and hand gestures, have been of research interest for some years. A common claim is that they can provide greater usability than more traditional user interfaces. For example, they have the potential to be more intuitive and easily learnable because they implement interaction means that are close to the ones used in everyday human-human communication. When users are given the freedom of using the modalities of interaction of their choice, multimodal systems can also be more flexible and AbsTRACT

[1]  David Taniar.  Encyclopedia of Mobile Computing and Commerce , 2007 .

[2]  Marie-Luce Bourguet,et al.  Designing and Prototyping Multimodal Commands , 2003, INTERACT.

[3]  In Lee.  Mobile Services Industries, Technologies, and Applications in the Global Economy , 2012 .

[4]  Anthony I. Wasserman,et al.  Extending State Transition Diagrams for the Specification of Human–Computer Interaction , 1985, IEEE Transactions on Software Engineering.

[5]  Gérard Chollet,et al.  Coupling Context Awareness and Multimodality in Smart Homes Concept , 2004, ICCHP.

[6]  David Taniar,et al.  Mobile Computing: Concepts, Methodologies, Tools, and Applications , 2008 .

[7]  Sharon L. Oviatt,et al.  Designing the User Interface for Multimodal Speech and Pen-Based Gesture Applications: State-of-the-Art Systems and Future Research Directions , 2000, Hum. Comput. Interact..

[8]  David Taniar,et al.  International Journal of Mobile Computing and Multimedia Communications , 2010 .

[9]  Susana Sargento,et al.  Session and Network Support for Autonomous Context-Aware Multiparty Communications in Heterogeneous Mobile Systems , 2010, Int. J. Handheld Comput. Res..

[10]  Frederic T. Chong,et al.  A Study of Reusing Smartphones to Augment Elementary School Education , 2012, Int. J. Handheld Comput. Res..

[11]  Giancarlo Fortino,et al.  E-Commerce Services Based on Mobile Agents , 2006 .

[12]  Marie-Luce Bourguet,et al.  Design and usability evaluation of multimodal interaction with finite state machines: a conceptual framework , 2008, Journal on Multimodal User Interfaces.

[13]  Songpol Kulviwat,et al.  Personalization and Customer Satisfaction in Mobile Commerce , 2009 .

[14]  Ann Blandford,et al.  Four easy pieces for assessing the usability of multimodal interaction: the CARE properties , 1995, INTERACT.

[15]  Annette Hallin,et al.  mCity: User Focused Development of Mobile Services Within the City of Stockholm , 2009 .