Exploring multimodality in the laboratory and the field

There are new challenges to us, as researchers, on how to design and evaluate new mobile applications because they give users access to powerful computing devices through small interfaces, which typically have limited input facilities. One way of overcoming these shortcomings is to utilize the possibilities of multimodality. We report in this paper how we designed, developed, and evaluated a multimodal mobile application through a combination of laboratory and field studies. This is the first time, as far as we know, that a multimodal application has been developed in such a way. We did this so that we would understand more about where and when users envisioned using different modes of interaction and what problems they may encounter when using an application in context.

[1]  D. A. Tyldesley,et al.  Employing Usability Engineering in the Development of Office Products , 1988, Comput. J..

[2]  William W. Gaver,et al.  Projected realities: conceptual design for cultural effect , 1999, CHI '99.

[3]  Giulio Jacucci,et al.  On the move with a magic thing: role playing in concept design of mobile services and devices , 2000, DIS '00.

[4]  Debora Shaw,et al.  Handbook of usability testing: How to plan, design, and conduct effective tests , 1996 .

[5]  Tom Rodden,et al.  At home with the technology: an ethnographic study of a set-top-box trial , 1999, TCHI.

[6]  Jacob Buur,et al.  The design collaboratorium: a place for usability design , 2002, TCHI.

[7]  Steve Howard,et al.  Provoking Innovation: Acting-out in Contextual Scenarios , 2002 .

[8]  Robert H. McKim,et al.  Experiences in Visual Thinking , 1972 .

[9]  L. Mathiassen,et al.  Professional systems development: experience, ideas and action , 1990 .

[10]  Lucy A. Suchman,et al.  Making work visible , 1995, CACM.

[11]  Werner Sperschneider,et al.  Ethnographic Fieldwork Under Industrial Constraints: Toward Design-in-Context , 2003, Int. J. Hum. Comput. Interact..

[12]  Konrad Tollmar,et al.  Virtually Living Together: A Design Framework for New Communication Media. , 2000 .

[13]  Leysia Palen,et al.  Beyond the handset: designing for wireless communications usability , 2002, TCHI.

[14]  Lynne Baillie,et al.  Investigating design issues in household environments , 2003, Cognition, Technology & Work.

[15]  Stephen A. Brewster,et al.  Overcoming the Lack of Screen Space on Mobile Computers , 2002, Personal and Ubiquitous Computing.

[16]  Jan Stage,et al.  Experimental Evaluation of Techniques for Usability Testing of Mobile Systems in a Laboratory Setting , 2003 .

[17]  Susanne Bødker,et al.  Scenarios in user-centred design-setting the stage for reflection and action , 1999, Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32. Abstracts and CD-ROM of Full Papers.

[18]  Konrad Tollmar,et al.  Virtually living together , 2000, DIS '00.

[19]  Alexandra Weilenmann,et al.  Collaborative Use of Mobile Telephones: A Field Study of Swedish Teenagers , 2000 .

[20]  Joseph F. Dumas,et al.  A Practical Guide to Usability Testing , 1993 .

[21]  Allison Druin,et al.  Cooperative inquiry: developing new technologies for children with children , 1999, CHI '99.

[22]  Ian Smith,et al.  Informing the design of an information management system with iterative fieldwork , 2000, DIS '00.

[23]  Susanne Bødker.  Scenarios in user-centred designsetting the stage for reflection and action , 2000, Interact. Comput..

[24]  Karel Vredenburg,et al.  The state of user-centered design practice , 2005, IEEE Engineering Management Review.

[25]  Jennifer Lai,et al.  Facilitating mobile communication with multimodal access to email messages on a cell phone , 2004, CHI EA '04.

[26]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[27]  Manfred Tscheligi,et al.  Joking, storytelling, artsharing, expressing affection: a field trial of how children and their social network communicate with digital images in leisure time , 2000, CHI.

[28]  Mikko Nikkanen.  User-centered development of a browser-agnostic mobile e-mail application , 2004, NordiCHI '04.

[29]  Stephen A. Brewster,et al.  Using Landmarks to Support Older People in Navigation , 2004, Mobile HCI.

[30]  John M. Carroll,et al.  Making Use: Scenario-Based Design of Human-Computer Interactions , 2000 .

[31]  Antti Oulasvirta,et al.  Understanding Mobile Contexts , 2003, Mobile HCI.

[32]  Jesper Kjeldskov,et al.  Is It Worth the Hassle? Exploring the Added Value of Evaluating the Usability of Context-Aware Mobile Systems in the Field , 2004, Mobile HCI.

[33]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..