User Study Techniques in the Design and Evaluation of a Ubicomp Environment

To be successful, ubicomp applications must be designed with their environment and users in mind and evaluated to confirm that they do not disrupt the users' natural workflow. Well-established techniques for understanding users and their environment exist, but are not specifically designed to assess how well the computing and physical task environments blend. We present strengths and weaknesses of several qualitative and quantitative user study techniques for ubicomp. We applied these techniques to the design and evaluation of a ubicomp application for cell biology laboratories (Labscape). We describe how these techniques helped identify design considerations that were crucial for Lab-scape's adoption and demonstrate their ability to measure how effectively applications blend into an environment.

[1]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[2]  J. Osofsky.  Handbook of infant development , 1979 .

[3]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[4]  Mark Weiser.  The computer for the 21st century , 1991 .

[5]  Mark Weiser,et al.  Some computer science issues in ubiquitous computing , 1993, CACM.

[6]  Tom Johnston,et al.  MacSHAPA and the enterprise of exploratory sequential data analysis (ESDA) , 1994, Int. J. Hum. Comput. Stud..

[7]  Debora Shaw,et al.  Handbook of usability testing: How to plan, design, and conduct effective tests , 1996 .

[8]  James D. Myers,et al.  Electronic laboratory notebooks for collaborative research , 1996, Proceedings of WET ICE '96. IEEE 5th Workshop on Enabling Technologies; Infrastucture for Collaborative Enterprises.

[9]  Larry E. Wood,et al.  Semi-structured interviewing for user-centered design , 1997, INTR.

[10]  Leysia Palen,et al.  “I'll get that off the audio”: a case study of salvaging multimedia meeting records , 1997, CHI.

[11]  Jonathan Kies,et al.  User and task analysis for interface design , 1998 .

[12]  Gregory D. Abowd,et al.  Classroom 2000: An Experiment with the Instrumentation of a Living Educational Environment , 1999, IBM Syst. J..

[13]  Keith Cheverst,et al.  Experiences of developing and deploying a context-aware tourist guide: the GUIDE project , 2000, MobiCom '00.

[14]  Gregory D. Abowd,et al.  Charting past, present, and future research in ubiquitous computing , 2000, TCHI.

[15]  David F. Redmiles,et al.  Extracting usability information from user interface events , 2000, CSUR.

[16]  Robert Grimm,et al.  Systems Support for Ubiquitous Computing: A Case Study of Two Implementations of Labscape , 2002, Pervasive.

[17]  Gregory D. Abowd,et al.  The Human Experience , 2002, IEEE Pervasive Comput..

[18]  Gaetano Borriello,et al.  Labscape: A Smart Environment for the Cell Biology Laboratory , 2002, IEEE Pervasive Comput..

[19]  Jenna Burrell,et al.  E-graffiti: evaluating real-world use of a context-aware system , 2002, Interact. Comput..