Multiple methods and the usability of interface prototypes: the complementarity of laboratory observation and focus groups

Recently, I used a focus group in a usability study of an interface prototype as a balance for a laboratory observation. The clients for this usability study wanted a sense of whether their interface was attractive to a range of users, whether the range of users understood the product, and whether the users could use the interface quickly; they also wanted user feedback on a list of potential features they could include in the next phase of development. Because of very limited resources available for the usability study, and because of the disparate questions the clients had, a focus group for some new users was used to supplement a laboratory observation and interview of other new users. This paper reports on what strengths and weaknesses these methods yielded as complementary approaches to testing the usability of interface prototypes.

[1]  P. Brink On reliability and validity in qualitative research. , 1987, Western journal of nursing research.

[2]  C. H. Germain Ethnography: Step By Step , 1990 .

[3]  D. Morgan Focus groups for qualitative research. , 1988, Hospital guest relations report.

[4]  J. W. Asher,et al.  Composition Research: Empirical Designs , 1988 .

[5]  Dixie Goswami,et al.  Writing in Non-Academic Settings. , 1981 .

[6]  Mary Beth Rosson,et al.  Usability Specifications as Tool in Iterative Development. , 1984 .

[7]  Sister Kristin Crawford,et al.  Figuring Things Out , 1986 .

[8]  Elliot W. Eisner,et al.  Qualitative Inquiry in Education: The Continuing Debate , 1990 .

[9]  Patricia Sullivan Usability in the computer industry: what contribution can longitudinal field studies make? , 1989, International Professional Communication Conference 'Communicating to the World.',.

[10]  J. V. Maanen,et al.  Tales of the Field: On Writing Ethnography , 1989 .

[11]  Janet Mancini Billson,et al.  Focus Groups: A Practical Guide for Applied Research , 1989 .

[12]  R. Merton,et al.  The Focused Interview: A Manual of Problems and Procedures , 1990 .

[13]  M. Gardiner,et al.  Applying cognitive psychology to user-interface design , 1987 .

[14]  Rudy Hirschheim,et al.  Understanding the office: A social-analytic perspective , 1986, TOIS.

[15]  Qualitative Analysis: Historical and Critical Essays. , 1974 .

[16]  Patricia Sullivan Beyond a narrow conception of usability testing , 1989 .

[17]  Jakob Nielsen,et al.  Traditional dialogue design applied to modern user interfaces , 1990, CACM.