Three looks at users: a comparison of methods for studying digital library use

Compares three user research methods of studying real-world digital library usage within the context of the Variations and Variations2 digital music libraries at Indiana University. After a brief description of both digital libraries, each method is described and illustrated with findings from the studies. User satisfaction questionnaires were used in two studies, one of Variations (n=30) and the other of Variations2 (n=12). Second, session activity log files were examined for 175 Variations2 sessions using both quantitative and qualitative methods. The third method, contextual inquiry, is illustrated with results from field observations of four voice students' information usage patterns. The three methods are compared in terms of expertise required; time required to set up, conduct, and analyse resulting data; and the benefits derived. Further benefits are achieved with a mixed-methods approach, combining the strengths of the methods to answer questions lingering as a result of other methods.

[1]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[2]  Edward A. Fox,et al.  Digital libraries , 1995, CACM.

[3]  Mary F. Casserly,et al.  Usage and Usability Assessment: Library Practices and Concerns , 2002 .

[4]  Mark Notess,et al.  Predicting user satisfaction from subject satisfaction , 2003, CHI Extended Abstracts.

[5]  Jon W. Dunn,et al.  VARIATIONS: a digital music library system at Indiana University , 1999, DL '99.

[6]  Rachael Green Clemens,et al.  Usage and Usability Assessment: Library Practices and Concerns , 2003 .

[7]  B. Cesnik,et al.  Digital Libraries , 2001, Yearbook of Medical Informatics.

[8]  Mike Kuniavsky,et al.  Observing the User Experience: A Practitioner's Guide to User Research (Morgan Kaufmann Series in Interactive Technologies) (The Morgan Kaufmann Series in Interactive Technologies) , 2003 .

[9]  Jon W. Dunn,et al.  Variations2: a digital music library system , 2002, JCDL '02.

[10]  Ann Peterson Bishop How We Do User-Centered Design and Evaluation of Digital Libraries: A Methodological Forum (Papers presented at the Allerton Park Institute held October 29-31, 1995) , 1995 .

[11]  Karen Holtzblatt,et al.  Contextual design , 1997, INTR.

[12]  Christine L Borgman,et al.  Final Report to the National Science Foundation , 2002 .

[13]  Jon W. Dunn,et al.  Indiana university digital music library project , 2001, JCDL '01.

[14]  Tom Wilson ‘Information Science’ and Research Methods , 2004 .

[15]  Erin V. Lehman,et al.  Development of an Instrument , 2005 .

[16]  Nancy A. Vanhouse,et al.  Digital Library Use: Social Practice in Design and Evaluation , 2003 .

[17]  Sally Jo Cunningham,et al.  A transaction log analysis of a digital library , 2000, International Journal on Digital Libraries.

[18]  Daniel Fallman,et al.  Design-oriented human-computer interaction , 2003, CHI '03.