A Usability Evaluation of Academic Virtual Reference Services

This study examined the usability of five virtual reference services—instant messenger chat, e-mail, telephone, text messaging, and Skype videoconferencing—by having 31 undergraduate and graduate students evaluate the usability of the virtual reference services of two different universities. The study’s results suggest that user preference and satisfaction for virtual reference service are highly correlated with the service’s overall usability in terms of effectiveness and efficiency. Online chat was rated highest across all measures including satisfaction and seven different usability factors. Major implications of the study suggest that online chat is the virtual reference of choice for university students and that usability metrics are a good predictor of user preferences centered on high return on investment, speed of transaction, convenience, and minimal effort.

[1]  Patrick W. Jordan,et al.  An Introduction to Usability , 1998 .

[2]  David Henry Ward,et al.  Measuring the completeness of reference transactions in online chats: Results of an unobtrusive study , 2004 .

[3]  Herbert Poole,et al.  Theories of the middle range , 1985 .

[4]  Barbara Pease,et al.  Digital Reference: A Case Study of Question Types in an Academic Library , 2001 .

[5]  M. Radford,et al.  “If it is too inconvenient I'm not going after it:” Convenience as a critical factor in information-seeking behaviors , 2011 .

[6]  Marie L. Radford,et al.  A multiple-case study investigation of the discontinuation of nine chat reference services , 2006 .

[8]  Lynn Silipigni Connaway,et al.  Virtual reference services: On the trail of the elusive non‐user: What research in virtual reference environments reveals , 2007 .

[9]  George Buchanan,et al.  Cognitive economy and satisficing in information seeking: A longitudinal study of undergraduate information behavior , 2009, J. Assoc. Inf. Sci. Technol..

[10]  Marilyn Von Seggern,et al.  General Information Seeking in Changing Times: A Focus Group Study. , 2001 .

[11]  Char Booth.  Developing Skype-Based Reference Services , 2008 .

[12]  Suzanne M. Gray.  Virtual Reference Services Directions and Agendas , 2000 .

[13]  Jody Condit Fagan,et al.  Instant messaging reference , 2002 .

[14]  Anthony Chow.  The usability of digital information environments: planning, design and assessment , 2013 .

[15]  Anthony Shong-Yu Chow,et al.  Information-Seeking Behavior and Reference Medium Preferences , 2012 .

[16]  Joseph E. Straw.  A Virtual Understanding: The Reference Interview and Question Negotiation in the Digital Age. , 2000 .

[17]  Lorri Mon,et al.  E-valuating E-reference , 2008 .

[18]  Kelly Broughton.  Usage and User Analysis of a Real-Time Digital Reference Service , 2002 .

[19]  David Henry Ward.  Why Users Choose Chat , 2005 .

[20]  Xiangming Mu,et al.  A Survey and Empirical Study of Virtual Reference Service in Academic Libraries , 2011 .

[21]  Bernie Sloan.  Twenty Years of Virtual Reference , 2006 .

[22]  Christina M. Desai.  Instant messaging reference: how does it compare? , 2003, Electron. Libr..

[23]  Nahyun Kwon,et al.  Public library patrons' use of collaborative chat reference service : The effectiveness of question answering by question type , 2007 .

[24]  M. C. Atlas,et al.  Library Anxiety in the Electronic Era, or Why Won't Anybody Talk to Me Anymore? One Librarian's Rant , 2004 .

[25]  Maryellen Allen,et al.  A Survey of the Usability of Digital Reference Services on Academic Health Science Library Web Sites , 2006 .

[26]  Joel Lara Linda Cummings,et al.  User Preferences in Reference Services: Virtual Reference and Academic Libraries , 2007 .

[27]  Laura K. Probst.  Digital Reference Management , 2005 .

[28]  Joseph W. Janes,et al.  Digital reference: Reference librarians' experiences and attitudes , 2002, J. Assoc. Inf. Sci. Technol..

[29]  Dayne Sherman,et al.  Text Messaging in an Academic Library: Integrating SMS into Digital Reference , 2007 .

[30]  Kirsti Nilsen,et al.  The Library Visit Study: user experiences at the virtual reference desk , 2003, Inf. Res..