Broccoli Librarianship and Google-Bred Patrons, or What's Wrong with Usability Testing?

Abstract Library Web site usability testing has become justifiably commonplace; with minimal effort, this kind of assessment can detect design-related problems that are often easily corrected. Yet, extensive limitations of usability testing compromise the value of results. Rather than reflecting patrons' actual library Web site usage patterns, the testing instrument reflects librarians' interpretation of “good” library Web site usage, or “broccoli librarianship.” Furthermore, usability testing instruments in general are biased toward ease of use instead of usefulness, a key distinction in the library sector. Moreover, participants accustomed to Google and other Web search engines tend to weigh results in favor of simplicity and ease of use rather than usefulness. Unfamiliarity with library terminology and limited research skills can also undermine the reliability of usability testing. Effective usability testing requires that participants possess a basic understanding of scholarly research, library langua...