Bridging the gulf: mixed methods and library service evaluation

This paper explores library evaluation in Australia and proposes a return to research fundamentals in which evaluators are asked to consider the centrality of philosophical issues and the role of different research methods. A critique of current evaluation examples demonstrates a system-centred, quantitative, input/output focus which fails to engage with users’ experiences or to address service objectives, and provides insufficient information upon which to make decisions about service improvements. This reliance on traditional evaluation is juxtaposed with the emphasis library and information studies places on alternative methodologies. The paper asks why a perspective that has become mainstream in academic research remains peripheral to practice-based evaluation.

[1]  Richard Widdows,et al.  The Focus Group Interview: A Method for Assessing Users' Evaluation of Library Service , 1991 .

[2]  Joan C. Durrance,et al.  Facilitating community information seeking using the Internet: Findings from three public library-community network systems , 2002, J. Assoc. Inf. Sci. Technol..

[3]  Vj. Janesick The choreography of qualitative research design , 2000 .

[4]  Carolyn M. Hall,et al.  Encyclopedia of Library and Information Science , 1971 .

[5]  B. Dervin,et al.  Information needs and uses. , 1986 .

[6]  Fadhel Kaboub Realistic Evaluation , 2004 .

[7]  R. Mcnabb Making all the right moves : Foucault, journals, and the authorization of discourse , 1999 .

[8]  Brenda Dervin Human studies and user studies: a call for methodological interdisciplinarity (Invited paper) , 2003, Inf. Res..

[9]  Rachael Green Clemens,et al.  Usage and Usability Assessment: Library Practices and Concerns , 2003 .

[10]  Henry A. Landsberger,et al.  Major Social Issues: A Multidisciplinary View , 1978 .

[11]  Martha Kyrillidou,et al.  From input and output measures to quality and outcome measures, or, from the user in the life of the library to the library in the life of the user , 2002 .

[12]  Susan Dunman,et al.  Seeking meaning: A process approach to library and information services , 1996 .

[13]  William M. K. Trochim,et al.  Concept Mapping as an Alternative Approach for the Analysis of Open-Ended Survey Responses , 2002 .

[14]  Melvin M. Mark,et al.  Realist Evaluation: An Emerging Theory in Support of Practice. , 1998 .

[15]  Louise Limberg,et al.  Experiencing information seeking and learning: a study of the interaction between two phenomena , 1999, Inf. Res..

[16]  Karen E. Pettigrew,et al.  Waiting for chiropody: contextual results from an ethnographic study of the information behaviour among attendees at community clinics , 1999, Inf. Process. Manag..

[17]  A. Parasuraman,et al.  Reassessment of expectations as a comparison standard in measuring service quality: Implications , 1994 .

[18]  Anne-Marié Pothas,et al.  Customer satisfaction: Keeping tabs on the issues that matter , 2001 .

[19]  Rik Panganiban,et al.  The World Summit on the Information Society , 2004 .

[20]  Karen E. Fisher,et al.  Determining How Libraries and Librarians Help , 2003, Libr. Trends.

[21]  Valerie J. Caracelli,et al.  Advances in mixed-method evaluation : the challenges and benefits of integrating diverse paradigms , 1997 .

[22]  Gary P. Radford Libraries, Librarians, and the Discourse of Fear , 2001, The Library Quarterly.

[23]  Belle Ruth Witkin,et al.  Needs Assessment Since 1981: The State of the Practice , 1994 .

[24]  Peter Hernon,et al.  Delivering Satisfaction and Service Quality: A Customer-Based Approach for Libraries , 2000 .

[25]  Rowena Cullen,et al.  An action plan for outcomes assessment in your library: by Peter Hernon and Robert E. Dugan. Chicago: American library association, 2002. 191p. $49.00 ($44.10 for ALA members). ISBN: 0-8389-0813-6 , 2002 .

[26]  James Krikelas,et al.  Barriers to information; How formal help systems fail battered women , 1996 .

[27]  Brian Fitzgerald Introduction to the Special Series of Papers on Informing Each Other: Bridging the Gap between Researcher and Practitioners , 2003, Informing Sci. Int. J. an Emerg. Transdiscipl..

[28]  Brenda Dervin,et al.  ASQ: Asking Significant Questions. Alternative Tools for Information Need and Accountability Assessments by Libraries. , 1987 .

[29]  Caroline White Little evidence for effectiveness of scientific peer review , 2003, BMJ : British Medical Journal.

[30]  Brenda Dervin,et al.  On studying information seeking methodologically: the implications of connecting metatheory to method , 1999, Inf. Process. Manag..

[31]  Alan Bernstein,et al.  From Survey to Service , 1997 .

[32]  Richard Biddiscombe The development of information professionals’ needs for Internet and IT skills: experiences at the University of Birmingham , 2001 .

[33]  Colleen Cook,et al.  LIBQUAL+ : ONE INSTRUMENT IN THE NEW MEASURES TOOLBOX , 2001 .

[34]  Ruth C. T. Morris Toward a User-Centered Information Service , 1994, J. Am. Soc. Inf. Sci..

[35]  Carol Collier Kuhlthau,et al.  Seeking Meaning: a process approach to library and information services" Ablex Publishing , 2003 .

[36]  Reijo Savolainen Everyday life information seeking: Approaching information seeking in the context of “way of life” , 1995 .

[37]  Brenda Dervin,et al.  From the mind’s eye of the user: The sense-making qualitative-quantitative methodology. , 1992 .

[38]  G. Henry Does the public have a role in evaluation? Surveys and democratic discourse , 1996 .

[39]  B. Dervin,et al.  Neutral Questioning: A New Approach to the Reference Interview. , 1986 .

[40]  B. Dervin Users as Research Inventions: How Research Categories Perpetuate Inequities , 1989 .

[41]  Alice A. Ketchand,et al.  Examining the Role of Service Quality in Overall Service Satisfaction , 1998 .

[42]  Elaina Norlin Reference Evaluation: A Three-Step Approach—Surveys, Unobtrusive Observations, and Focus Groups , 2000 .

[43]  M. Eisenhart The Paradox of Peer Review: Admitting too Much or Allowing too Little? , 2002 .

[44]  Mary F. Casserly,et al.  Usage and Usability Assessment: Library Practices and Concerns , 2002 .

[45]  Ethelene Whitmire,et al.  The Relationship between Undergraduates’ Background Characteristics and College Experiences and Their Academic Library Use , 2001 .

[46]  Heidi E. Julien,et al.  Barriers to Adolescents' Information Seeking for Career Decision Making , 1999, J. Am. Soc. Inf. Sci..