Evaluating digital libraries in the health sector. Part 2: measuring impacts and outcomes.

This is the second part of a two-part paper which explores methods that can be used to evaluate digital libraries in the health sector. Part 1 focuses on approaches to evaluation that have been proposed for mainstream digital information services. This paper investigates evaluative models developed for some innovative digital library projects, and some major national and international electronic health information projects. The value of ethnographic methods to provide qualitative data to explore outcomes, adding to quantitative approaches based on inputs and outputs is discussed. The paper concludes that new 'post-positivist' models of evaluation are needed to cover all the dimensions of the digital library in the health sector, and some ways of doing this are outlined.

[1]  Barry M. Leiner,et al.  The NCSTRL Approach to Open Architecture for the Confederated Digital Library , 1998, D-Lib Magazine.

[2]  Sarah Pritchard,et al.  Determining Quality in Academic Libraries , 1996, Libr. Trends.

[3]  Roswitha Poll.  Performance measures for library networked services and resources , 2001, Electron. Libr..

[4]  Christine Urquhart,et al.  Libraries without walls still need windows. , 2002, Health information and libraries journal.

[5]  F. W. Lancaster,et al.  The measurement and evaluation of library services , 1977 .

[6]  Steve Hiller.  The impact of information technology and online library resources on research, teaching and library use at the University Of Washington , 2002 .

[7]  Peter Hernon,et al.  Service quality in academic libraries , 1996 .

[8]  Ronald L. Larsen,et al.  The DLib Test Suite and Metrics Working Group: Harvesting the Experience from the Digital Library Initiative , 2002 .

[9]  Simon de Lusignan,et al.  National electronic Library for Health (NeLH) , 1999, BMJ.

[10]  B. Dervin.  AN OVERVIEW OF SENSE-MAKING RESEARCH: CONCEPTS, METHODS AND RESULTS TO DATE , 1983 .

[11]  Lisl Zach,et al.  The contributions of library and information services to hospitals and academic health sciences centers: a preliminary taxonomy. , 2002, Journal of the Medical Library Association : JMLA.

[12]  Carol Collier Kuhlthau,et al.  Seeking Meaning: a process approach to library and information services" Ablex Publishing , 2003 .

[13]  R. Kaplan,et al.  The balanced scorecard--measures that drive performance. , 2015, Harvard business review.

[14]  Gary Marchionini,et al.  Evaluating Digital Libraries: A Longitudinal and Multifaceted View , 2000, Libr. Trends.

[15]  Ronald R. Powell.  Impact Assessment of University Libraries: A Consideration of Issues and Research Methodologies. , 1992 .

[16]  N. Denzin,et al.  Handbook of Qualitative Research , 1994 .

[17]  R. Hanka,et al.  Evaluating information technology in health care: barriers and challenges , 1998, BMJ.

[18]  James Frew,et al.  User Evaluation: Summary of the Methodologies and Results for the Alexandria Digital Library, University of California at Santa Barbara , 1997 .

[19]  Peter Hernon,et al.  Evaluation And Library Decision Making , 1986 .

[20]  Alison Turner,et al.  A first class knowledge service: developing the National electronic Library for Health. , 2002, Health information and libraries journal.

[21]  Christine L. Borgman,et al.  What are Digital Libraries? Competing Visions , 1999, Inf. Process. Manag..

[22]  Tefko Saracevic,et al.  Digital Library Evaluation: Toward Evolution of Concepts , 2000, Libr. Trends.

[23]  Donald W. King,et al.  Increasing the information edge , 1993 .

[24]  J. Eldredge.  Cohort studies in health sciences librarianship. , 2002, Journal of the Medical Library Association : JMLA.

[25]  Peter Brophy,et al.  Management information systems and performance measurement for the electronic library: eLib supporting study (MIEL2) , 1997 .

[26]  John Carlo Bertot,et al.  Measuring Service Quality in the Networked Environment: Approaches and Considerations , 2001, Libr. Trends.

[27]  J. Burton.  The impact of medical libraries and literature on patient care in New Zealand. , 1995, Bulletin of the Medical Library Association.

[28]  M. S. Klein,et al.  Effect of online literature searching on length of stay and patient care costs , 1994, Academic medicine : journal of the Association of American Medical Colleges.

[29]  Elizabeth Roderick,et al.  Cost/benefit analysis for digital library projects: the Virginia Historical Inventory Project (VHI) , 2001 .

[30]  Dan Greenstein,et al.  Digital Libraries and Their Challenges , 2000, Libr. Trends.

[31]  Jeremy C. Wyatt,et al.  When and how to evaluate health information systems? , 2003, Int. J. Medical Informatics.

[32]  J. Marshall,et al.  The impact of the hospital library on clinical decision making: the Rochester study. , 1992, Bulletin of the Medical Library Association.