Impact evaluation of museums, archives and libraries: available evidence project.

This report provides a critical overview of impact evaluation in the museums, archives and libraries sector. The study, funded by Resource: The Council for Museums, Archives and Libraries, consisted largely of a review of the literature published during a five year retrospective period, with a particular emphasis on impact evaluations conducted within the UK. An advisory group, representing all three domains, was also established. The methodologies used in, and the evidence obtained from, these evaluation studies are discussed critically within the broad context of social, learning and economic impact. While there is an abundance of anecdotal evidence and descriptions of best practice in the sector, extensive hard evidence of impact, gathered systematically, is often lacking. The most compelling evidence from the review indicates that the sector has an impact on personal development. There is also a current emphasis on the impact evaluation of special projects and initiatives; a shift in emphasis towards the evaluation of core services will require a corresponding shift in professional thinking. Issues relating to physical, emotional and intellectual access to the sector by individuals or groups deemed to be in danger of exclusion are also discussed. While the profession is beginning to recognise access as a priority, there is a need to increase access throughout the sector in order to enable impact. The report concludes with a series of detailed recommendations for follow-on work, including: further consultation on impact evaluation, both within and outwith the sector; further research into economic impact, long-term impact, the impact of the archives domain, and the establishment of causal relationships between sector use and social, learning and economic impact; further development of, and access to, appropriate evaluation techniques and tools; increased support for evidence-based practice; and the development and adoption of a strategic plan for the sector.

[1]  C. Heath,et al.  Exhibiting Interaction: Conduct and Collaboration in Museums and Galleries , 2001 .

[2]  D. Stone.  A Comparative Study of Two Art Museum Tours and Their Impact on Adult Learning. , 1997 .

[3]  C. Sharp,et al.  Playing for Success : an evaluation of the third year , 2002 .

[4]  R. Gordon.  IMPACT OF SCHOOL LIBRARY SERVICES ON ACHIEVEMENT AND LEARNING , 2001 .

[5]  B. Hull.  Barriers to libraries as agents of lifelong learning , 2001 .

[6]  Rosemary Norman,et al.  Borrowed Time? The Future of Public Libraries in the UK: Review Article [Book Review] , 1994 .

[7]  R. H. A. Coutts.  Culture club , 1990, Nature.

[8]  Elaine Hall,et al.  Babies, Books and 'Impact': Problems and possibilities in the evaluation of a Bookstart project , 2001 .

[9]  Richard Sandell,et al.  Museums, society, inequality , 2002 .

[10]  Stephen Krashen,et al.  The Power of Reading: Insights from the Research , 2004 .

[11]  Liwen Vaughan.  The impact of the public library on business success: An analysis based on medium-sized businesses in Ontario , 1997 .

[12]  A. Morris,et al.  The Economic Value of Public Libraries , 2001 .

[13]  H. Farr,et al.  Estimating and interpreting the local economic benefits of visitor spending: an explanation , 2000 .

[14]  Bonnie Gratch Lindauer.  Defining and Measuring the Library’s Impact on Campuswide Outcomes , 1998 .

[15]  Eilean Hooper-Greenhill,et al.  Evaluating creativity: the evaluation of the 10 gallery education projects of encompass 2000 , 2001 .

[16]  E. Kerslake,et al.  Reviewing the Literature on Public Libraries and Social Inclusion , 1998 .

[17]  C. A. Fowler.  Review of Urquhart CJ & Hepworth JB The value to clinical decision making of information supplied by NHS library information services , 1996 .

[18]  Richard Sandell,et al.  Museums and social inclusion: the GLLAM Report , 2000 .

[19]  David Aug. Anderson.  A common wealth : museums in the learning age : a report to the Department for Culture, Media and Sport , 1999 .

[20]  K. Hetherington,et al.  Museums and the Visually Impaired: The Spatial Politics of Access , 2000 .

[21]  Sarah McNicol,et al.  User Learning Needs: A critical literature review , 2001 .

[22]  J. Marshall,et al.  The impact of the hospital library on clinical decision making: the Rochester study. , 1992, Bulletin of the Medical Library Association.

[23]  J. Falk,et al.  The Effect of Visitors ‘ Agendas on Museum Learning , 1998 .

[24]  J. Potter Briscoe.  The Library Association , 1898 .

[25]  Eilean Hooper-Greenhill.  Developing a scheme for finding evidence of the outcomes and impact of learning in museums, archives and libraries: the conceptual framework , 2002 .

[26]  Westone,et al.  Home Page , 2004, 2022 2nd International Conference on Intelligent Cybernetics Technology & Applications (ICICyTA).

[27]  Maurice B Line,et al.  Book Reviews of The Book Publishing Industry, The Stationers' Company ad the Book Trade 1550-1990, and Beyond Book Issues: The Social Potential of Library Projects , 1998 .

[28]  Dorothy A. Williams,et al.  Impact of school library services on achievement and learning in primary schools: critical literature review of the impact of school library provision on achievement and learning in primary level students. , 2002 .

[29]  Eilean Hooper-Greenhill,et al.  Visitors' interpretive strategies at Wolverhampton Art Gallery , 2001 .

[30]  John MacBeath,et al.  The impact of study support : a report of a longitudinal study into the impact of participation in out-of-school-hours learning on the academic attainment, attitudes and school attendance of secondary school students , 2001 .

[31]  Richard Proctor,et al.  An investigation into the impact of the Sheffield Libraries strike , 1996, Inf. Res..

[32]  Peter Brophy,et al.  The Value and Impact of End-User IT Services in Public Libraries , 2001 .

[33]  Melvyn Crann,et al.  A mass observation of the public library , 2000 .

[34]  M. Ashcroft.  The impact of information use on decision making by physiotherapists , 1998 .

[35]  Keith Curry Lance,et al.  Measuring Up to Standards Findings: The Impact of School Library Programs & Information Literacy in Pennsylvania Schools. , 2000 .

[36]  Jennie Ingham.  Books and Reading Development: The Bradford Book Flood Experiment. Second Edition. , 1981 .

[37]  Richard Sandell,et al.  Museums as agents of social inclusion , 1998 .

[38]  Kevin Crowley,et al.  Learning As Conversational Elaboration : A Proposal to Capture , Code , and Analyze Talk in Museums , 2000 .

[39]  E. G. Smith.  Texas School Libraries: Standards, Resources, Services, and Students' Performance. , 2001 .

[40]  Jocelyn Dodd,et al.  Seeing the museum through the visitors' eyes: the evaluation of the Education Challenge Fund , 2002 .

[41]  Keith Curry Lance,et al.  The Impact of School Library Media Centers on Academic Achievement , 1994 .

[42]  Sharon Markless,et al.  Developing performance and impact indicators and targets in public and education libraries , 2001, Int. J. Inf. Manag..

[43]  J. Pateman,et al.  Open to All? The public library and social exclusion: executive summary , 2001 .

[44]  Bruce T. Fraser,et al.  Economic Benefits and Impacts from Public Libraries in the State of Florida. Final Report. , 2001 .

[45]  K. Lance,et al.  How School Librarians Help Kids Achieve Standards: The Second Colorado Study , 2000 .

[46]  James C. Baughman.  School libraries and MCAS Scores , 2000 .

[47]  Haiyan Song,et al.  Estimating the value of the social benefits to visitors to a large art gallery. , 1998 .

[48]  R. Sawyer.  The economic and job creation benefits of Ontario public libraries , 1996 .

[49]  J. Falk,et al.  Learning from Museums: Visitor Experiences and the Making of Meaning , 2000 .

[50]  John K. Gilbert,et al.  MODELS AND DISCOURSE : A PRIMARY SCHOOL SCIENCE CLASS VISIT TO A MUSEUM , 1997 .

[51]  Ken Worpole,et al.  Libraries in a world of cultural change , 1995 .

[52]  J. Falk,et al.  School Field Trips: Assessing Their Long-Term Impact , 1997 .

[53]  Maureen Grieves.  The impact of information use on decision making: studies in five sectors ‐ introduction, summary and conclusions , 1998 .

[54]  David Harrison,et al.  Public Library Services for Visually Impaired People , 2001 .

[55]  Glen E. Holt,et al.  A framework for evaluating public investment in urban libraries , 1996 .

[56]  Dana L. Kelly,et al.  International Association for the Evaluation of Educational Achievement , 1998 .

[57]  M. Xanthoudaki.  Educational Provision for Young People as Independent Visitors to Art Museums and Galleries: Issues of Learning and Training , 1998 .

[58]  K. Crowley,et al.  Building Islands of Expertise in Everyday Family Activity , 2002 .

[59]  Laura Cram.  New Measures for the New Library: A Social Audit of Public Libraries [Book Review] , 1999 .

[60]  Ronald F. Dow.  Using Assessment Criteria To Determine Library Quality. , 1998 .

[61]  Hugh Preston,et al.  Demonstrating quality in academic libraries , 1999 .

[62]  Beatriz Plaza.  Evaluating the Influence of a Large Cultural Artifact in the Attraction of Tourism , 2000 .

[63]  S. Selwood.  The UK Cultural Sector: Profile and Policy Issues , 2001 .

[64]  M Gough,et al.  A Note on Family Learning , 2000 .

[65]  William T. Alderson.  The American Association for State and Local History , 1970 .

[66]  A. Newman,et al.  Heritage builds communities: The application of heritage resources to the problems of social exclusion , 1998 .

[67]  Maria Economou,et al.  User Evaluation: Report of Findings , 2002 .

[68]  Elspeth S. Scott.  How Good Is Your School Library Resource Centre? An Introduction to Performance Measurement. , 2002 .

[69]  P. Livingstone,et al.  Visitor Comments and the Socio-Cultural Context of Science: Public Perceptions and the Exhibition A Question of Truth , 2001 .

[70]  K. Lance,et al.  Information Empowered: The School Librarian as an Agent of Academic Achievement in Alaska Schools. Revised Edition. , 2000 .

[71]  Max Stafford-Clark,et al.  Taking stock , 2022, Trans. GIS.

[72]  K. Crowley,et al.  Learning conversations in museums , 2002 .

[73]  M. Munday,et al.  Assessing the Role of the Arts and Cultural Industries in a Local Economy , 2000 .

[74]  Judy Diamond,et al.  Practical Evaluation Guide: Tools for Museums and Other Informal Educational Settings. American Association for State and Local History Book Series. , 1999 .

[75]  L. Dierking.  The Family Museum Experience: Implications from Research , 1989 .

[76]  Skills,et al.  Learning through culture: the DfES Museums and Galleries Education Programme: a guide to good practice , 2002 .

[77]  Patricia A Iannuzzi.  Information Literacy Competency Standards for Higher Education , 2000 .

[78]  Bob Usherwood,et al.  New Library - New Measures: A Social Audit of Public Libraries , 1999 .

[79]  Richard Turner.  Out of Sight but not out of Mind: Visually Impaired People’s Perspectives of Library and Information Services , 2002 .

[80]  Catherine Stainton,et al.  Voices and Images: Making Connections Between Identity and Art , 2003 .

[81]  Jocelyn Dodd,et al.  A catalyst for change: the social impact of the Open Museum , 2002 .

[82]  Mike Freeman,et al.  Understanding Community Librarianship , 2000 .

[83]  François Matarasso.  Use or Ornament?: The Social Impact of Participation in the Arts , 1997 .

[84]  Eilean Hooper-Greenhill,et al.  Researching learning in museums and galleries 1990-1999: a bibliographic review , 2000 .

[85]  Danuta A. Nitecki,et al.  New measures for research libraries , 1999 .

[86]  Kevin Crowley,et al.  Objects of Learning , Objects of Talk : Changing Minds in Museums , 2001 .

[87]  Jocelyn Dodd,et al.  Including museums: perspectives on museums, galleries and social inclusion , 2001 .

[88]  Charles Oppenheim,et al.  The valuing of Information Assets in UK companies , 2000 .

[89]  Christine D. Reid,et al.  Impact of information on corporate decision making: the UK banking sector , 1998 .