Libcitations: A measure for comparative assessment of book publications in the humanities and social sciences

Bibliometric measures for evaluating research units in the book-oriented humanities and social sciences are underdeveloped relative to those available for journal-oriented science and technology. We therefore present a new measure designed for book-oriented fields: the “libcitation count.” This is a count of the libraries holding a given book, as reported in a national or international union catalog. As librarians decide what to acquire for the audiences they serve, they jointly constitute an instrument for gauging the cultural impact of books. Their decisions are informed by knowledge not only of audiences but also of the book world, e.g., the reputations of authors and the prestige of publishers. From libcitation counts, measures can be derived for comparing research units. Here, we imagine a matchup between the departments of history, philosophy, and political science at the University of New South Wales and the University of Sydney in Australia. We chose the 12 books from each department that had thehighest libcitation counts in the Libraries Australia union catalog during 2000–2006. We present each book’s raw libcitation count, its rank within its LC class, and its LC-class normalized libcitation score. The latter is patterned on the item-oriented field normalized citation score used in evaluative bibliometrics. Summary statistics based on these measures allow the departments to be compared for cultural impact. Our work has implications for programs such as Excellence in Research for Australia and the Research Assessment Exercise in the United Kingdom. It also has implications for data mining in OCLC’s WorldCat.

[1]  J. Najman,et al.  The validity of publication and citation counts for Sociology and other selected disciplines , 2003 .

[2]  Ed C. M. Noyons,et al.  International Comparison of Departments' Research Performance in the Humanities , 1992, J. Am. Soc. Inf. Sci..

[3]  Paul Metz,et al.  A Reputational Study of Academic Publishers. , 1996 .

[4]  Gaby Haddow Quality Australian Journals in the Humanities and Social Sciences , 2008 .

[5]  Roxanne Missingham,et al.  Australian university libraries: collections overlap study , 2003 .

[6]  C. Donovan The Hidden Perils of Citation Counting for Australasian Political Science , 2007 .

[7]  Charles Oppenheim,et al.  Use of citation analysis to predict the outcome of the 2001 Research Assessment Exercise for Unit of Assessment (UoA) 61: Library and Information Management, , 2001, Inf. Res..

[8]  Ulf Sandström,et al.  A metric for academic performance applied to australian universities 2001-2004 , 2007 .

[9]  M. Eysenck,et al.  The correlation between RAE ratings and citation counts in psychology Technical Report , 2002 .

[10]  Janice S. Lewis,et al.  An Assessment of Publisher Quality by Political Science Librarians , 2000 .

[11]  Henk F. Moed,et al.  Citation Analysis in Research Evaluation , 1899 .

[12]  Charles Oppenheim,et al.  The correlation between citation counts and the 1992 research assessment exercise ratings for British research in genetics, anatomy and archaeology , 1997, J. Documentation.

[13]  Henk F. Moed,et al.  Towards Research Performance in the Humanities , 2002, Libr. Trends.

[14]  T. J. Phelan,et al.  A compendium of issues for citation analysis , 1999, Scientometrics.

[15]  Linda Butler,et al.  Extending citation analysis to non-source items , 2006, Scientometrics.

[16]  Sheila S. Intner Brief Tests of Collection Strength: A Methodology for All Types of Libraries , 1996 .

[17]  Vincent Larivière,et al.  Benchmarking scientific output in the social sciences and humanities: The limits of existing databases , 2006, Scientometrics.

[18]  Charles Oppenheim,et al.  Comparing alternatives to the Web of Science for coverage of the social sciences' literature , 2007, J. Informetrics.

[19]  S. Wiberley The Social Sciences: Who Won the ‘90s in Scholarly Book Publishing , 2004 .

[20]  Stephen J. Bensman Donald J. Urquhart and the integration of science with librarianship: Part 1 , 2007 .

[21]  Anton J. Nederhof,et al.  Bibliometric monitoring of research performance in the Social Sciences and the Humanities: A Review , 2006, Scientometrics.

[22]  Jonas Lundberg,et al.  Lifting the crown - citation z-score , 2007, J. Informetrics.

[23]  Howard D. White Better Than Brief Tests: Coverage Power Tests of Collection Strength , 2008 .

[24]  Larry P. Goodson,et al.  Ranking the Presses: Political Scientists' Evaluations of Publisher Quality , 1999, PS: Political Science & Politics.

[25]  Henk F. Moed,et al.  Library Catalog Analysis is a Useful Tool in Studies of Social Sciences and Humanities , 2008 .

[26]  John W. East,et al.  Ranking Journals in the Humanities: An Australian Case Study , 2006 .

[27]  S. Wiberley The Humanities: Who Won the '90s in Scholarly Book Publishing , 2002 .

[28]  Jonathan Adams The use of bibliometrics to measure research quality in UK higher education institutions , 2009, Archivum Immunologiae et Therapiae Experimentalis.

[29]  Charles Oppenheim,et al.  Citation counts and the Research Assessment Exercise, part VI: Unit of assessment 67 (music) , 2008, Inf. Res..

[30]  Deepthi Kumara Henadeera,et al.  Is there a Role for Novel Citation Measures for the Social Sciences and Humanities in a National research Assessment Exercise , 2007 .

[31]  L. Butler,et al.  Testing novel quantitative indicators of research ‘quality’, esteem and ‘user engagement’: an economics pilot study , 2007 .

[32]  Charles A. Schwartz,et al.  Brief tests of collection strength: A methodology for all types of libraries , 1996 .

[33]  J. Scott Armstrong,et al.  The Ombudsman: Verification of Citations: Fawlty Towers of Knowledge? , 2008, Interfaces.

[34]  John Mingers,et al.  Ranking journals in business and management: a statistical analysis of the Harzing data set , 2007, Eur. J. Inf. Syst..

[35]  Charles Oppenheim,et al.  Citation counts and the Research Assessment Exercise V: Archaeology and the 2001 RAE , 2003, J. Documentation.

[36]  Peter Willett,et al.  The citedness of publications by United Kingdom library schools , 1995, J. Inf. Sci..