Book reviews in humanities research evaluations

Bibliometric evaluations of research outputs in the social sciences and humanities are challenging due to limitations associated with Web of Science data; however, background literature has shown that scholars are interested in stimulating improvements. We give special attention to book reviews processed by Web of Science history and literature journals, focusing on two types: Type I (i.e., reference to book only) and Type II (i.e., reference to book and other scholarly sources). Bibliometric data are collected and analyzed for a large set of reviews (1981–2009) to observe general publication patterns and patterns of citedness and co-citedness with books under review. Results show that reviews giving reference only to the book (Type I) are published more frequently while reviews referencing the book and other works (Type II) are more likely to be cited. The referencing culture of the humanities makes it difficult to understand patterns of co-citedness between books and review articles without further in-depth content analyses. Overall, citation counts to book reviews are typically low, but our data showed that they are scholarly and do play a role in the scholarly communication system. In the disciplines of history and literature, where book reviews are prominent, counting the number and type of reviews that a scholar produces throughout his/her career is a positive step forward in research evaluations. We propose a new set of journal quality indicators for the purpose of monitoring their scholarly influence. © 2011 Wiley Periodicals, Inc.

[1]  R. Kling,et al.  Scholarly communication and the continuum of electronic publishing , 1999 .

[2]  Peter Williams,et al.  The role and future of the monograph in arts and humanities research , 2009, Aslib Proc..

[3]  Grant Lewison James Bond and citations to his books , 2004, Scientometrics.

[4]  Kathryn La Barre,et al.  Mickey Mouse and Milton: book publishing in the humanities , 2004, Learn. Publ..

[5]  Allen Natowitz,et al.  Evaluating Review Content for Book Selection: An Analysis of American History Reviews in Choice , American Historical Review , and Journal of American History , 1997 .

[6]  Richard L. Russell,et al.  We Now Know: Rethinking Cold War History , 1998 .

[7]  Jonathan Furner,et al.  Scholarly communication and bibliometrics , 2005, Annu. Rev. Inf. Sci. Technol..

[8]  Darcy R. Fryer Generations of Captivity: A History of African-American Slaves , 2006 .

[9]  Peter A. Coclanis The Captivity of a Generation , 2004 .

[10]  Yu-Wei Chang,et al.  Characteristics of research output in social sciences and humanities: From a research evaluation perspective , 2008, J. Assoc. Inf. Sci. Technol..

[11]  Rob Kling,et al.  Scholarly Communication and the Continuum of Electronic Publishing , 1999, J. Am. Soc. Inf. Sci..

[12]  A. Preston,et al.  Bridging the Gap between the Sacred and the Secular in the History of American Foreign Relations , 2006 .

[13]  Joel Best,et al.  deviance may be alive, but is it intellectually lively? a reaction to goode , 2004 .

[14]  J. Nicolaisen The scholarliness of published peer reviews: a bibliometric study of book reviews in selected social science fields , 2002 .

[15]  Jean McGruer Parker Scholarly Book Reviews in Literature Journals as Collections Development Sources for Librarians , 1989 .

[16]  Geoffrey K. Roberts,et al.  Moscow and the Marshall plan: Politics, ideology and the onset of the cold war, 1947 , 1994 .

[17]  James W. Cortada,et al.  Five ways to be a terrible book reviewer , 1998 .

[18]  Mike Thelwall,et al.  Google book search: Citation analysis for social science and the humanities , 2009 .

[19]  Anton J. Nederhof,et al.  Bibliometric monitoring of research performance in the Social Sciences and the Humanities: A Review , 2006, Scientometrics.

[20]  James Hartley,et al.  Reading and writing book reviews across the disciplines , 2006, J. Assoc. Inf. Sci. Technol..

[21]  William Cronon,et al.  Nature's Metropolis: Chicago and the Great West , 1992 .

[22]  J. Serebnick Selection and Holdings of Small Publishers' Books in Oclc Libraries: A Study of the Influence of Reviews, Publishers, and Vendors , 1992, The Library Quarterly.

[23]  Eric Arnesen,et al.  Passion and Politics: Race and the Writing of Working‐Class History , 2006 .

[24]  James Goodman For the Love of Stories , 1998 .

[25]  Joel Best Controlling Vice: Regulating Brothel Prostitution in St. Paul, 1865–1883 , 1998 .

[26]  Robert F. Berkhofer Beyond the Great Story: History as Text and Discourse , 1995 .

[27]  Jack Andersen Scholarly book reviewing in the social sciences and humanities. The flow of ideas within and among disciplines , 1999 .

[28]  Virgil L. P. Blake The role of reviews and reviewing media in the selection process: an examination of the research record , 1989 .

[29]  Robert C. McMath The Promise of the New South: Life After Reconstruction (review) , 1993 .

[30]  Robert Bothwell,et al.  We Now Know: Rethinking Cold War History , 1997 .

[31]  Ben R. Martin,et al.  Towards a bibliometric database for the Social Sciences and Humanities - a European scoping project , 2010 .

[32]  Steven A. Reich The Great Migration and the Literary Imagination , 2009 .

[33]  Amanda Spink,et al.  Use of Scholarly Book Reviews: Implications for Electronic Publishing and Scholarly Communication , 1998, J. Am. Soc. Inf. Sci..

[34]  Hamilton Bailey,et al.  Book Reviewing , 1946, British medical journal.

[35]  Daniel Torres-Salinas,et al.  Library Catalog Analysis as a tool in studies of social sciences and humanities: An exploratory study of published book titles in Economics , 2009, J. Informetrics.

[36]  Edward L. Ayers The Promise of the New South: Life After Reconstruction , 1993 .

[37]  Jeppe Nicolaisen,et al.  The J-shaped distribution of citedness , 2002, J. Documentation.

[38]  Steven M. Stowe Thinking about Reviews , 1991 .

[39]  Jeppe Nicolaisen,et al.  Structure-based interpretation of scholarly book reviews: A new research technique , 2002 .

[40]  Adrian Furnham Book Reviews as a Selection Tool for Librarians , 1986 .

[41]  Grant Lewison,et al.  Evaluation of books as research outputs in history of medicine , 2001 .

[42]  Jennifer L. Weber Generations of Captivity: A History of African-American Slaves (review) , 2006 .