Altmetrics for the humanities: Comparing Goodreads reader ratings with citations to history books

Purpose – The purpose of this paper is to assess the value of Goodreads reader ratings for measuring the wider impact of scholarly books published in the field of History. Design/methodology/approach – Book titles were extracted from the reference lists of articles that appeared in 604 history journals indexed in Scopus (2007-2011). The titles were cleaned and matched with WorldCat.org (for publisher information) as well as Goodreads (for reader ratings) using an API. A set of 8,538 books was first filtered based on Dewey Decimal Classification class 900 “History and Geography”, then a subset of 997 books with the highest citations and reader ratings (i.e. top 25 per cent) was analysed separately based on additional characteristics. Findings – A weak correlation (0.212) was found between citation counts and reader rating counts for the full data set (n=8,538). An additional correlation for the subset of 997 books indicated a similar weak correlation (0.190). Further correlations between citations, reader ...

[1]  Rens Bod,et al.  Can we rank scholarly book publishers? A bibliometric experiment with the field of history , 2015, J. Assoc. Inf. Sci. Technol..

[2]  Cassidy R. Sugimoto,et al.  Do Altmetrics Work? Twitter and Ten Other Social Web Services , 2013, PloS one.

[3]  Barry Trott,et al.  Finding Good Reads on Goodreads , 2012 .

[4]  Vincent Larivière,et al.  Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature , 2013, J. Assoc. Inf. Sci. Technol..

[5]  Lutz Bornmann,et al.  Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics , 2014, J. Informetrics.

[6]  Henk F. Moed,et al.  Citation Analysis in Research Evaluation , 1899 .

[7]  Raúl Fuentes Navarro.  Books in the digital age. The transformation of Academic and Higher Education Publishing in Britain and the United States , 2015 .

[8]  Priem Jason,et al.  Prevalence and use of Twitter among scholars , 2012 .

[9]  Aba-Sah Dadzie,et al.  Making Sense of Microposts 2011: Proceedings of the ESWC2011 Workshop on 'Making Sense of Microposts': Big Things Come in Small Packages: co-located with the 8th Extended Semantic Web Conference, ESWC2011, Heraklion, Crete, May 30, 2011 , 2011 .

[10]  Fletcher T. H. Cole,et al.  Libcitations: A measure for comparative assessment of book publications in the humanities and social sciences , 2009 .

[11]  Björn Hammarfelt,et al.  Using altmetrics for assessing research impact in the humanities , 2014, Scientometrics.

[12]  Maurits van Bellen,et al.  A machine-learning approach to coding book reviews as quality indicators : towards a theory of ‘ mega-citation ’ , 2014 .

[13]  Michael Gibbons,et al.  Introduction: `Mode 2' Revisited: The New Production of Knowledge , 2003 .

[14]  Maarten van Someren,et al.  A machine‐learning approach to coding book reviews as quality indicators: Toward a theory of megacitation , 2014, J. Assoc. Inf. Sci. Technol..

[15]  C. Donovan,et al.  The Australian Research Quality Framework: A live experiment in capturing the social, economic, environmental, and cultural returns of publicly funded research , 2008 .

[16]  Kathryn La Barre,et al.  Mickey Mouse and Milton: book publishing in the humanities , 2004, Learn. Publ..

[17]  Chaim Zins,et al.  Mapping the knowledge covered by library classification systems , 2011, J. Assoc. Inf. Sci. Technol..

[18]  Bradley M. Hemminger,et al.  Altmetrics in the wild: Using social media to explore scholarly impact , 2012, ArXiv.

[19]  Mike Thelwall,et al.  Do blog citations correlate with a higher number of future citations? Research blogs as a potential source for alternative metrics , 2014, J. Assoc. Inf. Sci. Technol..

[20]  C. Donovan.  The qualitative future of research evaluation , 2007 .

[21]  Johan Tollebeek,et al.  De vreugden van Houssaye: apologie van de historische interesse , 1992 .

[22]  Ross McKibbin.  Making History: The Changing Face of the Profession in Britain , 2010 .

[23]  R. Barré,et al.  S&T Indicators for Policy Making in a Changing Science-Society Relationship , 2004 .

[24]  Frank Ankersmit,et al.  Sublime Historical Experience , 2005 .

[25]  Clyve Jones,et al.  The Characteristics of the Literature Used by Historians , 1972 .

[26]  Mike Thelwall,et al.  Validating online reference managers for scholarly impact measurement , 2011, Scientometrics.

[27]  M. Dalton,et al.  Historians and Their Information Sources , 2004 .

[28]  Tobias Siebenlist,et al.  Applying social bookmarking data to evaluate journal usage , 2011, J. Informetrics.

[29]  Eric H. J. Spruyt,et al.  Changing publication patterns in the Social Sciences and Humanities, 2000–2009 , 2012, Scientometrics.

[30]  Barry Trott.  finding Good Reads on Goodreads Readers Take RA into , 2012 .

[31]  A. Elzinga.  The New Production of Knowledge. The Dynamics of Science and Research in Contemporary Societies , 1997 .

[32]  Paul Nightingale,et al.  Peer review and the relevance gap: Ten suggestions for policy-makers , 2007 .

[33]  Jean-Claude Petit,et al.  Why do we need fundamental research? , 2004, European Review.

[34]  Lutz Bornmann,et al.  Usefulness of altmetrics for measuring the broader impact of research: A case study using data from PLOS and F1000Prime , 2014, Aslib J. Inf. Manag..

[35]  Katrin Weller,et al.  Citation Analysis in Twitter: Approaches for Defining and Measuring Information Flows within Tweets during Scientific Conferences , 2011, #MSM.

[36]  Stanley Hoffmann,et al.  A Nation on Trial: The Goldhagen Thesis and Historical Truth , 1998 .

[37]  Finn Årup Nielsen,et al.  Scientific citations in Wikipedia , 2007, First Monday.

[38]  R. Frodeman,et al.  Peer review and the ex ante assessment of societal impacts , 2011 .

[39]  Lutz Bornmann,et al.  What is societal impact of research and how can it be assessed? a literature survey , 2013, J. Assoc. Inf. Sci. Technol..

[40]  Nicholas Allen,et al.  Reputations and Research Quality in British Political Science: The Importance of Journal and Publisher Rankings in the 2008 RAE , 2013 .

[41]  John Tosh,et al.  Why History Matters , 2008 .