Assessing researchers' performance in developing countries : is Google Scholar an alternative?

This article compares the representation of 10 purposefully selected LIS researchers in South Africa in Google Scholar (GS), Thomson Scientific’s (herein referred to as ISI – Institute for Scientific Information) citation indexes, and Elsevier’s Scopus, in order to determine whether or not Google Scholar is an alternative tool for evaluating research in developing countries, particularly those situated in Sub-Saharan Africa. Three indicators, namely the number of publications, the number of citations and the h-index, were used to measure the similarity or dissimilarity between the three databases/ services in the coverage of South Africa’s LIS documents. The data was also subjected to a Pearson correlation analysis to examine the relationship between GS and ISI, GS and Scopus and ISI and Scopus. Results show that GS covers more publications and citations than ISI and Scopus. There is a stronger correlation between GS and Scopus than there is between GS and ISI. We conclude that GS is an alternative service, but should be cautiously used when evaluating research in developing countries. Areas for further research are also recommended.

[1]  E. Garfield Citation analysis as a tool in journal evaluation. , 1972, Science.

[2]  J. King A review of bibliometric and other science indicators and their role in research evaluation , 1987, J. Inf. Sci..

[3]  Publication Counting vs Citation Counting in evaluating research , 1998 .

[4]  G. E. Gorman,et al.  Testing Article Quality in LIS Journals: The Search Continues presented at the 68th IFLA Council and General Conference, August 18-24, 2002, Glasgow, UK , 2002 .

[5]  Daniel Pauly,et al.  Equivalence of results from two citation analyses: Thomson ISI's Citation Index and Google's Scholar service , 2005 .

[6]  Alireza Noruzi Google Scholar: The New Generation of Citation Indexes , 2005 .

[7]  J. E. Hirsch,et al.  An index to quantify an individual's scientific research output , 2005, Proc. Natl. Acad. Sci. USA.

[8]  N. Mohaghegh,et al.  WHY THE IMPACT FACTOR OF JOURNALS SHOULD NOT BE USED FOR EVALUATING RESEARCH , 2005 .

[9]  Judit Bar-Ilan,et al.  An ego-centric citation analysis of the works of Michael O. Rabin based on multiple citation indexes , 2006, Inf. Process. Manag..

[10]  Judit Bar-Ilan,et al.  Some measures for comparing citation databases , 2007, J. Informetrics.

[11]  Lokman I. Meho,et al.  Impact of data sources on citation counts and rankings of LIS faculty: Web of science versus scopus and google scholar , 2007, J. Assoc. Inf. Sci. Technol..

[12]  Yvonne Rogers,et al.  Citation counting, citation ranking, and h-index of human-computer interaction researchers: A comparison of Scopus and Web of Science , 2008, J. Assoc. Inf. Sci. Technol..

[13]  Anne-Wil Harzing,et al.  Google Scholar as a new source for citation analysis , 2008 .

[14]  Mike Thelwall,et al.  Sources of Google Scholar citations outside the Science Citation Index: A comparison between four science disciplines , 2008, Scientometrics.

[15]  Judit Bar-Ilan,et al.  Which h-index? — A comparison of WoS, Scopus and Google Scholar , 2008, Scientometrics.